Wednesday, January 29, 2025
How to setup node and angular platform using
1. Download node js tar file. For instance to download node 22 version, navigate to https://nodejs.org/en/blog/release/v22.11.0
Click on the belo0w
https://nodejs.org/dist/v22.11.0/node-v22.11.0-linux-x64.tar.xz
2. Copy the file to the linux instance, and from that folder untar the file.
tar -xf node-v22.11.0-linux-x64.tar.xz
3. You will see a folder like node-v22.11.0-linux-x64. Setup the Export path of the node.
4. export PATH=/root/node/node-v22.11.0-linux-x64/bin:$PATH
Saturday, July 27, 2024
Consumer related softwares
Paid versions
Gravity write - AI driven for story generation
11Eleven labs - AI driven voice genereation for stories
Adobe Express - for animation
capcut, Clickchamp - for final vedio clips merge
Wednesday, March 2, 2022
Splunk and Sterling Integrator Integration
Splunk Installation
rpm -i --prefix=/mnt/splunk2 splunk-8.2.2-87344edfcdb4-linux-2.6-x86_64.rpm
./splunk start --accept-license
Create the admin user - splunkadmin
Splunk DB Connect Manual Configuration
You can also install DB Connect by copying its directory into your Splunk Enterprise apps directory:
Download Splunk DB Connect and save it to a temporary location that you can access from your Splunk Enterprise instance.
Un-tar the download.
Move the splunk_app_db_connect directory into $SPLUNK_HOME/etc/apps.
Restart Splunk Enterprise (./mnt/splunk2/splunk/bin/splunk stop and then ./mnt/splunk2/splunk/bin/splunk start)
After you navigate to the Splunk DB Connect app, You may get "Cannot communicate with task server, please check your settings"
Setup the JRE Installation Path(JAVA_HOME) in the UI -
Check If java is install by issuing java -version command. If not installed, download the latest tar.gz (jdk-8u202-linux-i586.tar.gz) package from Oracle java.
tar zxvf jdk-8u202-linux-i586.tar.gz
Change the permissions if required - chown -R root:root jdk1.8.0_202
Navigate to the JRE, notedown the path and enter it in the UI - /mnt/jdk1.8.0_202/jre
Download the corresponding driver. Here it is DB2.
Untar the file to see the folder - jdbc_sqlj
Copy or move the db2jcc4.jar file to the $SPLUNK_HOME/etc/apps/splunk_app_db_connect/drivers directory
Uninstall Splunk
rpm -qa | grep -i splunk
Then put the command rpm -e above_command_result
Example : rpm -e splunkforwarder-6.3.2-aaff59bb082c.x86_64
Splunk Data Retreival from database
Create a read only user on the database and record the identity credentials.
Navigate to Splunk UI->apps->splunk_app_db_connect->Configuration->Identities. Create the identity using the identity credentails of the read only user
Create the Connection
On the Data Lab -> Retrieve the data. Use cron expressions for Execution Frequency like for every 2 minutes polling - */2 * * * *
Splunk Reports and Dashboards
To get the users created
index="edi" source="YFS_PERSON_INFO" sourcetype="database" | transaction LAST_NAME, CREATETS, MODIFYTS | table FIRSTNAME, LAST_NAME, EMAILID, DEPARTMENT, CREATETS, MODIFYTS | sort by CREATETS desc
Sunday, November 1, 2020
MQ Installation
1. Create a group before the installation:
For example to create a group named mqm with GID of 1010 you would type:
groupadd -g 1010 mqm
2. Create the mqm user and add the user to mqm group
useradd -u 1001 -g mqm -G mqm, root mqm
3. sudo passwd mqm
4. Add the below line to get sudo access.
vi /etc/sudoers
mqm ALL=(ALL) ALL
4. Check the maximum open files - sysctl fs.file-max
If value is lesser than the below add the line in /etc/sysctl.conf
fs.file-max = 524288
5. Increase the file descriptors (from root user)
vi /etc/security/limits.conf
#add the below line
mqm hard nofile 10240
mqm soft nofile 10240
6. gunzip the tar file and then run. sudo tar -xvf IBM_MQ_9.1.5_LINUX_X86-64.tar.gz
7. You must be a root to accept the lincese. Please switch to root.
8. Change directory to MQServer and then Accept the license
sudo ./mqlicense.sh
9. sudo rpm -ivh MQ*.rpm
How to keep the IP address on linux on VMware
Good file looking like this
/etc/sysconfig/network-scripts/ifcfg-eth0
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="dhcp"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
IPV6INIT="yes"
IPV6_AUTOCONF="yes"
IPV6_DEFROUTE="yes"
IPV6_FAILURE_FATAL="no"
IPV6_ADDR_GEN_MODE="stable-privacy"
NAME="enp0s3"
UUID="43558b3d-8a5d-4555-b105-c61eb883b0b1"
DEVICE="enp0s3"
ONBOOT="yes"
*********************************************************
One more possibility
/etc/sysconfig/network-scripts/ifcfg-(interface-name)
To find your network interface name, you can use the following
# nmcli con
# vim /etc/sysconfig/network-scripts/ifcfg-enp0s3
TYPE="Ethernet"
BOOTPROTO="none"
NAME="enp0s3"
IPADDR="192.168.20.150"
NETMASK="255.255.255.0"
GATEWAY="192.168.20.1"
DEVICE="enp0s3"
ONBOOT="yes"
Then restart the NetworkManager with:
# systemctl restart NetworkManager
Step by step process for installing Aspera Fasp.io gateway
Step by step process for installing Aspera Fasp.io gateway
Follow the IBM page. I got all these steps from there -
https://www.ibm.com/support/knowledgecenter/SSFKSJ_9.1.0/com.ibm.mq.con.doc/aspera_def_unixlinux.htm
Download ASP_FASP.IO_GW_V1.0.1_LNX_EN.zip from IBM site and keep it available in the server
Example: /opt/softwares/Aspera/
Unzip the file.
Example: sudo unzip ASP_FASP.IO_GW_V1.0.1_LNX_EN.zip
Use rpm file with yum install.
Example: sudo yum install ./ibm-fasp.io-gateway-1.0.1-1.x86_64.rpm
........
.......
Installed size: 8.8 M
Is this ok [y/d/N]: y
Then it looks like the below.
Running transaction test
Transaction test succeeded
Running transaction
Installing : ibm-fasp.io-gateway-1.0.1-1.x86_64 1/1
Verifying : ibm-fasp.io-gateway-1.0.1-1.x86_64 1/1
Installed:
ibm-fasp.io-gateway.x86_64 0:1.0.1-1
Complete!
_________________________________________________________________________________________
Location of installed files:
Executable: /usr/bin
Default configuration files: /etc/fasp.io
Documentation: /usr/share/fasp.io-gateway
SystemD startup file: /etc/systemd/system/fasp.io-gateway.service
**************************************************************************************************
Copied the below example from IBM Site only
Example
This example defines an Aspera gateway connection on two machines running Linux. The configuration is as follows:
The IP address of the local gateway machine is 9.20.193.107. The IP address of the remote gateway machine is 9.20.192.115.
The local queue manager is running on a machine with IP address 9.20.121.5. The remote queue manager is running on a machine with IP address 9.20.121.25. Both queue managers are listening on port 1414.
The queue manager channel on the local queue manager is changed to connect to the local Aspera gateway using conname 9.20.193.107(1500). The queue manager channel on the remote queue manager is changed to connect to the remote Aspera gateway using conname 9.20.192.115(1500).
Define an Aspera gateway connection on the local gateway machine:
Install the Aspera gateway:
rpm -ivh ibm-fasp.io-gateway-1.0.0_qa_48-1.x86_64.rpm
Modify the gateway.toml file in the /etc/fasp.io directory that was created by the install.
Edit it to set the local gateway definitions.
[[bridge]]
name = "Outbound"
[bridge.local]
protocol = "tcp"
host = "9.20.193.107"
port = 1500
[bridge.forward]
protocol = "fasp"
host = "9.20.192.115"
port = 1600
[[bridge]]
name = "Inbound"
[bridge.local]
protocol = "fasp"
host = "9.20.193.107"
port = 1600
[bridge.forward]
protocol = "tcp"
host = "9.20.121.5"
port = 1414
Repeat the previous step to define an Aspera gateway connection on the remote gateway machine. Modify the gateway.toml file in the /etc/fasp.io directory that was created by the install. Edit it to set the remote gateway definitions:
[[bridge]]
name = "Outbound"
[bridge.local]
protocol = "tcp"
host = "9.20.192.115"
port = 1500
[bridge.forward]
protocol = "fasp"
host = "9.20.193.107"
port = 1600
[[bridge]]
name = "Inbound"
[bridge.local]
protocol = "fasp"
host = "9.20.192.115"
port = 1600
[bridge.forward]
protocol = "tcp"
host = "9.20.121.25"
port = 1414
At each end of the connection, change the channel definition to connect to the port that the local gateway is listening on.
Change the queue manager channel on the local queue manager to connect to the local Aspera gateway using conname 9.20.193.107(1500).
Change the queue manager channel on the remote queue manager to connect to the remote Aspera gateway using conname 9.20.192.115(1500).
Start the local gateway by running the following command on the local gateway machine:
systemctl start fasp.io-gatewayCopy code
Start the remote gateway by running the following command on the remote gateway machine:
systemctl start fasp.io-gatewayCopy code
Restart the channels.
*************************************************************************************************************
In case if Queue manager and FASP gateway are on the same server. The configuration may look like below. Here local queue manager and FASP are on the same machine - 192.168.1.107. Similarly the remote FASP gateway is 192.168.1.108.
[[bridge]]
name = "Outbound"
#connection from the local queue manager to the local fasp gateway
[bridge.local]
protocol = "tcp"
host = "192.168.1.107"
port = 1500
#from the local fasp gateway to the remote fasp gateway
[bridge.forward]
protocol = "fasp"
host = "192.168.1.108"
port = 1600
[[bridge]]
name = "Inbound"
#the connection from the remote fasp gateway to the local fasp gateway
[bridge.local]
protocol = "fasp"
host = "192.168.1.107"
port = 1600
#from the local gateway to the local queue manager.
[bridge.forward]
protocol = "tcp"
host = "192.168.1.107"
port = 1414
[[bridge]]
name = "Outbound"
[bridge.local]
protocol = "tcp"
host = "192.168.1.108"
port = 1500
[bridge.forward]
protocol = "fasp"
host = "192.168.1.107"
port = 1600
[[bridge]]
name = "Inbound"
[bridge.local]
protocol = "fasp"
host = "192.168.1.108"
port = 1600
[bridge.forward]
protocol = "tcp"
host = "192.168.1.108"
port = 1414
Linux setup on VMware
Setup Bridged Network adapter
Select both boot and dvd iso files.
rhel-server-7.7-x86_64-boot.iso
rhel-server-7.7-x86_64-dvd.iso
Select "Software Selection"
select "Server with GUI" and other options
Select "Network & Hostname"
Apply the changes
Stop firewall rules systemctl disable firewalld
If not selected during installation then follow below
Type the following command
to
edit /etc/hostname using vi text
editor: sudo vi /etc/hostname
Delete the old name and setup new name.
Example: cat /etc/hostname statebank
Next
Edit the /etc/hosts file: sudo nano /etc/hosts
Replace any occurrence of the existing
computer name with your new one
Example: cat /etc/hosts 127.0.0.1 statebank
localhost.localdomain localhost4 localhost4.localdomain4 ::1 statebank
localhost.localdomain localhost6 localhost6.localdomain6
Reboot the system to changes take effect: sudo
reboot
Good file looking like this
/etc/sysconfig/network-scripts/ifcfg-eth0
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="dhcp"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
IPV6INIT="yes"
IPV6_AUTOCONF="yes"
IPV6_DEFROUTE="yes"
IPV6_FAILURE_FATAL="no"
IPV6_ADDR_GEN_MODE="stable-privacy"
NAME="enp0s3"
UUID="43558b3d-8a5d-4555-b105-c61eb883b0b1"
DEVICE="enp0s3"
ONBOOT="yes"
Tuesday, April 21, 2020
Apache Products Useful for Integrations
Hi All,
Please find the descriptions for Apache products which can be suitable for B2B Integrations. I copied this information from web.
MFT
1. Apache ActiveMQ - is a fast and powerful Message Broker which supports many Cross Language Clients and Protocols and many advanced features while fully supporting JMS 1.1 and J2EE 1.4.
37. The Apache FtpServer application is a 100% pure Java FTP server
41. Apache Guacamole is a clientless remote desktop gateway which supports standard protocols like VNC, RDP, and SSH.
49. The Apache HTTP Server is an open-source HTTP server for modern operating systems including UNIX, Microsoft Windows, Mac OS/X and Netware
52. The Apache Java Enterprise Mail Server (a.k.a. Apache James) is a 100% pure Java SMTP and POP3 Mail server and NNTP News server
Translators
5. Apache Anakia is an XML transformation tool that uses JDOM and Velocity to transform XML documents into the format of your choice. It provides an alternative to using Ant's style task and XSL to process XML files.
19. Apache Daffodil is an open-source implementation of the DFDL specification that uses DFDL data descriptions to parse fixed format data into an infoset, which is most commonly represented as either XML or JSON
33. Apache FOP (Formatting Objects Processor) is the world's first print formatter driven by XSL formatting objects (XSL-FO) and the world's first output independent formatter.
34. Apache Forrest™ software is a publishing framework that transforms input from various sources into a unified presentation in one or more output formats
Business Processes
3. Apache Airflow: workflow automation and scheduling that can be used to author and manage data pipelines
11. Apache Camel is a powerful open source integration library based on Enterprise Integration Patterns. Rules for Camel's routing engine can be defined in either a Java based DSL or XML
API
7. Apache APISIX is a cloud-native microservices API gateway, delivering the ultimate performance, security,open source and scalable platform for all your APIs and microservices
18. Apache CXF is an open source services framework.
Analytics
8. Apache Arrow Powering Columnar In-Memory Analytics
10. Apache Bahir Extensions to distributed analytic platforms such as Apache Spark
26. Apache Eagle open source analytics solution for identifying security and performance issues instantly on big data platforms
39. Apache Gobblin is a distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
43. Apache Hama is an efficient and scalable general-purpose BSP computing engine which can be used to speed up a large variety of compute-intensive analytics applications.
50. Apache Ignite In-Memory Database and Caching Platform is designed to deliver uncompromised performance for a wide set of in-memory computing use cases from high performance computing, to the industry most advanced data grid, in-memory SQL, in-memory file system, streaming, and more
56. Apache Lens provides an Unified Analytics interface
Database
9. Apache AsterixDB open source Big Data Management System
16. Apache CouchDB is a database that completely embraces the web. Store your data with JSON documents. Access your documents with your web browser, via HTTP
21. Apache Derby is an open source relational database implemented entirely in Java
25. Apache Druid analytical database software
28. Apache Empire-db is a relational database abstraction layer that allows developers to take a much more SQL-centric approach in application development than traditional Object/Relational mapping frameworks (ORM)
Operations
4. Apache Allura is an open source implementation of a software "forge", a web site that manages source code repositories, bug reports, discussions, wiki pages, blogs and more for any number of individual projects.
2. Apache Airavata: is a micro-service architecture based software framework for executing and managing computational jobs and workflows on distributed computing resources including local clusters, supercomputers, national grids, academic and commercial clouds. Airavata is dominantly used to build Web-based science gateways and assist to compose, manage, execute, and monitor large scale applications (wrapped as Web services) and workflows composed of these services.
6. Apache Apex is a unified platform for big data stream and batch processing. Use cases include ingestion, ETL, real-time analytics, alerts and real-time actions.
12. Apache Cassandra Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure make Apache Cassandra the perfect platform for mission-critical data
13. Apache Cayenne is a powerful, full-featured, opensource framework created for developers working with relational databases. it seamlessly maps any relational database to Java objects, reducing development time and adding considerable functionality to any application which requires a database.
14. Apache Chainsaw is a GUI log viewer
15. Apache Click is a modern Java web application framework, providing a natural rich client style programming model
17. Apache Curator is a Java/JVM client library for Apache ZooKeeper, a distributed coordination service
20. DataSketches is an open source, high-performance library of stochastic streaming algorithms commonly called "sketches" in the data sciences
22. Apache DirectMemory is a off-heap cache for the Java Virtual Machine
23. ApacheDS is an extensible and embeddable directory server entirely written in Java, which has been certified LDAPv3 compatible by the Open Group
24. Apache Directory Studio is a complete directory tooling platform intended to be used with any LDAP server however it is particularly designed for use with ApacheDS
27. Apache ECharts is a charting and data visualization library written in JavaScript.
29. Apache Felix OSGi framework implementation and related technologies.
30. Apache Flex® is a highly productive, open source application framework for building and maintaining expressive web applications that deploy consistently on all major browsers, desktops and devices
31. Apache Flume is a distributed, reliable, and available system for efficiently collecting, aggregating and moving large amounts of log data from many different sources to a centralized data store
32. Apache Fluo is a distributed processing system that lets users make incremental updates to large data sets.
35. Apache Fortress is a standards-based access management system, written in Java, that provides role-based access control, delegated administration and password policy services with LDAP.
36. Apache FreeMarker is a template engine: a Java library to generate text output (HTML web pages, e-mails, configuration files, source code, etc.) based on templates and changing data
38. Apache Giraph is an iterative graph processing system built for high scalability.
40. Apache Groovy is a powerful, optionally typed and dynamic language, with static-typing and static compilation capabilities, for the Java platform aimed at improving developer productivity thanks to a concise, familiar and easy to learn syntax
42. Apache Hadoop Distributed computing platform
44. Apache HBase software when you need random, realtime read/write access to your Big Data.
45. Apache Helix is a generic cluster management framework used for the automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes.
46. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage
47. The Apache Hivemall is a library for machine learning implemented as Hive UDFs/UDAFs/UDTFs
48. The Apache HiveMind is a framework for creating applications, not an application, or even an application server, itself.
51. Apache Isis is a framework for rapidly developing domain-driven apps in Java.
53. A single Kafka broker can handle hundreds of megabytes of reads and writes per second from thousands of clients.
54. Apache Kibble is a suite of tools for collecting, aggregating and visualizing activity in software projects.
55. Apache Labs A place for innovation where committers of the foundation can experiment with new ideas
57. Apache Lenya is an Open Source Java/XML Content Management Framework
58. Apache Log4j 2
59. Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java
60. Apache MADlib Scalable, Big Data, SQL-driven machine learning framework for Data Scientistsava
Please find the descriptions for Apache products which can be suitable for B2B Integrations. I copied this information from web.
MFT
1. Apache ActiveMQ - is a fast and powerful Message Broker which supports many Cross Language Clients and Protocols and many advanced features while fully supporting JMS 1.1 and J2EE 1.4.
37. The Apache FtpServer application is a 100% pure Java FTP server
41. Apache Guacamole is a clientless remote desktop gateway which supports standard protocols like VNC, RDP, and SSH.
49. The Apache HTTP Server is an open-source HTTP server for modern operating systems including UNIX, Microsoft Windows, Mac OS/X and Netware
52. The Apache Java Enterprise Mail Server (a.k.a. Apache James) is a 100% pure Java SMTP and POP3 Mail server and NNTP News server
Translators
5. Apache Anakia is an XML transformation tool that uses JDOM and Velocity to transform XML documents into the format of your choice. It provides an alternative to using Ant's style task and XSL to process XML files.
19. Apache Daffodil is an open-source implementation of the DFDL specification that uses DFDL data descriptions to parse fixed format data into an infoset, which is most commonly represented as either XML or JSON
33. Apache FOP (Formatting Objects Processor) is the world's first print formatter driven by XSL formatting objects (XSL-FO) and the world's first output independent formatter.
34. Apache Forrest™ software is a publishing framework that transforms input from various sources into a unified presentation in one or more output formats
Business Processes
3. Apache Airflow: workflow automation and scheduling that can be used to author and manage data pipelines
11. Apache Camel is a powerful open source integration library based on Enterprise Integration Patterns. Rules for Camel's routing engine can be defined in either a Java based DSL or XML
API
7. Apache APISIX is a cloud-native microservices API gateway, delivering the ultimate performance, security,open source and scalable platform for all your APIs and microservices
18. Apache CXF is an open source services framework.
Analytics
8. Apache Arrow Powering Columnar In-Memory Analytics
10. Apache Bahir Extensions to distributed analytic platforms such as Apache Spark
26. Apache Eagle open source analytics solution for identifying security and performance issues instantly on big data platforms
39. Apache Gobblin is a distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
43. Apache Hama is an efficient and scalable general-purpose BSP computing engine which can be used to speed up a large variety of compute-intensive analytics applications.
50. Apache Ignite In-Memory Database and Caching Platform is designed to deliver uncompromised performance for a wide set of in-memory computing use cases from high performance computing, to the industry most advanced data grid, in-memory SQL, in-memory file system, streaming, and more
56. Apache Lens provides an Unified Analytics interface
Database
9. Apache AsterixDB open source Big Data Management System
16. Apache CouchDB is a database that completely embraces the web. Store your data with JSON documents. Access your documents with your web browser, via HTTP
21. Apache Derby is an open source relational database implemented entirely in Java
25. Apache Druid analytical database software
28. Apache Empire-db is a relational database abstraction layer that allows developers to take a much more SQL-centric approach in application development than traditional Object/Relational mapping frameworks (ORM)
Operations
4. Apache Allura is an open source implementation of a software "forge", a web site that manages source code repositories, bug reports, discussions, wiki pages, blogs and more for any number of individual projects.
2. Apache Airavata: is a micro-service architecture based software framework for executing and managing computational jobs and workflows on distributed computing resources including local clusters, supercomputers, national grids, academic and commercial clouds. Airavata is dominantly used to build Web-based science gateways and assist to compose, manage, execute, and monitor large scale applications (wrapped as Web services) and workflows composed of these services.
6. Apache Apex is a unified platform for big data stream and batch processing. Use cases include ingestion, ETL, real-time analytics, alerts and real-time actions.
12. Apache Cassandra Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure make Apache Cassandra the perfect platform for mission-critical data
13. Apache Cayenne is a powerful, full-featured, opensource framework created for developers working with relational databases. it seamlessly maps any relational database to Java objects, reducing development time and adding considerable functionality to any application which requires a database.
14. Apache Chainsaw is a GUI log viewer
15. Apache Click is a modern Java web application framework, providing a natural rich client style programming model
17. Apache Curator is a Java/JVM client library for Apache ZooKeeper, a distributed coordination service
20. DataSketches is an open source, high-performance library of stochastic streaming algorithms commonly called "sketches" in the data sciences
22. Apache DirectMemory is a off-heap cache for the Java Virtual Machine
23. ApacheDS is an extensible and embeddable directory server entirely written in Java, which has been certified LDAPv3 compatible by the Open Group
24. Apache Directory Studio is a complete directory tooling platform intended to be used with any LDAP server however it is particularly designed for use with ApacheDS
27. Apache ECharts is a charting and data visualization library written in JavaScript.
29. Apache Felix OSGi framework implementation and related technologies.
30. Apache Flex® is a highly productive, open source application framework for building and maintaining expressive web applications that deploy consistently on all major browsers, desktops and devices
31. Apache Flume is a distributed, reliable, and available system for efficiently collecting, aggregating and moving large amounts of log data from many different sources to a centralized data store
32. Apache Fluo is a distributed processing system that lets users make incremental updates to large data sets.
35. Apache Fortress is a standards-based access management system, written in Java, that provides role-based access control, delegated administration and password policy services with LDAP.
36. Apache FreeMarker is a template engine: a Java library to generate text output (HTML web pages, e-mails, configuration files, source code, etc.) based on templates and changing data
38. Apache Giraph is an iterative graph processing system built for high scalability.
40. Apache Groovy is a powerful, optionally typed and dynamic language, with static-typing and static compilation capabilities, for the Java platform aimed at improving developer productivity thanks to a concise, familiar and easy to learn syntax
42. Apache Hadoop Distributed computing platform
44. Apache HBase software when you need random, realtime read/write access to your Big Data.
45. Apache Helix is a generic cluster management framework used for the automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes.
46. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage
47. The Apache Hivemall is a library for machine learning implemented as Hive UDFs/UDAFs/UDTFs
48. The Apache HiveMind is a framework for creating applications, not an application, or even an application server, itself.
51. Apache Isis is a framework for rapidly developing domain-driven apps in Java.
53. A single Kafka broker can handle hundreds of megabytes of reads and writes per second from thousands of clients.
54. Apache Kibble is a suite of tools for collecting, aggregating and visualizing activity in software projects.
55. Apache Labs A place for innovation where committers of the foundation can experiment with new ideas
57. Apache Lenya is an Open Source Java/XML Content Management Framework
58. Apache Log4j 2
59. Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java
60. Apache MADlib Scalable, Big Data, SQL-driven machine learning framework for Data Scientistsava
Sunday, January 26, 2020
IBM SI/SFG EDI TO XML Mapping
IBM SI/SFG EDI TO XML Mapping
You need to have schema to load the target side XML. Select the schema (XSD) if you have. If not use any of the tool like stylusstudio to create XSD
Load the complete XSD
On the target side X12 root element properties,
1. select prolong specified
2. Select One element per line
3. Select the check box Use character entity references
4 Make sure TS_850 or GS or ISA do not repeat multiple times
On the source side
1. Select the Root segment properties
2. Specify the delimiters
You need to have schema to load the target side XML. Select the schema (XSD) if you have. If not use any of the tool like stylusstudio to create XSD
Load the complete XSD
On the target side X12 root element properties,
1. select prolong specified
2. Select One element per line
3. Select the check box Use character entity references
4 Make sure TS_850 or GS or ISA do not repeat multiple times
On the source side
1. Select the Root segment properties
2. Specify the delimiters
Wednesday, October 18, 2017
Windows NonCluster SQL Server with SI 5.2.6 Steps
1. Check the Collation.
A. From the SQL Server Management Studio, Right click on the selected database.
B. On Options menu, set the Collation to SQL_Latin1_General_CP850_Bin
2. Install the required JDBC driver. In this case for this version, the JDBC version is 4.0. Just unzip the downloaded driver package which will have sqljdbc4.jar
3. Follow the Installation check list prepared on IBM Sterling Integration documentation website.
4. Install the IBM JDK
5. Install the Installation Manager
6. Make sure to show the path of the JDK upto bin without including bin
like -- C:\Program Files\IBM\Java70
7. Make sure you do not have spaces in the binraries path or in installation paths.
Wednesday, January 18, 2017
Axway Decision Insight - How to change/correct the ClusterID
DON'T DO -
If your installation is done with a wrong cluster ID and later when you changed it in platform.properties the application will not come back up during the next restart.
To fix this, I changed the correct cluster ID in metadata.txt in all the below directories but did not work.
C:\ADI\DecisionInsight-20160905-01\var\data\titanium-temporal\partition-0\checkpoint\tt.....
C:\ADI\DecisionInsight-20160905-01\var\data\titanium-temporal\configuration\checkpoint\tt0..
C:\ADI\DecisionInsight-20160905-01\var\data\calcium\checkpoint\tt..
I deleted all the checkpoints and also bunldes directories from C:\ADI\DecisionInsight-20160905-01\var\tmp\felix directory.
Generated new admin hash by running tnd-generate-admin-hash.bat
Started the application. It worked but all my configuration data is lost.
****************************************************************
If your installation is done with a wrong cluster ID and later when you changed it in platform.properties the application will not come back up during the next restart.
To fix this, I changed the correct cluster ID in metadata.txt in all the below directories but did not work.
C:\ADI\DecisionInsight-20160905-01\var\data\titanium-temporal\partition-0\checkpoint\tt.....
C:\ADI\DecisionInsight-20160905-01\var\data\titanium-temporal\configuration\checkpoint\tt0..
C:\ADI\DecisionInsight-20160905-01\var\data\calcium\checkpoint\tt..
I deleted all the checkpoints and also bunldes directories from C:\ADI\DecisionInsight-20160905-01\var\tmp\felix directory.
Generated new admin hash by running tnd-generate-admin-hash.bat
Started the application. It worked but all my configuration data is lost.
****************************************************************
Saturday, June 4, 2016
Map Editor unable to test
Error: Unable to load Java Virtual Machine. Error code 126.
Resolution: For SI 5.2.6.1 - Map Editor you need to have 32 bit java. It can be Oracle java. If you have multiple Java versions to use then, copy the JRE path till bin directory and then add that into the PATH environment variable.
1. Right click on My computer and click on Properties.
2. On the Advanced system properties->Environment variables-> Add the JRE 1.7 path till bin directory. This path should be in front of any other JRE path. TO test whether it is set correctly just run on command prompt->java -version.
Ex:C:\Program Files (x86)\Java\jre7\bin
Resolution: For SI 5.2.6.1 - Map Editor you need to have 32 bit java. It can be Oracle java. If you have multiple Java versions to use then, copy the JRE path till bin directory and then add that into the PATH environment variable.
1. Right click on My computer and click on Properties.
2. On the Advanced system properties->Environment variables-> Add the JRE 1.7 path till bin directory. This path should be in front of any other JRE path. TO test whether it is set correctly just run on command prompt->java -version.
Ex:C:\Program Files (x86)\Java\jre7\bin
Friday, May 27, 2016
incompatible lang setting on linux
Problem: incompatible lang setting on linux
Resolution:
1 If the base locale for the system is English, edit
the /etc/sysconfig/i18n file by changing the LANG
variable from en_US.utf8 to en_US.
Save and close the /etc/sysconfig/i18n file.
2 Reboot the system.
****************
Problem:
You may get error like below during SI 5.2.6 installation:
Your Current JVM information :
=============================
Found Oracle(Sun) JDK
JDK Vendor : Oracle Corporation
JDK version not supported.
OR
Your Current JVM information :
=============================
JRE 1.7.0 IBM J9 2.7 Windows Server 2012 R2 amd64-64 Compressed References 20150407_243189 (JIT enabled, AOT enabled)
J9VM - R27_Java727_SR3_20150407_1831_B243189
JIT - tr.r13.java_20150406_89182
GC - R27_Java727_SR3_20150407_1831_B243189_CMPRSS
J9CL - 20150407_243189
=============================
***********************
Validating for : IBM-1.7-SR5
Checking for valid JDK Vendor....IBM
Found valid JDK vendor IBM
Checking for valid JDK Version....1.7
Found valid JDK version 1.7
Checking for valid JDK minor version....SR5
JDK minor version is not supported.
OR
Your Current JVM information :
=============================
JRE 1.7.0 IBM J9 2.7 Windows Server 2012 R2 x86-32 20150407_243189 (JIT enabled, AOT enabled)
J9VM - R27_Java727_SR3_20150407_1831_B243189
JIT - tr.r13.java_20150406_89182
GC - R27_Java727_SR3_20150407_1831_B243189
J9CL - 20150407_243189
=============================
***********************
Validating for : IBM-1.7-SR5
Checking for valid JDK Vendor....IBM
Found valid JDK vendor IBM
Checking for valid JDK Version....1.7
Found valid JDK version 1.7
Checking for valid JDK minor version....SR5
JDK minor version is not supported.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Please upgrade your JDK to supported version as per the documentation.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
JDK version not supported.
Resolution:
Use the IBM java instead of SUN java. Download SDK_5020600.zip and extract that java.
Resolution:
1 If the base locale for the system is English, edit
the /etc/sysconfig/i18n file by changing the LANG
variable from en_US.utf8 to en_US.
Save and close the /etc/sysconfig/i18n file.
2 Reboot the system.
****************
Problem:
You may get error like below during SI 5.2.6 installation:
Your Current JVM information :
=============================
Found Oracle(Sun) JDK
JDK Vendor : Oracle Corporation
JDK version not supported.
OR
Your Current JVM information :
=============================
JRE 1.7.0 IBM J9 2.7 Windows Server 2012 R2 amd64-64 Compressed References 20150407_243189 (JIT enabled, AOT enabled)
J9VM - R27_Java727_SR3_20150407_1831_B243189
JIT - tr.r13.java_20150406_89182
GC - R27_Java727_SR3_20150407_1831_B243189_CMPRSS
J9CL - 20150407_243189
=============================
***********************
Validating for : IBM-1.7-SR5
Checking for valid JDK Vendor....IBM
Found valid JDK vendor IBM
Checking for valid JDK Version....1.7
Found valid JDK version 1.7
Checking for valid JDK minor version....SR5
JDK minor version is not supported.
OR
Your Current JVM information :
=============================
JRE 1.7.0 IBM J9 2.7 Windows Server 2012 R2 x86-32 20150407_243189 (JIT enabled, AOT enabled)
J9VM - R27_Java727_SR3_20150407_1831_B243189
JIT - tr.r13.java_20150406_89182
GC - R27_Java727_SR3_20150407_1831_B243189
J9CL - 20150407_243189
=============================
***********************
Validating for : IBM-1.7-SR5
Checking for valid JDK Vendor....IBM
Found valid JDK vendor IBM
Checking for valid JDK Version....1.7
Found valid JDK version 1.7
Checking for valid JDK minor version....SR5
JDK minor version is not supported.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Please upgrade your JDK to supported version as per the documentation.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
JDK version not supported.
Resolution:
Use the IBM java instead of SUN java. Download SDK_5020600.zip and extract that java.
Sunday, December 13, 2015
How to change the ICONs on the top bar
Hi All,
To change the ICON with your customized ICON on the SI dashboard, please find the ICON in the below location.
ICON name: topbar_sub_integrator, Integrator_login
Installation folder:
\SI51\install\noapp\deploy\dashboard\webapp\images
You may need to use ms paint to save your customized ICON in gif format.
Also check this, I am not sure how to change the second half of the header
C:\SI51\install\noapp\deploy\dashboard\webapp\WEB-INF\templates\jsp\screens\html\Login.jsp
To change the ICON with your customized ICON on the SI dashboard, please find the ICON in the below location.
ICON name: topbar_sub_integrator, Integrator_login
Installation folder:
\SI51\install\noapp\deploy\dashboard\webapp\images
You may need to use ms paint to save your customized ICON in gif format.
Also check this, I am not sure how to change the second half of the header
C:\SI51\install\noapp\deploy\dashboard\webapp\WEB-INF\templates\jsp\screens\html\Login.jsp
Friday, August 28, 2015
Perimeter Installation on Windows 64 bit OS
Perimeter Installation on Windows 64 bit OS
I.
Install the same JDK version that SI is running
on preferably.
II.
Make sure you know whether it is a 32 bit or 64
bit version of Windows If you are installing in Windows.
III.
Before you install the perimeter server, you
need to gather the following information and answer the following questions:
Table 1.0 Simple Table for myself to
understand easily
Perimeter Server Information Gathering Checklist
|
Your Notes
|
Path to java
|
C:\Program Files\Java\jdk1.6.0_31
|
Path to the Sterling B2B Integrator installation
directory
|
C:\perimeter1
|
Will this perimeter server be installed in a less secure
network?
|
NO
|
Please enter the network address that integration server (SI) will
listen on for the connection from this server:
(Sterling B2B Integrator host IP)
|
|
Please enter the port that integration server (SI) will listen on for
the connection from this server:
(Sterling B2B Integrator side Listen port)
|
9070
|
Please enter the local port that perimeter will use for the connection
to the integration server (SI):
(Perimeter server side listening
port)
|
9060
|
I believe there are some documentation errors from the
website.
1.
Do not create the perimeter server directory
before you run the installation. Because,
PS code will estimate the size on the disk.
2.
Also, the second point “Path to
the Sterling B2B Integrator installation directory” is not the right
word in website check list. It should be the path to perimeter server
installation directory.
In my example, I am expecting my HTTP data on port 9080.
On Sterling B2B Integrator side, I am listening on port 9070
from Perimeter.
On Perimeter side, Perimeter will listen on the port 9060
from Sterling B2B Integrator.
Installation:
Open the command prompt by “Run as Administrator”. Navigate
to Java/bin folder.
Note down the path to the folder ps_4500.jar
file which you either copied from Sterling B2B integrator (\install\packages)
or from the CD.
Just give your Sterling B2B Integrator Host if no proxy is
involved between.
v
Do not run the installPS.cmd now.
v
Just open the installPS.cmd in a text editor.
Just change the below value from false to true.
java_64_bits=true.
Now run the installPS and startPSservice.
Now run the installPS and startPSservice.
Friday, August 21, 2015
Sterling Integrator installation and starting problems
I installed SI on Java 32 bit and it installed successfully but I was unable to start the server. There were no logs created apart from one "servicelist" which shows windows services.
Later when I installed SI on Java 64 bit it is successful.
*************************************************************************
External host name and port is important.
If you install SI with hostname as localhost then the installation may work fine. When we wanted to run the GPM from any other computer then we see issue in connecting. So it is suggested to give the proper host name during the installation itself.
The ProcessModeler.jnlp.in file is accessed from E:\IBM\SterlingIntegrator\install\noapp\deploy\gbm\webapp\pmodeler. It looks like below.
<jnlp spec="1.0+" codebase="http://&EXT_HOST_ADDR;:&DAV_PORT;/gbm/pmodeler" href="ProcessModeler.jnlp" version="1.0">
<title>Modeler-&HOST_NAME;-&WEBAPP_LIST_PORT;</title>
<argument>&EXT_HOST_ADDR;</argument>
Where the EXT_HOST_ADDR is defined in sandbox.cfg file.
Open the file and change this value
EXT_HOST_ADDR=Your hostname
Run the setupfiles.
*************************************************************************
Installation Steps followed on Windows Non Cluster
1. Install the database. If it is Oracle, run the below DB script. This works for SI 5.1 and 5.2.6.2 as of today. For production environments, please refer the Oracle tuning parameters to setup.
create user siadmin identified by Welcome1;
grant resource to siadmin;
GRANT "CONNECT" TO siadmin;
GRANT SELECT_CATALOG_ROLE TO siadmin;
ALTER USER siadmin DEFAULT ROLE "CONNECT", SELECT_CATALOG_ROLE;
GRANT CREATE PROCEDURE TO siadmin;
GRANT CREATE TRIGGER TO siadmin;
GRANT CREATE TYPE TO siadmin;
GRANT EXECUTE ANY PROCEDURE TO siadmin;
GRANT EXECUTE ANY TYPE TO siadmin;
GRANT SELECT ANY TABLE TO siadmin;
GRANT SELECT ANY DICTIONARY TO siadmin;
grant create any table to siadmin;
grant insert any table to siadmin;
grant update any table to siadmin;
grant create any view to siadmin;
grant create any synonym to siadmin;
grant create session to siadmin;
grant create any sequence to siadmin;
grant alter session to siadmin;
GRANT SELECT ON CTXSYS.CTX_USER_INDEXES TO siadmin;
GRANT SELECT ON SYS.DBA_DATA_FILES TO siadmin;
GRANT SELECT ON SYS.DBA_FREE_SPACE TO siadmin;
GRANT SELECT ON SYS.DBA_USERS TO siadmin;
GRANT SELECT ON SYS.V_$PARAMETER TO siadmin;
2. Get the IBM Java from IBM site
3. Start the Installer
*************************************************************************
Later when I installed SI on Java 64 bit it is successful.
*************************************************************************
External host name and port is important.
If you install SI with hostname as localhost then the installation may work fine. When we wanted to run the GPM from any other computer then we see issue in connecting. So it is suggested to give the proper host name during the installation itself.
The ProcessModeler.jnlp.in file is accessed from E:\IBM\SterlingIntegrator\install\noapp\deploy\gbm\webapp\pmodeler. It looks like below.
<jnlp spec="1.0+" codebase="http://&EXT_HOST_ADDR;:&DAV_PORT;/gbm/pmodeler" href="ProcessModeler.jnlp" version="1.0">
<title>Modeler-&HOST_NAME;-&WEBAPP_LIST_PORT;</title>
<argument>&EXT_HOST_ADDR;</argument>
Where the EXT_HOST_ADDR is defined in sandbox.cfg file.
Open the file and change this value
EXT_HOST_ADDR=Your hostname
Run the setupfiles.
*************************************************************************
Installation Steps followed on Windows Non Cluster
1. Install the database. If it is Oracle, run the below DB script. This works for SI 5.1 and 5.2.6.2 as of today. For production environments, please refer the Oracle tuning parameters to setup.
create user siadmin identified by Welcome1;
grant resource to siadmin;
GRANT "CONNECT" TO siadmin;
GRANT SELECT_CATALOG_ROLE TO siadmin;
ALTER USER siadmin DEFAULT ROLE "CONNECT", SELECT_CATALOG_ROLE;
GRANT CREATE PROCEDURE TO siadmin;
GRANT CREATE TRIGGER TO siadmin;
GRANT CREATE TYPE TO siadmin;
GRANT EXECUTE ANY PROCEDURE TO siadmin;
GRANT EXECUTE ANY TYPE TO siadmin;
GRANT SELECT ANY TABLE TO siadmin;
GRANT SELECT ANY DICTIONARY TO siadmin;
grant create any table to siadmin;
grant insert any table to siadmin;
grant update any table to siadmin;
grant create any view to siadmin;
grant create any synonym to siadmin;
grant create session to siadmin;
grant create any sequence to siadmin;
grant alter session to siadmin;
GRANT SELECT ON CTXSYS.CTX_USER_INDEXES TO siadmin;
GRANT SELECT ON SYS.DBA_DATA_FILES TO siadmin;
GRANT SELECT ON SYS.DBA_FREE_SPACE TO siadmin;
GRANT SELECT ON SYS.DBA_USERS TO siadmin;
GRANT SELECT ON SYS.V_$PARAMETER TO siadmin;
2. Get the IBM Java from IBM site
3. Start the Installer
*************************************************************************
Friday, January 16, 2015
Sterling Integrator 5.1 GPM does not start
Hi All,
Recently, One of my friend installed Sterling Integrator 5.1 on Windows 2008 R2 server. The installation went well and it took almost 20 minutes.
After the installation, accessed the dashboard on the port 15000 (http://localhost:15000) with default username admin and password as password. He wanted to run GPM. So, navigated to Business Process module and clicked on Manager and then clicked on Run Graphical Process Modeler - Go button.
He do not remember exact words in the exception but it sounds more of like below.
The first exceptiont is "You are seeing this message because either Java 5 is not installed on your system or, you are using older version of Java web start. Please download the java 1.5 from http://java.sun.com".
I was surprised to see this message because JRE 1.6 is already running on my server. SI 5.1 requires JDK 1.6.0_14. So when we install JDK it also installs JRE then why the above exception occurred.
The reason behind is Java Web Start is not running even though we installed JDK and JRE.
Go to the installed JDK folder (something like C:\Program Files\Java\jdk1.6.0_14\bin) and find javaws.exe file. Run this file as an administrator. When you run this file it prompts with pop-up that shows the options and parameters to supply.
After that he went back to the SI dashboard and click on "Run Graphical Process Modeler - Go button"
He got an exception - "unable to launch GPM". When I see the details, it is trying to connect to http://java.sun.com and download through the JNLP file.
To let JNLP know where my Java WS is running, I opened the command prompt as an administrator.
Navigated to JDK bin folder to run Java WS with arguments.
Command entered is: javaws -offline requiredjnlpfile
like this: javaws -offline C:\SI51\install\noapp\deploy\gbm\webapp\pmodeler\ProcessModeler.jnlp
Now GPM is started successfully.
Note: The environment I dealt with is Windows 2008 R2, Oracle 10.1. version, 64 bit OS, SI 5.1, JRE 1.6.0_14.
For any questions: meduri.phanendra@gmail.com
http://silearning.freeforums.
Recently, One of my friend installed Sterling Integrator 5.1 on Windows 2008 R2 server. The installation went well and it took almost 20 minutes.
After the installation, accessed the dashboard on the port 15000 (http://localhost:15000) with default username admin and password as password. He wanted to run GPM. So, navigated to Business Process module and clicked on Manager and then clicked on Run Graphical Process Modeler - Go button.
He do not remember exact words in the exception but it sounds more of like below.
The first exceptiont is "You are seeing this message because either Java 5 is not installed on your system or, you are using older version of Java web start. Please download the java 1.5 from http://java.sun.com".
I was surprised to see this message because JRE 1.6 is already running on my server. SI 5.1 requires JDK 1.6.0_14. So when we install JDK it also installs JRE then why the above exception occurred.
The reason behind is Java Web Start is not running even though we installed JDK and JRE.
Go to the installed JDK folder (something like C:\Program Files\Java\jdk1.6.0_14\bin) and find javaws.exe file. Run this file as an administrator. When you run this file it prompts with pop-up that shows the options and parameters to supply.
After that he went back to the SI dashboard and click on "Run Graphical Process Modeler - Go button"
He got an exception - "unable to launch GPM". When I see the details, it is trying to connect to http://java.sun.com and download through the JNLP file.
To let JNLP know where my Java WS is running, I opened the command prompt as an administrator.
Navigated to JDK bin folder to run Java WS with arguments.
Command entered is: javaws -offline requiredjnlpfile
like this: javaws -offline C:\SI51\install\noapp\deploy\gbm\webapp\pmodeler\ProcessModeler.jnlp
Now GPM is started successfully.
Note: The environment I dealt with is Windows 2008 R2, Oracle 10.1. version, 64 bit OS, SI 5.1, JRE 1.6.0_14.
For any questions: meduri.phanendra@gmail.com
http://silearning.freeforums.
Subscribe to:
Posts (Atom)