WORKLOAD AUTOMATION COMMUNITY
  • Home
  • Blogs
  • Forum
  • Resources
  • Events
    • IWA 9.5 Roadshows
  • About
  • Contact
  • What's new

Unleash the power of HCL Workload Automation in an Amazon EKS cluster

8/4/2020

0 Comments

 
Picture
Don’t get left behind! The new era of digital transformation of businesses has moved on tonew operating models such as containers and cloud orchestration. 
​

Let’s find out how to get the best of Workload Automation (WA) by deploying the solution on a cloud-native environment such as Amazon Elastic Kubernetes Service (Amazon EKS).
This type of deployment makes the WA topology implementation 10x easier, 10x faster, and 10x more scalable compared to the same deployment in an on-premises classical platform. ​  

In an Amazon EKS deployment, to best fit the cloud networking needs of your company, you can select the appropriate networking cloud components supported by the WA Helm chart to be used for the server and console components:  
​
  • Load balancers  
  • Ingresses  

Y
ou can also leverage the Grafana monitoring tool to display WA performance data and metrics related to the server and console application servers (WebSphere Application Server Liberty Base). Grafana needs to be installed manually on Amazon EKS to have access to Grafana dashboards. Metrics provide drill-down for the state, health, and performance of your WA deployment and infrastructure. 

In this blog you can 
discover how to: 
  • Deploy WA components (Server, Agent, Console) in an Amazon EKS cluster, using one of the available cloud network configurations. 
  • Download the Kubernetes job plug-in from the Automation Hub website and configure it in your AWS EKS cloud environment.  
  • Monitor the WA solution from the WA customized Grafana Dashboard. 

 
Let’s start by taking a tour!!! 

Deploy WA components (Server, Agent, Console) in an Amazon EKS cluster, using one of the available network configurations 


In this 
example, we set up the following topology for the WA environment and we configure the use of the ingress network configuration for the server and console components:  
  • 1 server  
  • 2 dynamic agents  
  • 1 console 

Let’s
 demonstrate how you can roll out the deployment without worrying about thecomponent installation process. 

For more 
information about the complete procedure, see: 
https://github.com/WorkloadAutomation/hcl-workload-automation-chart OR https://github.com/WorkloadAutomation/ibm-workload-automation-chart/blob/master/README.md 
​
  1. Create hwa-test namespace for the Workload Automation environment 

2. Add the Helm chart to the repo 
Add the Workload Automation chart to your repo and then pull it on your machine 


3. Customize the Helm Chart values.yaml file 
Extract the package from the HCL or IBM Entitled Registry, as explained in the README fileand open the values.yaml Helm chart file. The values.yaml file contains the configurable parameters for the WA components. 
To deploy 2 Agents in the same instance, set the waagent replicaCount parameter to 2
Picture
Snap of replicaCount parameter from the values.yaml file
Set the Console exposeServiceType as Ingress as follows:
Picture
Snap of console Ingress configuration parameters from the values.yaml file
Set the server exposeServiceType as Ingress as follows:
Picture
Snap of server Ingress configuration parameters from the values.yaml file
Save the changes in the values.yaml file and get ready to deploy the WA solution!  
​

4. Deploy the WA environment configuration  
Now it’s time to deploy the configuration. From the directory where the values.yaml file is located, run: ​
Picture
After about ten minutes, the WA environment is deployed and ready to use! 

No other configurations or settings are needed, you can start to get the best of the WA solution in the AWS EKS cluster!   
To work with the WA scheduling and monitoring functions, you can use the console as usual,or take advantage of the composer/conman command lines by accessing the WA master pod. 
​

To figure out how to get the WA console URL, continue to read this article!
Picture
Workload Automation component pod view from the Kubernetes Manager tool Lens
Install and configure the Automation Hub Kubernetes plug-in 

Let’s start to explore how to install and configure the native Kubernetes jobs on the AWS EKS environment.  
NOTE: These installation steps are also valid for any other Plug–in available in the AutomationHub catalog. 
To download the Kubernetes Batch Job Plug–in 9.5.0.02 version, go to the following Automation Hub URL:
Picture
Workload Automation Kubernetes Batch Job plug–in in Automation Hub  
  1. Download the package from Automation Hub and extract it to your machine
Picture
Download the package from Automation Hub and extract it to your machine
2. Copy the JAR file in the DATA_DIR folder of your WA master pod 
From the directory where you extracted the plug-in content, log in to your AWS EKS cluster, and run the command: ​
Picture
3. Copy the JAR file in the applicationJobPlugin folder 
Access the master pod and copy the Kubernetes JAR file from the /home/wauser/wadata/wa-plugin folder to the applicationJobPlugin folder.
Picture
Copy command from the Server pod terminal
4. Restart the application server  
From the appservertools folder in TWS inst directory run the commands ​
Picture
Workload Automation application server start/stop commands.
Now the plug–in is installed, and you can start creating Kubernetes job definitions from the Dynamic Workload Console.  
5. Create and submit the job  
To access the Dynamic Workload Console, you need the console ingress address. You can find it running the command:
Picture
Kubernetes command to get the list of ingress addresses. ​
Build up the URL of the console by copying the ingress address, as follows:
Picture
From the Workload Designer create a new Kubernetes job definition:
Picture
Job definition search page from the Dynamic Workload Console. 
Define the name of the job and workstation where the job runs:
Picture
Job definition page of the Dynamic Workload Console. 
On the Connections page, check the connection to your cluster:
Picture
Connection panel of the Kubernetes Batch Job plug–in in the Dynamic Workload Console.  
From the Run Kubernetes Job page, specify the name of the Kubernetes job yaml file that you have defined on your workstation. ​
Picture
Kubernetes job configuration page of Workload Automation console 
Now there’s nothing left to do but save the job and submit it to run!!! 
 As expected, the k8s job runs on a new pod deployed under the hwa-test namespace:
Picture
Kubernetes Batch job pod view from Kubernetes Manager tool Lens. 

Once the job is done, the pod is automatically terminated.  

Monitor the WA environment through the customized Grafana Dashboard 


Now that your environment is 
running and you get how to install and use the plug–ins, you can monitor the health and performance of your WA environment. 

Use
 the metrics that WA has reserved for you!!! 

To get
 a list of all the amazing WA metrics  available, see the Metric Monitoring section of the readme: https://github.com/WorkloadAutomation/hcl-workload-automation-chart 

​Log
 in to the WA custom Grafana Dashboard, and access one of the following available custom metrics:
Picture
List of Workload Automation custom metrics from the Grafana dashboard  
In each section, discover a brand-new way to monitor the health of your environment!
Picture
Workload Automation custom metrics from the Grafana dashboard – Pod resources 
Take a look at the space available for your WA persistent volumes for WA DATA_DIR!
Picture
Workload Automation custom metrics from the Grafana dashboard – Disk usage
Picture
Full message queues are just an old memory! 
Workload Automation custom metrics from the Grafana dashboard – Message queue 
For an installation process example check this out!
Picture
Learn more about Workload Automation and get in touch with us here!
Author's Bio
Picture
Serena Girardini
She is the Verification Test manager for the Workload Automation product in distributed environments. She joined IBM in 2000 as a Tivoli Workload Scheduler developer and she was involved in the product relocation from the San Jose Lab to the Rome Lab during a short-term assignment in San Jose (CA).  For 14 years, Serena gained experience in Tivoli Workload Scheduler distributed product suite as adeveloper, customer support engineer, tester and information developer. She covered for a long time the role of L3 fix pack release Test Team Leader and, in this period, she was a facilitator during critical situations and upgrade scenarios at customer sites. In her last 4 years at IBM, she became IBM Cloud Resiliency and Chaos Engineering Test Team Leader. She rejoined HCL in April, 2019 as an expert Tester and she was recognized as Test Leader for the product porting to the most important Cloud offerings in the market. She has a Bachelor Degree in Mathematics.
View my profile on LinkedIn
Picture
Louisa Ientile
Louisa works as an Information Developer planning, designing, developing, and maintaining customer-facing technical documentation and multimedia assets.  Louisa completed her degree at University of Toronto, Canada, and currently lives in Rome, Italy. ​
View my profile on LinkedIn
Picture
Davide Malpassini
He joined HCL in September 2019 as Technical Lead starting to work on IBM Workload Automation product suite. He has 14 years experience on software development and his activity was the extension of the Workload Automation product from a Kubernetes native environment to OpenShift Container Platform and  REST API for Engine of Workload Automation . He has a Computer Engineering Master Degree.
View my profile on LinkedIn
Picture
Pasquale Peluso
He is a Workload Automation Software Engineer. He joined HCL in September 2019 in the Verification Test team. He works as verification tester for Workload Automation suite on distributed and cloud-native environments. He has a master’s degree in Automation Engineering.
View my profile on LinkedIn
Picture
Filippo Sorino 
He joined HCL in September 2019 as Junior Software Developer starting to work as Tester for IBM Workload Automation product suite.  He has a computer engineering bachelor’s degree.
View my profile on LinkedIn
Picture
Federico Yusteenappar
He joined HCL in September 2019 as Junior Software Developer starting to work as Cloud Developer for IBM Workload Automation product suite. Hismain activity was the extension of the Workload Automation product from a Kubernetes native environment to OpenShift Container Platform. He has a Computer Engineering Master Degree.
View my profile on LinkedIn
0 Comments

Your comment will be posted after it is approved.


Leave a Reply.

    Archives

    March 2023
    February 2023
    January 2023
    December 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    January 2020
    December 2019
    November 2019
    October 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017

    Categories

    All
    Analytics
    Azure
    Business Applications
    Cloud
    Data Storage
    DevOps
    Monitoring & Reporting

    RSS Feed

www.hcltechsw.com
About HCL Software 
HCL Software is a division of HCL Technologies (HCL) that operates its primary software business. It develops, markets, sells, and supports over 20 product families in the areas of DevSecOps, Automation, Digital Solutions, Data Management, Marketing and Commerce, and Mainframes. HCL Software has offices and labs around the world to serve thousands of customers. Its mission is to drive ultimate customer success with their IT investments through relentless innovation of its products. For more information, To know more  please visit www.hcltechsw.com.  Copyright © 2019 HCL Technologies Limited
  • Home
  • Blogs
  • Forum
  • Resources
  • Events
    • IWA 9.5 Roadshows
  • About
  • Contact
  • What's new