WORKLOAD AUTOMATION COMMUNITY
  • Home
  • Blogs
  • Forum
  • Resources
  • Events
  • About
  • Contact
  • What's new

Connect to Google Batch with Workload Automation

8/2/2023

0 Comments

 
Picture
​Let's start understanding Google Batch, and then go forward to discovering the GCP Batch plug-in and the benefits of using it. Google Batch is a fully managed service that lets you schedule, queue, and execute batch processing workloads on Google Cloud resources. 
Picture
Using Batch, we don't need to configure and manage third-party job schedulers, provision and deprovision resources, or request resources one zone at a time. To run a job, you specify parameters for the resources required for your workload, then Batch obtains resources and queues the job for execution. Batch provides native integration with other Google Cloud services to aid in the scheduling, execution, storage, and analysis of batch jobs, so you can focus on submitting a job and consuming the results.
 
Thus, to empower your Workload Automation environment, download the Google Batch plug-in available on Automation Hub. After downloading it, log in to the Dynamic Workload Console and go to the Workload Designer. Create a new job and select “Google Batch” in the Cloud section.
Picture
Connection
​
To begin, connect to the Google Cloud server. To connect to Google Cloud, you have two options under the Connection tab:
 
1. GCP Default Credentials: If the VM is already located within the GCP environment, you can select this option since no explicit credentials are required.

2. GCP Server Credentials: By choosing this option, you can manually enter the project ID and the GCS account. (a unique name associated with each project). 
 
After that, choosing Test Connection, you can check your Google Cloud connection.
​
Picture
Picture
​ActionUse this section to define options for GCP cloud batch function.
You can choose to make a batch using a script or container, delete an existing job, or both. To create a job, you have two options. Create a job using script.
Create a job using container.
Create Job
You can select the "Create Job" to create a job,
 
Job Name
Enter the Job name.
Machine Configuration
Machine type- Machine Type must be defined in Google Cloud Batch Machines which are defined in Google Cloud Batch documentation.
Task details
Script
You can see the text area where you can input the script once you choose the "Script" radio button, provided that all relevant fields are enabled. while keeping the Container task's associated fields enabled.
Task Count
Enter the total number of tasks. Must be a whole number between 1 and 10,000.
Task Parallelism
Enter the number of tasks you want running at the same time. Must be a whole number between 1 and 1,000.
Task VCPUs
Enter between 0.5 and 224 vCPUs
 
Task Memory
Enter between 0.5 and 896 GB
 
Note: Job name, Machine type, taskCount, taskParallelism, task CPUs, task and Memory fields are mandatory fields
Container
You can select the "Container" radio button to enable all the required fields, while keeping the fields related to the Script task disabled.
Containerimage URL
Enter your image URL from a public registry or use a private image hosted on the Google Container Registry.
Entry Point
Specify the command that have to run instead of your container's entrypoint command.
Containterimage command
Enter the command to be run in place of the CMD command for your container image.
Note: It is not recommended to specify "zero" in the TaskCount, TaskParallelism, Task CPUs, or TtaskMemory columns.
Save Function Output to File
Select the check box to save the function output.
Output File Path
Provide the location to save the function output files.
Picture
Picture
Picture
Submitting your job ​
​ Now, it is time to submit the job in the current plan. Add the job to the job stream that automates your business process flow. Select the action menu in the top-left corner of the job definition panel and click Submit Job into Current Plan. A confirmation message is displayed, and you can switch to the Monitoring view to see what is going on.

Picture
Monitor Page
Picture
JOB Log:
Picture

Author
Umamaheswararao Basa
Senior Developer at HCLSoftware

​Works as a Plugin Developer in Workload Automation. Acquired skills on Java, Spring, Spring Boot, Hibernate, Microservices, Docker, Kubernetes, AngularJS, JavaScript, AWS Development(serverless)
Picture
D Krishna Kumar
Senior Software Engineer(Tester) at HCLSoftware

​Working as a Tester in Workload Automation for the different plugins. Acquired skills on Functional Testing, Regression Testing, Smoke Testing, java, selenium
Picture

Co-author
​Ernesto Carrabba, Product Manager, HCL Clara, HCL HERO and HCL Workload Automation 
 
Ernesto Carrabba is the Product Manager for HCL Clara, HCL HERO and HCL Workload Automation. Ernesto is a very dynamic product manager with experience in building and launching IoT products, combined with a master's degree in mechanical engineering and study researches on Augmented and Virtual Reality. 
Picture
0 Comments

Your comment will be posted after it is approved.


Leave a Reply.

    Archives

    March 2025
    February 2025
    January 2025
    December 2024
    November 2024
    October 2024
    September 2024
    August 2024
    July 2024
    June 2024
    May 2024
    April 2024
    March 2024
    February 2024
    January 2024
    October 2023
    August 2023
    July 2023
    June 2023
    May 2023
    April 2023
    March 2023
    February 2023
    January 2023
    December 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    January 2020
    December 2019
    November 2019
    October 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017

    Categories

    All
    Analytics
    Azure
    Business Applications
    Cloud
    Data Storage
    DevOps
    Monitoring & Reporting

    RSS Feed

www.hcltechsw.com
About HCL Software 
HCL Software is a division of HCL Technologies (HCL) that operates its primary software business. It develops, markets, sells, and supports over 20 product families in the areas of DevSecOps, Automation, Digital Solutions, Data Management, Marketing and Commerce, and Mainframes. HCL Software has offices and labs around the world to serve thousands of customers. Its mission is to drive ultimate customer success with their IT investments through relentless innovation of its products. For more information, To know more  please visit www.hcltechsw.com.  Copyright © 2024 HCL Technologies Limited
  • Home
  • Blogs
  • Forum
  • Resources
  • Events
  • About
  • Contact
  • What's new