WORKLOAD AUTOMATION COMMUNITY
  • Home
  • Blogs
  • Forum
  • Resources
  • Events
    • IWA 9.5 Roadshows
  • About
  • Contact
  • What's new

Run Amazon S3 Batch Operations jobs with Workload Automation

8/4/2022

0 Comments

 
Picture
Are you working with Amazon S3 and would you like an easy way to perform your batch operations? We have what you are looking for! The Amazon S3 Batch Operations plug-in is available on Automation Hub, download it to empower your Workload Automation environment.  
Picture
Figure 1: Job Definition Page

Connection

First, establish a connection to the AWS server by entering the required details.
Then, you can test the connection to AWS server by clicking on Test Connection.
Picture
Figure 2: Connection Page

Action

After having successfully tested the connection, you can go to the Action tab and specify the details about the manifest file and the kind of operation (copy, invoke lambda function, restore) you need to perform.
Manifest object contains objects and their bucket reference. Use manifest bucket and manifest object to select the manifest file that you want to use.
Picture
Figure 3: Action Page

a. Copy:

Use this operation to copy all the objects that are referenced in the manifest file to the specified location.
Picture
Figure 4: Action Page > Copy section

b. Invoke AWS Lambda function:

Use this operation to invoke the selected lambda function on the objects specified on the manifest file.
Picture
Figure 5: Action Page > Invoke AWS Lambda Function section

c. Restore:

Use this operation to restore the objects that are specified in the manifest file.
You can also specify the type of retrieval that you like to use and for how many days the restored object should be available.

Picture
Figure 6: Action Page > Restore section

Additional Job Configurations:
In Amazon S3 Batch Operations, there is no job name, so the job is differentiated using the description, also you add tags for this job.
You can also set the priority for this job and assign the role that the job can use to complete the job.
You can set the condition for report generation and where to generate it.

Picture
Figure 7: Action Page > Additional Job Configuration section A
Picture
Figure 8: Action Page > Additional Job Configuration Section B

Submitting your job:
Once the job definition is ready, save it and submit it into the plan.
The job will start its execution and perform the desired operation.
​
Monitoring your job:
While Amazon S3 Batch Operations executes the process, the plug-in offers the possibility to monitor real-time the execution. Such monitor page, called Workflow details, is accessible from the monitor jobs view and contains all details about the job. Refresh the page to see the updates. 
Picture
Figure 9: Workflow Details Page

Thus, thanks to the Amazon S3 Batch Operations plug-in, you can automate your Amazon S3 Batch Operations jobs and monitor them, all from one place.
 
On Automation Hub there are many other integrations that will enable you to automate everything you want.
Automate more, automate better!

Author's Bio
Picture
Riyas - Software Engineer for HCL Workload Automation

Riyas works as a software engineer for workload automation team Bangalore. He holds a Biotechnology degree from National Institute of Technology, Warangal. He is self-driven and motivated and constantly experimenting with new technologies and techniques. He is proficient in C++, Java, JavaScript, and Python. In his free time, he loves to read fictional novels
0 Comments

Your comment will be posted after it is approved.


Leave a Reply.

    Archives

    March 2023
    February 2023
    January 2023
    December 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    January 2020
    December 2019
    November 2019
    October 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017

    Categories

    All
    Analytics
    Azure
    Business Applications
    Cloud
    Data Storage
    DevOps
    Monitoring & Reporting

    RSS Feed

www.hcltechsw.com
About HCL Software 
HCL Software is a division of HCL Technologies (HCL) that operates its primary software business. It develops, markets, sells, and supports over 20 product families in the areas of DevSecOps, Automation, Digital Solutions, Data Management, Marketing and Commerce, and Mainframes. HCL Software has offices and labs around the world to serve thousands of customers. Its mission is to drive ultimate customer success with their IT investments through relentless innovation of its products. For more information, To know more  please visit www.hcltechsw.com.  Copyright © 2019 HCL Technologies Limited
  • Home
  • Blogs
  • Forum
  • Resources
  • Events
    • IWA 9.5 Roadshows
  • About
  • Contact
  • What's new