SAP Cloud Platform Integration for Data Services with Workload Automation

​Let us begin with understanding SAP Cloud Platform Integration for Data Services, what it is all about along with our SAP Cloud Platform Integration for Data Services Plug-in, and how it benefits our workload automation users. To empower your Workload Automation environment, download the SAP Cloud Platform Integration for Data Services plug-in available on Automation Hub.

​In the swiftly evolving digital landscape of today, businesses are always seeking innovative tools to enhance efficiency and streamline operations. SAP Cloud Platform Integration for Data Services (CPI-DS) emerges as a transformative solution, delivering robust capabilities for seamless data integration and transformation. 

By leveraging the SAP CPI-DS Plug-in for Workload Automation, you can effortlessly incorporate advanced data processing into your existing workflows, enabling automated data handling and smarter business operations.
 
Key Features of the SAP Cloud Platform Integration for Data Services:
The SAP CPI-DS Plug-in enhances Workload Automation by simplifying and optimizing your data integration efforts. It offers:

• Seamless integration: Connect Workload Automation with SAP CPI-DS to efficiently trigger and manage data integration tasks across various systems.
• Versatile connectivity: Easily link to diverse data sources like on-premise databases, cloud applications, and hybrid environments using CPI-DS’s extensive connectivity options.
• Tailored transformations: Define data mappings, transformations, and cleansing rules to ensure consistent, high-quality data aligned with your business needs.
• Scalable processing: Handle large volumes of data integration tasks effectively, without managing complex infrastructure.
• Comprehensive logging: Access detailed job logs for monitoring and troubleshooting, providing clear visibility into data flows and integration processes.

 
Use Cases:
The SAP CPI-DS Plug-in unlocks numerous possibilities for automating data workflows. Here are some common applications:

• Data synchronization: Automate syncing between on-premise systems and cloud applications to maintain real-time consistency.
• ETL pipeline creation: Build efficient Extract, Transform, Load (ETL) processes to convert raw data into actionable insights for analytics and reporting.
• Master data integration: Streamline the integration of master data across systems to ensure accuracy and consistency in operations.
• Cloud migration: Simplify data transitions from legacy systems to cloud platforms, minimizing disruption while preserving data integrity.
• Real-time analytics: Enable real-time data integration to support dynamic dashboards and faster decision-making.

 
Example Workflow: Automation of ETL processes utilizing SAP CPI-DS and Workload Automation: A Retail Sector Application
A large retail company wants to import their customer master information (located in an on-premise SAP Business Suite Application R/3 system) into the SAP Cloud Platform after having processed the latest sales orders. By using the IBM Workload Scheduler plug-in for SAP Cloud Platform Integration for Data Services, the ETL task can be launched after the processing of the sales orders.
 
 
Getting Started with the SAP Cloud Platform Integration for Data Services Plug-in.
 
To begin using the SAP Cloud Platform Integration for Data Services, follow these steps:
 
1. Connect to SAP Cloud Platform Integration for Data Services
Log in to the Dynamic Workload/UnO Console and open the Workload Designer/Designer. Create a new job definition/task and select the SAP Cloud Platform Integration for Data Services.

Organisation Name: Provide the Organisation name for accessing SAP CPI-DS application.
Username and Password: Provide the Username and Password.
isProduction: If true, this is a production instance. Else, this is a non-production / trial instance.

Test Connection: Verify the connection to ensure the credentials and organisation name are correctly configured.

2. Define the Action
In the Action tab, use this section to define the options for SAP Cloud Platform Integration for Data Services operations. You can specify the following:

• Agent Name: Select the agent identifier to execute the job. Note: Format to be followed is "AgentGroupName ::: AgentName".
• Active Agents Only: If true, only active agents can be considered.
• Project Name: The project name to use for running the job.
• Task Name: Specify the task name to execute within the selected project.
• Task Description (Optional): The description of the task to be executed.
• Task Profile Name (Optional): The task profile name to be used for the task execution.
• Global Variables (Optional): The input parameters for the task to be executed.
• Get Task Log Details: If true, task details can be logged in the job log.

Note: If the Task Description, Task Profile Name, and Global Variables fields are defined in the SAP application, a valid value must be passed from the job definition.

3. Add/Save and Submit/Run your Job
 
Once the job is defined, add/save it and submit/run it to the current plan. To automate your business process flow, add the job to a job stream. You can monitor the job execution in the Monitoring View.

4. Monitor Job Execution
 
Monitor the job's progress on the Monitor Page. If the job completes successfully, the status will update to "Successful."

Why Choose the SAP Cloud Platform Integration for Data Services?
 
The SAP Cloud Platform Integration for Data Services enables businesses to effortlessly connect and integrate data from both cloud and on-premise systems, enhancing efficiency and providing real-time insights. By utilizing powerful ETL (extract, transform, load) capabilities, you can centralize and streamline data workflows, ensuring scalability, security, and consistency across your enterprise operations. Whether you are synchronizing supply chain data, improving analytics, or integrating SAP and non-SAP applications, this platform serves as your gateway to smarter, automated, and data-driven business processes.

Job Log Details: 

In Conclusion:
 
The SAP Cloud Platform Integration for Data Services plugin is a powerful tool that empowers you to seamlessly integrate your data integration processes managed by SAP CPI-DS with the broader automation capabilities of Workload Automation. By providing centralized orchestration, monitoring, and control, this plugin enables you to build robust, efficient, and reliable data pipelines across your enterprise landscape, driving better data-driven insights and business outcomes.

​Saketh Siva Ram Modali - Senior Software Engineer at HCL Software

Saketh is a Technical Lead and Senior Software Engineer with extensive expertise in Java development, specializing in HCL Workload Automation within the WA Plugin Factory team. He excels in designing and deploying robust, scalable applications across multiple cloud technologies, consistently driving innovative solutions. Saketh holds a bachelor's degree in Electronics and Communication from NIT-B. Outside of work, he enjoys watching movies, photography, and exploring new travel destinations.

---

Ernesto Carrabba, Product Manager, HCL Clara, HCL HERO and HCL Workload Automation 
Ernesto Carrabba is the Product Manager for HCL Clara, HCL HERO and HCL Workload Automation. Ernesto is a very dynamic product manager with experience in building and launching IoT products, combined with a master's degree in mechanical engineering and study researches on Augmented and Virtual Reality

---