Skip to main content Skip to main navigation Skip to search Skip to footer

Datastage version upgrade leading to 30% reduction in run time of ETL jobs

Datastage version upgrade leading to 30% reduction in run time of ETL jobs

Client

A leading banking and financial service provider with services in retail, business and institutional banking

Services offered

DataStage Upgrade

Domain

BFSI

Application environment

Datastage V8.1, Teradata V12.0, Unix AIX V6.1, Oracle V 9g and Autosys

Location

Australia

Client background

The client is a leading banking and financial service provider founded in 1911. It provides services in retail, business and institutional banking, funds management, broking, investment banking, wealth management, private equity, superannuation and insurance services. It is the largest bank in Australia by market capitalization.

HCLT solution

  • Essentially, there are two major dimensions to this project. First is the OS migration from Sun Solaris to IBM AIX and second is the Datastage version upgrade.
  • In order to overcome the bottleneck in the ETL load process, ETL tool upgrade (Datastage 8.0.1 to Datastage 8.1.1) and OS migration from Sun Solaris Version 5.1 to IBM AIX version 6.1 are suggested. Since Datastage and AIX are from the same vendor, this combination is supposed to have a positive impact on the ETL load process.
  • 9000 Datastage jobs, 500 + Master sequences, 5500 Autosys Jobs and 1200 unix scripts, 1200 Teradata tables from 40 different applications have been successfully migrated over the period of six months

Project challenges

  • Need for revisiting the ETL load strategy at regular intervals because with the expansion of business the data warehouse gets loaded with data from operational source systems
  • Due to the large volume of source data the ETL window got widened every month resulting in issues where business is not able to access the data or generate reports on time leading to SLA violations
  • Widening of ETL window and resulted delays were also impacting the downstream applications which were dependent on them
  • The objective of DataStage upgrade project is to migrate all the DataStage applications that are currently existing in IBM Web Sphere Information Server Version 8.0.1 on Sun Solaris Version 5.1 to IBM WebSphere Information Server Version 8.1 on IBM AIX version 6.1

Benefits in business operations

  • Reduction in the run time of DataStage ETL batch jobs to the tune of 30%
  • High and on time availability of data resulting in no violation of SLAs
  • Less I/O, CPU and memory utilization and hence significant operational cost saving
  • Additional data can be loaded into the Group Data warehouse without major bottlenecks
  • Project has been completed as per the schedule with a savings of $150,000 to the client

DOWNLOAD THE SUCCESS STORY

Contact Us
MAX CHARACTERS: 10,000

We will treat any information you submit with us as confidential. Please read our privacy statement for additional information.

We will treat any information you submit with us as confidential. Please read our privacy statement for additional information.