Datastage Engineer

Centraprise; Midvale (UT); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Centraprise, Corp. is seeking an experienced DataStage ETL Engineer to design and load data into the Greenplum EDW. You will work with Oracle/DB2/SQL Server/Teradata sources and target a high-quality data platform.

The role requires 8+ years of hands-on experience, strong data modeling, data quality, and profiling, plus scripting in SQL and Python. The position is based in Midvale, Utah with hybrid in-office days.

Qualifications

• 8+ years designing and developing IBM DataStage ETL jobs for Greenplum EDW.

Responsibilities

• Design and develop DataStage ETL jobs to load into Greenplum EDW within SLAs.
• Analyze data designs and manage code versions for development, staging, and testing.
• Monitor jobs, debug issues, and optimize performance.
• Set up and maintain Control-M schedules.
• Collaborate with Information Analysts and teams across levels.

Skills

DataStage ETL design

Data modeling

Data quality & profiling

Team mentoring

Independent work

Problem solving

Tools

IBM DataStage

IBM InfoSphere DataStage

Greenplum

Cloudera Data Lake

Control-M

Python

SQL

Unix Shell

Oracle

DB2

SQL Server

Teradata

Job description

Location: Midvale UT / Hybrid: 3 days in TCS Office, if working from other location

Job Description

Skill: DATA Stage Engineer

• 8+ years of experience supporting, designing and developing applications using IBM DataStage ETL jobs to load into the Greenplum EDW Database to meet the business requirements
• Sound understanding of data modeling, data quality and data profiling.
• Familiar with IBM InfoSphere DataStage
• Experience in writing Script using SQL and Python
• Knowledge on Cloudera data lake
• Ability and desire to learn new technologies quickly.
• Ability to work independently and collaborate with others at all levels of technical understanding.
• Analyze environment and data designs to assess impacts to requested changes by managing code base and environment usage for development, staging and testing and applying branch and code versioning to support different data sets [10%]
• Ensure processes are consistent with business requirements from Information Analysts (IAs) on how to process the upstream data [10%]
• Source data from Oracle, DB2, SQL Server, Teradata, and profile the data to understand the requirements [10%]
• Designing the IBM DataStage ETL jobs to load into the Greenplum EDW Database to meet the business requirements within the SLAs [10%]
• Perform unit tests on code [5%]
• Setup Control-M Schedules and order them per the business needs [5%]
• Keep track of the reported defects, and support other teams to resolve defects [5%]
• Monitor DataStage jobs, identify bugs, and resolve issues by fixing the data or rewriting the code [10%]
• Work and mentor team on use of IBM InfoSphere DataStage [5%]
• Design, build and maintenance of transform rules and processes to derive the correct data from the extracted data and to transform it into the required format [10%]
• Design code and write SQL, Python scripts, and Unix Shell Scripts based on ETL requirements [5%]
• Create mappings to assist Information analysts on the team [5%]
• Design and develop data pipeline to load into Cloudera data lake [10%]