ETL Developer

Capgemini; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Capgemini is seeking a skilled DataStage Developer to design, develop, and maintain robust ETL processes for a growing data warehouse. You will bridge raw data and insights using IBM DataStage, SQL, and UNIX shell scripting to build high-performance data pipelines.

Responsibilities include ETL design, performance tuning, automation with Unix scripts, and collaboration with data architects and analysts to translate requirements into technical specs.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 4+ years of hands-on ETL development with IBM DataStage.
• Strong skills in SQL including complex queries, stored procedures, and triggers.
• Proficiency in UNIX/Linux environment and shell scripting (Bash/Korn).
• Knowledge of DW concepts (Star/Snowflake schema, SCD Type 1/2).
• Experience with scheduling tools like Control-M or Autosys is a major plus.

Responsibilities

• Design, develop, and maintain ETL jobs using IBM DataStage (v11.x preferred).
• Write and optimize SQL/PL-SQL queries across Oracle, DB2, and SQL Server.
• Create UNIX shell scripts to automate data processing and job scheduling.
• Identify bottlenecks and tune ETL pipelines for better throughput.
• Provide RCA for production job failures and ensure data integrity.
• Collaborate with data architects and analysts to translate requirements.

Skills

DataStage

SQL

UNIX shell scripting

ETL design

DW concepts

Education

Bachelor's degree in Computer Science/IT

Tools

DataStage

Control-M

Autosys

Oracle

DB2

SQL Server

Job description

We are seeking a highly skilled DataStage Developer to design, develop, and maintain robust ETL processes for our growing data warehouse. In this role, you will be the bridge between raw data and actionable business insights, leveraging your expertise in IBM InfoSphere DataStage, complex SQL, and UNIX shell scripting to build high-performance data pipelines.

Locations: Pune/Bangalore

Key Responsibilities:

• ETL Design & Development: Create, test, and deploy complex Parallel and Sequencer jobs using DataStage (v11.x preferred).
• Database Optimization: Write and optimize advanced SQL/PL-SQL queries to extract and load data efficiently across various RDBMS platforms like Oracle, DB2, or SQL Server.
• Automation: Develop and maintain UNIX Shell Scripts to automate data processing, file manipulation, and job scheduling.
• Performance Tuning: Identify bottlenecks in the ETL pipeline and implement tuning strategies to improve data throughput.
• Troubleshooting: Provide root cause analysis (RCA) for job failures in production and ensure data integrity through robust error-handling.
• Collaboration: Partner with data architects and business analysts to translate functional requirements into technical specifications.

Requirements:

• Experience: Minimum 4 years of hands-on experience in ETL development using IBM DataStage.
• SQL Mastery: Strong expertise in writing complex queries, stored procedures, and triggers.
• UNIX Skills: Proficiency in UNIX/Linux environments and shell scripting (Bash/Korn).
• Data Warehousing: Deep understanding of DW concepts (Star/Snowflake schema, SCD Type 1/2).
• Tools: Experience with scheduling tools like Control-M or Autosys is a major plus.
• Education: Bachelor's degree in Computer Science, Information Technology, or a related field.