Overview
Job Title: Senior Data Engineer - DataStage
Years of Experience: 6 - 10 Years
Job Description: We are looking for skilled and experienced Data Engineers to join our Client. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, think strategically, innovate, and help others, this job is for you! Senior Data Engineer specializing in IBM DataStage, responsible for designing, developing, and managing the ETL processes and data infrastructure. Play a critical role in ensuring the smooth flow, transformation, and integration of data from various sources to the data warehouse or data lake.
Primary Skills
DataStage
Secondary Skills
Data & Analytics Concepts, ETL & Performance Testing, IBM DB2
Role Description
We are looking for a Senior Data Engineer to lead the design, development, and management of scalable data platforms and pipelines. This role demands a strong technical foundation in data architecture, big data technologies, and database systems (both SQL and NoSQL), along with the ability to work across functional teams to deliver robust, secure, and high-performing data solutions.
Role Responsibilities
- Design, develop, and maintain end-to-end data pipelines and infrastructure.
- Translate business and functional requirements into scalable, well-documented technical solutions.
- Build and manage data flows across structured and unstructured data sources, including streaming and batch integrations.
- Ensure data integrity and quality through automated validations, unit testing, and robust documentation.
- Optimize data processing performance and manage large datasets efficiently.
- Monitor and optimize ETL workflows to ensure performance, scalability, and reliability.
- Collaborate closely with stakeholders and project teams to align data solutions with business objectives.
- Implement and maintain security and privacy protocols to ensure safe data handling.
- Lead development environment setup and configuration of tools and services.
- Mentor junior data engineers and contribute to continuous improvement and automation initiatives.
- Coordinate with QA and UAT teams during testing and release phases.
Role Requirements
- Strong proficiency in SQL (including procedures, performance tuning, and analytical functions).
- Solid understanding of data warehousing concepts, including dimensional modeling and SCDs.
- Hands-on experience with scripting languages (Shell / PowerShell).
- Familiarity with Cloud and Big data technologies.
- Experience working with relational, non-relational databases, and data streaming systems.
- Proficiency in data profiling, validation, and testing practices.
- Excellent problem-solving, communication (written and verbal), and documentation skills.
- Exposure to Agile methodologies and CI / CD practices.
- Self-motivated, adaptable, and capable of working in a fast-paced environment.
Additional Requirements
- Minimum 6 years of experience in Data Engineering with strong expertise in ETL / ELT development using IBM DataStage.
- Prior onsite and client-facing experience in managing requirements and project delivery.
- Certifications in IBM DataStage or related data engineering technologies are desirable.