Ab Initio ETL Expert

BMW TechWorks India Private Limited; India; On-site; INR 2,800,000 - 4,500,000; Full time

Job summary

BMW TechWorks India Private Limited is seeking an experienced Ab Initio Data Integration Engineer to design, build, and optimize complex Ab Initio components and ETL processes. The role requires collaboration with analysts and end users to capture requirements and ensure timely delivery.

The candidate should have 8–10 years of Ab Initio experience, strong UNIX shell scripting and Python skills, and hands-on experience with Ab Initio GDE and Metadata Hub for deployment and lineage management.

Qualifications

• Bachelor’s degree in computer science or related field.
• 8–10 years of Ab Initio experience.
• Experience handling large data volumes and data integration.
• Proficient in UNIX shell scripting and Python.
• Experience with Ab Initio metadata hub and graph deployment.

Responsibilities

• Researching, designing, and developing complex components for Ab Initio applications.
• Interacting with analysts and end users for information requirements.
• Tuning Ab Initio processes to reduce total run time.
• Implementing design decisions using Ab Initio and UNIX wrapper scripts.
• Executing deliverables to meet deadlines.

Skills

Ab Initio development

UNIX shell scripting

Python

ETL data integration

Data modelling

Batch processing

Deployment architectures

Debugging & troubleshooting graphs

Agile methodologies

Communication skills

Education

Bachelor’s degree in Computer Science or related field

Tools

Ab Initio GDE

Metadata Hub/EME

Job description

Ab Initio Ab Initio EME Data Integration Python Unix Shell Scripting ETL and Data Modelling ETL AWS

• Researching, designing, and developing complex components for Ab Initio applications with quality coding.
• Interacting with analysts and end users for information requirements.
• Coding Ab Initio graphs and components using ETL tools (Ab Initio GDE) and ensuring they are in line with user requirements
• Tuning Ab Initio process by maximizing the use of components and MFS file system to achieve a reduction of total process time.
• Storing, retrieving, and manipulating data by building queries for system analysis and requirements.
• Implementing design decisions using design patterns and plans in Ab Initio and creating UNIX wrapper scripts to handle the complex transformation logic.
• Performing unit testing, coding, design, and documentation.
• Executing deliverables to ensure the deadlines are met in a timely manner.

What should you bring along

• Leading Design Discussion and importing the feeds from different sources.
• Develop and maintain high-performance, scalable, and reliable applications.
• You have prior Ab Initio development experience, including experience in deployment architectures, debugging, and troubleshooting graphs.
• Implement and optimize batch processes.
• Propose and implement solutions to improve application performance, scalability, and reliability.
• Collaborate with other teams (e.g., DevOps, product) to ensure successful project delivery.
• Strong understanding of Agile methodologies with the ability to work in at least one of the common frameworks.
• You possess strong critical thinking and problem-solving skills.
• You are a team player with good communication skills to be able to interact with various stakeholders.
• You are detail-oriented, take pride in delivering high-quality work, and organize and deliver work in a timely manner.

Must have technical skill

• You have a bachelor’s degree in computer science, Computer/Management Information Systems, or a related field.
• You have 8 – 10 years of experience with Ab initio and Ab Initio-Metadata Hub (Reference data, Logical Models, Reports, and Business Specification).
• You have solid experience in experience in handling large volumes of data and are well-versed in data integration, batch processing, delta processing, and data capturing.
<
• You have a Strong understanding and hands-on scripting/programming experience skills - UNIX shell scripts and Python.
• Resolve the dependency issues in GDE and import the objects from EME.
• Experience with creating rule files for Transformations and importing the feeds.
• Experience on working in both continuous flow and batch graphs.
• Experience with creating feeds in the Metadata portal and loaded the datasets, executables to establish the end-to-end lineage for objects.
• Experience with execution of the feeds and validation in portal.
• Experience with importing the Business terms and groups into Data Dictionary.
• Experience with Resolving the broken lineage in objects.
• Experience with importing the non-Ab Initio objects from various sources and built lineage with Ab Initio objects using Specifications.

Good to have Technical skills

• Strong understanding of ETL Concepts, design patterns, industry best practices.