Data Engineer with Python and Abinitio

Citi; New York (NY); Hybrid; USD 12,000 - 21,000; Full time

Job summary

Citi is seeking a Data Engineer with strong Python skills and Ab Initio exposure to design, build, and maintain scalable data pipelines in a hybrid environment across multiple locations. You will implement ETL/ELT processes, collaborate with analytics and engineering teams, and ensure data quality and governance across enterprise platforms.

The role emphasizes Python-driven data engineering, batch and near-real-time processing, and integration with cloud/enterprise systems, with opportunities to

Qualifications

• 4+ years of experience in data engineering, ETL development, or data integration.
• Strong programming experience in Python, including scripting, object-oriented programming, data processing, and automation.
• Good knowledge of SQL, relational databases, data warehousing, dimensional modeling, and ETL concepts.
• Experience with Python data libraries such as Pandas and PySpark, or equivalent distributed processing frameworks.
• Exposure to Ab Initio tools, including GDE, Co>Operating System, EME, or Conduct>It.
• Understanding of Ab Initio graphs, components, metadata, workflows, and operational processes.
• Experience implementing data validation, reconciliation, error handling, and monitoring.
• Familiarity with Git, CI/CD, testing practices, and Agile delivery methods.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable batch and near-real-time data pipelines using Python.
• Build ETL/ELT processes for data extraction, transformation, validation, and loading.
• Work with relational databases, data warehouses, APIs, files, and distributed data platforms.
• Develop reusable Python modules, frameworks, and automation utilities for data engineering workflows.
• Support and enhance existing Ab Initio applications, graphs, and workflows under guidance from senior team members.
• Collaborate with business analysts, data architects, developers, and stakeholders to understand data requirements.
• Implement data quality checks, reconciliation, error handling, logging, and exception management.
• Optimize pipeline performance, scalability, reliability, and resource utilization.
• Perform root cause analysis and resolve data-related production issues.
• Integrate data pipelines with enterprise systems, databases, cloud platforms, and scheduling/orchestration tools.
• Participate in code reviews, testing, deployment, and production support activities.
• Document technical designs, data mappings, operational procedures, and workflows.
• Follow data governance, security, compliance, and engineering standards.

Skills

Python

ETL development

SQL

Pandas

PySpark

Ab Initio

CI/CD

Git

Agile

Data quality

Education

Bachelor’s or Master’s degree in CS/IT/Engineering

Tools

Ab Initio

Airflow

Spark

Kafka

Job description

Data Engineer with Python and Abinitio

Location(s):

Chennai, Tamil Nadu, India, Pune, Maharashtra, India

Job Type:

Hybrid

Discover your future at Citi

Working at Citi is far more than just a job. A career with us means joining a team of approximately 219,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Description: Data Engineer – Python with Ab Initio Exposure

We are seeking a skilled Data Engineer with strong Python experience and exposure to Ab Initio. The ideal candidate will design, develop, and maintain reliable data pipelines, ETL processes, and data integration solutions using modern Python-based technologies while supporting enterprise data platforms.

Key Responsibilities

• Design, develop, and maintain scalable batch and near-real-time data pipelines using Python.
• Build ETL/ELT processes for data extraction, transformation, validation, and loading.
• Work with relational databases, data warehouses, APIs, files, and distributed data platforms.
• Develop reusable Python modules, frameworks, and automation utilities for data engineering workflows.
• Support and enhance existing Ab Initio applications, graphs, and workflows under guidance from senior team members.
• Collaborate with business analysts, data architects, developers, and stakeholders to understand data requirements.
• Implement data quality checks, reconciliation, error handling, logging, and exception management.
• Optimize pipeline performance, scalability, reliability, and resource utilization.
• Perform root cause analysis and resolve data-related production issues.
• Integrate data pipelines with enterprise systems, databases, cloud platforms, and scheduling/orchestration tools.
• Participate in code reviews, testing, deployment, and production support activities.
• Document technical designs, data mappings, operational procedures, and workflows.
• Follow data governance, security, compliance, and engineering standards.

Required Skills and Qualifications

• 4+ years of experience in data engineering, ETL development, or data integration.
• Strong programming experience in Python, including scripting, object-oriented programming, data processing, and automation.
• Good knowledge of SQL, relational databases, data warehousing, dimensional modeling, and ETL concepts.
• Experience with Python data libraries such as Pandas and PySpark, or equivalent distributed processing frameworks.
• Exposure to Ab Initio tools, including GDE, Co>Operating System, EME, or Conduct>It.
• Understanding of Ab Initio graphs, components, metadata, workflows, and operational processes.
• Experience implementing data validation, reconciliation, error handling, and monitoring.
• Familiarity with Git, CI/CD, testing practices, and Agile delivery methods.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Skills

• Experience with Apache Airflow, Control-M, or other workflow orchestration tools.
• Exposure to Spark, Kafka, cloud data platforms, or containerized environments.
• Familiarity with data modeling, metadata management, data lineage, and data quality frameworks.
• Experience working in financial services, banking, or other highly regulated environments.
• Knowledge of performance tuning for Python, SQL, Spark, or Ab Initio workloads.
• Experience supporting enterprise-scale data migration or modernization initiatives.

Education

Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.

Experience Level

Mid-level Data Engineer with strong Python expertise and working exposure to Ab Initio; candidates with deeper Ab Initio experience are welcome.

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.