Senior Python Data Engineer with Ab Initio Experience

Citi; New York (NY); Hybrid; USD 12,000 - 21,000; Full time

Job summary

Citi is seeking a Data Engineer with strong Python skills and Ab Initio exposure to design, build, and maintain scalable data pipelines in a hybrid environment across multiple locations. You will implement ETL/ELT processes, collaborate with analytics and engineering teams, and ensure data quality and governance across enterprise platforms.

The role emphasizes Python-driven data engineering, batch and near-real-time processing, and integration with cloud/enterprise systems, with opportunities to

Qualifications

• 4+ years of experience in data engineering, ETL development, or data integration.
• Strong programming experience in Python, including scripting, object-oriented programming, data processing, and automation.
• Good knowledge of SQL, relational databases, data warehousing, dimensional modeling, and ETL concepts.
• Experience with Python data libraries such as Pandas and PySpark, or equivalent distributed processing frameworks.
• Exposure to Ab Initio tools, including GDE, Co>Operating System, EME, or Conduct>It.
• Understanding of Ab Initio graphs, components, metadata, workflows, and operational processes.
• Experience implementing data validation, reconciliation, error handling, and monitoring.
• Familiarity with Git, CI/CD, testing practices, and Agile delivery methods.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable batch and near-real-time data pipelines using Python.
• Build ETL/ELT processes for data extraction, transformation, validation, and loading.
• Work with relational databases, data warehouses, APIs, files, and distributed data platforms.
• Develop reusable Python modules, frameworks, and automation utilities for data engineering workflows.
• Support and enhance existing Ab Initio applications, graphs, and workflows under guidance from senior team members.
• Collaborate with business analysts, data architects, developers, and stakeholders to understand data requirements.
• Implement data quality checks, reconciliation, error handling, logging, and exception management.
• Optimize pipeline performance, scalability, reliability, and resource utilization.
• Perform root cause analysis and resolve data-related production issues.
• Integrate data pipelines with enterprise systems, databases, cloud platforms, and scheduling/orchestration tools.
• Participate in code reviews, testing, deployment, and production support activities.
• Document technical designs, data mappings, operational procedures, and workflows.
• Follow data governance, security, compliance, and engineering standards.

Skills

Python

ETL development

SQL

Pandas

PySpark

Ab Initio

CI/CD

Git

Agile

Data quality

Education

Bachelor’s or Master’s degree in CS/IT/Engineering

Tools

Ab Initio

Airflow

Spark

Kafka

Job description

Citi is seeking a Data Engineer with strong Python skills and Ab Initio exposure to design, build, and maintain scalable data pipelines in a hybrid environment across multiple locations. You will implement ETL/ELT processes, collaborate with analytics and engineering teams, and ensure data quality and governance across enterprise platforms.

The role emphasizes Python-driven data engineering, batch and near-real-time processing, and integration with cloud/enterprise systems, with opportunities to