Python and AI Data Engineering Lead - Senior Vice President

Citigroup Inc.; Pune District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Citi is seeking a senior data engineer with 12+ years of experience in data domain and ETL development in Pune. You will contribute as an individual contributor, handling large volumes of data and building scalable data pipelines.

Expertise in Python, SQL, and modern data architectures is required, along with strong communication and problem-solving skills. The role emphasizes API-first design, data quality, and documentation.

Qualifications

• Experience in data domain and ETL design, development and maintenance.
• Strong SQL/PL-SQL scripting skills.
• Python data pipelines (Pandas, PySpark) and related libraries.
• Knowledge of AI concepts and modern data architectures (APIs, microservices).
• Experience with Docker/Openshift and CI/CD pipelines.

Responsibilities

• Design, develop, and maintain ETL processes to load data into data warehouse.
• Write complex SQL queries and PL/SQL for data manipulation and validation.
• Develop data pipelines using Python and related libraries.
• Optimize ETL and pipelines for performance and scalability.
• Collaborate with data analysts and stakeholders to meet data requirements.
• Implement data quality checks and monitor data accuracy.
• Troubleshoot data-related issues and maintain technical documentation.
• Stay updated with data management and analytics trends.

Job description

12+ years of Experience in Data Domain , Expert at handling large Volume Data, Candidate will Individual Contributor

• Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into our data warehouse.
• Write complex SQL queries and PL/SQL scripts to perform data manipulation, validation, and transformation.
• Develop and maintain data pipelines using Python and related libraries (e.g., Polar ,Pandas).
• Optimize ETL processes and data pipelines for performance and scalability.
• Collaborate with data analysts and other stakeholders to understand data requirements and develop solutions to meet their needs.
• Implement data quality checks and monitoring to ensure data accuracy and consistency.
• Troubleshoot and resolve data-related issues.
• Create and maintain technical documentation for ETL processes, data pipelines, and database solutions.
• Stay up-to-date with the latest trends and technologies in data management and analytics.

• Database Knowledge: Basic knowledge of databases such as Oracle/SQL.
• Scripting: Basic knowledge of Python.
• Problem-Solving: Excellent analytical and problem-solving skills.
• Communication: Strong communication and interpersonal skills.
• Teamwork: Ability to work effectively in a team environment.
• Methodology of AI includes Chunking, Embedding, AI Engineering, Prompt Engineering

• Deep hands-on experience in engineering and executing scalable enterprise solutions.
• Expert-level proficiency in Python (e.g., FastAPI, Flask, PySpark) or Java (e.g., Spring Boot, Spring Cloud, Spring Security).
• Proficiency in UI (e.g., Angular, React, Node.js, TypeScript) for full-stack development.
• Proficiency in database technologies, such as Oracle, Postgres, or MongoDB.
• Solid understanding of core AI concepts, including knowledge representation, automated planning, decision-making under uncertainty, and multi-agent systems.
• Hands-on experience with relevant frameworks (e.g., Google ADK, LanGraph, LangChain, AutoGen, CrewAI, N8N).
• Extensive experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and relevant libraries (e.g., Scikit-Learn, NumPy, Pandas).
• Proven experience in creating, deploying, and integrating MCPs (Model Context Protocol) into agentic AI systems.
• Deep familiarity with large language models (LLMs) such as ChatGPT, Claude, Gemini, and Llama, including their application within agentic systems.
• Demonstrated experience in designing and implementing robust APIs for AI services.
• Proficient in software development best practices, including version control (Git), CI/CD pipelines, comprehensive testing, and code reviews. Strong understanding of agile methodologies, application resiliency, and security principles applied to complex AI projects. Proven expertise in system design, application development, and ensuring operational stability for AI initiatives.
• Deep experience with application and data architecture patterns and designs. Experience leveraging managed services and existing platforms, with a strong emphasis on API-First Design, microservices, and event-driven architectures.
• Hands-on experience with Docker and Openshift.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.