Applications Developer - ETL/Pyspark - Assistant Vice President

Citi; Chennai District; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Citi is seeking an enthusiastic ETL Developer to design, develop, and maintain scalable data pipelines using PySpark, Talend, and Ab Initio. You will transform raw data into insights, ensuring data quality and performance.

Responsibilities include building ETL workflows, big data processing, data ingestion, transformation, and performance tuning, with production support and documentation as part of daily duties.

Qualifications

• Bachelor's degree or equivalent experience in a relevant field.
• 8–10 years of ETL/data engineering experience.
• Proficiency in PySpark and SQL required.

Responsibilities

• ETL Pipeline Development: Build and maintain ETL workflows.
• Big Data Processing: Use PySpark for data processing and analysis.
• Data Extraction & Ingestion: Pull data from relational sources and files.
• Data Transformation: Apply business logic to large datasets.
• Performance Tuning: Optimize ETL jobs and Spark scripts.
• Testing & Documentation: Unit tests and maintain docs.
• Production Support: Monitor daily/weekly jobs; troubleshoot issues.

Skills

PySpark

SQL

Unix/Linux Shell Scripting

Hadoop

Oracle

PostgreSQL

Ab Initio

Talend

Big Data

Education

Bachelor's degree

Tools

Ab Initio

Talend

PySpark

Job description

We are seeking an enthusiastic, detail-oriented ETL Developer to join our data engineering team. In this role, you will be designing, developing, and maintaining scalable data pipelines using PySpark, Talend, and Ab Initio. You will work closely with senior developers to transform raw data into valuable business insights, ensuring optimal data quality and performance.

• ETL Pipeline Development: Building and maintaining Extraction, Transformation, and Loading (ETL) workflows
• Big Data Processing: Utilize PySpark for data processing, manipulation, and analysis within big data ecosystems.
• Data Extraction & Ingestion: Extract data from multiple sources including relational databases (SQL), flat files etc.
• Data Transformation: Create mapping documents and apply business logic to transform large datasets.
• Performance Tuning: Assist in analyzing and optimizing existing ETL jobs and Spark scripts for better scalability and execution speed.
• Testing & Documentation: Perform unit testing, validate data accuracy, and maintain technical documentation for all ETL processes.
• Production Support: Help monitor scheduled daily/weekly jobs and troubleshoot data integration or quality issues

Recommended Qualifications

• 8-10 years of relevant experience
• Experience in systems analysis and programming of software applications
• Programming Languages: Proficiency in Pyspark and SQL.
• Big Data Frameworks: Hands-on experience or strong conceptual understanding of PySpark.
• ETL Tools: Familiarity with Data Integration/Big Data tools and Ab Initio components.
• Scripting: Basic to intermediate knowledge of Unix/Linux Shell Scripting.
• Databases: Understanding of Big Data (Hadoop) & RDBMS like Oracle, or PostgreSQL
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Education

• Bachelor's degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group

Technology

------------------------------------------------------

Job Family

Applications Development

------------------------------------------------------

Time Type

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi's EEO Policy Statement and the Know Your Rights poster.