PySpark Data Engineer – Assistant Vice President

Citigroup Inc.; Chennai District; On-site; INR 3,500,000 - 6,500,000; Full time

Job summary

Citigroup Inc. in India seeks a senior Data Engineer (C12 / AVP) to develop high-quality data products for regulatory requirements and data-driven decisions. You will work with data architecture standards, data warehousing, and BI on an agile team to deliver scalable data solutions.

The role requires 9–11 years of experience with relational databases, SQL, data modelling, and cloud-native patterns. Strong communication and mentoring skills are essential to lead medium-sized components

Qualifications

• First Class Degree in Engineering/Technology (4-year graduate).
• 9 to 11 years’ experience implementing data-intensive solutions using agile methodologies.
• Experience with relational databases and SQL for data querying and transformation.
• Experience modelling data for analytical consumers.
• Ability to automate and streamline build, test and deployment of data pipelines.
• Experience in cloud native technologies and patterns.
• Commitment to learning new technologies and growth.
• Excellent communication and problem-solving skills.
• Mentor mindset with ability to lead medium-sized components independently.

Responsibilities

• Developing and supporting scalable, extensible, and highly available data solutions.
• Deliver on critical business priorities while aligning with architectural vision.
• Identify and address potential risks in the data supply chain.
• Follow and contribute to technical standards.
• Design and develop analytical data models.

Skills

ETL

Big Data

Data Warehousing

Data Modeling

Programming (Python/Java/Scala)

DevOps

Data Governance

Communication

Mentoring

Education

First Class Degree in Engineering/Technology

Tools

Ab Initio

Apache Spark

Talend

Informatica

Hadoop

Hive

Snowflake

Redshift

Databricks

BigQuery

Docker

Kubernetes

Job description

Job Title: Data Engineer – C12 / Assistant Vice President (India)

The Role

The Data Engineer is accountable for developing high quality data products to support the Bank’s regulatory requirements and data driven decision making. A Data Engineer will serve as an example to other team members, work closely with customers, and remove or elevate roadblocks. By applying their knowledge of data architecture standards, data warehousing, data structures, and business intelligence they will contribute to business outcomes on an agile team.

Responsibilities

• Developing and supporting scalable, extensible, and highly available data solutions
• Deliver on critical business priorities while ensuring alignment with the wider architectural vision
• Identify and help address potential risks in the data supply chain
• Follow and contribute to technical standards
• Design and develop analytical data models

Required Qualifications & Work Experience

• First Class Degree in Engineering/Technology (4-year graduate course)
• 9 to 11 years’ experience implementing data-intensive solutions using agile methodologies

• Experience of relational databases and using SQL for data querying, transformation and manipulation
• Experience of modelling data for analytical consumers

• Ability to automate and streamline the build, test and deployment of data pipelines

• Experience in cloud native technologies and patterns
• A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
• Excellent communication and problem-solving skills
• An inclination to mentor; an ability to lead and deliver medium sized components independently

Technical Skills (Must Have)

• ETL: Hands on experience of building data pipelines. Proficiency in two or more data integration platforms such as Ab Initio, Apache Spark, Talend and Informatica
• Big Data: Experience of ‘big data’ platforms such as Hadoop, Hive or Snowflake for data storage and processing
• Data Warehousing & Database Management: Expertise around Data Warehousing concepts, Relational (Oracle, MSSQL, MySQL) and NoSQL (MongoDB, DynamoDB) database design
• Data Modeling & Design: Good exposure to data modeling techniques; design, optimization and maintenance of data models and data structures
• Languages: Proficient in one or more programming languages commonly used in data engineering such as Python, Java or Scala
• DevOps: Exposure to concepts and enablers - CI/CD platforms, version control, automated quality control management
• Data Governance: A strong grasp of principles and practice including data quality, security, privacy and compliance

Technical Skills (Valuable)

• Ab Initio: Experience developing Co>Op graphs; ability to tune for performance. Demonstrable knowledge across full suite of Ab Initio toolsets e.g., GDE, Express>IT, Data Profiler and Conduct>IT, Control>Center, Continuous>Flows
• Cloud: Good exposure to public cloud data platforms such as S3, Snowflake, Redshift, Databricks, BigQuery, etc. Demonstratable understanding of underlying architectures and trade-offs
• Data Quality & Controls: Exposure to data validation, cleansing, enrichment and data controls
• Containerization: Fair understanding of containerization platforms like Docker, Kubernetes
• File Formats: Exposure in working on Event/File/Table Formats such as Avro, Parquet, Protobuf, Iceberg, Delta
• Others: Experience of using a Job scheduler e.g., Autosys. Exposure to Business Intelligence tools e.g., Tableau, Power BI

Certification on any one or more of the above topics would be an advantage.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.

------------------------------------------------------