Senior PySpark Python Data Engineer - Assistant Vice President

Citi; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Citi is seeking a Senior PySpark Python Data Engineer - AVP for Pune. You will bridge business requirements and data solutions, focusing on regulatory reporting and liquidity risk initiatives. Collaborate with stakeholders and technology teams to ensure data quality and actionable insights.

Responsibilities include designing robust data models, preparing data for AI/ML, and building dashboards with Tableau, Power BI or QlikView. Strong communication and SDLC expertise are essential.

Qualifications

• 8-12 years of experience as a Senior PySpark Python Data Engineer or similar role in financial services.
• Advanced proficiency in PySpark, Python, SQL for large datasets.
• Experience with relational databases and data warehousing concepts.
• Expertise with Big Data tech including Hadoop, Spark, Kafka, and cloud platforms.
• Proficiency in data visualization tools and strong Excel skills.
• Experience with AI/ML data preparation is desirable.

Responsibilities

• Consult with business clients to determine functional specifications and align with objectives.
• Define, document, and validate data requirements, flows, and lineage.
• Provide technical input during development and architecture enhancements.
• Design and develop data models to support reporting and analytics.
• Prepare data for AI/ML model development and feature engineering.
• Utilize advanced SQL for data extraction and analysis from multiple sources.
• Develop dashboards and reports using Tableau, Power BI, or QlikView.
• Lead analysis of complex data to identify trends and risks for regulatory reporting.
• Identify data-related risks and propose mitigation options.
• Evaluate new data technologies and recommend enhancements to systems.

Skills

PySpark

Python

SQL

Big Data

Data modeling

Data governance

SDLC

Education

Bachelor's degree

Master's degree preferred

Tools

Hadoop

Spark

Kafka

Databricks

AWS S3

Tableau

Power BI

QlikView

Job description

Job Profile Name

Senior PySpark Python Data Engineer - Assistant Vice President- C12

Job Description

The Technical Data Analyst is a senior-level position responsible for bridging the gap between complex business requirements and technical data solutions, leveraging advanced analytical and technical skills to develop data-driven solutions, with a focus on regulatory reporting and liquidity risk initiatives. This role will liaise extensively with business stakeholders and technology teams to articulate data needs, extract insights, and ensure data quality and integrity.

Responsibilities

• Consult with business clients to determine system functional specifications and partner with multiple management teams and other units to meet organizational objectives.
• Define, document, and validate detailed data requirements, data flows, and data lineage for new or enhanced systems and applications.
• Provide technical input during the development and implementation phases, including formulating and defining systems scope, data objectives, and necessary data architecture enhancements for complex, high-impact projects.
• Design and develop robust data models (conceptual, logical, physical) to support reporting, analytics, and business processes.
• Prepare and curate data for AI/ML model development, working closely with AI engineers to ensure data quality, feature engineering, and model validation.
• Utilize advanced SQL for data extraction, manipulation, and analysis from various relational databases, data warehouses, and Big Data platforms.
• Develop and maintain data visualization dashboards and reports using tools such as Tableau, Power BI, or QlikView, translating complex data into understandable business insights.
• Lead the analysis of complex data sets to identify trends, patterns, and anomalies relevant to regulatory reporting, liquidity risk, and other critical financial functions.
• Identify and communicate data-related risks and impacts and propose risk mitigation options, considering business implications of the application of technology to the current business environment.
• Evaluate new data technologies, analytical tools, and evolving business requirements, and recommend appropriate systems alternatives and/or enhancements to current systems by analyzing business processes, systems and industry standards.
• Serve as advisor or coach to new or lower level analysts.
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm’s reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications

• 8-12 years of experience as a Senior PySpark Python Data Engineer or similar role within the Financial Services industry, preferably in regulatory reporting (e.g., Basel, CCAR, FR 2052a) and liquidity risk.
• Advanced proficiency in PySpark, Python, SQL for complex data querying, analysis, and optimization across large datasets.
• Strong experience with relational databases (e.g., Oracle, SQL Server, DB2) and data warehousing concepts (e.g., dimensional modeling, star/snowflake schemas).
• Demonstrated expertise with Big Data technologies including Hadoop, Spark (PySpark/Scala Spark), Kafka, and cloud-based data platforms (e.g., AWS S3, Databricks).
• Demonstrated experience with data modeling tools and techniques.
• Proficiency in data visualization tools (e.g., Tableau, Power BI, QlikView) and strong Excel skills for data manipulation and presentation.
• Experience with scripting languages for data analysis (e.g., Python, R) is highly desirable.
• Experience with data preparation for AI/ML models and understanding of core AI/ML concepts and workflows is highly desirable.
• Comprehensive knowledge of data analysis principles, methodologies, and data governance frameworks.
• Experience across all phases of the Software Development Life Cycle (SDLC), with a focus on data-centric projects.
• Consistently demonstrates clear and concise written and verbal communication.
• Demonstrated problem-solving and decision-making skills.
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements.

Education

• Bachelor's degree/University degree or equivalent experience.
• Master's degree preferred.

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.