Senior PySpark Python Data Engineer - Assistant Vice President

Citigroup Inc.; Pune District; On-site; INR 350,000 - 600,000; Full time

Job summary

Citigroup Inc. is seeking a Senior PySpark Python Data Engineer - AVP for the Pune area to bridge business needs and technical data solutions.

You will work with stakeholders and tech teams to ensure data quality and governance across complex, high-impact projects. The role emphasizes PySpark, Python, SQL, and data modeling for reporting and analytics, with Big Data technologies, cloud platforms, and AI/ML data prep experience highly valued.

Qualifications

• 8-12 years of experience as a Senior PySpark Data Engineer or similar role within Financial Services.
• Advanced proficiency in PySpark, Python, SQL for complex data querying and optimization.
• Strong experience with relational databases (Oracle, SQL Server, DB2) and data warehousing concepts.
• Demonstrated expertise with Big Data tech including Hadoop, Spark, Kafka and cloud platforms like AWS.
• Experience with data modeling tools and visualization tools (Tableau, Power BI, QlikView) and Excel.
• Experience with data prep for AI/ML models and understanding of AI/ML concepts is desirable.
• SDLC knowledge and data governance frameworks.
• Clear written and verbal communication; ability to work under pressure.

Responsibilities

• Consult with business clients to determine system specifications and align with multiple teams.
• Define and document data requirements, data flows, and data lineage for new systems.
• Provide input during development, including data architecture enhancements for complex projects.
• Design and develop data models (conceptual to physical) to support reporting and analytics.
• Prepare data for AI/ML model development and assist feature engineering and validation.
• Use advanced SQL for data extraction and analysis from databases and data warehouses.
• Develop dashboards/reports with Tableau, Power BI, or QlikView to translate data into insights.
• Lead analysis of complex data sets to identify trends relevant to regulatory reporting and liquidity risk.
• Communicate data-related risks and mitigation options to stakeholders.
• Evaluate new data technologies and recommend improvements to current systems.
• Serve as advisor or coach to junior analysts.
• Ensure compliance with laws, policy, and governance; escalate concerns as needed.

Skills

PySpark

Python

SQL

Data modeling

Data warehousing

Tableau

Power BI

QlikView

Excel

R

Education

Bachelor's degree

Master's degree preferred

Tools

Hadoop

Spark

Kafka

AWS S3

Databricks

Oracle

SQL Server

DB2

Job description

Job Profile Name: Senior PySpark Python Data Engineer - Assistant Vice President- C12

Job Description:

The Technical Data Analyst is a senior-level position responsible for bridging the gap between complex business requirements and technical data solutions, leveraging advanced analytical and technical skills to develop data-driven solutions, with a focus on regulatory reporting and liquidity risk initiatives. This role will liaise extensively with business stakeholders and technology teams to articulate data needs, extract insights, and ensure data quality and integrity.

Responsibilities:

• Consult with business clients to determine system functional specifications and partner with multiple management teams and other units to meet organizational objectives.
• Define, document, and validate detailed data requirements, data flows, and data lineage for new or enhanced systems and applications.
• Provide technical input during the development and implementation phases, including formulating and defining systems scope, data objectives, and necessary data architecture enhancements for complex, high-impact projects.
• Design and develop robust data models (conceptual, logical, physical) to support reporting, analytics, and business processes.
• Prepare and curate data for AI/ML model development, working closely with AI engineers to ensure data quality, feature engineering, and model validation.
• Utilize advanced SQL for data extraction, manipulation, and analysis from various relational databases, data warehouses, and Big Data platforms.
• Develop and maintain data visualization dashboards and reports using tools such as Tableau, Power BI, or QlikView, translating complex data into understandable business insights.
• Lead the analysis of complex data sets to identify trends, patterns, and anomalies relevant to regulatory reporting, liquidity risk, and other critical financial functions.
• Identify and communicate data-related risks and impacts and propose risk mitigation options, considering business implications of the application of technology to the current business environment.
• Evaluate new data technologies, analytical tools, and evolving business requirements, and recommend appropriate systems alternatives and/or enhancements to current systems by analyzing business processes, systems and industry standards.
• Serve as advisor or coach to new or lower level analysts.
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 8-12 years of experience as a Senior PySpark Python Data Engineer or similar role within the Financial Services industry, preferably in regulatory reporting (e.g., Basel, CCAR, FR 2052a) and liquidity risk.
• Advanced proficiency in PySpark, Python, SQL for complex data querying, analysis, and optimization across large datasets.
• Strong experience with relational databases (e.g., Oracle, SQL Server, DB2) and data warehousing concepts (e.g., dimensional modeling, star/snowflake schemas).
• Demonstrated expertise with Big Data technologies including Hadoop, Spark (PySpark/Scala Spark), Kafka, and cloud-based data platforms (e.g., AWS S3, Databricks).
• Demonstrated experience with data modeling tools and techniques.
• Proficiency in data visualization tools (e.g., Tableau, Power BI, QlikView) and strong Excel skills for data manipulation and presentation.
• Experience with scripting languages for data analysis (e.g., Python, R) is highly desirable.
• Experience with data preparation for AI/ML models and understanding of core AI/ML concepts and workflows is highly desirable.
• Comprehensive knowledge of data analysis principles, methodologies, and data governance frameworks.
• Experience across all phases of the Software Development Life Cycle (SDLC), with a focus on data-centric projects.
• Consistently demonstrates clear and concise written and verbal communication.
• Demonstrated problem-solving and decision-making skills.
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements.

Education:

• Bachelor's degree/University degree or equivalent experience.
• Master's degree preferred.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills:

Please see the requirements listed above.

Other Relevant Skills:

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.