Lead Python and Spark Data Engineer - Vice President

Citigroup; Pune District; In loco; INR 2.800.000 - 5.200.000; Tempo pieno

Descrizione del lavoro

Citi in Pune is hiring for a development lead in the Data and Reporting team within Citi Futures and Derivatives Clearing Technology. You will own a large-scale data warehouse, design scalable data architectures, and deliver data-driven solutions for real-time trading data, margins, and client reporting.

The role requires hands-on experience with Python, Java, Airflow, Spark and cloud-native tools (AWS, Docker), plus strong leadership to guide engineers, collaborate with stakeholders, and drive

Competenze

• Experience designing and building enterprise data architectures.
• Hands-on data pipelines for large-scale datasets.
• Experience with APIs, Kafka, Python, Java, Airflow, Spark.
• Knowledge of cloud-native architecture and DevOps practices.

Mansioni

• Own a large-scale data warehouse and data products.
• Lead architecture, design, development, and maintenance of scalable data platforms.
• Define data models, metadata, mappings, and semantic layers.
• Build automated data integration solutions and pipelines.
• Drive data governance, quality, and security across platforms.
• Lead CI/CD, testing, and collaboration with stakeholders.

Conoscenze

Data architecture

Data pipelines

DevOps

CI/CD

Agile/Scrum

Cloud-native

Trading data

Formazione

Bachelor's degree in CS/Engineering

Strumenti

Python

Java

Airflow

Spark

Databricks

Snowflake

Kafka

AWS

Docker

Descrizione del lavoro

About CitiCiti

About CitiCiti, the leading global financial services company, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients.Citi’s Mission and Value Proposition explains what we do and Citi Leadership Standards explain how we do it. Our mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. We strive to earn and maintain our clients’ and the public’s trust by constantly adhering to the highest ethical standards and making a positive impact on the communities we serve. Our Leadership Standards is a common set of skills and expected behaviours that illustrate how our employees should work every day to be successful and strengthens our ability to execute against our strategic priorities.Diversity is a key business imperative and a source of strength at Citi. We serve clients from every walk of life, every background and every origin. Our goal is to have our workforce reflect this same diversity at all levels. Citi has made it a priority to foster a culture where the best people want to work, where individuals are promoted based on merit, where we value and demand respect for others and where opportunities to develop are widely available to all.

About Team and Platform

Citi Futures and Derivatives Clearing Technology supports a rapidly growing business that uses technological innovation to maintain competitive advantage in a constantly evolving market. Working closely with the business, external vendors and internal technology teams, you would build-out and maintain our next generation clearing platforms. You would manage complex projects that will involve everything from incorporating a new functionality within the existing ecosystem, to analyzing new requirements, documenting solutions, managing implementation and testing systems, ensuring that they are fit for purpose. You would regularly work with a range of Business Analysts and high-profile stakeholders.The Data and Reporting team develops and supports a platform that provides client reporting and feeds other downstream applications within Citi. It provides reporting such as real-time trades, positions, initial and variation margin, positions and balances for external clients and internal users such as traders, operations and sales. A major ongoing initiative is to modernize the existing platform in order to provide scale and to enhance product offerings and new business requirements.As the development lead for the data and reporting, you will lead the team to deliver best in class technical solutions to meet the needs of our Futures and Clearing business. This includes researching best practices, designing the application and data and integration architecture, designing the solutions, and delivering our application to the business. The team works closely with cross-functional business users, QA engineers and BAs collaborating to deliver best in class solutions. This role suits experienced architects/developers who have excellent communication and are passionate about driving technical solutions through leadership, excellence, collaboration.

Responsibilities

Own a large-scale data warehouse; develop data products; and lead the architecture, design, development, and maintenance of scalable and secure data architectures to support downstream reporting applications, data integration, and simplified complex data processes — utilizing best engineering practices and data lifecycle management principles.Identify, evaluate, implement improvements to legacy systems, ensure alignment with target architecture designProvide strong leadership to engineering teams including mentoring, code review and enforcing engineering best practices.Own and define data models, taxonomies, metadata, data mappings, data standards, versioning, and semantic layers for domains and data products and support data consumption, AI enablement, and regulatory requirements.Build automated data integration solutions and data pipelines including reference data to meet business and reporting requirementsExhibit strong leadership qualities, fostering a positive and collaborative work environment, providing guidance and mentorship to team members, and promoting a culture of continuous learning.Implement data governance and management frameworks, quality standards, and data controls to ensure data accuracy and security, enabling downstream applications to consume data with confidence. Manage and maintain data process documentationDefine target-state data architecture and drive delivery against the strategy, manage the execution to deliveryContribute to technical direction and enhancement as a technical expert in data development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutionsWork closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions.Contribute to CI/CD implementation using DevOps best practices and ensure robust testing framework is utilized for functional and nonfunctional testing for the release cycles based on industry and Citi standards and work to implement them.Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions.Contribute to technical direction and strategic decisions as a technical expert in all development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutionsDemonstrate a data-driven approach to problem-solving and decision-making, utilizing metrics, and performance indicators to assess team efficiency and identify improvement opportunities.Manage and maintain data processes and jobs. Partner with the Support team to ensure the stability of the production environment through proactive monitoring and health checksPartner with other Citi development teams to build APIs, integrations and share components that are critical to our platform’s success.

Qualifications

Strong experience in designing and building best in class enterprise data architecture with site engineering excellence in a highly matrixed, complex organizationStrong experience in architecting complex, end-to-end data pipelines within highly available, distributed systems — encompassing data extraction, ingestion, and processing of large-scale datasetsStrong hands‑on, advanced development experience with very large databases, complex data models, stored procedures, error handling, performance tuning and profiling, data security, database optimization, and configurationsStrong experience in large complex physical and logical data model design and development for data warehouse, reporting and reference and master data.Hands‑on experience with complex data integration and developing scalable, high-volume data pipelines using APIs, Kafka, Python, Java, Airflow, and SparkProven experience in developing data quality and reconciliation controls, data lineage tracking, and data catalog documentation; establishing data control monitoring and proactively identifying and resolving data inconsistencies and gapsExcellent verbal and written communication skills, enabling effective collaboration with cross‑functional teams, stakeholders, and management.Strong hands‑on experience in S3, Starburst, Oracle database, Databricks and Snowflake preferred.Strong hands‑on experience with modern software paradigms including cloud‑native (AWS, Docker) and microservicesExperience in implementation of DevOps such as CI/CD and modern best practises such as testing frameworks and the SOLID principles; CI/CD tooling, automation of testing toolsPassion and commitment for adopting new technologies with exploratory mind‑setExperience working in an Agile/Scrum work environmentExperience in building observability dashboard for data processes and job monitoringInnovative ideas and can‑do attitude to work under pressureExperience in managing agile scrum teams and end‑to‑end deliveryStrong understanding of trading data and experience working within the financial services industry is requiredExperience in GenAI/Agentic, AI workflow, AI governance, AI agent, and MCPs automation development

Education

Bachelor’s degree/University degree or equivalent experience in computer sciences, engineering, math/statistics

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use your search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.