Data Engineer, Java, Apache Spark, Hive - Assistant Vice President

Citigroup Inc.; Pune District; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

Citigroup Inc. seeks a Senior Technologist to design and build a high-performance risk analytics platform. You will architect data pipelines to ingest trillions of PV calculations, transform them into strategic data assets, and expose intelligent APIs for risk teams.

You will work with front-office and risk quants to implement NLP-enabled interfaces and fast OLAP analytics using Pinot, Druid, and Trino. This role demands strong Java/Scala skills and leadership in large-scale data projects.

Qualifications

• Degree in a quantitative or technical field (e.g., CS, Financial Mathematics, Financial Engineering).
• Expert-level hands-on experience with big data technologies, esp. Apache Spark.
• Strong programming skills in Java and/or Scala; expert SQL.
• Experience with OLAP databases and data modeling.
• Understanding of risk calculations (VaR, Stress Testing) is a plus.

Responsibilities

• Architect and build robust, scalable data pipelines ingesting billions of PV calculations from stress engines.
• Develop and optimize large-scale Spark aggregation jobs for high performance.
• Design and deliver intelligent data APIs for on-demand risk data access.
• Integrate NLP to enable query-based interfaces for analytics.
• Load and model massive datasets into OLAP engines like Pinot/Druid/Trino; build fast dashboards.
• Collaborate with Front Office, Quant, and Risk stakeholders to deliver innovative solutions.

Skills

Core Java

Apache Spark

SQL

Java/Scala

NLP

Communication

Problem solving

Education

Bachelor's degree in Computer Science or related

Tools

Apache Pinot

Apache Druid

Trino

Hive

Job description

The Opportunity: Are You Ready to Build the Future of Risk Analytics?

Want to solve one of the most challenging big data problems in finance today? Are you excited by the idea of working directly with front-office and risk quants on massive-scale analytics for critical regulations like FRTB? Do you want to tame billions of rows of complex financial data with Apache Spark and deliver insights to senior leaders in a fraction of a second? Citi is looking for an elite, hands-on technologist to engineer the next-generation analytics platform for our Market Risk organization. This isn't just another data job. You will be the architect and builder of a high-performance system that ingests, processes, and serves petabytes of risk calculation data, making it instantly accessible and understandable to the entire firm.

Your Role and Impact

As a Senior Technologist, you will be at the heart of the action, designing the systems that power our most sophisticated risk-based calculations. You will take the raw, trade-level Present Value (PV) outputs from our Historical VaR and FRTB Expected Shortfall engines and transform them into a strategic data asset. Your impact will be immediate and far-reaching. You will build the data pipelines that handle immense volumes, create intelligent APIs that democratize data access, and leverage cutting-edge OLAP and NLP technologies to provide unparalleled drill-down and analytical capabilities. You will be the go-to expert who empowers senior stakeholders in the Markets and Risk organizations to make faster, smarter decisions.

Key Responsibilities

• Architect and build robust, scalable data pipelines to ingest and process billions of trade-level PV calculations from various stress engines.


• Develop and optimize large-scale aggregation jobs using Apache Spark, ensuring high performance and efficiency.


• Design and deliver a suite of "intelligent data APIs" that provide flexible, on-demand access to both aggregated and non-aggregated risk data for teams across the firm.


• Integrate Natural Language Processing (NLP) capabilities to create intuitive, query-based interfaces for data exploration, lowering the barrier to entry for complex analytics.


• Load and model massive aggregated datasets into high-performance OLAP engines like Apache Pinot, Apache Druid, and Trino.


• Build powerful, interactive analytical tools and dashboards on top of the OLAP layer, providing summary views and lightning-fast drill-down capabilities.


• Partner directly with senior stakeholders in the Front Office, Quantitative teams, and Risk Management to understand their analytical needs and deliver innovative solutions.

What We're Looking For

• A true passion for data, analytics, and solving complex problems at massive scale.


• A degree in a quantitative or technical field such as Computer Science, Financial Mathematics, or Financial Engineering.


• Expert-level, hands-on experience with big data technologies, particularly Apache Spark.


• Proven experience with high-performance OLAP databases such as Apache Pinot, Apache Druid, or Trino.


• Strong programming skills in Java and/or Scala, and expert-level SQL.


• Strong background in fundamental computer science concepts, including data structures and algorithms.


• A mindset for 'AI-first' development, constantly looking for ways to embed intelligence into systems.


• Experience or a strong interest in applying Natural Language Processing (NLP) to data access and analytics.


• A knack for solving 'needle in a haystack' problems, with a talent for debugging complex data and access issues.


• Experience in the financial industry with an understanding of market risk, derivatives, and risk calculations (VaR, Stress Testing, PV) is highly desirable.


• Exceptional problem-solving skills and the ability to work independently and lead technical projects.


• Excellent communication skills, with the confidence to collaborate with senior business and quantitative stakeholders.

Qualifications:

• 5+ years of relevant experience using Core Java, Apache Spark, Big Data Technologies HDFC, Hive etc.


• Experience in systems analysis and programming of software applications


• Experience in managing and implementing successful projects


• Working knowledge of consulting/project management techniques/methods


• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Job Family Group: Technology

Job Family: Applications Development

Time Type: Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.