Data Engineer, Java, Apache Spark, Hive - Assistant Vice President

Citi; Pune District; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Citi in Pune, India, seeks a Senior Technologist to design and build the next‑generation risk analytics platform. Manage ingestion, processing, and serving of petabytes of risk data, enabling instant access for front‑office and risk quants. You will craft scalable pipelines, intelligent APIs, and NLP‑driven interfaces for rapid, drill‑down analytics.

You will partner with Front Office, Quant, and Risk teams to deliver high‑impact solutions, applying AI‑first thinking and strong CS fundamentals.

Qualifications

• 5+ years of relevant experience using Core Java, Apache Spark and big data technologies.
• Experience with high‑performance OLAP databases such as Pinot, Druid, or Trino.
• Strong programming skills in Java and/or Scala, and expert‑level SQL.
• Background in CS concepts including data structures and algorithms.

Responsibilities

• Architect and build robust data pipelines processing billions of PV calculations.
• Develop large‑scale aggregation jobs using Spark for performance and efficiency.
• Design intelligent data APIs for flexible access to risk data.
• Incorporate NLP capabilities to enable query‑based data exploration.
• Load and model data into OLAP engines like Pinot, Druid, and Trino.
• Build interactive analytical tools and dashboards on OLAP layers.

Skills

Apache Spark

Java

Scala

SQL

NLP

Big Data

Risk Analytics

Problem Solving

Communication

Education

Computer Science

Financial Mathematics

Financial Engineering

Tools

Apache Pinot

Apache Druid

Trino

Hive

Job description

The Opportunity: Are You Ready to Build the Future of Risk Analytics?

Want to solve one of the most challenging big data problems in finance today? Are you excited by the idea of working directly with front‑office and risk quants on massive‑scale analytics for critical regulations like FRTB? Do you want to tame billions of rows of complex financial data with Apache Spark and deliver insights to senior leaders in a fraction of a second? Citi is looking for an elite, hands‑on technologist to engineer the next‑generation analytics platform for our Market Risk organization. This isn't just another data job. You will be the architect and builder of a high‑performance system that ingests, processes, and serves petabytes of risk calculation data, making it instantly accessible and understandable to the entire firm.

Your Role and Impact

As a Senior Technologist, you will be at the heart of the action, designing the systems that power our most sophisticated risk‑based calculations. You will take the raw, trade‑level Present Value (PV) outputs from our Historical VaR and FRTB Expected Shortfall engines and transform them into a strategic data asset.

Your impact will be immediate and far‑reaching. You will build the data pipelines that handle immense volumes, create intelligent APIs that democratize data access, and leverage cutting‑edge OLAP and NLP technologies to provide unparalleled drill‑down and analytical capabilities. You will be the go‑to expert who empowers senior stakeholders in the Markets and Risk organizations to make faster, smarter decisions.

Key Responsibilities

• Architect and build robust, scalable data pipelines to ingest and process billions of trade‑level PV calculations from various stress engines.
• Develop and optimize large‑scale aggregation jobs using Apache Spark, ensuring high performance and efficiency.
• Design and deliver a suite of "intelligent data APIs" that provide flexible, on‑demand access to both aggregated and non‑aggregated risk data for teams across the firm.
• Integrate Natural Language Processing (NLP) capabilities to create intuitive, query‑based interfaces for data exploration, lowering the barrier to entry for complex analytics.
• Load and model massive aggregated datasets into high‑performance OLAP engines like Apache Pinot, Apache Druid, and Trino.
• Build powerful, interactive analytical tools and dashboards on top of the OLAP layer, providing summary views and lightning‑fast drill‑down capabilities.
• Partner directly with senior stakeholders in the Front Office, Quantitative teams, and Risk Management to understand their analytical needs and deliver innovative solutions.

What We're Looking For

• A true passion for data, analytics, and solving complex problems at massive scale.
• A degree in a quantitative or technical field such as Computer Science, Financial Mathematics, or Financial Engineering.
• Expert‑level, hands‑on experience with big data technologies, particularly Apache Spark.
• Proven experience with high‑performance OLAP databases such as Apache Pinot, Apache Druid, or Trino.
• Strong programming skills in Java and/or Scala, and expert‑level SQL.
• Strong background in fundamental computer science concepts, including data structures and algorithms.
• A mindset for 'AI-first' development, constantly looking for ways to embed intelligence into systems.
• Experience or a strong interest in applying Natural Language Processing (NLP) to data access and analytics.
• A knack for solving 'needle in a haystack' problems, with a talent for debugging complex data and access issues.
• Experience in the financial industry with an understanding of market risk, derivatives, and risk calculations (VaR, Stress Testing, PV) is highly desirable.
• Exceptional problem‑solving skills and the ability to work independently and lead technical projects.
• Excellent communication skills, with the confidence to collaborate with senior business and quantitative stakeholders.

Qualifications:

• 5+ years of relevant experience using Core Java, Apache Spark, Big Data Technologies HDFC, Hive etc.
• Experience in systems analysis and programming of software applications
• Experience in managing and implementing successful projects
• Working knowledge of consulting/project management techniques/methods
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.