Senior Databricks Spark Engineer — AWS Data Modernization

Citi; New York (NY); Hybrid; USD 26,000 - 48,000; Full time

Job summary

Citi is seeking a Senior Data Engineer in Pune, India, hybrid, full-time. You will modernize data pipelines on Databricks on AWS, refactor Spark jobs, and design scalable, production-ready solutions. You’ll translate architecture into concrete designs and collaborate with global teams to drive high-impact data initiatives.

The role requires 11+ years in data engineering, strong Spark/Databricks on AWS, Delta Lake, and SQL, with a focus on performance tuning and cloud-native architecture.

Qualifications

• 11+ years in data engineering or distributed systems.
• Strong expertise in Apache Spark (JavaSpark / PySpark), Databricks on AWS, and Delta Lake.
• Experience with SQL and large-scale distributed data processing.
• Experience modernizing legacy data platforms into cloud-based architectures.
• Ability to translate architecture into implementable designs.

Responsibilities

• Platform Engineering & Modernization: refactor Spark pipelines to Databricks architectures; replace Hadoop dependencies; optimize processing.
• Databricks Native Development: build and optimize solutions with Delta Lake and Databricks Workflows.
• Design & Solution Engineering: contribute to architecture, data models, and reusable components; ensure scalable, production-ready designs.
• Performance Optimization & Simplification: improve Spark performance and simplify pipelines.
• Engineering Standards & Best Practices: write clean, modular code; contribute to shared libraries.
• Collaboration & Stakeholder Engagement: work with senior architects, platform teams, and DevOps; provide guidance.
• Testing & Quality Assurance: develop unit/integration/data validation tests; support releases.

Skills

Data engineering experience

Apache Spark

Databricks on AWS

Delta Lake

SQL

AWS services

Distributed systems

Education

Bachelor’s degree

Tools

Databricks

AWS

Job description

Citi is seeking a Senior Data Engineer in Pune, India, hybrid, full-time. You will modernize data pipelines on Databricks on AWS, refactor Spark jobs, and design scalable, production-ready solutions. You’ll translate architecture into concrete designs and collaborate with global teams to drive high-impact data initiatives.

The role requires 11+ years in data engineering, strong Spark/Databricks on AWS, Delta Lake, and SQL, with a focus on performance tuning and cloud-native architecture.