Lead Data Engineer

Recro; Chennai; Sur place; INR 1 800 000 - 3 600 000; Plein temps

Résumé du poste

Recro is seeking a Technical Leader in Chennai to drive modernization of the Sales Validation platform. You will own the Databricks-based architecture, guide migration from Synapse, and set engineering standards across multiple workstreams.

The role demands hands-on delivery, mentoring, and performance optimization to scale the data platform. You will partner with data engineers, analytics teams, and security specialists to ensure robust data governance, cost efficiency, and reliable data

Qualifications

• Proven Databricks architecture and data platform delivery.
• Experience in Synapse to Databricks migration.
• Ability to define engineering standards and reusable frameworks.
• Mentor engineers and conduct design reviews.
• Performance tuning and scalability across workloads.
• Familiarity with Lakehouse concepts and ADLS Gen2, Azure security patterns.

Responsabilités

• Lead Databricks architecture and delivery
• Drive Synapse-to-Databricks migration
• Establish engineering standards and reusable frameworks
• Mentor engineers and conduct design reviews
• Own technical delivery across major workstreams
• Drive performance optimization and scalability

Connaissances

Databricks

PySpark

Spark SQL

Unity Catalog

Databricks Workflows

Databricks Asset Bundles

Lakehouse Architecture

ADLS Gen2

Azure Security Patterns

Outils

Apache Airflow

Snowflake

Data Governance

Description du poste

Technical leader responsible for the modernization and future-state architecture of

the Sales Validation platform.

Responsibilities

• Lead Databricks architecture and delivery


• Drive Synapse-to-Databricks migration


• Establish engineering standards and reusable frameworks


• Mentor engineers and conduct design reviews


• Own technical delivery across major workstreams


• Drive performance optimization and scalability

Required Skills

• Databricks


• PySpark


• Spark SQL


• Unity Catalog


• Databricks Workflows


• Databricks Asset Bundles


• Lakehouse Architecture


• ADLS Gen2


• Azure Security Patterns

Migration Experience

• Synapse Spark


• Synapse SQL Pools


• Synapse Notebooks


• Synapse Data Flows


• Modernization of legacy ETL workloads


• Advanced SQL


• Data Modeling


• Performance Tuning

Preferred

• Apache Airflow


• Snowflake
  
• Data Governance