Databricks Lead Data Engineer

R Systems; Bengaluru; On-site; INR 3,000,000 - 4,800,000; Full time

Job summary

R Systems in Bengaluru is seeking a Databricks Lead Data Engineer to spearhead data engineering initiatives and drive modernization while establishing governance for data quality. You will lead solution architecture for data projects and collaborate with cross-functional teams.

The role requires strong technical leadership, extensive experience with Databricks/Spark, and cloud familiarity across AWS/Azure/GCP.

Qualifications

• Proven experience leading data engineering projects using Databricks and Spark.
• Strong SQL, data modeling, and data warehousing knowledge.
• Experience enabling data governance and data quality frameworks.

Responsibilities

• Lead solution architecture for data engineering projects using Databricks.
• Drive modernization programs to improve data processing and analytics capabilities.
• Establish and manage governance frameworks to ensure data quality and compliance.
• Participate in presales activities, including providing technical expertise and estimations.
• Deliver technical solutions in a timely and efficient manner, ensuring alignment with client requirements.
• Collaborate with data scientists, analysts, and other engineers to create scalable data solutions.
• Mentor and guide junior data engineers to enhance the team’s overall skill set.

Skills

Databricks

Apache Spark

SQL

Data modeling

Data warehousing

Cloud platforms

ETL

Data governance

Data quality

Problem solving

Communication

Collaboration

Project leadership

Python/Scala

Job description

Company Name: R Systems

Job Title: Databricks Lead Data Engineer

Job Description: R Systems is seeking a Databricks Lead Data Engineer to spearhead our data engineering initiatives. In this role, you will lead solution architecture efforts and drive modernization programs to enhance our data capabilities. Your leadership will be critical in establishing governance frameworks that ensure the integrity and quality of our data solutions. You will also play a key role in presales activities, providing estimations and technical delivery support to meet client needs. The ideal candidate will possess strong technical skills and experience with data engineering best practices, as well as the ability to collaborate effectively with cross-functional teams.

Responsibilities:

• Lead solution architecture for data engineering projects using Databricks.
• Drive modernization programs to improve data processing and analytics capabilities.
• Establish and manage governance frameworks to ensure data quality and compliance.
• Participate in presales activities, including providing technical expertise and estimations.
• Deliver technical solutions in a timely and efficient manner, ensuring alignment with client requirements.
• Collaborate with data scientists, analysts, and other engineers to create scalable data solutions.
• Mentor and guide junior data engineers to enhance the team’s overall skill set.

Skills and Tools Required:

• Extensive experience with Databricks and Apache Spark.
• Strong proficiency in SQL and data modeling.
• Knowledge of data warehousing concepts and tools.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with ETL processes and tools.
• Understanding of data governance and data quality frameworks.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Ability to lead and manage multiple projects simultaneously.
• Experience with programming languages such as Python or Scala is a plus.