Azure Databricks Tech Lead - Spark & Data

Black Rock Groups; Charlotte (NC); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Medical insurance

Vision insurance

Dental insurance

Life insurance

Disability insurance

Paid time off

Job summary

Tech Mahindra is seeking an Azure Databricks Engineer with leadership experience to guide a team of developers in building scalable data processing solutions in Azure Databricks. The role focuses on designing pipelines, data lakes, and data warehousing concepts while collaborating with multiple teams.

The ideal candidate will have 12+ years of experience, strong Python/Scala/SQL skills, and familiarity with Azure Data Lake Storage and Azure SQL Database.

Qualifications

• Bachelor's degree in a related field.
• 7–10 years of experience in data engineering or software development.
• Proven track record in leading technical teams.

Responsibilities

• Lead and mentor a team of professionals, fostering high performance.
• Design and implement Azure Databricks data processing solutions for scalable pipelines.
• Collaborate with cross-functional teams to gather requirements and translate them into specs.
• Oversee the full development lifecycle from planning to deployment and maintenance.
• Conduct code reviews to ensure quality and best practices.

Skills

Azure Databricks

Spark

Python

Scala

SQL

data pipelines

data lakes

leadership

communication

Education

Bachelor's degree

Tools

Azure DevOps

Job description

Tech Mahindra is seeking an Azure Databricks Engineer with leadership experience to guide a team of developers in building scalable data processing solutions in Azure Databricks. The role focuses on designing pipelines, data lakes, and data warehousing concepts while collaborating with multiple teams.

The ideal candidate will have 12+ years of experience, strong Python/Scala/SQL skills, and familiarity with Azure Data Lake Storage and Azure SQL Database.