Azure Databricks Engineer

Black Rock Groups; Charlotte (NC); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Medical insurance

Vision insurance

Dental insurance

Life insurance

Disability insurance

Paid time off

Job summary

Tech Mahindra is seeking an Azure Databricks Engineer with leadership experience to guide a team of developers in building scalable data processing solutions in Azure Databricks. The role focuses on designing pipelines, data lakes, and data warehousing concepts while collaborating with multiple teams.

The ideal candidate will have 12+ years of experience, strong Python/Scala/SQL skills, and familiarity with Azure Data Lake Storage and Azure SQL Database.

Qualifications

• Bachelor's degree in a related field.
• 7–10 years of experience in data engineering or software development.
• Proven track record in leading technical teams.

Responsibilities

• Lead and mentor a team of professionals, fostering high performance.
• Design and implement Azure Databricks data processing solutions for scalable pipelines.
• Collaborate with cross-functional teams to gather requirements and translate them into specs.
• Oversee the full development lifecycle from planning to deployment and maintenance.
• Conduct code reviews to ensure quality and best practices.

Skills

Azure Databricks

Spark

Python

Scala

SQL

data pipelines

data lakes

leadership

communication

Education

Bachelor's degree

Tools

Azure DevOps

Job description

Job Title: Azure Databricks Engineer (Day1 Onsite)

Location: Charlotte,NC

Years of Experience: 12 + Years

MS Fabrics and ADF recent Exp is must to have

Job Summary:

We are seeking a highly skilled and motivated Technical Team Lead with extensive experience in Azure Databricks to join our dynamic team. The ideal candidate will possess a strong technical background, exceptional leadership abilities, and a passion for driving innovative solutions. As a Technical Team Lead, you will be responsible for guiding a team of developers and engineers in the design, development, and implementation of data driven solutions that leverage Azure Databricks.

Responsibilities:

• Lead and mentor a team of technical professionals, fostering a collaborative and high performance culture.
• Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
• Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
• Oversee the development lifecycle, from planning and design to deployment and maintenance.
• Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
• Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering.
• Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals.
• Identify and mitigate risks associated with project delivery and team performance.

Mandatory Skills:

• Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
• Strong programming skills in languages such as Python, Scala, or SQL.
• Experience with cloud based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Demonstrated ability to lead technical teams and manage multiple projects simultaneously.

Preferred Skills:

• Familiarity with Azure DevOps for CI/CD processes.
• Experience with machine learning frameworks and libraries.
• Knowledge of data governance and compliance standards.
• Strong analytical and problem solving skills.
• Excellent communication and interpersonal skills.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 7 10 years of experience in data engineering, software development, or a related technical role.
• Proven track record of leading technical teams and delivering successful projects.
• Relevant certifications in Azure or data engineering are a plus.

The pay range for this role is $100k - $130k per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.

Thanks & Regards

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at [e-mail].