Azure Databricks Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Charlotte (NC); Remote; USD 99,000 - 132,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Charlotte, NC is seeking a skilled Azure Databricks Engineer and Technical Team Lead to guide a team of developers in building scalable data solutions on Azure Databricks. You will design data pipelines, data lakes, and models, mentor engineers, perform code reviews, and collaborate with stakeholders to translate requirements into robust technical specs.

Remote-friendly; on-site coordination as needed.

Qualifications

• A strong background in Azure Databricks, Spark, and data pipelines.
• Proficient in Python/Scala/SQL for data processing.
• Experience with cloud data storage and data modeling concepts.

Responsibilities

• Lead and mentor a team of technical professionals, fostering a collaborative and high performance culture.
• Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
• Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
• Oversee the development lifecycle, from planning and design to deployment and maintenance.
• Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
• Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering.
• Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals.
• Identify and mitigate risks associated with project delivery and team performance.

Skills

Azure Databricks

Spark

Python

Scala

SQL

Azure Data Lake Storage

Azure SQL Database

Data modeling

ETL

Data warehousing

Leadership

Job description

Job Title

Azure Databricks Engineer

Location

Charlotte, NC (Remote)

Duration

24 Months + Extension

Bill Rate

$84/hour (C2C)

Job Type

W-2, 1099, C2C

Client

To Be Discussed Later

Work Authorization

US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

We are seeking a highly skilled and motivated Technical Team Lead with extensive experience in Azure Databricks to join our dynamic team. The ideal candidate will possess a strong technical background, exceptional leadership abilities, and a passion for driving innovative solutions. As a Technical Team Lead, you will be responsible for guiding a team of developers and engineers in the design, development, and implementation of data driven solutions that leverage Azure Databricks.

Responsibilities

• Lead and mentor a team of technical professionals, fostering a collaborative and high performance culture.
• Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
• Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
• Oversee the development lifecycle, from planning and design to deployment and maintenance.
• Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
• Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering.
• Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals.
• Identify and mitigate risks associated with project delivery and team performance.

Mandatory Skills

• Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
• Strong programming skills in languages such as Python, Scala, or SQL.
• Experience with cloud based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Demonstrated ability to lead technical teams and manage multiple projects simultaneously.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.