Azure Databricks Data Engineer: Scalable Pipelines Lead

MACHINE LEARNING TECHNOLOGIES LLC; Houston (TX); On-site; USD 137,760 - 179,088; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is looking for an Azure Databricks Engineer in Houston, TX. This role requires 7 years of experience in designing scalable data solutions using Azure Databricks.

The engineer will lead the development of data pipelines, troubleshoot issues, and mentor junior members. The ideal candidate should have strong skills in PySpark and Python, as well as experience integrating with various Azure data services. A competitive hourly rate will be offered based on experience.

Qualifications

• 7 years of experience designing and developing data solutions using Azure Databricks.
• Experience with PySpark and Python coding.
• Ability to integrate Azure Databricks with Azure data services.

Responsibilities

• Lead design, development, and enhancement of data pipelines using Azure Databricks.
• Troubleshoot issues related to data pipelines for high availability.
• Mentor junior team members on best practices in data engineering.

Skills

Databricks

Job description

MACHINE LEARNING TECHNOLOGIES LLC is looking for an Azure Databricks Engineer in Houston, TX. This role requires 7 years of experience in designing scalable data solutions using Azure Databricks.

The engineer will lead the development of data pipelines, troubleshoot issues, and mentor junior members. The ideal candidate should have strong skills in PySpark and Python, as well as experience integrating with various Azure data services. A competitive hourly rate will be offered based on experience.