Senior Azure Databricks Engineer - Data Pipelines

MACHINE LEARNING TECHNOLOGIES LLC; Houston (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking an Azure Databricks Engineer in Houston, TX to design and build scalable data pipelines using Azure Databricks. You will develop ETL workflows and integrate with Azure data services to enable enterprise-grade analytics.

The ideal candidate has around 7 years of experience in data engineering, strong PySpark and Python skills, and a track record of delivering robust data platforms in cloud environments. This role is on-site with DOE compensation.

Qualifications

• Experience designing scalable data pipelines using Azure Databricks.
• Strong ETL development and data integration skills.
• Familiarity with cloud data services and data governance practices.

Responsibilities

• Lead design and enhancement of complex data pipelines with Azure Databricks.
• Write clean PySpark and Python code for data ingestion and transformation.
• Troubleshoot data pipelines to ensure high availability and performance.
• Collaborate with architects and stakeholders to deliver scalable data solutions.

Tools

Databricks

PySpark

Python

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking an Azure Databricks Engineer in Houston, TX to design and build scalable data pipelines using Azure Databricks. You will develop ETL workflows and integrate with Azure data services to enable enterprise-grade analytics.

The ideal candidate has around 7 years of experience in data engineering, strong PySpark and Python skills, and a track record of delivering robust data platforms in cloud environments. This role is on-site with DOE compensation.