Azure Data Analytics Architect - Lead Databricks Pipelines

MACHINE LEARNING TECHNOLOGIES LLC; Houston (TX); On-site; USD 140,000 - 170,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC invites an experienced Azure Data Analytics Architect to design and lead analytics initiatives in the Azure Databricks ecosystem in Houston. You will own end-to-end data pipelines, work with business stakeholders, and drive data-driven decisions across the enterprise.

Responsibilities include building scalable data models, integrating Azure services, and mentoring a data engineering team while ensuring security and governance compliance.

Qualifications

• 8+ years in data ingestion and transformation pipelines with Databricks/Synapse notebooks and Azure Data Factory.

Responsibilities

• Lead architecture and implementation of analytics solutions on Azure Databricks/ Fabric.
• Collaborate with stakeholders to translate requirements into data solutions.
• Oversee end-to-end data solutions to meet business needs.
• Develop data pipelines and ETL using Databricks, PySpark, and related tools.
• Integrate Databricks with Azure services and on-prem systems.
• Provide technical leadership and mentorship to the data engineering team.
• Document architecture and data flows, ensuring security and governance compliance.
• Ensure code quality, data security, and scalability.
• Stay current with Databricks innovations.

Skills

Azure Databricks

Hadoop

Spark

Azure Data Lake

Azure Synapse

Azure Data Factory

ETL/ELT

SQL

NoSQL

CI/CD

Git

Cloud security

Communication

Problem-solving

Leadership

Tools

PySpark

Databricks SQL

Delta Lake

Azure Data Factory

Job description

MACHINE LEARNING TECHNOLOGIES LLC invites an experienced Azure Data Analytics Architect to design and lead analytics initiatives in the Azure Databricks ecosystem in Houston. You will own end-to-end data pipelines, work with business stakeholders, and drive data-driven decisions across the enterprise.

Responsibilities include building scalable data models, integrating Azure services, and mentoring a data engineering team while ensuring security and governance compliance.