Azure Data Architect: Databricks & Cloud Analytics Lead

Valiant Technologies LLC; Houston, Northern (TX, KY); Hybrid; USD 140,000 - 180,000; Full time

Job summary

VALIANT TECHNOLOGIES LLC in Houston seeks a senior data engineer to lead architecture and execution of analytics solutions using Azure Databricks and Fabric, with strong SQL and data processing expertise. You will guide a talented team and partner with stakeholders to deliver scalable data platforms.

Responsibilities include designing end-to-end data pipelines, implementing Delta Lake on ADLS Gen2, and enabling Power BI reporting.

Qualifications

• 8+ years building data ingestion and transformation pipelines with Databricks and Synapse.
• Deep knowledge of Delta Lake, ADLS Gen2, and data warehousing concepts.
• Experience with Delta Live Tables, Auto Loader, and Databricks SQL.
• Proficiency in integrating Databricks with Power BI for end-to-end analytics.
• Familiar with CI/CD practices in cloud-native data platforms.

Responsibilities

• Lead architecture, design, and implementation of advanced analytics solutions using Azure Databricks / Fabric.
• Collaborate with stakeholders and IT teams to capture requirements and deliver solutions.
• Oversee end-to-end data solution implementations aligned with business needs.
• Develop data pipelines and ETL processes using Databricks, PySpark, and related tools.
• Integrate Databricks with Azure services and on-prem systems.
• Provide technical leadership and mentor the data engineering team.

Skills

Azure Databricks expertise

SQL skills

Leadership / mentoring

Communication

Cloud computing

Tools

Azure Data Factory

Delta Lake

Power BI

Azure Synapse

Databricks Delta Live Tables

Auto Loader

PySpark

Git

Job description

VALIANT TECHNOLOGIES LLC in Houston seeks a senior data engineer to lead architecture and execution of analytics solutions using Azure Databricks and Fabric, with strong SQL and data processing expertise. You will guide a talented team and partner with stakeholders to deliver scalable data platforms.

Responsibilities include designing end-to-end data pipelines, implementing Delta Lake on ADLS Gen2, and enabling Power BI reporting.