Azure Data Analytics Architect - Lead Data Solutions

Valiant Technologies LLC; Houston (TX); On-site; USD 150,000 - 200,000; Full time

Job summary

VALIANT TECHNOLOGIES LLC is seeking an experienced data architecture leader to design and implement advanced analytics solutions on Azure Databricks and Fabric. You will drive end-to-end data pipelines, collaborate with stakeholders, and mentor a growing data engineering team.

Responsibilities include integrating Databricks with Azure Data Lake, Synapse, and Data Factory, while ensuring compliance with security and governance standards and delivering scalable, high‑quality data solutions.

Qualifications

• 8+ years of experience building data ingestion and transformation pipelines with Databricks / Synapse notebooks and Azure Data Factory.
• Deep knowledge of Delta tables, Delta Lake and ADLS Gen2.
• Experience with Databricks SQL for query layering.
• Experience integrating Databricks with Power BI for end‑to‑end analytics.
• Familiarity with CI/CD practices in cloud-native data environments.

Responsibilities

• Lead architecture, design, and implementation of advanced analytics solutions using Azure Databricks / Fabric.
• Collaborate with stakeholders and IT teams to translate requirements into technical designs.
• Oversee end-to-end data solution implementation ensuring alignment with business needs.
• Develop data pipelines and ETL processes using Databricks, PySpark, and related tools.
• Integrate Databricks with Azure services (Data Lake, Synapse, Data Factory) and on-prem systems.
• Provide technical leadership and mentorship to the data engineering team.
• Document architecture, processes, and data flows with emphasis on security and governance.
• Uphold code quality, data security, and scalable design practices.
• Stay current with Databricks and related tech to drive innovation.

Skills

Azure Databricks

Big Data

SQL

PySpark

Azure Synapse

Azure Data Factory

CI/CD

Cloud Security

Leadership

Mentoring

Tools

Delta Lake

Databricks

Azure Data Lake

Power BI

Git

ARM templates

Spark

Auto Loader

Job description

VALIANT TECHNOLOGIES LLC is seeking an experienced data architecture leader to design and implement advanced analytics solutions on Azure Databricks and Fabric. You will drive end-to-end data pipelines, collaborate with stakeholders, and mentor a growing data engineering team.

Responsibilities include integrating Databricks with Azure Data Lake, Synapse, and Data Factory, while ensuring compliance with security and governance standards and delivering scalable, high‑quality data solutions.