Senior Azure Databricks Architect & Data Analytics

Quantum Technologies LLC; Dallas (TX); Hybrid; USD 130,000 - 190,000; Full time

Job summary

Quantum Technologies LLC in Dallas, TX seeks a senior data engineer with deep expertise in big data, data engineering, and cloud computing on Azure Databricks. You will design and implement ETL/ELT pipelines, Delta Lake, and data lakes, collaborating with business stakeholders and IT teams to define scope and timelines.

You will document architecture, enforce security and governance, and promote code quality, data security, and scalable solutions while mentoring a team of data engineers and

Qualifications

• 12+ years of IT experience with 5+ years in data analytics projects.
• Strong experience with AzureDatabricks notebook development and Delta Lake.
• Solid understanding of Azure services (Azure Data Lake, Synapse, Data Factory).
• Experience with ETL/ELT processes, data warehousing, and building data lakes.
• Proficient in SQL; familiarity with NoSQL databases.
• Experience with CI/CD pipelines and Git.

Responsibilities

• Understand requirements with stakeholders and define engagement scope and timelines.
• Document architecture and ensure security and governance compliance.
• Promote best practices for code quality, data security, and scalable solutions.
• Stay updated with Databricks developments to drive innovation.
• Lead and mentor a team of data engineers and communicate with non-technical stakeholders.

Skills

Azure

Databricks

Delta Lake

ETL/ELT

SQL

NoSQL

CI/CD

Git

Leadership

Power BI

Microsoft Fabric

Spark Streaming

Tools

Git

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Synapse

Databricks notebooks

Job description

Quantum Technologies LLC in Dallas, TX seeks a senior data engineer with deep expertise in big data, data engineering, and cloud computing on Azure Databricks. You will design and implement ETL/ELT pipelines, Delta Lake, and data lakes, collaborating with business stakeholders and IT teams to define scope and timelines.

You will document architecture, enforce security and governance, and promote code quality, data security, and scalable solutions while mentoring a team of data engineers and