Lead Azure Data Lake & Databricks Architect (Hybrid)

System One; Houston (TX); Hybrid; USD 96,000 - 193,000; Part time

Job summary

System One in Houston, Texas seeks a Principal Data Engineer for a contract role. The position blends onsite and remote work in a hybrid model to lead Azure-based data lake and Databricks initiatives in a high-volume environment.

You will architect scalable Azure data solutions, define roadmaps for Databricks Delta Live Tables, Unity Catalog, and Qlik Sense, and mentor teams while translating complex tech challenges into executive actions.

Qualifications

• 15-17 years IT experience with cloud-based analytics delivery.
• Proficiency in Azure: ADF, ADLS, Databricks, Stream Analytics, Delta Live Tables, Synapse.
• Advanced SQL plus Python, Scala, or Spark SQL.
• Experience with scalable ETL pipelines, data workflow optimization, and cloud migration.
• Azure Data Engineering or Databricks certification preferred.
• Nice to have: Hadoop, Kafka, Spark, Power BI/QlikSense, AI/ML/NLP/GenAI

Responsibilities

• Lead delivery of data analytics solutions with emphasis on Azure data lake architecture, Databricks engineering, governance, and operational performance in a high-volume environment.
• Architect and implement scalable Azure-based data lake solutions.
• Establish roadmaps across Qlik Replicate, Databricks Delta Live Tables, and Unity Catalog.
• Lead data transformation pipelines using Delta Live Tables and Structured Streaming.
• Optimize Databricks resources for performance and cost.
• Use Unity Catalog for governance, lineage, and metadata management.
• Establish data governance, security, and quality policies; monitor production pipeline performance.
• Mentor teams and translate technical challenges into executive-level actions.

Skills

Azure Data Factory

Databricks

SQL

Python

Spark

Data Governance

Tools

Delta Live Tables

Unity Catalog

Qlik Sense

Job description

System One in Houston, Texas seeks a Principal Data Engineer for a contract role. The position blends onsite and remote work in a hybrid model to lead Azure-based data lake and Databricks initiatives in a high-volume environment.

You will architect scalable Azure data solutions, define roadmaps for Databricks Delta Live Tables, Unity Catalog, and Qlik Sense, and mentor teams while translating complex tech challenges into executive actions.