Senior Data Engineer: Azure & Databricks

Publicis Sapient; Houston (TX); Hybrid; USD 104,000 - 120,000; Full time

Benefits offered by this job

Competitive compensation and benefits

Job summary

Publicis Sapient is seeking a hands-on Senior Data Engineer in Houston, working in a hybrid role. The candidate will design and implement scalable batch and streaming data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.

You will establish data governance controls, ensure data quality and security, and collaborate with data engineers, analysts, and stakeholders across cloud platforms. The role emphasizes building Lakehouse architectures, using Unity Catalog, and optimizing

Qualifications

• 5+ years of hands-on Data Engineering experience.
• 2+ years of hands-on Databricks experience.
• Strong proficiency in PySpark, Spark SQL, Databricks Workflows, Delta Lake, and Unity Catalog.
• Demonstrated experience building scalable data pipelines and integration solutions.

Responsibilities

• Design, build, and optimize batch and streaming pipelines using Databricks, PySpark, Spark SQL, and Databricks Workloads.
• Develop scalable ingestion and ETL/ELT frameworks that integrate data from multiple sources.
• Implement Lakehouse architectures using Delta Lake and Medallion design patterns.
• Apply Unity Catalog for data cataloging, lineage, and access controls.
• Establish automated data-quality controls, monitoring, and testing.
• Optimize Databricks workloads for performance and cost efficiency.
• Governance standards for metadata, retention, privacy, and compliance.
• Collaborate with data architects, analysts, data scientists, and business stakeholders.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Data governance

CI/CD

Git

Cloud platforms

SQL

Communication

Education

Bachelor’s degree in CS/Engineering/IS

Tools

Databricks Workflows

Azure Data Factory

Airflow

Terraform

Kafka

Job description

Publicis Sapient is seeking a hands-on Senior Data Engineer in Houston, working in a hybrid role. The candidate will design and implement scalable batch and streaming data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.

You will establish data governance controls, ensure data quality and security, and collaborate with data engineers, analysts, and stakeholders across cloud platforms. The role emphasizes building Lakehouse architectures, using Unity Catalog, and optimizing