Senior Data Engineer – Azure/Databricks Lakehouse

Publicis Sapient; Houston (TX); Hybrid; USD 104,000 - 120,000; Full time

Benefits offered by this job

Inclusive workplace and collaboration

Learning and development opportunities

Competitive compensation and benefits

Work-life balance flexibility

Job summary

Publicis Sapient is seeking a hands-on Senior Data Engineer in Houston to design and implement scalable batch and streaming data pipelines. You will leverage Databricks, PySpark, Spark SQL, and Delta Lake to build Lakehouse architectures and enable strong data governance across the analytics stack.

You will collaborate with data architects, analysts, data scientists, and business stakeholders, while applying CI/CD, IaC, and version control to ensure reliable, cost-efficient cloud pipelines.

Qualifications

• 5+ years of hands-on Data Engineering experience.
• 2+ years of hands-on Databricks experience.
• Strong proficiency in PySpark, Spark SQL, Databricks Workflows, Delta Lake, and Unity Catalog.
• Demonstrated experience building scalable data pipelines and integration solutions.
• Strong SQL, troubleshooting, and performance-optimization skills.

Responsibilities

• Design, build, and optimize batch and streaming pipelines using Databricks, PySpark, Spark SQL, and Databricks Workflows.
• Develop scalable ingestion and ETL/ELT frameworks that integrate data from multiple enterprise sources.
• Implement Lakehouse architectures using Delta Lake and Medallion design patterns.
• Apply Unity Catalog for data cataloging, lineage, discovery, RBAC, and permissions management.
• Establish automated data-quality controls, including validation, reconciliation, monitoring, and testing.
• Collaborate with data architects, analysts, data scientists, business stakeholders, data owners, and stewards.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Cloud data services

Data pipelines

SQL

Data governance

CI/CD / Git

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks Workflows

Git

Terraform

Azure Data Factory

Airflow

Job description

Publicis Sapient is seeking a hands-on Senior Data Engineer in Houston to design and implement scalable batch and streaming data pipelines. You will leverage Databricks, PySpark, Spark SQL, and Delta Lake to build Lakehouse architectures and enable strong data governance across the analytics stack.

You will collaborate with data architects, analysts, data scientists, and business stakeholders, while applying CI/CD, IaC, and version control to ensure reliable, cost-efficient cloud pipelines.