Senior Data Engineer - Databricks Lakehouse (Hybrid)

Publicis Groupe; Houston (TX); Hybrid; USD 104,000 - 120,000; Full time

Benefits offered by this job

Inclusive workplace with diverse teams

Ongoing learning and development

Competitive compensation and benefits

Job summary

Publicis Sapient seeks a hands-on Senior Data Engineer in Houston, offering a hybrid work arrangement. You will design and operate batch and streaming data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, while establishing data governance and cost-efficient cloud infrastructure.

You will build scalable ingestion frameworks, implement Lakehouse architectures, and collaborate with data stewards, engineers, scientists, and business partners to improve data quality and trust across

Qualifications

• 5+ years of hands-on Data Engineering experience.
• 2+ years of hands-on Databricks experience.
• Strong proficiency in PySpark, Spark SQL, Databricks Workflows, Delta Lake, and Unity Catalog.
• Experience with Azure, AWS, or GCP data services.
• Experience with Git, automated testing, CI/CD, and Infrastructure as Code.
• Strong communication skills with the ability to partner across technical and business teams.

Responsibilities

• Design, build, and optimize batch and streaming pipelines using Databricks, PySpark, Spark SQL, and Databricks Workflows.
• Develop scalable ingestion and ETL/ELT frameworks that integrate data from multiple enterprise sources.
• Implement Lakehouse architectures using Delta Lake and Medallion design patterns.
• Apply Unity Catalog for data cataloging, lineage, discovery, role-based access, and permission management.
• Establish automated data-quality controls, including validation, reconciliation, monitoring, and testing.
• Optimize Databricks workloads for performance, scalability, reliability, and cloud cost efficiency.
• Implement governance standards for metadata, classification, retention, privacy, security, and regulatory compliance.
• Support Git-based source control, CI/CD pipelines, and Infrastructure-as-Code deployments.
• Collaborate with data architects, analysts, data scientists, business stakeholders, data owners, and stewards.
• Document technical solutions, pipeline dependencies, and governance standards.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Data Pipelines

SQL

Azure

AWS

GCP

Git CI/CD

Data Governance

Education

Bachelor’s degree in Computer Science/Engineering/Information Systems or related field

Tools

Airflow

Kafka

Terraform

Power BI

Azure DevOps

Azure Data Factory

Job description

Publicis Sapient seeks a hands-on Senior Data Engineer in Houston, offering a hybrid work arrangement. You will design and operate batch and streaming data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, while establishing data governance and cost-efficient cloud infrastructure.

You will build scalable ingestion frameworks, implement Lakehouse architectures, and collaborate with data stewards, engineers, scientists, and business partners to improve data quality and trust across