Senior Data Engineer: Databricks Lakehouse Architect

Beusa Energy Group

The Woodlands (TX)

Presencial

USD 120 000 - 160 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Beusa Energy Group is seeking an experienced Data Engineer to own the performance, reliability, and cost-efficiency of the Databricks environment. You will design and optimize Delta tables, pipelines, and SQL workloads to deliver fast, trustworthy data at low cost.

You will collaborate with cross-functional teams to translate requirements into high-performing datasets and dashboards with clear SLAs, and you will mentor junior engineers while advancing Beusa’s data-driven strategy.

Qualificações

  • 8+ years of experience in Data Engineering, Data Warehousing, or Analytics.
  • 3+ years hands-on with Databricks and the Lakehouse Platform.
  • Expert-level proficiency with PySpark, Spark SQL, and distributed data processing concepts.
  • Advanced SQL development skills with Microsoft SQL Server preferred.
  • Experience designing and implementing Databricks Medallion Architectures (Bronze, Silver, Gold).
  • Experience building and optimizing batch and streaming data pipelines.
  • Experience CI/CD deployment strategies for data platforms.

Responsabilidades

  • Build Lakehouse pipelines on Databricks (Bronze/Silver/Gold) using Delta Lake, Delta Live Tables (DLT), and/or Jobs.
  • Own ingestion patterns (Autoloader, CDC, streaming) optimization
  • Own data modeling, quality checks, and performance optimization.
  • Tune Spark/SQL workloads: partitioning, clustering, constraints, and table health.
  • Engineer Delta tables for speed and cost; manage table health with Auto Optimize, OPTIMIZE, VACUUM.
  • Implement incremental processing patterns with idempotency and exactly-once delivery.
  • Deliver reliable, well-documented datasets with clear SLAs.
  • Design and implement dashboards and reports using Power BI and other visualization tools.
  • Collaborate with Operations, Field Engineers, Assets to translate requirements into technical solutions.
  • Develop and maintain data models ensuring data quality and integrity.
  • Integrate data from multiple sources including real-time sensors.
  • Educate and support stakeholders on data tools and practices.

Conhecimentos

Databricks
PySpark
SQL
Data modeling
Data pipelines
CI/CD
Spark SQL
Governance

Formação académica

Bachelor’s degree

Ferramentas

Git
Azure DevOps

Descrição da oferta de emprego

Beusa Energy Group is seeking an experienced Data Engineer to own the performance, reliability, and cost-efficiency of the Databricks environment. You will design and optimize Delta tables, pipelines, and SQL workloads to deliver fast, trustworthy data at low cost.

You will collaborate with cross-functional teams to translate requirements into high-performing datasets and dashboards with clear SLAs, and you will mentor junior engineers while advancing Beusa’s data-driven strategy.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer - Databricks Lakehouse & Delta Tables
Data Engineer - Databricks Lakehouse & Delta Tables

Beusa Energy, Inc. • The Woodlands (TX)

Híbrido
USD 90 000 - 140 000
Senior Databricks Data Engineer – Lakehouse & Dashboards
Senior Databricks Data Engineer – Lakehouse & Dashboards

Evolution Well Services, LLC • The Woodlands (TX)

Presencial
USD 120 000 - 150 000
Senior Data Engineer - Databricks Lakehouse Architect
Senior Data Engineer - Databricks Lakehouse Architect

UNAVAILABLE • McLean (VA)

Presencial
USD 120 000 - 160 000
Senior Data Engineer: Databricks Lakehouse Leader
Senior Data Engineer: Databricks Lakehouse Leader

Tata Consultancy Services Limited • Irvine (CA)

Presencial
USD 120 000 - 180 000
Senior Databricks Lakehouse Engineer
Senior Databricks Lakehouse Engineer

Ethereum Technologies LLC • Austin (TX)

Presencial
USD 130 000 - 185 000
Senior Data Engineer - Databricks Lakehouse (Remote)
Senior Data Engineer - Databricks Lakehouse (Remote)

Stermedia • EUA

Teletrabalho
USD 57 000 - 85 000
Flexible working hours
Remote work possible
Self-development budget
+2
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)

Capgemini • Atlanta (GA)

Presencial
USD 89 000 - 166 000
Vacation: 12-25 days
Company paid holidays
Personal days
+5
Senior Data Engineer - Databricks Lakehouse & AWS
Senior Data Engineer - Databricks Lakehouse & AWS

Ethereum Technologies • Tampa (FL)

Presencial
USD 91 000 - 124 000
Databricks Data Engineer - Lakehouse & Delta Lead
Databricks Data Engineer - Lakehouse & Delta Lead

Jobgether • EUA

Teletrabalho
USD 110 000 - 160 000
Healthcare coverage
Meal vouchers
Life insurance
+4
Remote Lakehouse Data Engineer | Databricks
Remote Lakehouse Data Engineer | Databricks

BairesDev • EUA

Teletrabalho
USD 120 000 - 180 000
100% remote work
Competitive USD salary
Home office setup provided
+3