Senior Data Engineer: Databricks Lakehouse Architect

Beusa Energy Group; The Woodlands (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Beusa Energy Group is seeking an experienced Data Engineer to own the performance, reliability, and cost-efficiency of the Databricks environment. You will design and optimize Delta tables, pipelines, and SQL workloads to deliver fast, trustworthy data at low cost.

You will collaborate with cross-functional teams to translate requirements into high-performing datasets and dashboards with clear SLAs, and you will mentor junior engineers while advancing Beusa’s data-driven strategy.

Qualifications

• 8+ years of experience in Data Engineering, Data Warehousing, or Analytics.
• 3+ years hands-on with Databricks and the Lakehouse Platform.
• Expert-level proficiency with PySpark, Spark SQL, and distributed data processing concepts.
• Advanced SQL development skills with Microsoft SQL Server preferred.
• Experience designing and implementing Databricks Medallion Architectures (Bronze, Silver, Gold).
• Experience building and optimizing batch and streaming data pipelines.
• Experience CI/CD deployment strategies for data platforms.

Responsibilities

• Build Lakehouse pipelines on Databricks (Bronze/Silver/Gold) using Delta Lake, Delta Live Tables (DLT), and/or Jobs.
• Own ingestion patterns (Autoloader, CDC, streaming) optimization
• Own data modeling, quality checks, and performance optimization.
• Tune Spark/SQL workloads: partitioning, clustering, constraints, and table health.
• Engineer Delta tables for speed and cost; manage table health with Auto Optimize, OPTIMIZE, VACUUM.
• Implement incremental processing patterns with idempotency and exactly-once delivery.
• Deliver reliable, well-documented datasets with clear SLAs.
• Design and implement dashboards and reports using Power BI and other visualization tools.
• Collaborate with Operations, Field Engineers, Assets to translate requirements into technical solutions.
• Develop and maintain data models ensuring data quality and integrity.
• Integrate data from multiple sources including real-time sensors.
• Educate and support stakeholders on data tools and practices.

Skills

Databricks

PySpark

SQL

Data modeling

Data pipelines

CI/CD

Spark SQL

Governance

Education

Bachelor’s degree

Tools

Git

Azure DevOps

Job description

Beusa Energy Group is seeking an experienced Data Engineer to own the performance, reliability, and cost-efficiency of the Databricks environment. You will design and optimize Delta tables, pipelines, and SQL workloads to deliver fast, trustworthy data at low cost.

You will collaborate with cross-functional teams to translate requirements into high-performing datasets and dashboards with clear SLAs, and you will mentor junior engineers while advancing Beusa’s data-driven strategy.