Senior Data Engineer - Azure Databricks Lakehouse

Consolia

United States

Remote

USD 110,000 - 170,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Full private health insurance

Job summary

Consolia is seeking a Data Engineer to own the evolution of its Databricks-based analytics platform. You will design and optimize data pipelines, ingest data from various sources, and build Bronze-Silver-Gold layers while collaborating with analysts and stakeholders across Europe and North America.

The role emphasizes scalable, cost-aware cloud data engineering, governance, and delivery of trusted datasets for BI consumption, with a strong focus on performance and quality.

Qualifications

  • Proven experience as a Data Engineer in a modern data environment.
  • Hands-on experience with Databricks, including AI/BI Dashboards and Genie
  • Strong SQL skills and experience with relational data.
  • Strong Python and/or PySpark experience.
  • Experience designing, building and maintaining ELT/ETL data pipelines.
  • Experience with orchestration tools such as Azure Data Factory or equivalent.
  • Good understanding of medallion architecture (Bronze/Silver/Gold).
  • Experience with cloud-based data storage and processing technologies.
  • Understanding of data modelling for BI consumption.
  • Experience with multiple data sources including APIs and files.
  • Knowledge of performance optimization, scalability and cost management in cloud platforms.
  • Experience with Git, Azure DevOps or similar tooling.
  • Excellent communication skills to convey technical topics to non-technical stakeholders.

Responsibilities

  • Design, build, maintain and optimise data pipelines within Azure Databricks.
  • Take technical ownership of data ingestion from source systems into the Belgium data platform.
  • Build and maintain Bronze, Silver and Gold data layers using a medallion architecture.
  • Add and integrate new data sources, including internal systems, external datasets, APIs and file-based feeds.
  • Improve pipeline performance, reliability, monitoring and observability.
  • Identify opportunities to speed up data processing and reduce platform running costs.
  • Support the transition from legacy reporting to a modern Databricks Lakehouse platform.
  • Work with the Data Analyst to provide trusted datasets for Power BI reporting.
  • Collaborate with business users to translate data requirements into robust solutions.
  • Implement data quality checks and reconciliation processes.
  • Document data flows, definitions, assumptions and technical design decisions.
  • Contribute to engineering standards and reusable patterns.
  • Work within DevOps practices and structured delivery methods.
  • Support secure development practices and non-functional requirements.
  • Proactively seek innovative solutions to improve the platform.

Skills

Data Engineer experience
Databricks
SQL
Python PySpark
Data modeling
Cloud data platforms
Stakeholder engagement

Tools

Databricks
Azure Data Factory
Delta Lake
Unity Catalog
Git
Azure DevOps
Power BI
Terraform
Azure Functions

Job description

Consolia is seeking a Data Engineer to own the evolution of its Databricks-based analytics platform. You will design and optimize data pipelines, ingest data from various sources, and build Bronze-Silver-Gold layers while collaborating with analysts and stakeholders across Europe and North America.

The role emphasizes scalable, cost-aware cloud data engineering, governance, and delivery of trusted datasets for BI consumption, with a strong focus on performance and quality.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer — Databricks Lakehouse Lead
Senior Data Engineer — Databricks Lakehouse Lead

Remote • San Francisco (CA)

On-site
USD 150,000 - 210,000
Health insurance
Paid time off
Parental leave
+2
Senior Data Engineer - Databricks Lakehouse (Remote)
Senior Data Engineer - Databricks Lakehouse (Remote)

Stermedia • United States

Remote
USD 57,000 - 85,000
Flexible working hours
Remote work possible
Self-development budget
+2
Senior Data Engineer — Databricks on Azure Lakehouse
Senior Data Engineer — Databricks on Azure Lakehouse

PROSTAFF Schweiz GmbH • United States

Remote
USD 168,000 - 252,000
Lead Data Engineer - Azure Databricks & Lakehouse
Lead Data Engineer - Azure Databricks & Lakehouse

EPAM Systems • United States

Remote
USD 140,000 - 170,000
Senior Data Engineer – Azure/Databricks Lakehouse
Senior Data Engineer – Azure/Databricks Lakehouse

Publicis Sapient • Houston (TX)

Hybrid
USD 104,000 - 120,000
Inclusive workplace and collaboration
Learning and development opportunities
Competitive compensation and benefits
+1
Senior Data Engineer - Databricks/PySpark/SQL | Remote
Senior Data Engineer - Databricks/PySpark/SQL | Remote

HumanIT Digital Consulting • United States

Remote
USD 28,000 - 37,000
15th month salary
Health insurance for family
Birthday off
+3
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)

Capgemini • Atlanta (GA)

On-site
USD 89,000 - 166,000
Vacation: 12-25 days
Company paid holidays
Personal days
+5
Senior Data Engineer - Databricks Lakehouse Architect
Senior Data Engineer - Databricks Lakehouse Architect

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 160,000
Senior Data Engineer: Azure/Databricks & Lakehouse Expert
Senior Data Engineer: Azure/Databricks & Lakehouse Expert

Publicis Groupe • Houston (TX)

Hybrid
USD 104,000 - 120,000
Inclusive workplace
Learning opportunities
Competitive compensation
+4
Senior Data Engineer, Azure Databricks Lakehouse (Hybrid)
Senior Data Engineer, Azure Databricks Lakehouse (Hybrid)

Publicis Sapient • Houston (TX)

Hybrid
USD 104,000 - 120,000
Inclusive workplace
Ongoing learning and development
Competitive compensation and benefits
+4