Senior Data Engineer — Databricks Lakehouse (Remote)

AgileEngine; Województwo pomorskie; On-site; PLN 447,000 - 559,000; Full time

Benefits offered by this job

Growth budget

Competitive compensation

100% remote with flexible hours

Meaningful, modern projects

Collaborative culture

Well-being support

Job summary

AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design and operate batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture (bronze/silver/gold) for analytics and ML use.

You'll leverage AI tools like Claude and GitHub Copilot to accelerate development, write clean Python and SQL, and collaborate with cross-functional teams in a fully remote environment with flexible hours.

Qualifications

• 4+ years of professional data engineering experience.
• Strong experience with Apache Spark (PySpark) and cloud data architectures.
• Advanced SQL and Python with data modeling skills.

Responsibilities

• Design, build, and operate batch and streaming pipelines on Databricks using PySpark, Delta Lake, and Databricks Workflows.
• Model and maintain a medallion architecture (bronze/silver/gold) for analytics and ML.
• Migrate legacy ETL workloads to Lakehouse with data parity and minimal disruption.

Skills

Databricks

PySpark

Delta Lake

SQL

Python

Education

Bachelor's degree in CS/SE or related field

Tools

Databricks Workflows

Job description

AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design and operate batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture (bronze/silver/gold) for analytics and ML use.

You'll leverage AI tools like Claude and GitHub Copilot to accelerate development, write clean Python and SQL, and collaborate with cross-functional teams in a fully remote environment with flexible hours.