Databricks Data Engineer: Lakehouse & AI Platform

RemoDevs; Warszawa, Kraków; On-site; PLN 180,000 - 280,000; Full time

Job summary

RemoDevs is seeking a Data Engineer with strong Databricks experience to join a data & AI project that builds a modern, scalable data platform supporting analytics, ML and AI use cases. You will design and maintain production-grade data pipelines, work with Data Scientists and Analysts, and help evolve lakehouse architectures.

Candidate should have hands-on Databricks experience, solid SQL and PySpark skills, and familiarity with cloud environments (Azure/AWS/GCP). Delta Lake knowledge is a plus.

Qualifications

• Hands-on Databricks experience is required.
• Strong SQL and PySpark / Apache Spark skills.
• Experience with large datasets and distributed data processing.
• Experience with cloud environments (Azure, AWS or GCP).
• Knowledge of Delta Lake is a plus.

Responsibilities

• Design, build and maintain scalable data pipelines using Databricks and Apache Spark.
• Integrate data from multiple sources and build reliable, reusable data flows.
• Develop and optimize data processing solutions for large volumes of data.
• Collaborate with Data Scientists, Analysts and business stakeholders to deliver data products supporting ML, BI and analytics.
• Contribute to the development of a unified data platform and high-quality data layer.
• Ensure data pipelines are reliable, scalable, performant and easy to maintain.
• Optimize data processing and infrastructure with a focus on performance, scalability and cost efficiency.
• Implement and maintain data quality, monitoring and data engineering best practices.
• Support the development and evolution of modern lakehouse and cloud data architectures.

Skills

Databricks

SQL

PySpark

Spark

Cloud platforms

Delta Lake

Tools

Delta Lake

Job description

RemoDevs is seeking a Data Engineer with strong Databricks experience to join a data & AI project that builds a modern, scalable data platform supporting analytics, ML and AI use cases. You will design and maintain production-grade data pipelines, work with Data Scientists and Analysts, and help evolve lakehouse architectures.

Candidate should have hands-on Databricks experience, solid SQL and PySpark skills, and familiarity with cloud environments (Azure/AWS/GCP). Delta Lake knowledge is a plus.