ETL Developer (with Databrics)

eConsulting; Warszawa; Remote; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Private medical care

Sports card

Group insurance

English lessons

Training library

Sports activities

Team events

Job summary

eConsulting is seeking an independent ETL Developer with strong Databricks expertise to design, build, and optimize scalable data pipelines. You will own projects end-to-end and collaborate across teams with minimal supervision.

Ideal candidates have 3+ years in data engineering or ETL development, hands-on Databricks experience, and familiarity with Data Lake / Lakehouse architectures. This role offers mostly remote work with occasional visits to Warsaw.

Qualifications

• 3+ years (Regular) / 5+ years (Senior) experience in data engineering or ETL development.
• Hands-on Databricks experience (PySpark, Spark SQL).
• Experience with cloud platforms (Azure preferred, AWS/GCP acceptable).
• Knowledge of Data Lake / Lakehouse architecture.
• Strong problem-solving skills and ability to work independently.
• Version control experience (Git).

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Spark SQL).
• Integrate and transform data from databases, APIs, flat files, streaming.
• Optimize data pipelines for performance, scalability, and reliability.
• Manage and structure data in Data Lake / Lakehouse environments (Bronze/Silver/Gold).
• Implement data quality checks, validation frameworks, and ensure consistent data delivery.
• Translate business requirements into technical solutions and propose architecture improvements.
• Monitor, troubleshoot, and maintain ETL jobs, ensuring smooth operation and minimal downtime.

Skills

Databricks PySpark

Spark SQL

ETL/ELT development

Azure

AWS/GCP

Data Lake / Lakehouse

Git

Independent work

Job description

Workplace: Mostly remote, ocassional visits in Warsaw

Workload: Full-time

Contract type: B2B

We are looking for an independent ETL Developer with strong experience in Databricks who can design, build, and optimize scalable data pipelines. This role requires a high level of ownership, technical decision-making capability, and the ability to work with minimal supervision.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Spark SQL).
• Integrate and transform data from multiple sources (databases, APIs, flat files, streaming).
• Optimize data pipelines for performance, scalability, and reliability.
• Manage and structure data in Data Lake / Lakehouse environments (Bronze/Silver/Gold layers).
• Implement data quality checks, validation frameworks, and ensure consistent data delivery.
• Translate business requirements into technical solutions and propose architecture improvements.
• Monitor, troubleshoot, and maintain ETL jobs, ensuring smooth operation and minimal downtime.

Required Skills & Experience

• 3+ years (Regular) / 5+ years (Senior) experience in data engineering or ETL development
• Hands-on Databricks experience (PySpark, Spark SQL)
• Experience with cloud platforms (Azure preferred, AWS/GCP acceptable)
• Knowledge of Data Lake / Lakehouse architecture
• Strong problem-solving skills and ability to work independently
• Version control experience (Git).

What do we offer?

• Benefits package (private medical care, sports card, group insurance).
• Free English lessons with a dedicated teacher.
• Access to an extensive training library covering both soft and technical skills.
• Sports activities outside of work.
• Team-building events, competitions, and challenges.

Who We Are – In a Few Words

Industry: We operate in the IT sector.

Clients: We support international companies from regulated industries (banking, finance, insurance, pharmaceuticals).

Services: We provide comprehensive quality assurance and implement modern HR platforms for employee management.

How do we work? See what our employees say Piotr i Julia