Data Engineer: Azure + Databricks for Big Data & ML

Addepto; Poland; Hybrid; PLN 80,000 - 100,000; Full time

Benefits offered by this job

Flexible work arrangements

20 fully paid days off

Medical and sports packages

Career growth opportunities

Job summary

Addepto, a leading AI consulting and data engineering company in Poland, is seeking a Data Engineer to design and develop scalable data processing pipelines and applications. The role involves collaboration with technology experts on challenging projects across various industries.

Successful candidates will have at least 3 years of experience with Big Data systems, strong programming skills in Python, and experience in cloud environments. Enjoy flexible work arrangements and numerous perks for professional growth.

Qualifications

• At least 3+ years of commercial experience with Big Data systems.
• Experience implementing data governance and management processes.
• Familiarity with cloud environments, preferably Azure.

Responsibilities

• Design scalable data processing pipelines for streaming and batch using Big Data technologies.
• Develop applications to aggregate, process, and analyze data.
• Collaborate with Data Science on Machine Learning projects.

Skills

Strong programming skills in Python

Experience with Big Data technologies

Excellent communication skills

Ability to work independently

Education

Bachelor's or Master's degree in Computer Science, Data Science, Mathematics, Physics, or a related field

Tools

Databricks

Apache Airflow

Spark

DBT

Job description

Addepto, a leading AI consulting and data engineering company in Poland, is seeking a Data Engineer to design and develop scalable data processing pipelines and applications. The role involves collaboration with technology experts on challenging projects across various industries.

Successful candidates will have at least 3 years of experience with Big Data systems, strong programming skills in Python, and experience in cloud environments. Enjoy flexible work arrangements and numerous perks for professional growth.