Data Platform Engineer for AI & Big Data Pipelines

Addepto; Polska; Hybrid; PLN 180,000 - 320,000; Full time

Benefits offered by this job

Remote/hybrid work options

Career growth and training

Databricks and Anthropic partnership

Job summary

Addepto, a leading AI consulting and data engineering company, seeks a Senior Big Data Engineer to design and build scalable data platforms using Databricks, Spark, Airflow, and Dagster. You will work on global projects across aerospace, energy, and automotive sectors, guiding architecture and data governance.

With flexible remote/hybrid arrangements, you will collaborate with Data Science teams, advance CI/CD/MLOps practices, and leverage partnerships with Databricks and Anthropic for

Qualifications

• 3+ years of commercial Big Data experience.
• Proficient in Python with clean code and OOP.
• Strong SQL skills including performance tuning and data warehousing experience.
• Experience designing data governance and data management processes.
• Deep expertise with Databricks, Spark, Airflow, and related tooling.
• Experience deploying solutions in Azure cloud environments.
• Ability to translate business needs into scalable data solutions.

Responsibilities

• Design and optimize scalable data processing pipelines for streaming and batch workloads using Databricks, Airflow, and Dagster.
• Architect end-to-end data platforms with high availability and reliability.
• Lead CI/CD and MLOps for automated deployments and model lifecycle management.
• Develop applications to aggregate, process, and analyze data from diverse sources for performance and scalability.
• Collaborate with Data Science teams on ML projects, including feature engineering and deployment.
• Manage data transformations using Databricks, DBT, and Airflow to ensure integrity.
• Translate business requirements into scalable technical solutions while ensuring data quality and governance.

Skills

Python programming

SQL & data warehousing

Big Data technologies

Consulting experience

Independent work

Education

Master’s or Ph.D. in CS/DS/Math/Physics

Tools

Databricks

Spark

Apache Airflow

Dagster

Azure

Power BI

Job description

Addepto, a leading AI consulting and data engineering company, seeks a Senior Big Data Engineer to design and build scalable data platforms using Databricks, Spark, Airflow, and Dagster. You will work on global projects across aerospace, energy, and automotive sectors, guiding architecture and data governance.

With flexible remote/hybrid arrangements, you will collaborate with Data Science teams, advance CI/CD/MLOps practices, and leverage partnerships with Databricks and Anthropic for