Data Engineer - Hybrid (Warsaw) | Big Data, Spark & CI/CD

Talan Group; Warszawa; Hybrid; PLN 252,844 - 337,126; Full time

Benefits offered by this job

Private medical insurance

Training and career development

Smart Office Pack for comfortable work at home

Life insurance

Multicultural team experience

Job summary

An international consulting group is seeking a highly skilled Data Engineer based in Warsaw, Poland. The ideal candidate will have over 4 years of experience with ETL processes, big data technologies, and tools like Apache Spark and Scala. This hybrid role involves designing scalable data solutions, optimizing ETL pipelines, and working with BI tools such as Databricks and Power BI. Strong SQL and cloud storage experience are essential. The company offers a full-time contract with benefits including private medical insurance and professional development opportunities.

Qualifications

• 4+ years of experience in implementing ETL pipelines.
• 2+ years of experience working with Apache Spark.
• 2+ years of hands-on experience with Scala programming.
• 2+ years of experience with BI tools (Databricks, Power BI, Starburst, or similar).
• Strong expertise in SQL and relational database systems.
• Experience designing and implementing data models for enterprise use cases.
• Familiarity with data lakes and cloud-based storage environments.
• Strong background in data validation, unit testing, and best practices for code quality.
• Solid understanding of CI/CD principles and experience delivering high-quality code.

Responsibilities

• Design, develop, and optimize robust ETL pipelines.
• Build and maintain high-performance data models for analytics.
• Work with large-scale distributed systems and data lake architectures.
• Ensure data quality through strong validation practices.
• Collaborate closely with cross-functional teams.
• Implement and maintain CI/CD pipelines.
• Work with BI tools for effective data visualization.

Skills

ETL processes

Apache Spark

Scala programming

SQL

Data validation

CI/CD principles

Tools

Databricks

Power BI

Starburst

Apache Hive

AWS S3

Job description

An international consulting group is seeking a highly skilled Data Engineer based in Warsaw, Poland. The ideal candidate will have over 4 years of experience with ETL processes, big data technologies, and tools like Apache Spark and Scala. This hybrid role involves designing scalable data solutions, optimizing ETL pipelines, and working with BI tools such as Databricks and Power BI. Strong SQL and cloud storage experience are essential. The company offers a full-time contract with benefits including private medical insurance and professional development opportunities.