Data Engineer

Nextchallenge; Polska; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Flexible working hours and remote work

Health insurance

Professional development allowances

Vacation and sick leave policy

Monthly activity allowance

Referral program

Team-building events

Job summary

Nextchallenge is seeking a Data Engineer to design, build and maintain our data platform on AWS, leveraging S3, Redshift, Glue and Lambda. You will develop reliable data pipelines, optimize data infrastructure and contribute to modernising legacy processes while collaborating with analytics and stakeholders.

The role emphasises production-grade data pipelines, data modelling, APIs, and real-time processing with Kafka, plus strong SQL/Python skills and upper-intermediate English.

Qualifications

• 2+ years of professional data engineering experience.
• Strong SQL and Python skills.
• Hands-on AWS (S3, Redshift, Glue, Lambda) experience.
• Experience with Apache Airflow.
• Knowledge of data warehousing concepts and data modelling.
• Experience building production data pipelines with reliability and data quality.
• Familiarity with Git and CI/CD procedures (GitLab).
• Experience developing APIs and data integrations.
• English proficiency (Upper-intermediate or higher).

Responsibilities

• Design, develop and maintain scalable and reliable data pipelines and ETL/ELT processes;
• Develop and optimise data warehouse solutions;
• Develop and maintain data infrastructure on AWS while supporting legacy infra;
• Develop APIs and data integrations;
• Contribute to real-time data pipelines using Kafka;
• Automate and optimise data processes and workflows;
• Monitor, troubleshoot and improve pipelines reliability, performance, security and data quality;
• Collaborate with analytics and stakeholders to meet data needs;
• Maintain clear documentation for pipelines and infrastructure;
• Contribute to modernization of data processes and architecture.

Skills

SQL

Python

Apache Airflow

AWS (S3, Redshift, Glue, Lambda)

Data modelling

Data pipelines & reliability

Git & CI/CD (GitLab)

APIs & data integrations

Kafka (real-time)

MS SQL Server/SSIS

English communication

Tools

GitLab

MS SQL Server

SSIS

Kafka

Apache Airflow

Job description

Our client is looking for a Data Engineer to help them develop and maintain their data platform. Their infrastructure is primarily AWS-based, with Airflow, S3 and Redshift at its core, alongside a legacy stack based on MS SQL Server, SSIS and custom Python scripts. You will work on building reliable data pipelines, improving data infrastructure, and gradually modernising legacy processes.

Key Responsibilities:

• Design, develop and maintain scalable and reliable data pipelines and ETL/ELT processes;
• Develop and optimise data warehouse solutions;
• Develop and maintain data infrastructure, primarily on AWS, while also supporting parts of our legacy infrastructure;
• Develop APIs and data integrations;
• Contribute to the development and maintenance of real-time data pipelines using Kafka;
• Automate and optimise data processes and workflows;
• Monitor, troubleshoot and improve the reliability, performance, security and data quality of pipelines and infrastructure;
• Work closely with the analytics team and other stakeholders to understand their data needs and deliver effective solutions;
• Maintain clear and up-to-date documentation for data pipelines, infrastructure and workflows;
• Contribute to the improvement and modernisation of existing data processes and architecture.

Required Skills & Experience:

• 2+ years of professional experience in data engineering;
• Strong SQL and Python skills;
• Hands-on experience with AWS, including S3, Redshift, Glue and Lambda;
• Hands-on experience with Apache Airflow;
• Strong understanding of data warehousing concepts and data modelling;
• Hands-on experience designing, developing and maintaining production data pipelines, with a focus on reliability, monitoring and data quality;
• Solid understanding of relational and non-relational databases;
• Familiarity with Git and CI/CD practices, preferably GitLab;
• Experience developing APIs and data integrations;
• Kafka and real-time data processing experience is a plus;
• MS SQL Server and SSIS experience is a plus;
• Good written and verbal communication skills;
• Upper-intermediate English or higher.

The company guarantees you the following benefits:

• A positive workplace atmosphere that creates a culture of collaboration and support, making it a place you'll love working in;
• Competitive compensation and regular career development reviews;
• Flexible working hours and remote working options, you'll enjoy the freedom that the company provides;
• A generous vacation and sick leave policy, allowing you to take time off and enjoy a work-life balance;
• Financial assistance for professional development, helping you stay ahead of the curve and love your career path;
• Educational Allowances that give you the opportunity to expand your knowledge and experience;
• You'll have a monthly allowance for personal activities, giving you the opportunity to pursue your interests and hobbies outside of work;
• A comprehensive health insurance plan, depending on your current location;
• Referral program with financial rewards for bringing top talent to the company;
• Engaging in team-building activities and corporate parties.
• HR Interview with the Recruiter;
• Technical interview with the team;
• Final interview with the team.