Data Engineer

Vertex Agility; Kraków; Hybrid; PLN 120,000 - 160,000; Full time

Benefits offered by this job

Private medical care

Life insurance

Multisport card

Job summary

Vertex Agility in Kraków is seeking an experienced Data Engineer to join a team focused on building and optimizing high-performance data processing solutions. You’ll transform experimental code into scalable, reliable production workflows using PySpark and SQL.

The role emphasizes Spark performance tuning, Hadoop ecosystem work (YARN), and data pipeline design. Hybrid work arrangement requires 6 days/month in the office; private medical care and long-term projects are offered.

Qualifications

• Experience with PySpark and Spark for data processing.
• Experience designing and optimizing data pipelines.
• Strong SQL development and data analysis skills.
• Hands-on experience with Hadoop ecosystem and Spark on YARN.
• GCP experience is a plus.
• Troubleshooting and analytical abilities.

Responsibilities

• Develop and maintain data processing solutions using PySpark and Spark.
• Convert experimental code into production-ready workflows.
• Design, implement, and optimize data processing pipelines.
• Perform advanced SQL development and data analysis.
• Optimize Spark applications for performance and scalability.
• Work within Hadoop ecosystem, including Spark on YARN.
• Troubleshoot and improve data processing workflows.
• Support scalable and reliable data solutions.
• Strong experience with PySpark and data engineering.
• Advanced SQL skills.
• Strong Spark development and optimization.
• Hands-on Hadoop ecosystem experience.
• Experience working with Spark on YARN.
• Strong understanding of data processing and distributed computing.
• Experience developing performant and scalable data workflows.

Skills

PySpark

Advanced SQL

Spark

Hadoop ecosystem

YARN

Data engineering

Troubleshooting

Distributed computing

Analytical skills

Tools

Hadoop

Spark on YARN

Job description

Kraków (hybrid - 6 days/month in the office)

We’re looking for an experienced Data Engineer to join a team focused on building and optimizing high-performance data processing solutions. You’ll work with modern data technologies, transforming experimental code and features into scalable, reliable, and performant workflows and modules.

About the role

You’ll be part of a team responsible for developing and optimizing data processing solutions, with a strong focus on PySpark and advanced SQL. Your role will involve turning experimental implementations into production-ready workflows, improving Spark performance, and working within the Hadoop ecosystem.

• Develop and maintain data processing solutions using PySpark and Spark
• Convert experimental code and features into performant, production-ready workflows and modules
• Design, implement, and optimize data processing pipelines
• Perform advanced SQL development and data analysis
• Optimize Spark applications for performance and scalability
• Work within the Hadoop ecosystem, including Spark on YARN
• Troubleshoot and improve data processing workflows
• Support the implementation of scalable and reliable data solutions
• Strong experience with PySpark and data engineering
• Advanced SQL skills
• Strong experience in Spark development and Spark optimization
• Hands-on experience with the Hadoop ecosystem
• Experience working with Spark on YARN
• Strong understanding of data processing and distributed computing
• Experience developing performant and scalable data workflows
• GCP experience - nice to have
• Strong troubleshooting and analytical skills

What we offer

• B2B contract
• Private medical care, life insurance, and access to Multisport card
• Stable, long-term projects with full-time employment