Senior Data Engineer (PST Overlap)

Appliscale; Kraków; On-site; PLN 180,000 - 260,000; Full time

Job summary

Appliscale in Kraków is seeking a Senior Data Engineer to join the Data Experiences and Automation team. You will design scalable data pipelines and data models to empower product teams and AI/ML initiatives.

You will collaborate with a technical lead, implement robust data solutions, and optimize pipelines handling petabytes of information across global deployments. Experience with Python, PySpark, DBT, Airflow, and AWS is essential.

Qualifications

• 5+ years of commercial data engineering experience.
• Bachelor's or higher in Computer Science, Software Engineering, or related field.
• Proficiency in Python for data processing and analysis.

Responsibilities

• Design, build, and optimize scalable data pipelines.
• Design data models capturing end-to-end ecosystem views.
• Architect robust, maintainable data solutions and optimize performance.
• Automate workflows to improve data processing efficiency.
• Ensure data quality, governance, and compliance.

Skills

Python

Data engineering

Teamwork

Communication

Education

Bachelor's degree in Computer Science/Software Engineering

Tools

DBT

Airflow

PySpark

Databricks

AWS

Job description

Our client is one of the largest game studios known for their very successful MOBA and FPS franchises. You will be a member of the Data Experiences and Automation team which collects and uses data to improve the player's experience.

Data Team is an initiative accountable for decision science, data products, data capture, and data warehousing and governance. Their mission is to harness the power of data for player-centric decisions and AI/ML products that make it better to be a player.

You'll work closely with a technical lead to expand data consumption and reporting capabilities and build solutions to improve the development lifecycle for data engineers and insight analysts throughout the organization. You'll be helping to enable advancements and fast iteration in Machine Learning and GenAI pipelines.

As a core contributor, you will play a vital role in building robust data solutions capable of processing petabytes of information. The ultimate goal is to help product teams to operate their services with enhanced efficiency. Your extensive experience working with large-scale data and globally distributed systems will be invaluable in aiding our efforts to develop effective solutions.

Responsibilities

• Please note, availability to attend afternoon/evening meetings is a requirement for this role as most of the team is located on the US West Coast (LA and Seattle)
• Design, build, and optimize scalable pipelines for data, supporting insight into the the Data Foundation ecosystem
• Design and implement data models using industry best practices that capture a complete ecosystem view of internal customer experiences, while ensuring accuracy, scalability,and long-term usability
• Architect and implement robust, maintainable, and high-performance data solutions
• Automate workflows to reduce manual intervention and enhance data processing efficiency, including automation for content, growth, and pubsports areas of coverage
• Optimize query performance and resolve pipeline bottlenecks to improve data accessibility
• Evaluate and adopt new tools, frameworks, and methodologies to advance data engineering capabilities
• Support cost optimization by ensuring scalable and efficient data solutions
• Ensure data quality, governance, and compliance with regulatory standards (e.g., GDPR, CCPA)
• Contribute to engineering discipline by shaping infrastructure, craft standards, tooling, and organizational best practices

Required qualifications

• Minimum of 5 years commercial work experience in data engineering or a related field
• Bachelor's or higher degree in Computer Science, Software Engineering, or a related field
• Proficiency in Python, essential for data processing and analysis tasks
• Hands-on experience with DBT (Data Build Tool) and Airflow
• Commercial experience using PySpark and Databricks
• Proficiency in AWS cloud infrastructure (AWS)
• Effective communication and teamwork skills

Nice to have

• Experience with ML Operations and GenAI pipelines and infrastructure
• Experience in the gaming industry, particularly with online multiplayer games
• Experience working with cross-discipline organizations that build data products
• Proficient in large-scale data manipulation across various data types
• Demonstrated ability to troubleshoot and optimize complex ETL pipelines
• Proven experience mentoring and guiding other engineers