Junior Data Engineer (Databricks)

N-iX; Kraków, Wrocław; On-site; PLN 120,000 - 190,000; Full time

Job summary

N-iX in Kraków is seeking a Data Engineer to design, build, and maintain robust data pipelines using Python and PySpark, collaborating with an international team to unlock scalable data solutions.

You will troubleshoot complex data issues, document processes, set up new tenants for onboarding, and work with Databricks and Azure to deliver reliable data services for our SaaS platform.

Qualifications

• 1–2 years of experience as data/software engineer or related field.
• Python for delivering/maintaining data pipelines and debugging code.
• Structured approach to data insights and diagnostic skills.
• Familiarity with Azure or other cloud platforms.
• Knowledge of Databricks, Snowflake, or similar platforms.
• Relational databases and SQL knowledge.
• Documentation of structured processes and data flows.
• Experience with pytest for testing.
• Git and GitLab (or equivalent).
• English and Polish proficiency (B2+).
• Strong collaboration, willingness to learn, adaptive mindset.

Responsibilities

• Design, build, and maintain data pipelines using Python/PySpark.
• Collaborate with an international team to develop scalable data solutions.
• Debug system bugs (Tier 2) and analyze data issues.
• Create smart, documented checklists and workflows.
• Set up and configure new tenants for smooth onboarding.
• Write unit/integration tests to ensure data service quality.
• Work with GitLab for code, CI/CD and collaboration.
• Utilize Databricks for data processing and management.
• Work in Azure cloud.

Skills

Python

PySpark

SQL

Git/GitLab

pytest

Azure

Databricks

Tools

Databricks

Snowflake

Docker

Kubernetes

Job description

#6025

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, our Client’s platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities

• Design, build, and maintain data pipelines using Python/PySpark.
• Collaborate with an international team to develop scalable data solutions.
• Conduct in-depth analysis and debugging of system bugs (Tier 2).
• Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows.
• Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding.
• Write unit/integration tests to ensure the quality and reliability of data services.
• Work with Gitlab to manage code, CI/CD and collaborate with team members.
• Utilize Databricks for data processing and management.
• Work in Azure cloud.

Requirements

• Programming: Minimum of 1-2 years as data/software engineer, or in a relevant field.
• Python working knowledge: Coding experience in Python, particularly in delivering/maintaining data pipelines and troubleshooting code-based bugs. Experience working with large codebases, working with an IDE and Git.
• Data Skills: Structured approach to data insights and diagnostic skills for data-related issues.o data insights.
• Cloud: Familiarity with cloud platforms (preferably Azure).
• Data Platforms: Knowledge of Databricks, Snowflake, or similar data platforms.
• Database Skills: Knowledge of relational databases, and working experience with SQL.
• Documentation: Experience in creating and maintaining structured documentation.
• Testing: Proficiency in utilizing testing frameworks (pytest) to ensure code reliability and maintainability.
• Version Control: Experience with Git and Gitlab or equivalent.
• English and Polish Proficiency: B2 plus.
• Interpersonal Skills: Strong collaboration abilities, willing to learn new skills and tools, adaptive and exploring mindset. We're looking for candidates who do not fear reaching out to others.

Nice to have:

• Big Data: Experience using Apache Spark/PySpark.
• Knowledge of Docker and Kubernetes.
• Ability to travel abroad once/twice a year for an on-site team building (Oslo, Norway) .