Junior Data Engineer (Databricks)

Nix; Boston; Hybrid; PHP 5,718,000 - 7,624,000; Full time

Benefits offered by this job

Flexible work format

Competitive salary and benefits

Career growth and professional dev

Job summary

Nix is expanding its data engineering team to enhance a robust data pipeline powering a SaaS product. You will collaborate with international product teams, analyze real-world engineering data, and build data quality solutions to bolster customer confidence.

The role includes flexible work options (remote, office-based, or hybrid) and opportunities to travel for team events. Responsibilities include building pipelines with Python/PySpark,开展 data analysis, testing with pytest, and maintaining

Qualifications

• 1–2 years as data/software engineer or in a related field.
• Python experience delivering/maintaining data pipelines and debugging large codebases.
• Structured approach to data insights and diagnostics.
• Cloud familiarity, preferably Azure.
• Experience with Databricks, Snowflake or similar platforms.
• Knowledge of SQL and relational databases.
• Experience creating and maintaining structured documentation.
• Proficiency with pytest testing frameworks.
• Git and GitLab or equivalent version control.
• English and Polish at B2 level.
• Strong collaboration and willingness to learn new tools.

Responsibilities

• Design, build, and maintain data pipelines using Python/PySpark.
• Collaborate with an international team to develop scalable data solutions.
• Analyze and debug system issues (Tier 2).
• Create and maintain process documentation, checklists, and workflows.
• Set up and configure new tenants and support onboarding.
• Write unit and integration tests to ensure data service quality.
• Work with GitLab for CI/CD and code collaboration.
• Utilize Databricks for data processing and Azure cloud.
• Contribute to testing and quality assurance practices.

Skills

Python

SQL

Git

PySpark

Databricks

Azure

Spark

Docker

Kubernetes

pytest

CI/CD

English

Polish

Tools

Databricks

GitLab

Azure

PyCharm

VS Code

Job description

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, our Client’s platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities

• Design, build, and maintain data pipelines using Python/PySpark.
• Collaborate with an international team to develop scalable data solutions.
• Conduct in-depth analysis and debugging of system bugs (Tier 2).
• Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows.
• Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding.
• Write unit/integration tests to ensure the quality and reliability of data services.
• Work with Gitlab to manage code, CI/CD and collaborate with team members.
• Utilize Databricks for data processing and management.
• Work in Azure cloud.

Requirements

• Programming: Minimum of 1-2 years as data/software engineer, or in a relevant field .
• Python working knowledge: Coding experience in Python, particularly in delivering/maintaining data pipelines and troubleshooting code-based bugs. Experience working with large codebases, working with an IDE and Git.
• Data Skills: Structured approach to data insights and diagnostic skills for data related issues.o data insights.
• Cloud: Familiarity with cloud platforms (preferably Azure).
• Data Platforms: Knowledge of Databricks, Snowflake, or similar data platforms.
• Database Skills: Knowledge of relational databases, and working experience with SQL.
• Documentation: Experience in creating and maintaining structured documentation.
• Testing: Proficiency in utilizing testing frameworks (pytest) to ensure code reliability and maintainability.
• Version Control: Experience with Git and Gitlab or equivalent.
• English and Polish Proficiency: B2 plus.
• Interpersonal Skills: Strong collaboration abilities, willing to learn new skills and tools, adaptive and exploring mindset. We're looking for candidates that do not fear to reach out to others.

Nice to have

• Big Data: Experience using Apache Spark/PySpark.
• Knowledge of Docker and Kubernetes.
• Ability to travel abroad once/twice a year for an on-site team building (Oslo, Norway) .

We offer

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

not applicable for freelancers