Remote Data Engineer: Azure Databricks & Python Pipelines

your Jared; Warszawa; Hybrid; PLN 138,000 - 179,000; Full time

Benefits offered by this job

100% remote work

Job summary

your Jared is hiring a Data Engineer to build and optimize scalable data solutions in Microsoft Azure. The role focuses on ETL/ELT pipeline development using Azure Databricks, Python, PySpark, and Azure Data Factory.

You will implement automated tests, data quality controls, monitoring, and CI/CD automation while ensuring production readiness and performance scalability in a remote setup with international collaboration.

Qualifications

• Minimum 2 years of experience with Microsoft Azure.
• Hands-on experience with Azure Databricks, Azure Data Factory, and Azure DevOps.
• Proficient in Python and PySpark; strong SQL and data modeling skills.
• Experience with CI/CD, automated testing, and TDD.

Responsibilities

• Build and optimize scalable data pipelines and ETL/ELT processes.
• Process data using Python and PySpark.
• Develop solutions based on Azure Databricks, Azure Data Factory, and Azure Storage.
• Implement automated tests, data quality controls, and monitoring.
• Participate in CI/CD processes and deployment automation.
• Troubleshoot data performance and scalability issues.
• Collaborate with technical and business teams.

Skills

Azure Databricks

Python

PySpark

SQL

Tools

Azure Data Factory

Azure DevOps

Job description

your Jared is hiring a Data Engineer to build and optimize scalable data solutions in Microsoft Azure. The role focuses on ETL/ELT pipeline development using Azure Databricks, Python, PySpark, and Azure Data Factory.

You will implement automated tests, data quality controls, monitoring, and CI/CD automation while ensuring production readiness and performance scalability in a remote setup with international collaboration.