Remote Senior Data Engineer: Data Pipelines & Cloud

Vytwo; Poland; Teletrabalho; PLN 449 000 - 599 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work

Career growth

Competitive salary

Resumo da oferta

Vytwo is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using Python and PySpark, supporting both batch and streaming workloads on cloud platforms such as Databricks and Snowflake.

You will develop robust data models (OLTP/OLAP), optimize SQL, create Airflow workflows, and enforce data governance with Purview, collaborating with data architects, analysts, scientists, and business stakeholders to deliver scalable, reliable data solutions.

Qualificações

• 7+ years of experience in data engineering or software engineering
• Proficiency with Databricks or Snowflake
• Experience with orchestration tools such as Apache Airflow
• Experience with cloud ecosystems (Azure preferred; AWS/GCP acceptable)
• Advanced SQL skills and OLTP/OLAP data modeling
• Familiarity with data governance tools, especially Microsoft Purview
• Strong Python/PySpark programming skills
• If offered, ability to provide extensive personal information for security clearance and eligibility

Responsabilidades

• Design, build, and maintain scalable data pipelines using Python and PySpark for batch and streaming workloads
• Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake
• Design and implement robust data models including OLTP and OLAP schemas
• Develop high quality SQL code with performance tuning
• Create and manage workflow orchestration using Airflow
• Implement data governance and metadata standards with Purview
• Build automated data quality and validation frameworks
• Collaborate with cross-functional teams to deliver scalable data solutions
• Lead design sessions and code reviews to promote best practices
• Support cloud infrastructure and DevOps practices including CI/CD
• Monitor and troubleshoot production data pipelines
• Contribute to evolution of the enterprise data platform

Conhecimentos

Python

PySpark

SQL

OLTP/OLAP data modeling

Cloud platforms (Azure/AWS/GCP)

Airflow

Ferramentas

Databricks

Snowflake

Microsoft Purview

Docker

Kubernetes

Descrição da oferta de emprego

Vytwo is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using Python and PySpark, supporting both batch and streaming workloads on cloud platforms such as Databricks and Snowflake.

You will develop robust data models (OLTP/OLAP), optimize SQL, create Airflow workflows, and enforce data governance with Purview, collaborating with data architects, analysts, scientists, and business stakeholders to deliver scalable, reliable data solutions.