Senior Data Engineer – Remote

Vytwo; Poland; Teletrabalho; PLN 449 000 - 599 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work

Career growth

Competitive salary

Resumo da oferta

Vytwo is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using Python and PySpark, supporting both batch and streaming workloads on cloud platforms such as Databricks and Snowflake.

You will develop robust data models (OLTP/OLAP), optimize SQL, create Airflow workflows, and enforce data governance with Purview, collaborating with data architects, analysts, scientists, and business stakeholders to deliver scalable, reliable data solutions.

Qualificações

• 7+ years of experience in data engineering or software engineering
• Proficiency with Databricks or Snowflake
• Experience with orchestration tools such as Apache Airflow
• Experience with cloud ecosystems (Azure preferred; AWS/GCP acceptable)
• Advanced SQL skills and OLTP/OLAP data modeling
• Familiarity with data governance tools, especially Microsoft Purview
• Strong Python/PySpark programming skills
• If offered, ability to provide extensive personal information for security clearance and eligibility

Responsabilidades

• Design, build, and maintain scalable data pipelines using Python and PySpark for batch and streaming workloads
• Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake
• Design and implement robust data models including OLTP and OLAP schemas
• Develop high quality SQL code with performance tuning
• Create and manage workflow orchestration using Airflow
• Implement data governance and metadata standards with Purview
• Build automated data quality and validation frameworks
• Collaborate with cross-functional teams to deliver scalable data solutions
• Lead design sessions and code reviews to promote best practices
• Support cloud infrastructure and DevOps practices including CI/CD
• Monitor and troubleshoot production data pipelines
• Contribute to evolution of the enterprise data platform

Conhecimentos

Python

PySpark

SQL

OLTP/OLAP data modeling

Cloud platforms (Azure/AWS/GCP)

Airflow

Ferramentas

Databricks

Snowflake

Microsoft Purview

Docker

Kubernetes

Descrição da oferta de emprego

Role: Senior Data Engineer

Remote Work

*Must be a US Citizen* & have a USA Passport

Primary Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming workloads.
• Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake, ensuring performance, reliability, and cost efficiency
• Design and implement robust data models, including transactional (OLTP) and dimensional (OLAP) schemas, to support analytics, reporting, and application integration
• Develop high quality SQL code including complex queries, stored procedures, and views, with a focus on performance tuning and efficient data access patterns
• Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable scheduling, dependency management, and monitoring
• Implement and enforce data governance and metadata standards through tools such as Microsoft Purview, including data lineage, classification, cataloging, and security policies
• Build automated data quality and validation frameworks to ensure accuracy, completeness, and reliability of production datasets
• Collaborate with cross functional teams including data architects, analysts, scientists, and business stakeholders to understand requirements and deliver scalable, well designed data solutions
• Lead technical design sessions and code reviews, promoting engineering best practices, reusability, and maintainability
• Support cloud infrastructure and DevOps practices, including CI/CD pipelines, version control, testing automation, and environment management
• Monitor and troubleshoot production data pipelines, proactively addressing issues, performance bottlenecks, and system failures
• Contribute to the evolution of the enterprise data platform, recommending tools, frameworks, and architectures to improve scalability and efficiency

You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Required Qualifications:

• 7+ years of experience in data engineering, software engineering, or similar disciplines
• Hands-on experience with Databricks or Snowflake
• Experience with orchestration tools such as Apache Airflow
• Experience working with cloud ecosystems (Azure preferred; AWS/GCP acceptable)
• Advanced SQL skills and experience with OLTP and OLAP data modeling
• Solid understanding of modern data warehousing, data lake, and ELT/ETL design patterns
• Familiarity with data governance tools, especially Microsoft Purview
• Solid programming expertise in Python, PySpark, or similar languages
• If you are offered this position, you will be required to provide extensive personal information to obtain and maintain a suitability or determination of eligibility for a Confidential/Secret or Top Secret security clearance as a condition of your employment
• Must be a US Citizen

Preferred Qualifications:

• Healthcare industry experience, including claims, clinical, FHIR, HL7, or provider data
• Experience with containerization (Docker, Kubernetes) for data workloads
• Experience supporting machine learning workflows or analytical data science pipelines
• Knowledge of distributed computing concepts and performance tuning

This is a remote position.