Data Engineer

Svitla Systems; United States; Remote; USD 101,000 - 134,000; Full time

Benefits offered by this job

Remote or on-site flexibility

Generous time off

Personalized learning programs

Free tech webinars and meetups

Regular corporate online activities

Awesome team and supportive community

Bonuses for talks/publications

Job summary

Svitla Systems Inc. is seeking a Data Engineer for a full-time role (40 hours per week) focused on Europe-based operations.

You will join the data engineering function to migrate ~1,000 datasets to Snowflake, orchestrated by Airflow 3, while working closely with the data platform team on modernization efforts. The role emphasizes execution over design, with migrations across Airflow 2→3, Confluent region changes, and Iceberg transitions, targeting completion by March 2027.

Qualifications

• 3+ years of experience with large-scale datasets, Airflow and Spark.
• Strong software engineering fundamentals and hands-on Python.
• Advanced SQL with complex joins, CTEs, window functions and performance tuning.
• Snowflake data modeling experience.
• Experience with Apache Airflow and Python pipelines.
• Experience with Apache Kafka and Spark (PySpark).
• Experience with Iceberg and Parquet formats.
• AWS experience (S3, data lakes, partitioning, lifecycle).
• Testing strategy experience and debugging.
• Strong communication and ability to work independently.

Responsibilities

• Migrate ~1,000 datasets to Snowflake with Airflow 3 orchestration.
• Migrate pipelines from Airflow 2 to Airflow 3.
• Migrate Confluent connections to a new region.
• Migrate pipelines Hive to Iceberg using Snowpark Connect.
• Adapt data pipelines to Snowflake ensuring data quality and reliability.
• Support workflow scheduling and monitoring in Apache Airflow.

Skills

Airflow

Spark

Python

SQL

Snowflake

Kafka

Iceberg

Parquet

AWS S3

Testing

Communication

Independent work

Tools

Snowpark Connect

Job description

Svitla Systems Inc. is looking for a Data Engineer for a full-time position (40 hours per week) in Europe. Our client is one of the world’s largest and fastest-growing job sites. We are looking for a Data Engineer to work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort. The role centers on migrating approximately 1,000 datasets to Snowflake, with Apache Airflow 3 handling orchestration. The core architecture and technical approach are already defined by the client’s team, so the focus is on execution rather than design. The overarching objective is to accelerate a set of time-sensitive migrations (Airflow 2 to 3, Confluent region migration, and the move to Iceberg), targeted for completion by the end of March 2027. Coverage until 12:00 PM PT.

Requirements

• 3+ years of industry experience working with large-scale datasets, including Airflow and Spark.
• Strong software engineering fundamentals.
• Hands-on Python development experience.
• Advanced SQL, including complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling experience.
• Experience developing and testing pipelines in Apache Airflow and Python.
• Experience with Apache Kafka.
• Experience with Apache Spark, including hands-on PySpark.
• Experience with Iceberg and Parquet data formats.
• AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
• Testing strategy experience, with the ability to debug and test code hands-on.
• Strong communication skills.
• Ability to work independently.
• Will be a plus Hands-on experience with Snowflake migrations (data warehouse modernization, performance and cost optimization).
• Experience with Apache Airflow migrations (version upgrades, executor changes, or platform migrations).
• Experience using AI tools for development.

Responsibilities

• Carry out the migration of approximately 1,000 datasets to Snowflake, with Apache Airflow 3 handling orchestration.
• Migrate a set of pipelines from Apache Airflow 2 to Airflow 3.
• Migrate Confluent connections to a new region.
• Migrate a set of pipelines from Hive to Iceberg using Snowpark Connect.
• Adapt existing data pipelines to Snowflake while ensuring data quality and reliability throughout.
• Support workflow scheduling and monitoring in Apache Airflow.

• We offerUS and EU projects based on advanced technologies.
• Competitive compensation based on skills and experience.
• Regular performance appraisals to support your growth.
• Flexibility in workspace, either remote or our welcoming office.
• Bonuses for article writing, public talks, and other activities.
• Generous time off, including vacation, national holidays, sick leaves, and family days.
• Personalized learning programs tailored to your interests and skill development.
• Free tech webinars and meetups organized by Svitla.
• Regular corporate online activities.
• Awesome team and a friendly, supportive community!