Senior Data Engineer - Remote (Ukraine) for Scalable Pipelines

Simulmedia; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Simulmedia is seeking an experienced Data Engineer to join our Data Services team. You will design, build and operate the data platform powering our TV and streaming advertising platform, ingesting and transforming multi-billion-row datasets from external partners, and delivering robust, accessible data to internal products.

The role emphasizes strong Python and SQL skills and experience with Spark/Databricks, Redshift and Airflow, along with AWS and Docker.

Qualifications

• Bachelor’s degree in CS, Engineering, or equivalent practical experience.
• 7+ years of work experience as a data engineer.
• Proficiency in Python as the primary development language in recent years.
• Expert-level SQL: complex analytics on very large tables and debugging discrepancies.
• Hands-on experience with distributed data processing platforms (Spark/Databricks preferred; EMR, Snowflake or BigQuery also relevant) and columnar data warehouses (Redshift, Snowflake, BigQuery, ClickHouse, etc).
• Ability to design complex data models: normalized, dimensional and temporal (slowly changing dimensions, etc).
• Experience with workflow orchestration tools (Airflow or similar).
• Experience integrating third-party data feeds with schema drift handling and versioned reference data.
• Experience building REST services in Python (FastAPI, Flask, etc).
• Experience developing, maintaining, and debugging large server-side codebases.
• Working knowledge of AWS (S3, IAM, ECS or similar compute) and Docker.
• Knowledge of engineering best practices and testing (unit/integration tests, code review, CI/CD).
• Desire to take ownership and learn new technologies; ability to communicate with U.S.-based teams.
• Knowledge of Delta Lake / medallion lakehouse architectures is a plus.
• Experience migrating legacy pipelines with parity requirements is a plus.
• Experience with advertising, media or measurement data is a plus.

Responsibilities

• Design and build batch data pipelines ingesting multi-billion-row datasets from external data providers and internal systems.
• Model complex real-world data including slowly changing dimensions and temporal data, safely evolving models as upstream schemas change.
• Develop and operate workloads on lakehouse platform (Databricks / Spark / Delta) and Redshift, migrating pipelines as needed.
• Orchestrate pipelines with Airflow: scheduling, dependencies, retries, backfills and alerting.
• Prove correctness with parity checks and large historical backfills; investigate data discrepancies at row level.
• Build and maintain Python services and REST APIs serving data to internal products.
• Optimize performance and cost: query tuning, table design, workload management and right-sizing compute.
• Own deployments: monitor production pipelines, incident triage and root-cause analysis.
• Collaborate cross-functionally with product managers, data scientists, and stakeholders; work in an Agile team.
• Take ownership and experiment with new technologies to improve our software.

Skills

Python

SQL

Spark/Databricks

Airflow

REST APIs

AWS

Docker

CI/CD

Postgres

Redshift

Snowflake

BigQuery

Delta Lake

Education

Bachelor's degree in CS/Engineering

Tools

Databricks

Redshift

Snowflake

BigQuery

ClickHouse

Job description

Simulmedia is seeking an experienced Data Engineer to join our Data Services team. You will design, build and operate the data platform powering our TV and streaming advertising platform, ingesting and transforming multi-billion-row datasets from external partners, and delivering robust, accessible data to internal products.

The role emphasizes strong Python and SQL skills and experience with Spark/Databricks, Redshift and Airflow, along with AWS and Docker.