Senior Data Platform Engineer - ETL, Spark & Snowflake

Virtusa; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

Virtusa seeks a senior Core Data Engineer to design, build, and optimize scalable ETL/ELT pipelines in Python and PySpark, with strong SQL. You will work with Snowflake, BigQuery or Redshift and Databricks to model data for self‑service analytics. Emphasis on data quality, testing, and reliable datasets.

The role involves collaboration with analysts, data scientists, and business teams, leveraging Airflow, dbt, and CI/CD tooling to deliver robust data solutions.

Qualifications

• 5+ years designing robust data pipelines (ETL/ELT).
• 4+ years Python coding and advanced SQL.
• 3+ years with Spark (PySpark) and Databricks.
• Cloud data platforms: Snowflake, BigQuery or Redshift.
• Experience with data quality, automated testing, and error handling.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Python, PySpark, and Databricks.
• Implement Medallion Architecture and optimized data models in Snowflake/BigQuery/Redshift.
• Tune performance, troubleshoot data workflows, and ensure reliability.
• Collaborate with analysts, data scientists, and business teams to deliver high‑quality datasets.

Skills

Python

SQL

PySpark

Databricks

Snowflake

BigQuery

Redshift

Airflow

Prefect

dbt

Terraform

Kafka

Kinesis

Spark

Tools

Databricks

Snowflake

BigQuery

Redshift

Airflow

Prefect

dbt

GitHub Actions

GitLab CI

Jenkins

Terraform

Kafka

Kinesis

Spark

Job description

Virtusa seeks a senior Core Data Engineer to design, build, and optimize scalable ETL/ELT pipelines in Python and PySpark, with strong SQL. You will work with Snowflake, BigQuery or Redshift and Databricks to model data for self‑service analytics. Emphasis on data quality, testing, and reliable datasets.

The role involves collaboration with analysts, data scientists, and business teams, leveraging Airflow, dbt, and CI/CD tooling to deliver robust data solutions.