Senior Data Engineer, Data Platform

Virtasant; United States; Remote; USD 140,000 - 180,000; Full time

Benefits offered by this job

Remote within contig US

Independent contractor agreement

Job summary

Virtasant seeks a Senior Data Engineer to join our client’s Data Platform team. You will architect and build core services, automation tools, and integrations powering a healthcare-focused data ecosystem.

Lead high-impact platform components, improve pipeline reliability and observability, and partner with data engineering, analytics, and DevOps to scale and improve developer experience. Fully remote in contig US; requires eligible contractor status.

Qualifications

• 7+ years in data engineering or software development with production data systems.
• Strong Python and SQL in data pipelines.
• Experience with Snowflake/BigQuery/Redshift.
• Build tooling for data contracts and self-service.
• Knowledge of streaming and S3-based formats.
• Familiarity with orchestration tools (Airflow, Dagster, Prefect).
• Experience with AWS (2+ years).
• DBT experience.

Responsibilities

• Design and build scalable data platform services and APIs.
• Develop data pipelines with Airflow, Spark, and dbt.
• Improve observability, data lineage, and quality metrics.
• Collaborate with data engineering, analytics, and DevOps teams.

Skills

Python

SQL

Data engineering

CI/CD

Docker

Tools

Snowflake

BigQuery

Redshift

Airflow

dbt

Kafka

Spark

S3

Job description

About Virtasant Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries. We specialize in cloud architecture, infrastructure, migration, and optimization, helping enterprises scale efficiently while maintaining cost control. Our clients range from Fortune 500 companies to fast-growing startups, relying on us to build high-performance infrastructure, optimize cloud environments, and enable continuous delivery at scale.

About the role

We're looking for a Senior Data Engineer to join us and work with our client's Data Platform team. Our client is a leading healthcare technology company, dedicated to transforming the patient and provider experience through innovative, data-driven solutions. You will architect and build core services, automation tools, and integrations that power our client's data ecosystem. You'll own high-impact platform components, improve pipeline reliability and observability, and partner closely with data engineering, analytics, and DevOps to advance the scalability and developer experience of our client's data platform.

For this role, we can only consider candidates located in contiguous US states. Also, we are only able to consider candidates who are either US citizens, or Green Card Holders, or sole proprietors of their own LLC company. We are NOT able to consider candidates on any kind of visa that requires sponsorship, like STEM OPT, H4 EAD, F-1 OPT, L-2S, CPT, etc.

What You'll Do

• Build Automation & Tooling: Develop scalable backend services, APIs, and internal tools to automate data platform workflows (e.g., data onboarding, validation, pipeline orchestration, schema tracking, quality monitoring).
• Data Platform Integration: Integrate tools with core data infrastructure, building pipelines (Airflow, Spark, dbt, Kafka, Snowflake, or similar) to expose capabilities via APIs and UIs.
• Observability & Governance: Build visualization and monitoring components for data lineage, job health, and quality metrics.
• Collaboration: Work cross-functionally with data engineering, product, and DevOps teams to define requirements and deliver end-to-end solutions.

What We're Looking For

• You have to live in the contiguous United States and have all the necessary documentation to work under an independent contractor agreement. We cannot offer sponsorships or sponsorship transfers, so unfortunately, we CANNOT consider candidates on H1B, OPT, EAD, or CPT visas.

Must-Have Experience

• 7+ years of experience in data engineering or software development with at least 5 years building production-grade data or platform services
• Strong programming skills in Python & SQL and at least one major data platform (Snowflake, BigQuery, Redshift, or similar)
• Develop tooling for schema evolution, data contracts, and developer self-service
• Deep experience with streaming, distributed compute, or S3-based table formats (Spark, Kafka, Iceberg/Delta/Hudi).
• Experience with schema governance, metadata systems, and data quality frameworks.
• Understanding of orchestration tools (Airflow, Dagster, Prefect, etc.)
• Solid grasp of CI/CD and Docker
• At least 2 years of experience in AWS
• Experience with building data pipelines using dbt

Nice-to-haves

• Experience with data observability, data catalog, or metadata management tools
• Experience working with healthcare data (X12, FHIR)
• Proven experience in data migration projects (legacy technologies to the latest technologies)
• Experience building internal developer platforms or data portals
• Understanding of authentication/authorization (OAuth2, JWT, SSO)

Our recruitment process

• Recruiter interview (30 min)
• Technical Interview (45 min)
• Screening interview with the client's hiring manager (30 min)
• Client technical interview (45 min)

What we offer

• Totally remote within the contiguous United States, full-time (40h/week)
• Stable, long-term independent contract agreement
• Work hours - US Eastern time office hours