Spark Data Engineer

Swoon; McLean (VA); Hybrid; USD 83,000 - 110,000; Full time

Job summary

Swoon is seeking an experienced Data Engineer to support a large-scale ETL modernization in McLean, VA. You will migrate legacy ETL workloads to a Spark/Scala-based architecture while ensuring data accuracy throughout the migration.

This 12-month contract role requires hands-on Spark, ETL modernization, and data validation expertise. The position offers a hybrid schedule with on-site presence in McLean.

Qualifications

• Hands-on Apache Spark experience (required).
• ETL modernization or migration experience.
• Data comparison, validation, or reconciliation experience.
• Experience with legacy-to-modern architecture migrations.
• Hybrid work schedule in McLean, VA.

Responsibilities

• Build and maintain large-scale data pipelines using Spark and Scala.
• Modernize legacy ETL workloads into a newer data architecture.
• Perform data comparison, reconciliation, and validation between legacy and modern pipelines.
• Identify and troubleshoot data discrepancies during migration.
• Ensure migrated pipelines maintain data quality and accuracy.

Skills

Apache Spark

Scala

ETL modernization

Data validation

Legacy-to-modern migrations

Ab Initio

Job description

Work Model: Hybrid – must be able to work onsite in McLean, VA

Duration: 12-month contract

Pay: $70/hr W2

We’re looking for an experienced Data Engineer to support a large-scale ETL modernization initiative. This role will focus on migrating legacy ETL workloads into a modern Spark/Scala-based architecture while ensuring data accuracy and consistency throughout the migration.

What You’ll Be Doing:

• Build and maintain large-scale data pipelines using Apache Spark and Scala
• Modernize legacy ETL workloads into a newer data architecture
• Perform data comparison, reconciliation, and validation between legacy and modern pipelines
• Identify and troubleshoot data discrepancies during migration
• Ensure migrated pipelines maintain data quality and accuracy

Must-Haves:

• Hands‑on Apache Spark experience
• ETL modernization or migration experience
• Data comparison, validation, or reconciliation experience
• Experience working with legacy-to-modern architecture migrations
• Ability to work a hybrid schedule in McLean, VA

The existing environment includes Ab Initio, but prior Ab Initio experience is NOT required.

This is a traditional Data Engineering position. AI/GenAI experience is not required.

If you’re a Senior Data Engineer with strong Spark/Scala experience and are open to a hybrid opportunity in McLean, VA, I’d love to connect.