Hybrid Data Engineer: Scalable Pipelines & Data Quality

Swoon; McLean (VA); Hybrid; USD 83,000 - 152,000; Full time

Job summary

Swoon is seeking a data engineering contractor for hybrid work at McLean, VA or Riverwoods, IL. You will design and implement high-performance data pipelines, ensure data integrity with lineage tracking, and contribute to the data quality framework in a terabyte-scale environment.

Key requirements include expert Python and PySpark, hands-on AWS Glue/EMR, and experience with S3 data lakes and relational databases. Financial services exposure is a plus for this role.

Qualifications

• Expert-level Python and PySpark
• Hands-on AWS Glue and Amazon EMR experience
• Proven track record building scalable data pipelines (Terabyte-scale)
• Experience implementing data lineage and data quality frameworks
• Strong experience with S3-based data lakes and relational databases (RDS/PostgreSQL/MySQL)

Responsibilities

• Designing and implementing high-performance data pipelines that handle large volumes of data
• Ensuring data integrity through advanced quality checks and lineage tracking

Skills

Python

PySpark

Data pipelines

Data quality

Data lineage

Tools

AWS Glue

Amazon EMR

S3

RDS/PostgreSQL/MySQL

Kinesis

Kafka

Job description

Swoon is seeking a data engineering contractor for hybrid work at McLean, VA or Riverwoods, IL. You will design and implement high-performance data pipelines, ensure data integrity with lineage tracking, and contribute to the data quality framework in a terabyte-scale environment.

Key requirements include expert Python and PySpark, hands-on AWS Glue/EMR, and experience with S3 data lakes and relational databases. Financial services exposure is a plus for this role.