Senior Data Engineer (Hybrid) – ETL, Spark & Cloud

Edgesource Corp.; McLean (VA); On-site; USD 130,000 - 145,000; Full time

Benefits offered by this job

Flex Time Off

Hybrid Workplace

401K Program

Paid Parental Leave

Extensive Coverage

Continuing Education

Open Job Opportunities

Job summary

Edgesource Corp. in McLean, VA is seeking a Data Engineer to build and optimize complex data pipelines for a high-scale environment. You will work with Python, Spark, and AWS services, focusing on data security, governance, and compliant data handling.

The ideal candidate has 5+ years of experience, strong SQL skills, and hands-on experience with ETL workflows, orchestration tools, and production-grade data pipelines. This is an on-site, full-time role offering a competitive compensation package.

Qualifications

• Active TS/SCI Full Scope Polygraph
• Minimum of 5 years' experience
• Production data pipelines and ETL/EL workflows at scale
• Proficiency with Apache Spark and PySpark
• Advanced Python programming with Pandas/NumPy
• Understanding of data security, privacy, governance and compliance
• Experience with workflow orchestration tools (Step Functions, Airflow)
• Containerization and cloud deployment (Docker/Podman, AWS)
• Experience with AWS services (S3, Lambda, Step Functions)
• Production experience with PostgreSQL and MySQL; query optimization
• SQL and data pipeline version control (Git)
• Stakeholder collaboration with minimal oversight
• Strong problem-solving and debugging for data quality & performance bottlenecks
• Experience with large-scale data migrations or platform modernization
• Documentation and best-practice contribution

Responsibilities

• Build end-to-end data pipelines with Python
• Deploy data pipelines with orchestration tools
• Containerize applications for cloud deployment
• Work with MySQL/PostgreSQL; performance tuning & schema design
• Optimize SQL for complex analytics
• Use Git and CI/CD for pipelines
• Handle data catalogs and data lineage, including geospatial formats
• Integrate AI/ML services and models
• Collaborate with stakeholders to gather data requirements
• Troubleshoot data quality issues and performance bottlenecks
• Contribute to data engineering docs and design patterns
• Support data migration and platform modernization initiatives

Skills

Advanced Python

Spark/PySpark

Data security & governance

Workflow orchestration

Containerization

AWS services

PostgreSQL & MySQL

SQL optimization

Git/CI/CD

Data pipelines

Tools

Docker/Podman

Apache Spark

Airflow/Step Functions

CI/CD tooling

MySQL/PostgreSQL

Job description

Edgesource Corp. in McLean, VA is seeking a Data Engineer to build and optimize complex data pipelines for a high-scale environment. You will work with Python, Spark, and AWS services, focusing on data security, governance, and compliant data handling.

The ideal candidate has 5+ years of experience, strong SQL skills, and hands-on experience with ETL workflows, orchestration tools, and production-grade data pipelines. This is an on-site, full-time role offering a competitive compensation package.