Data Engineer: Real-Time Analytics & AWS Pipelines

Edgesource Corporation; Chantilly (VA); On-site; USD 90,000 - 130,000; Full time

Benefits offered by this job

Flexible PTO Policy + 11 Paid Holidays

Flexible Work Schedules (Remote / Hybд

Job summary

Edgesource Corporation seeks a data engineer to design and maintain ETL/ELT pipelines and data architectures for analytics and ML workloads. You will integrate diverse data sources, optimize processing in AWS S3, and collaborate with data scientists and stakeholders to deliver structured datasets and visualizations.

The role emphasizes data quality, rapid delivery, and scalable pipelines, with client-site development and opportunities across DoD, DHS, and federal programs.

Qualifications

• Active TS/SCI FSP required.
• 3–5 years of professional data engineering experience.
• Strong collaboration with Data Scientists, Analysts and Engineers.
• Ability to convey complex technical concepts to non-technical stakeholders.
• Detail-oriented with strong focus on data quality.
• Able to juggle multiple priorities in a fast-paced environment.

Responsibilities

• Design, develop and maintain ETL/ELT pipelines for batch and real-time processing using Python and SQL.
• Integrate data from databases, APIs, streaming platforms, PDFs, and MS Office files.
• Build scalable data architectures to support analytics and ML workloads.
• Optimize data processing and queries for performance and cost in AWS S3.
• Exposure to PySpark or other big data frameworks for future scalability.
• Develop and implement web scraping and data ingestion workflows to collect open-source data and produce structured datasets and visualizations.

Skills

Active TS/SCI FSP

3-5 years + data engineering

Collaboration with Data Scientists

Communication of technical concepts

Data quality & detail orientation

Multi-priority management

Python

SQL

PySpark

Elastic/OpenSearch

AWS

Linux

Git

Docker

Kubernetes

CI/CD

Tools

Python

SQL

PySpark

Elastic/OpenSearch

AWS

Linux

Git

Docker

Kubernetes

CI/CD

Job description

Edgesource Corporation seeks a data engineer to design and maintain ETL/ELT pipelines and data architectures for analytics and ML workloads. You will integrate diverse data sources, optimize processing in AWS S3, and collaborate with data scientists and stakeholders to deliver structured datasets and visualizations.

The role emphasizes data quality, rapid delivery, and scalable pipelines, with client-site development and opportunities across DoD, DHS, and federal programs.