Senior Data Engineer: Big Data ETL for AI/ML (TS/SCI)

Archer; Chantilly (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

Archer, in collaboration with ManTech, seeks a Senior Data Engineer to join our Chantilly, VA team. You will design, ingest, cleanse, transform, load, and visualize large-scale data sets, leveraging your software development skills and experience with Big Data.

Responsibilities include building ETL pipelines with Airflow, data profiling, and collaborating with data scientists to enable AI/ML workflows, plus some Linux administration. An active TS/SCI with Polygraph is required.

Qualifications

• High School Diploma/GED with 10+ years of software development and data experience.
• Proficient in Python/Java and SQL with Big Data experience.
• Experience with end-to-end data lifecycle from ingestion to display.

Responsibilities

• Design, implement, and optimize data ingestion, cleansing, transformation, loading for large-scale data."
• Develop ETL pipelines and data profiling to analyze new data sources."
• Leverage Big Data assets to power AI/ML analytics and build custom data solutions."
• Collaborate with data scientists to craft data pipelines for AI/ML workloads."
• Perform light Linux admin tasks and communicate software risks and constraints."
• Collaborate with teammates, vendors, and users to improve data processing methods.

Skills

Python

SQL

Big Data

ETL

Restful APIs

Linux

Airflow

Data modeling

Tools

FastAPI

Git

Job description

Archer, in collaboration with ManTech, seeks a Senior Data Engineer to join our Chantilly, VA team. You will design, ingest, cleanse, transform, load, and visualize large-scale data sets, leveraging your software development skills and experience with Big Data.

Responsibilities include building ETL pipelines with Airflow, data profiling, and collaborating with data scientists to enable AI/ML workflows, plus some Linux administration. An active TS/SCI with Polygraph is required.