Senior Data Engineer - Big Data & AI/ML Pipelines

ManTech; Chantilly (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

MANTECH seeks a Senior Data Engineer to join our team in Chantilly, VA. You will leverage your software development expertise to design, ingestion, cleansing, transformation, load and visualize large-scale data sets for advanced analytics.

Collaborate with data scientists to craft data pipelines for AI/ML workflows, build robust ETL processes, and maintain data layer documentation. This role includes light Linux server administration and coordinating with vendors and users to optimize data

Qualifications

• High School Diploma or GED with 10+ years of software development experience.
• Strong SQL and database experience with Python/Java programming.
• Experience across data lifecycle from ingestion to display in a Big Data environment.
• Experience with Python-related technologies (e.g., environment management, async development, FastAPI) and RESTful APIs.
• Experience with data pipelining systems (e.g., Apache Airflow) and developing ETL tasks within a Linux environment.

Responsibilities

• Design, implement, and optimize data extraction, cleansing, transformation, loading and large-scale ingestion systems within a Big Data environment.
• Develop ad-hoc ETL pipelines and build data profiling, deduping, and matching logic to analyze new data sources.
• Leverage Big Data holdings to power prototypical AI/ML-based analytics and build custom solutions to ingest and exploit data.
• Organize and maintain Data Layer documentation while collaborating closely with data scientists to craft data pipelines for AI/ML workflows.
• Perform light administration responsibilities for a small number of Linux servers while articulating software solution risks and constraints.
• Collaborate with teammates, service providers, vendors, and users to develop efficient data processing methods.

Skills

Python

Java

SQL

Big Data

ETL

Education

High School Diploma or GED

Tools

Apache Airflow

Linux

FastAPI

Job description

MANTECH seeks a Senior Data Engineer to join our team in Chantilly, VA. You will leverage your software development expertise to design, ingestion, cleansing, transformation, load and visualize large-scale data sets for advanced analytics.

Collaborate with data scientists to craft data pipelines for AI/ML workflows, build robust ETL processes, and maintain data layer documentation. This role includes light Linux server administration and coordinating with vendors and users to optimize data