Senior Data Engineer

Archer; Chantilly (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

Archer, in collaboration with ManTech, seeks a Senior Data Engineer to join our Chantilly, VA team. You will design, ingest, cleanse, transform, load, and visualize large-scale data sets, leveraging your software development skills and experience with Big Data.

Responsibilities include building ETL pipelines with Airflow, data profiling, and collaborating with data scientists to enable AI/ML workflows, plus some Linux administration. An active TS/SCI with Polygraph is required.

Qualifications

• High School Diploma/GED with 10+ years of software development and data experience.
• Proficient in Python/Java and SQL with Big Data experience.
• Experience with end-to-end data lifecycle from ingestion to display.

Responsibilities

• Design, implement, and optimize data ingestion, cleansing, transformation, loading for large-scale data."
• Develop ETL pipelines and data profiling to analyze new data sources."
• Leverage Big Data assets to power AI/ML analytics and build custom data solutions."
• Collaborate with data scientists to craft data pipelines for AI/ML workloads."
• Perform light Linux admin tasks and communicate software risks and constraints."
• Collaborate with teammates, vendors, and users to improve data processing methods.

Skills

Python

SQL

Big Data

ETL

Restful APIs

Linux

Airflow

Data modeling

Tools

FastAPI

Git

Job description

Archer is collaborating with MANTECH to connect them with exceptional professionals for this role. MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. In this role, you will leverage your software development expertise to support the design, ingestion, cleansing, transformation, loading, and visualization of complex, large-scale data sets.

Responsibilities

• Design, implement, and optimize data extraction, cleansing, transformation, loading, and large-scale ingestion systems within a Big Data environment.
• Develop ad-hoc ETL pipelines and build data profiling, deduping, and matching logic to analyze new data sources.
• Leverage Big Data holdings to power prototypical AI/ML-based analytics and build custom solutions to ingest and exploit data.
• Organize and maintain Data Layer documentation while collaborating closely with data scientists to craft data pipelines for AI/ML workflows.
• Perform light administration responsibilities for a small number of Linux servers while articulating software solution risks and constraints.
• Collaborate with teammates, service providers, vendors, and users to develop efficient data processing methods.

Minimum Qualifications

• High School Diploma/GED with 10+ years of relevant software development and programming experience.
• Demonstrated data analysis, parsing, and programming language experience (e.g., Python, Java) coupled with significant SQL and database experience.
• Experience with the full data lifecycle, from ingestion through display, within a Big Data environment.
• Hands-on experience with Python-related technologies (e.g., environment management, async development, FastAPI) and RESTful APIs.
• Experience with data pipelining systems (e.g., Apache Airflow) and developing ETL tasks within a Linux environment.

Preferred Qualifications

• Experience deploying software systems that leverage AI/ML technology.
• Experience publishing data analytics and results into BI dashboards.
• Demonstrated ability to automate routine Linux server management tasks.

Clearance Requirements

• An active TS/SCI with Polygraph is required.

Physical Requirements

• Must be able to remain in a stationary position 50% of the time.
• Needs to occasionally move about inside the office to access file cabinets and office machinery.
• Frequently communicates with co-workers, management, and customers; must be able to exchange accurate information in these situations.