Data Engineer, Big Data & AI Pipelines

Probity; Chantilly (VA); On-site; USD 150,000 - 190,000; Full time

Job summary

Probity in Chantilly, VA seeks a Data Engineer to design, ingest, cleanse, transform, load, and display large data sets for AI/ML analytics. You will build and optimize ETL pipelines, work with Python/Java and SQL, and collaborate with data scientists to deliver scalable data solutions.

The role requires hands-on Big Data experience, RESTful APIs, and familiarity with Linux environments. A Top Secret/SCI clearance with polygraph is required for consideration.

Qualifications

• Proven experience with data extraction, cleansing, transformation and loading.
• Strong programming in Python/Java with SQL expertise.
• Experience with Big Data, ETL pipelines and RESTful APIs.

Responsibilities

• Design, implement and optimize large-scale data ingest and transformation pipelines.
• Develop ad-hoc ETL processes to analyze new data sources.
• Collaborate with data scientists to support AI/ML analytics pipelines.
• Maintain data layer documentation and ensure data quality.
• Support Linux server administration as needed.
• Evaluate and communicate risks and constraints of software solutions.

Skills

Python

Java

SQL

RESTful APIs

Apache Airflow

Education

High School Diploma or GED

Tools

Linux

FastAPI

Apache Airflow

Job description

Probity in Chantilly, VA seeks a Data Engineer to design, ingest, cleanse, transform, load, and display large data sets for AI/ML analytics. You will build and optimize ETL pipelines, work with Python/Java and SQL, and collaborate with data scientists to deliver scalable data solutions.

The role requires hands-on Big Data experience, RESTful APIs, and familiarity with Linux environments. A Top Secret/SCI clearance with polygraph is required for consideration.