Big Data Developer

System Soft Technologies

Chantilly (VA)

On-site

USD 120,000 - 170,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Performance-based bonus

Job summary

System Soft Technologies seeks an experienced Data Engineer with 10+ years of software development to design and optimize large-scale data ingestion, ETL, and processing solutions in a Big Data environment.

The role emphasizes Python/Java development, advanced SQL, Apache Airflow, and Linux-based environments, with opportunities to collaborate on AI/ML analytics and BI dashboards. Onsite location in Chantilly, VA, working hours 9:00 AM – 3:00 PM EST.

Qualifications

  • Design and optimize large-scale data ingestion, ETL, data extraction, cleansing, transformation, and loading pipelines.
  • Strong programming in Python and/or Java with advanced SQL and database knowledge.
  • Hands-on Python technologies including environment management, asynchronous development, FastAPI, and REST APIs.
  • Experience with Big Data environments and data lifecycle from ingestion to visualization.
  • Strong experience with Apache Airflow, ETL development, and Linux-based environments.

Responsibilities

  • Design and optimize large-scale data ingestion, ETL, data extraction, cleansing, transformation, and data loading pipelines.
  • Strong programming experience in Python and/or Java, with advanced SQL and database knowledge.
  • Hands‑on experience with Python technologies, including environment management, asynchronous development, FastAPI, and REST APIs.
  • Experience with Big Data environments and the complete data lifecycle, from data ingestion to visualization.
  • Strong experience with Apache Airflow, ETL development, and Linux‑based environments.
  • Develop data profiling, deduplication, matching logic, and custom data integration solutions.
  • Leverage Big Data for AI/ML‑based analytics and collaborate with Data Scientists to support AI/ML workflows.
  • Maintain data layer documentation and perform basic Linux server administration.

Skills

Python
Java
SQL
FastAPI
REST APIs
Apache Airflow
Big Data
AI/ML analytics
Linux

Education

High School Diploma/GED

Tools

Linux

Job description

Location: Chantilly, VA (100% Onsite)

Employment Type: Full-Time

Security Clearance: Active CI Polygraph Required

Working Hours: 9:00 AM – 3:00 PM EST

Bonus: Performance-Based

Job Summary:

We are seeking an experienced Data Engineer with 10+ years of software development/programming experience to design, develop, and optimize large-scale data ingestion, ETL, data transformation, and processing solutions in a Big Data environment.

Key Responsibilities & Required Skills:
  • Design and optimize large-scale data ingestion, ETL, data extraction, cleansing, transformation, and data loading pipelines.
  • Strong programming experience in Python and/or Java, with advanced SQL and database knowledge.
  • Hands‑on experience with Python technologies, including environment management, asynchronous development, FastAPI, and REST APIs.
  • Experience with Big Data environments and the complete data lifecycle, from data ingestion to visualization.
  • Strong experience with Apache Airflow, ETL development, and Linux‑based environments.
  • Develop data profiling, deduplication, matching logic, and custom data integration solutions.
  • Leverage Big Data for AI/ML‑based analytics and collaborate with Data Scientists to support AI/ML workflows.
  • Maintain data layer documentation and perform basic Linux server administration.
Preferred Skills:
  • Experience deploying AI/ML-enabled solutions.
  • Experience creating and publishing BI dashboards.
Minimum Qualification:

High School Diploma/GED with 10+ years of relevant software development experience

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data Engineer - Onsite ETL & AI/ML (Chantilly)
Senior Big Data Engineer - Onsite ETL & AI/ML (Chantilly)

System Soft Technologies • Chantilly (VA)

On-site
USD 120,000 - 170,000
Performance-based bonus
Data Engineer
Data Engineer

MANTECH • Chantilly (VA)

On-site
USD 110,000 - 150,000
Big Data Engineer
Big Data Engineer

Cymertek Corporation • Reston (VA)

On-site
USD 110,000 - 170,000
Data Engineer, Big Data & AI Pipelines
Data Engineer, Big Data & AI Pipelines

Probity • Chantilly (VA)

On-site
USD 150,000 - 190,000
DS Data Engineer 2
DS Data Engineer 2

Probity Inc. • Chantilly (VA)

On-site
USD 150,000 - 190,000
Data Engineer (Senior)
Data Engineer (Senior)

Amatriot Group • Chantilly (VA)

On-site
USD 140,000 - 170,000
Data Engineer
Data Engineer

Bespoketechnologies • Chantilly (VA)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Strategic Staffing Solutions • McLean (VA)

On-site
USD 103,000 - 117,000
Data Engineer with Security Clearance
Data Engineer with Security Clearance

Cornerstone Defense • Chantilly (VA)

On-site
USD 120,000 - 160,000
Medical, Dental and Vision Plans
Generous PTO Policy
401(k)
+11
BIg Data Engineer
BIg Data Engineer

Eliassen Group • McLean (VA)

Hybrid
USD 103,000 - 128,000
Medical, Dental, Vision benefits
401k with company matching
Life insurance