TS/SCI Spark Data Engineer — Cloud Pipelines & Analytics

GRVTY; Tysons (VA); On-site; USD 120,000 - 190,000; Full time

Job summary

GRVTY is seeking a Spark Data Engineer in Tysons, VA, requiring a TS/SCI with Poly clearance to join a high-impact project. You will build and manage robust data pipelines, leverage AWS services, and work with Spark and Python on secure data platforms.

The ideal candidate has strong SQL skills, experience with diverse data formats, and a background in Linux scripting and unit testing to ensure reliable data processing and validation in a federal contracting environment.

Qualifications

• Active TS/SCI with Polygraph Clearance is required.
• Demonstrated experience building and managing data pipelines.
• Proficient in Python programming.
• Hands-on experience with AWS cloud services.
• Experience processing data with Apache Spark.
• Strong SQL skills with RDBMS (Postgres/Oracle/MySQL).
• Proficiency with Linux and shell scripting.
• Experience handling data in csv/xml/json/avro/parquet formats.
• Ability to write and validate unit tests.

Skills

Active TS/SCI with Polygraph Clearance

Data pipelines

Python

AWS

Apache Spark

SQL & RDBMS

Linux shell scripting

Data formats (csv, xml, json, avro,Par

Unit tests

Tools

EMR/Spark cluster

Apache Airflow

NiFi

Job description

GRVTY is seeking a Spark Data Engineer in Tysons, VA, requiring a TS/SCI with Poly clearance to join a high-impact project. You will build and manage robust data pipelines, leverage AWS services, and work with Spark and Python on secure data platforms.

The ideal candidate has strong SQL skills, experience with diverse data formats, and a background in Linux scripting and unit testing to ensure reliable data processing and validation in a federal contracting environment.