Spark Data Engineer

GRVTY; Tysons (VA); On-site; USD 120,000 - 190,000; Full time

Job summary

GRVTY is seeking a Spark Data Engineer in Tysons, VA, requiring a TS/SCI with Poly clearance to join a high-impact project. You will build and manage robust data pipelines, leverage AWS services, and work with Spark and Python on secure data platforms.

The ideal candidate has strong SQL skills, experience with diverse data formats, and a background in Linux scripting and unit testing to ensure reliable data processing and validation in a federal contracting environment.

Qualifications

• Active TS/SCI with Polygraph Clearance is required.
• Demonstrated experience building and managing data pipelines.
• Proficient in Python programming.
• Hands-on experience with AWS cloud services.
• Experience processing data with Apache Spark.
• Strong SQL skills with RDBMS (Postgres/Oracle/MySQL).
• Proficiency with Linux and shell scripting.
• Experience handling data in csv/xml/json/avro/parquet formats.
• Ability to write and validate unit tests.

Skills

Active TS/SCI with Polygraph Clearance

Data pipelines

Python

AWS

Apache Spark

SQL & RDBMS

Linux shell scripting

Data formats (csv, xml, json, avro,Par

Unit tests

Tools

EMR/Spark cluster

Apache Airflow

NiFi

Job description

GRVTY is seeking a Spark Data Engineer with a TS/SCI + Poly clearance (applicable to this customer) to join one of our top projects in Tysons, VA.

What You Must Have

• Active TS/SCI with Polygraph Clearance
• Demonstrated experience building and managing data pipelines
• Demonstrated experience with Python.
• Demonstrated experience with cloud computing using AWS services.
• Demonstrated experience processing data using Apache Spark.
• Demonstrated experience with an RDBMS (Postgres, Oracle, MySQL) and writing SQL queries.
• Demonstrated experience with Linux and shell scripting.
• Demonstrated experience analyzing data in different file formats like csv, xml, json, avro, parquet, etc.
• Demonstrated experience writing and validating unit tests.

What Would be Nice to Have

• Demonstrated experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines.
• Demonstrated experience with Java or Scala.
• Demonstrated experience administering an EMR/Spark cluster
• Demonstrated experience conducting performance tuning of a spark job
• Demonstrated experience developing cloud-based security solutions
• Demonstrated experience following a configuration mgmt. process to review and deploy code as part of releases

Pay Range:

At GRVTY, we understand that compensation is influenced by many factors—such as geographic location, federal contract labor categories, wage rates, prior experience, skillsets, education, and certifications.We’re proud to offer a work environment that empowers our team to achieve a strong work-life balance. GRVTY provides competitive pay, comprehensive benefits, and meaningful opportunities for professional growth.Our benefits package is designed to support the well-being of our employees and their families, and includes coverage in areas such as healthcare, financial wellness, retirement planning, family assistance, continued education, and paid time off.