TS/SCI Spark Developer for Mission-Critical Data Pipelines

Absolute Business Solutions Corp.; Herndon (VA); Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

401k Fully Vested with Match

Tuition Assistance Program

Annual Health and Wellness Allowance

Career Development Funds

Volunteer Time Off

Charitable Match

Referral Program

Living Our Values awards program

Job summary

Absolute Business Solutions Corp. is seeking an Apache Spark Developer in Herndon, VA to support critical data modernization missions. This role involves designing and maintaining Spark data pipelines and optimizing performance within secure environments. Ideal candidates must have experience in data engineering with strong skills in Apache Spark, Python, and containerization technologies. The position offers flexible hours and other great benefits to foster professional growth and community engagement.

Qualifications

• TS/SCI eligibility with willingness/ability to obtain CI polygraph.
• Strong hands‑on experience with Apache Spark and Python (PySpark).
• Experience with object storage systems (e.g., S3 or equivalent).

Responsibilities

• Design, develop, and maintain Apache Spark pipelines using PySpark and/or Scala.
• Implement Structured Streaming pipelines for near real-time data processing.
• Integrate Spark pipelines with downstream systems including analytics platforms.

Skills

Apache Spark (mandatory)

Python (PySpark)

Data processing at scale

Strong troubleshooting and performance tuning skills

Bash or scripting proficiency

Education

Bachelor's degree plus 5 years experience in data engineering or Spark development

Tools

Docker

Kubernetes

Parquet

Delta Lake

Git

Jenkins (CI/CD)

Job description

Absolute Business Solutions Corp. is seeking an Apache Spark Developer in Herndon, VA to support critical data modernization missions. This role involves designing and maintaining Spark data pipelines and optimizing performance within secure environments. Ideal candidates must have experience in data engineering with strong skills in Apache Spark, Python, and containerization technologies. The position offers flexible hours and other great benefits to foster professional growth and community engagement.