TS/SCI Spark Developer – Scalable Data Pipelines

Absolute Business Solutions Corp.; St. Louis (MO); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

401k Fully Vested with Match

Tuition Assistance Program

Annual Health and Wellness Allowance

Annual Funds for Education and Training

Volunteer Time Off

Charitable Match

Referral Program

Living Our Values awards

Job summary

Absolute Business Solutions Corp. is looking for a talented Apache Spark Developer to enhance NGA’s Data Modernization Services. The position focuses on building efficient data processing pipelines within a secure environment while ensuring optimal performance and reliability.

The ideal candidate will have expertise in Apache Spark and Python, alongside a minimum of 5 years in a relevant role, qualifying for TS/SCI clearance. A competitive benefits package is offered.

Qualifications

• Bachelor's degree plus 5 years' experience in data engineering or Spark development.
• Strong hands-on experience with Apache Spark and Python.
• Experience with Parquet and/or Delta Lake, and distributed data systems.

Responsibilities

• Design, develop, and maintain Apache Spark pipelines using PySpark and/or Scala.
• Optimize Spark jobs, including memory tuning and storage efficiency.
• Integrate Spark pipelines with downstream systems for analytics and AI/ML.

Skills

Apache Spark

Python (PySpark)

Data processing at scale

Performance tuning

Bash / scripting

Education

Bachelor’s degree in a relevant field

Tools

Docker

Kubernetes

CI/CD (Jenkins, Git)

Job description

Absolute Business Solutions Corp. is looking for a talented Apache Spark Developer to enhance NGA’s Data Modernization Services. The position focuses on building efficient data processing pipelines within a secure environment while ensuring optimal performance and reliability.

The ideal candidate will have expertise in Apache Spark and Python, alongside a minimum of 5 years in a relevant role, qualifying for TS/SCI clearance. A competitive benefits package is offered.