Remote Scala Data Engineer — Spark/Hive on CDP

Torrey Holistics; Newark (NJ); On-site; USD 120,000 - 160,000; Full time

Job summary

Torrey Holistics is seeking a Senior Scala Developer / Data Engineer to maintain and evolve a large-scale Medicaid data processing framework. You will own the Scala/Spark application stack, Drools rules, and data ingestion pipelines, while ensuring reliability on the Cloudera Data Platform.

Remote US-based role with potential 12-month contracting terms. The candidate will work across Linux environments, optimize Spark/Hive workloads, and coordinate deployments with infrastructure teams.

Qualifications

• Minimum 7 years of experience developing enterprise-scale distributed data processing applications.
• Strong hands-on development experience with Scala.
• Experience with Apache Spark 2.x and/or Spark 3.x.
• Experience deploying on Cloudera Data Platform (CDP) 7.x or equivalent Hadoop distributions.
• Experience with Hive 3.x for data processing and Hive table management.
• Experience implementing business rules using the Drools Rules Engine.
• Strong SQL development and query optimization skills.
• Experience supporting Linux-based production environments.
• Experience troubleshooting distributed Spark applications in production.
• Experience using Git and modern version control practices.

Responsibilities

• Own Scala/Spark framework for Medicaid Encounter Processing.
• Own Drools rule implementation and maintenance.
• Own data ingestion and Spark/Hive batch workflows.
• Own production issue investigation and defect resolution.
• Own releases, version management, and deployment coordination.
• Own performance tuning and operational documentation.
• Provide basic operational administration of Cloudera Data Platform.

Skills

Scala

Apache Spark

Hive

Drools

SQL

Linux

Git

Tools

Cloudera Data Platform (CDP)

Hadoop

Apache Hive

IBM DataStage

AWS

Job description

Torrey Holistics is seeking a Senior Scala Developer / Data Engineer to maintain and evolve a large-scale Medicaid data processing framework. You will own the Scala/Spark application stack, Drools rules, and data ingestion pipelines, while ensuring reliability on the Cloudera Data Platform.

Remote US-based role with potential 12-month contracting terms. The candidate will work across Linux environments, optimize Spark/Hive workloads, and coordinate deployments with infrastructure teams.