Senior Data Engineer - Spark/Scala on CDP (Remote)

Intone Inc; Northern (KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Intone Inc. is seeking a Senior Data Engineer to serve as the technical owner of Nebraska's enterprise data processing framework supporting Medicaid Encounter Processing. This is a 12-month contract and is based remotely.

You will maintain and enhance a mission-critical platform built in Scala, Apache Spark, Hive, and Drools on the Cloudera Data Platform, providing operational support and scalable data workflows.

Qualifications

• Minimum 7 years building enterprise-scale distributed data processing apps.
• Strong hands-on Scala development experience.
• Experience with Apache Spark 2.x and/or 3.x.
• Experience on CDP 7.x or equivalent Hadoop distributions.
• Experience with Apache Hive 3.x and Hive table management.
• Experience implementing rules with Drools.
• Strong SQL development and performance tuning.
• Experience supporting Linux-based production environments.
• Experience debugging distributed Spark jobs in production.
• Experience using Git and modern version control.

Responsibilities

• Own the Scala/Spark application framework for Medicaid Encounter Processing.
• Own Drools rule implementation and ongoing maintenance.
• Own enterprise data ingestion for master data and source files.
• Own Spark and Hive batch processing workflows.
• Investigate production issues and resolve defects.
• Manage production releases, version control, and deployments.
• Tune performance and optimize applications.
• Develop and maintain technical docs and runbooks.
• Provide ops admin and monitoring for CDP with infra/cloud teams

Skills

Scala

Apache Spark

Cloudera CDP

Hive

Drools

SQL

Linux

Git

Tools

Cloudera Manager

HDFS

YARN

Job description

Intone Inc. is seeking a Senior Data Engineer to serve as the technical owner of Nebraska's enterprise data processing framework supporting Medicaid Encounter Processing. This is a 12-month contract and is based remotely.

You will maintain and enhance a mission-critical platform built in Scala, Apache Spark, Hive, and Drools on the Cloudera Data Platform, providing operational support and scalable data workflows.