Senior Data Engineer: Healthcare Data Pipelines

SOMERSET STAFFING; Center Square (PA); On-site; USD 120,000 - 180,000; Full time

Job summary

SOMERSET STAFFING is seeking a Senior Data Engineer to build complex data pipelines on a cutting-edge Data Ingestion Platform and supporting Big Data/Analytics products. You will ensure timely data delivery across products to enable revenue in a fast-paced environment.

The role requires strong experience with Hadoop, Spark, SQL, Linux, and shell scripting, plus healthcare data knowledge. You will mentor juniors and help drive SAFe-aligned delivery in a collaborative team.

Qualifications

• 5+ years experience with data aggregation, standardization, linking, quality check mechanisms, and reporting.
• 5+ years experience with Hadoop and Spark.
• 5+ years experience with Oracle or MS SQL Server and SQL or ETL tools.
• Strong Linux understanding; shell scripting and file systems knowledge.
• Bachelor's degree in Computer Science, Engineering, or related field with 8–10 years' experience.

Responsibilities

• Build data pipelines to load source data into data lake on the proprietary platform.
• Support and improve data ingestion processes for healthcare data applications.
• Develop and maintain data engineering processes using T-SQL, Spark, Scala, and shell scripting.
• Improve process efficiencies and data performance.
• Review and test data for accuracy before loading into data lake.
• Perform data analysis, data mining, and root-cause investigations.
• Collaborate with Technical Operations to troubleshoot database issues including OS and storage.
• Provide off-hours support for production issues.
• Mentor junior team members on data engineering and quality best practices.
• Oversee delivery of business priorities in SAFe environment.

Skills

Data aggregation

Hadoop

Spark

SQL & RDBMS

Linux

Shell scripting

Education

Bachelor's degree in Computer Science or Engineering

Tools

T-SQL

Spark

Scala

Shell scripting

Job description

SOMERSET STAFFING is seeking a Senior Data Engineer to build complex data pipelines on a cutting-edge Data Ingestion Platform and supporting Big Data/Analytics products. You will ensure timely data delivery across products to enable revenue in a fast-paced environment.

The role requires strong experience with Hadoop, Spark, SQL, Linux, and shell scripting, plus healthcare data knowledge. You will mentor juniors and help drive SAFe-aligned delivery in a collaborative team.