Senior Data Engineer - Big Data Pipelines & Healthcare

Zuven technologies Inc; Center Square (PA); On-site; USD 120,000 - 180,000; Full time

Job summary

Zuven technologies Inc is seeking a Senior Data Engineer to build complex data pipelines on a cutting-edge Data Ingestion Platform and drive data products in the Big Data/Advanced Analytics space.

You will work in a fast-paced environment delivering accurate data across products to enable revenue, with emphasis on healthcare data management, data validation, and performance optimization.

Qualifications

• 5+ years in data aggregation, quality checks, and reporting.
• 5+ years with Hadoop and Spark.
• 8-10 years industry experience with a relevant Bachelor's degree.

Responsibilities

• Build data pipelines per data transformation specs for loading into data lake via proprietary platform.
• Support and improve existing data ingestion processes for healthcare data applications.
• Develop and maintain data engineering processes using T-SQL, Spark, Scala, and shell scripting.
• Develop tools to improve process efficiencies and data performance.
• Review and test data to ensure accuracy before uploading to the data lake.
• Data troubleshooting and analysis.
• Work with Technical Operations to troubleshoot complex DB issues across OS, storage and servers; provide off-hours support.
• Mentor junior team members in data engineering and quality best practices.
• Oversee delivery of business priorities in SAFe environment.

Skills

Data aggregation

Big data tech

SQL

Linux shell

Education

Bachelor's degree in CS/Engineering/related

Tools

T-SQL

Spark

Scala

Job description

Zuven technologies Inc is seeking a Senior Data Engineer to build complex data pipelines on a cutting-edge Data Ingestion Platform and drive data products in the Big Data/Advanced Analytics space.

You will work in a fast-paced environment delivering accurate data across products to enable revenue, with emphasis on healthcare data management, data validation, and performance optimization.