Senior Data Engineer - Java, Scala & Spark ML

Comtech LLC; San Jose (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

A woman-owned small business is seeking a skilled Data Engineer in San Jose, CA. The role requires over 8 years of experience, especially in Java, Python, and Scala, alongside strong skills in Spark and Machine Learning. Key responsibilities include gathering and processing large datasets, collaborating with engineering teams, and conducting statistical analyses to inform business decisions. Ideal candidates are proficient in transforming unstructured data into actionable insights, contributing significantly to the organization's data-driven strategies.

Qualifications

• 8+ years of experience in Java, Python, and Scala.
• Experience with Spark and Machine Learning, 3+ years.

Responsibilities

• Gather and process raw data at scale through various means.
• Collaborate with the engineering team to integrate algorithms.
• Process unstructured data for analysis.
• Support business decisions with ad hoc analysis.
• Extract data from relational databases and explore it.
• Analyze health service utilization trends.
• Identify areas for improvement and communicate plans.

Skills

Java

Python

Scala

Spark

Machine Learning

Job description

A woman-owned small business is seeking a skilled Data Engineer in San Jose, CA. The role requires over 8 years of experience, especially in Java, Python, and Scala, alongside strong skills in Spark and Machine Learning. Key responsibilities include gathering and processing large datasets, collaborating with engineering teams, and conducting statistical analyses to inform business decisions. Ideal candidates are proficient in transforming unstructured data into actionable insights, contributing significantly to the organization's data-driven strategies.