Data Engineer with Java & Scala

Comtech LLC; San Jose (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

A woman-owned small business is seeking a skilled Data Engineer in San Jose, CA. The role requires over 8 years of experience, especially in Java, Python, and Scala, alongside strong skills in Spark and Machine Learning. Key responsibilities include gathering and processing large datasets, collaborating with engineering teams, and conducting statistical analyses to inform business decisions. Ideal candidates are proficient in transforming unstructured data into actionable insights, contributing significantly to the organization's data-driven strategies.

Qualifications

• 8+ years of experience in Java, Python, and Scala.
• Experience with Spark and Machine Learning, 3+ years.

Responsibilities

• Gather and process raw data at scale through various means.
• Collaborate with the engineering team to integrate algorithms.
• Process unstructured data for analysis.
• Support business decisions with ad hoc analysis.
• Extract data from relational databases and explore it.
• Analyze health service utilization trends.
• Identify areas for improvement and communicate plans.

Skills

Java

Python

Scala

Spark

Machine Learning

Job description

Comtech is a woman-owned small business founded in 1998 and headquartered in Reston, VA. We offer IT solutions across the disciplines of program/project management, applications development, infrastructure, Cyber security, and enterprise content/data management services. We have developed our methodologies and processes based on the IT Infrastructure Library (ITIL) v.3 Framework across enterprise infrastructure operations. These methodologies and processes are reinforced through our organization’s externally accredited certifications, which include ISO 9001:2008 Quality Management System (QMS), ISO/IEC 20000-1:2011 IT Service Management Systems (SMS, corporate ITIL certification), ISO 27001:2005 Information Security Management System (ISMS), and CMMI-DEV Level 3

Job Description

Data Engineer
San Jose, CA
3 +(with possibility of extension)

Qualifications

• 8+ years exp in Java, Python and Scala
• With Spark and Machine Learning (3+)

Responsibilities

• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
• Work closely with our engineering team to integrate and build algorithms
• Process unstructured data into a form suitable for analysis – and then do the analysis.
• Support business decisions with ad hoc analysis as needed
• Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
• Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
• Establish and maintain effective processes for validating and updating predictive models
• Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
• Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
• Perform statistical analysis to prioritize in order to maximize success
• Identify areas for improvement, communicating action plans
• Perform strategic data analysis and research to support business needs
• Identify opportunities to improve productivity via sophisticated statistical modeling
• Explore data to identify opportunities to improve business results
• Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
• Gain understanding of business needs and necessary analysis where appropriate through internal discussion