Data Engineer with Scala/Spark and Java

Comtech LLC; San Jose (CA); On-site; USD 110,000 - 130,000; Full time

Job summary

A woman-owned small business based in San Jose is seeking an experienced data engineer with over 8 years of expertise in Java, Python, and Scala. The ideal candidate will have a solid background in Spark and Machine Learning, with responsibilities including gathering and processing large data sets, collaborating with engineering teams, and performing extensive data analysis to support business decision-making. This is an excellent opportunity to contribute to innovative data solutions in a dynamic environment.

Qualifications

• 8+ years of experience in Java, Python, and Scala.
• Experience with Spark and Machine Learning.
• Expertise in data mining and analysis.

Responsibilities

• Gather and process raw data at scale.
• Work with engineering teams to build algorithms.
• Analyze unstructured data for insights.
• Support business decisions with ad hoc analysis.

Skills

Java

Python

Scala

Spark

Machine Learning

Data mining

Data analysis

Education

Bachelors or Masters in related field

Job description

Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.

Job Description

Primary Skills:

• 8+ years exp in Java, Python and Scala
• With Spark and Machine Learning (3+)
• Data mining, Data analysis

Roles and Responsibilities:

• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
• Work closely with our engineering team to integrate and build algorithms
• Process unstructured data into a form suitable for analysis – and then do the analysis.
• Support business decisions with ad hoc analysis as needed
• Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
• Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
• Establish and maintain effective processes for validating and updating predictive models
• Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
• Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
• Perform statistical analysis to prioritize in order to maximize success
• Identify areas for improvement, communicating action plans
• Perform strategic data analysis and research to support business needs
• Identify opportunities to improve productivity via sophisticated statistical modeling
• Explore data to identify opportunities to improve business results
• Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
• Gain understanding of business needs and necessary analysis where appropriate through internal discussion
  

Qualifications

Bachelors or Masters in related field

Additional Information

All your information will be kept confidential according to EEO guidelines.