Senior Big Data Engineer: Spark, AWS & ML Deployments

Disys - Oak Brook; Tampa (FL); On-site; USD 90,000 - 120,000; Full time

Job summary

A technology consulting firm based in Florida is seeking a qualified candidate for a critical role involving the design of data pipelines and the deployment of machine learning models. Ideal applicants should have strong skills with Apache Spark and SCALA, along with experience in AWS services. This role requires collaboration across engineering and data science teams to build scalable data solutions. Suitable candidates will have a graduate degree in Computer Science or a related field and a passion for innovative problem-solving.

Qualifications

• 2+ years of experience in data ingesting, cleansing, and processing.
• Hands-on experience with model deployment and application deployment.
• Experience in building stable, scalable, and high-speed live streams.

Responsibilities

• Design interfaces to the data warehouses and machine learning applications.
• Interface with various teams to ensure data pipelines fit within the production framework.
• Deploy the machine learning model and serve outputs as RESTful API calls.

Skills

Apache Spark (Spark SQL)

SCALA

Java

AWS Big Data components

Docker

Kubernetes

Linux scripting

ETL processes

Apache KAFKA

Hadoop

AGILE development

Education

Graduation (MS or Undergraduate) in Computer Science/Engineering/relevant field

Tools

AWS

Docker

Kubernetes

Apache Spark

MapReduce

Hive

HBase

Job description

A technology consulting firm based in Florida is seeking a qualified candidate for a critical role involving the design of data pipelines and the deployment of machine learning models. Ideal applicants should have strong skills with Apache Spark and SCALA, along with experience in AWS services. This role requires collaboration across engineering and data science teams to build scalable data solutions. Suitable candidates will have a graduate degree in Computer Science or a related field and a passion for innovative problem-solving.