ML Data Engineer

DataJobs; Irving (TX); On-site; USD 115,000 - 135,000; Full time

Job summary

DataJobs in Irving, TX is seeking a production-focused AI/ML engineer to build and operationalize model pipelines across on-prem and cloud systems. You will partner with data scientists to turn prototypes into production-ready code using PySpark and Python within a Hadoop environment.

You will deploy and monitor AI/ML models on AWS/GCP, apply MLOps practices, and continuously improve performance, scalability, and user experience. On-site role with a competitive salary of USD 124,560 per year.

Qualifications

• Strong experience with PySpark and Python to integrate with AI/ML models.
• Understanding of AI/ML models with on-prem and cloud environments.
• Familiarity with MLOps/LLMOps and distributed systems.
• Experience with big data platforms such as Cloudera Hadoop and cloud platforms such as AWS and GCP.
• Solid understanding of system design patterns, scalability, observability, and performance tuning.
• Strong analytical and problem-solving skills.
• Interest in exploring and building with emerging technologies.

Responsibilities

• Partner with data scientists and data engineers to productionize prototypes.
• Collaborate with product and engineering to deploy AI/ML models using PySpark.
• Productionalize AI/ML models within a Hadoop environment.
• Troubleshoot AI/ML models post-implementation.
• Monitor model performance and continuously improve efficiency and user experience.

Skills

PySpark

Python

MLOps/LLMOps

Distributed systems

Cloudera Hadoop

AWS

GCP

System design patterns

Scalability

Observability

Performance tuning

Analytical skills

Tools

OpenShift

Kubernetes

Hadoop

Cloudera Hadoop

AWS

GCP

Job description

This role focuses on building and operationalizing AI/ML model pipelines across on-prem and cloud systems.

Responsibilities

• Partner with data scientists and data engineers to convert prototypes and theoretical work into production-ready code


• Collaborate with product and engineering teams to implement AI/ML models using PySpark


• Productionalize AI/ML models within a Hadoop environment


• Troubleshoot AI/ML models after implementation to address issues raised by users


• Monitor model performance and continuously improve efficiency, accuracy, and user experience

Requirements

• Strong experience with PySpark and Python to integrate with AI/ML models


• Understanding of AI/ML models and how they integrate with on-prem and cloud environments


• Familiarity with MLOps/LLMOps and distributed systems


• Experience with big data platforms such as Cloudera Hadoop and cloud platforms such as AWS and GCP


• Solid understanding of system design patterns, scalability, observability, and performance tuning


• Strong analytical and problem-solving skills


• Interest in exploring and building with emerging technologies

Tech Stack

• Python, PySpark


• OpenShift, Kubernetes


• Hadoop, Cloudera Hadoop


• AWS, GCP

Location & Compensation

• Location: Irving, TX (onsite)


• Salary: USD 124,560 per year

Note: The structured data lists additional required skills as “DevOps Engineer Senior Email Security Engineer,” but no further details are provided.