ML Engineer - Observability & PySpark Orchestration

York Solutions, LLC; Brooklyn Park (MN); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

BCBS Medical with multiple plan options

Delta Dental plan

Eye Med Vision plan

Life and Accidental Death Insurance

401(k) Retirement Plan

Voluntary Insurance programs

Flexible work environment

Team-oriented culture

Learning and development opportunities

Job summary

A technology solutions company is hiring a Machine Learning Engineer to support and maintain workflows that generate forecasts. Key responsibilities include ensuring smooth operations, enhancing job performance, and implementing monitoring solutions. Proficiency in Python, Spark, and experience with orchestration tools are required. The role offers a flexible work environment and a strong focus on collaboration and continuous improvement.

Qualifications

• Proficiency with Python (PySpark), Bash, and experience with R.
• Experience with Apache Spark on YARN‑managed clusters.
• Familiarity with workflow orchestration tools.
• Strong background in job monitoring and troubleshooting in distributed environments.
• Knowledge of observability/monitoring practices.

Responsibilities

• Ensure smooth daily operations including monitoring jobs to minimize downtime.
• Contribute development expertise by enhancing job functionality and performance.
• Implement observability metrics and monitoring solutions.
• Collaborate via GitHub and identify improvement opportunities.

Skills

Python (PySpark)

Bash

R

Apache Spark

Airflow

Terraform

Job monitoring and troubleshooting

Observability practices

GitHub workflows

Job description

A technology solutions company is hiring a Machine Learning Engineer to support and maintain workflows that generate forecasts. Key responsibilities include ensuring smooth operations, enhancing job performance, and implementing monitoring solutions. Proficiency in Python, Spark, and experience with orchestration tools are required. The role offers a flexible work environment and a strong focus on collaboration and continuous improvement.