Machine Learning Engineer

York Solutions, LLC; Brooklyn Park (MN); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

BCBS Medical with multiple plan options

Delta Dental plan

Eye Med Vision plan

Life and Accidental Death Insurance

401(k) Retirement Plan

Voluntary Insurance programs

Flexible work environment

Team-oriented culture

Learning and development opportunities

Job summary

A technology solutions company is hiring a Machine Learning Engineer to support and maintain workflows that generate forecasts. Key responsibilities include ensuring smooth operations, enhancing job performance, and implementing monitoring solutions. Proficiency in Python, Spark, and experience with orchestration tools are required. The role offers a flexible work environment and a strong focus on collaboration and continuous improvement.

Qualifications

• Proficiency with Python (PySpark), Bash, and experience with R.
• Experience with Apache Spark on YARN‑managed clusters.
• Familiarity with workflow orchestration tools.
• Strong background in job monitoring and troubleshooting in distributed environments.
• Knowledge of observability/monitoring practices.

Responsibilities

• Ensure smooth daily operations including monitoring jobs to minimize downtime.
• Contribute development expertise by enhancing job functionality and performance.
• Implement observability metrics and monitoring solutions.
• Collaborate via GitHub and identify improvement opportunities.

Skills

Python (PySpark)

Bash

R

Apache Spark

Airflow

Terraform

Job monitoring and troubleshooting

Observability practices

GitHub workflows

Job description

***At this time, we are unable to consider candidates requiring visa sponsorship or third-party recruitment agencies for this role. We thank you for your understanding.***

York Solutions is hiring a Machine Learning Engineer. You will support and maintain critical batch workflows that generate large-scale forecasts. These workflows are orchestrated through a custom in-house scheduling tool and leverage R, Python, Bash, and Spark on a YARN‑managed on‑premise cluster.

Location: 2 days per week onsite - Brooklyn Park, MN or Remote

Responsiblities:

• The engineer will be responsible for ensuring smooth daily operations, including monitoring, restarting, and troubleshooting jobs to minimize downtime and maintain system reliability.
• Strong problem‑solving skills and the ability to quickly diagnose issues across multiple technologies will be key in this role.
• In addition to operations, the engineer will contribute development expertise by enhancing the functionality, stability, and performance of existing jobs. This will include submitting code changes in Python (PySpark), Bash, or Terraform to improve orchestration and infrastructure configurations.
• The role also involves implementing observability metrics and monitoring solutions, using tools such as OTEL, Kibana, REST APIs, and custom instrumentation.
• The ideal candidate will be comfortable collaborating via GitHub (PRs), proactive in identifying improvement opportunities, and effective at balancing operational support with development contributions.

Technical Skills:

• Proficiency with Python (PySpark), Bash, and working knowledge of R
• Experience with Apache Spark on YARN‑managed clusters (large‑scale, on‑premise environments preferred)
• Familiarity with workflow orchestration tools (Airflow, Luigi, or custom equivalents)
• Experience with Terraform (infrastructure‑as‑code)
• Strong background in job monitoring and troubleshooting in distributed environments
• Knowledge of observability/monitoring practices using OTEL, Kibana, REST APIs, and custom metrics instrumentation
• Hands‑on experience with GitHub workflows (pull requests, branching strategies, code reviews)

Soft Skills:

• Strong analytical and troubleshooting skills with attention to detail
• Clear and effective communication, especially in cross‑functional environments
• Ability to prioritize operational stability while driving code improvements
• Proactive mindset with a focus on reliability and continuous improvement
• Collaborative attitude, able to work effectively with developers, data scientists, and operations staff

Benefits:

• BCBS Medical with 3 Plans to choose from (PPO and High deductible PPO plans with Health Savings Program)
• Delta Dental plan with 2 free cleanings and insurance discounts
• Eye Med Vision with annual check‑ups and discounts on lens
• Life and Accidental Death Insurance paid by company
• John Hancock 401(k) Retirement Plan with discretionary company match
• Voluntary Insurance programs such as: Hospital Indemnity, Identity Protection, Legal Insurance, Long Term Care, and Pet Insurance.
• Flexible work environment with some remote working opportunities
• Strong fun and teamwork environment
• Learning, development, and career growth