Senior ML Platform Engineer - Real-Time & Batch

Parafin; United States; On-site; USD 220,000 - 265,000; Full time

Benefits offered by this job

Equity grant

Insurance

Remote work

Unlimited PTO

Commuter benefits

Free lunches

Parental leave

401(k)

EAP

Job summary

Parafin is hiring a Software Engineer for its Infrastructure team to lead the evolution of the ML Platform powering underwriting and other ML-driven products. You will design, build, and maintain core abstractions and platforms that let data scientists ship high-quality models to production—safely and quickly.

You’ll partner with Data Science and Platform Engineering, own the ML platform end-to-end, and develop batch and real-time underwriting infrastructure.

Qualifications

• 5+ years of software engineering experience including ML platform/MLOps experience.
• Strong Python and SQL fundamentals with Spark/PySpark experience.
• Knowledge of ML fundamentals and model evaluation, drift, monitoring.
• Experience with AWS, Databricks, MLflow/registry, and Airflow.
• Experience building real-time and batch pipelines at scale.
• Proficiency in feature-store concepts and model serving.
• Strong communication and cross-functional collaboration skills.

Responsibilities

• Turn notebooks into reusable software components with clear interfaces.
• Create developer-friendly ML abstractions—SDKs, CLIs, and templates.
• Build and scale a real-time ML inference platform.
• Enhance batch ML inference: scheduling, cost controls, observability.
• Own offline/online feature store design and semantics.
• Instrument training/inference for latency, throughput and cost; build dashboards.
• Collaborate with Data Science and Platform Eng to support underwriting systems.

Skills

Python

SQL

Spark/PySpark

ML Platform

AWS

Databricks

Airflow

Real-time systems

Feature store

Model serving

Communication

Tools

Databricks

MLflow

Kafka/Kinesis

Job description

Parafin is hiring a Software Engineer for its Infrastructure team to lead the evolution of the ML Platform powering underwriting and other ML-driven products. You will design, build, and maintain core abstractions and platforms that let data scientists ship high-quality models to production—safely and quickly.

You’ll partner with Data Science and Platform Engineering, own the ML platform end-to-end, and develop batch and real-time underwriting infrastructure.