Software Architect

Machinify

United States

Remote

USD 230,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical benefits
Dental benefits
Vision benefits
Tuition reimbursement
401(k) with company match
Unlimited PTO
Equity
Flexible environment

Job summary

Machinify is seeking a Software Architect to own the design and implementation of our intelligent document processing and agentic evaluation framework. This hands-on, senior staff role sets the architectural direction for how our platform ingests, understands, and reasons over complex healthcare documents at scale.

You will design APIs and abstractions, write production code in Python, mentor engineers, and drive reliability, observability, and performance in AI systems used across health plans.

Qualifications

  • 10+ years of software engineering with ownership of system architecture at scale.
  • Experience designing Python-based frameworks and idiomatic APIs in Python/Scala/Java.
  • Ability to define abstractions and boundaries in complex systems.
  • Experience architecting agentic or multi-step reasoning systems with LLMs in production.
  • Strong background in processing unstructured data like documents and medical records.
  • Proficiency in API design and building platforms for other engineers.
  • Track record of productionizing AI/ML systems with reliability and observability.

Responsibilities

  • Own the architecture of the intelligent document processing platform and agentic evaluation framework.
  • Design abstractions and interfaces enabling agentic workflows to reason over medical records and claims data.
  • Define boundaries among orchestration, retrieval, LLM interaction, and domain logic; ensure scalability.
  • Write production code and lead through implementation, not just design documents.
  • Make foundational decisions on prompt architecture, multi-modal LLM integration, and RAG patterns.
  • Drive reliability and observability in healthcare-grade AI systems.
  • Collaborate with Data Science, Data Engineering, and Product to translate requirements into design.
  • Reduce technical debt and establish scalable architectural patterns.
  • Mentor engineers on system design, API design, and building production-grade AI systems.

Skills

Software architecture
Python
Scala/Java
API design
Distributed systems
LLM integration
System performance
Mentoring
CS fundamentals

Education

Bachelor's or Master's degree in Computer Science, or equivalent experience

Tools

Spark
Flink
Kafka
Airflow
Ray
Prometheus
Grafana

Job description

JD for Software Architect: Software Architect | Intelligent Document Processing & Agentic Systems

Location: Remote - US

About Machinify

Machinify is a healthcare intelligence platform deployed across 85+ health plans, serving over 270 million lives. We build AI-powered systems for payment integrity and audit solutions that optimize financial outcomes and reduce healthcare costs — processing hundreds of millions of documents and validating millions of claims annually.

The Role

We are seeking a Software Architect to own the design and implementation of our intelligent document processing and agentic evaluation framework. This is a hands-on, Senior Staff-level technical leadership role responsible for setting the architectural direction for how our platform ingests, understands, and reasons over complex healthcare documents at scale. This role requires both architectural vision and strong implementation skills. You will design the APIs, abstractions, and frameworks that power agentic case analysis — and build them alongside a team of experienced engineers. The ideal candidate brings deep expertise in system design, has strong convictions about where abstraction boundaries belong, and writes Python that sets the standard for the team.

What You'll Do
  • Own the architecture of Machinify's intelligent document processing platform and agentic evaluation framework — from API design to implementation
  • Design abstractions and interfaces that enable agentic workflows to reason over medical records, claims data, and unstructured healthcare documents
  • Define the boundaries between orchestration, retrieval, LLM interaction, and domain logic — creating a framework that is principled yet pragmatic. Ensure the system scales.
  • Write performant production code — this is a hands-on role where you lead through implementation, not solely through design documents
  • Make foundational technology decisions around prompt architecture, multi-modal LLM integration, RAG patterns, and workflow orchestration
  • Drive reliability and observability into AI systems that must operate at healthcare-grade standards
  • Collaborate closely with Data Science, Data Engineering, and Product teams to translate complex domain requirements into clean system design
  • Reduce technical debt and establish architectural patterns that scale with the platform
  • Mentor engineers on system design, API design, and building production-grade AI systems
What We're Looking For
  • 10+ years of software engineering experience with a proven track record of owning system architecture at scale
  • Experience with Python & Scala/Java — deep experience designing Python-based frameworks and writing idiomatic, well-structured APIs in Python and Scala/Java
  • Demonstrated ability to design effective abstractions: knowing when to generalize, when to keep things concrete, and where to draw boundaries in complex systems
  • Experience architecting agentic or multi-step reasoning systems that integrate LLMs into production workflows — framework-agnostic design thinking is valued over familiarity with any specific tool
  • Strong background in designing large-scale systems that process unstructured data such as documents, medical records, and images
  • Deep understanding of API design principles and building platforms that other engineers build upon
  • Proven ability to productionize AI/ML systems with a focus on reliability, observability, and maintainability
  • Strong experience with designing with system performance and scaling trade-offs in mind
  • Strong CS fundamentals — data structures, distributed systems, asynchronous programming
  • Bachelor's or Master's degree in Computer Science, or equivalent experience
  • Nice to Have Experience with Spark, Flink, Kafka, Airflow, or Ray Knowledge of Prometheus, Grafana, and observability tooling Background in healthcare, fintech, or other regulated industries Cross-functional collaboration experience with data scientists and ML engineers
What We Offer

Work from anywhere in the US! Machinify is digital-first. Top Medical/Dental/Vision offerings FSA/HSA Tuition reimbursement Competitive salary, 401(k) with company match Unlimited PTO Additional health and wellness benefits and perks Flexible and trusting environment where you’ll feel empowered to do your best work

The salary for this position is based on an array of factors unique to each candidate: Such as years and depth of experience, set skills, certifications, etc. We are hiring for different levels and the base salary can range from $230k-$280k+ based on your assessed level. Compensation also includes meaningful equity, healthcare, unlimited PTO, and more.

Equal Employment Opportunity at Machinify

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace. Machinify is an employment at will employer. We participate in E-Verify as required by applicable law. In accordance with applicable state laws, we do not inquire about salary history during the recruitment process. If you require a reasonable accommodation to complete any part of the application or recruitment process, please let our recruiters know. See our Candidate Privacy Notice at:

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff ML Engineer
Staff ML Engineer

Machinify • United States

Remote
USD 180,000 - 250,000
Work from anywhere in the US
Medical/Dental/Vision
FSA/HSA
+3
Staff ML Engineer
Staff ML Engineer

The Rawlings Group • United States

Remote
USD 180,000 - 250,000
Work from anywhere in the US
Top medical/dental/vision
FSA/HSA
+4
Staff Machine Learning Engineer job at Machinify in US National
Staff Machine Learning Engineer job at Machinify in US National

Machinify • United States

Remote
USD 180,000 - 250,000
Top Medical/Dental/Vision
401(k) with company match
Unlimited PTO
+3
Staff AI Engineer | Agentic Systems
Staff AI Engineer | Agentic Systems

The Rawlings Group • United States

Remote
USD 180,000 - 300,000
Work from anywhere in the US
Medical/Dental/Vision benefits
Tuition reimbursement
+1
Director | Engineering, ML
Director | Engineering, ML

Rawlings Company • United States

Remote
USD 190,000 - 260,000
Top medical/ dental/ vision coverage
FSA/HSA
Tuition reimbursement
+4
Senior Data Engineer
Senior Data Engineer

Machinify • United States

Remote
USD 180,000 - 220,000
Medical/Dental/Vision for employees &/
Unlimited PTO
Equity & 401(k) with employer match
Staff AI Engineer | Agentic Systems
Staff AI Engineer | Agentic Systems

Machinify • United States

Remote
USD 180,000 - 260,000
Digital-first company
Top health coverage
FSA/HSA
+4
Senior Software Engineer, Backend | Audit Product Team
Senior Software Engineer, Backend | Audit Product Team

The Rawlings Group • United States

Remote
USD 200,000 - 230,000
Work from anywhere in the US
Top Medical/Dental/Vision
FSA/HSA
+5
Remote Senior Backend Engineer — AI‑Driven Health Platform
Remote Senior Backend Engineer — AI‑Driven Health Platform

The Rawlings Group • United States

Remote
USD 200,000 - 230,000
Work from anywhere in the US
Top Medical/Dental/Vision
FSA/HSA
+5
Senior Data Engineer
Senior Data Engineer

Rawlings Company • United States

Remote
USD 180,000 - 220,000
Remote US
Healthcare
Unlimited PTO
+3