Staff Software Engineer (Spark & Databricks)

Insight Global; Murray (UT); On-site; USD 150,000 - 190,000; Full time

Job summary

Insight Global is seeking a Staff Software Engineer to design, build, and scale a healthcare data platform. This role partners closely with engineering, product, and business stakeholders to deliver high-quality data solutions and drive business outcomes.

The ideal candidate brings deep data platform expertise, leadership experience, and comfort influencing architecture while mentoring engineers in a collaborative Agile environment.

Qualifications

• 10+ years of software engineering or data engineering experience.
• 5+ years in a technical leadership, architect, or staff role.
• Deep expertise in Spark, Python, Scala, Databricks and Big Data patterns.
• Experience building cloud platforms on Azure, AWS or GCP.
• Strong practices: version control, automated testing, CI/CD, Agile.
• Experience designing APIs and web services (REST/JSON/SOAP/XML).
• Excellent written and verbal communication; able to explain complex tech.
• Bachelor's degree in CS/SE or related field.
• Healthcare technology industry experience.
• Experience with clinical/healthcare claims data lifecycle.
• Knowledge of Epic, FHIR, HL7 interoperability standards.
• Experience building healthcare data platforms or analytics solutions.
• History leading initiatives across teams or units.

Responsibilities

• Lead design, development, and optimization of scalable data platform solutions.
• Partner with leadership to define technical roadmaps and strategy.
• Evaluate new technologies and advise on architecture and tooling.
• Gather requirements from stakeholders and translate to technical plans.
• Design and build high-performance data pipelines and cloud data solutions.
• Review code and guide teams on maintainability, performance, and tests.
• Support CI/CD, automated deployments, and dev environments.
• Mentor junior engineers as a trusted technical advisor.
• Drive continuous improvements in architecture and delivery practices.

Skills

Apache Spark

Python

Scala

Databricks

Big Data architectures

Cloud platforms (Azure/AWS/GCP)

CI/CD pipelines

REST APIs

Communication skills

Leadership / staff-level

Education

Bachelor's degree in Computer Science or related field

Tools

Azure

AWS

GCP

Job description

Job Description

We are seeking a Staff Software Engineer to help design, build, and scale our healthcare data platform. This individual will serve as a technical leader, partnering closely with engineering, product, and business stakeholders to deliver high-quality data solutions that drive business and customer outcomes.

This role is ideal for an experienced engineer who combines deep technical expertise in modern data platforms with the ability to influence architecture decisions, mentor engineers, and drive strategic technology initiatives. The ideal candidate has experience working with large-scale healthcare data, understands claims and clinical data lifecycles, and thrives in a collaborative Agile environment.

Responsibilities

• Lead the design, development, and optimization of scalable data platform solutions.
• Partner with product and engineering leadership to define technical roadmaps and long-term platform strategy.
• Evaluate emerging technologies and provide recommendations on architecture, tooling, and engineering best practices.
• Collaborate with business stakeholders and product teams to gather requirements, estimate work, and translate business needs into technical solutions.
• Design and develop high-performance data pipelines, integrations, and cloud-based data solutions.
• Review code and guide engineering teams on maintainability, scalability, performance, and testing best practices.
• Support and enhance CI/CD processes, automated deployments, and development environments.
• Mentor and develop junior engineers while serving as a trusted technical advisor across multiple teams.
• Drive continuous improvement initiatives related to architecture, delivery practices, and platform performance.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

Skills and Requirements

• 10+ years of software engineering and/or data engineering experience.
• 5+ years of experience serving in a technical leadership, architect, or staff-level engineering role.
• Deep expertise in, Apache Spark, Python, Scala, Databricks, Big Data architectures and design patterns
• Experience building and supporting cloud-based platforms within Azure, AWS, or GCP.
• Strong understanding of modern software development practices, including:
  • Version control
  • Automated testing
  • CI/CD pipelines
  • Agile methodologies
• Experience designing and consuming APIs and web services utilizing REST, JSON, SOAP, XML, and related technologies.
• Excellent written and verbal communication skills with the ability to explain complex technical concepts to both technical and non-technical audiences.
• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Healthcare technology industry experience.
• Experience working with clinical and healthcare claims data throughout its lifecycle.
• Knowledge of healthcare interoperability standards, including: Epic, FHIR, HL7
• Experience building healthcare data platforms, data lakes, or analytics solutions.
• Track record of leading technical initiatives that span multiple teams or business units.