Senior Data Engineer

Insight Global; Irving (TX); Remote; USD 130,000 - 170,000; Full time

Benefits offered by this job

Fully remote

Job summary

Insight Global is seeking a Senior Data Engineer for a long-term contract supporting a major healthcare PBM client within Analytics & Behavioral Change. The role focuses on building scalable data pipelines in Azure and GCP using Databricks, Python, PySpark and Spark SQL, with an emphasis on AI-assisted development and GenAI capabilities.

The candidate will contribute to the Connected PBM Ecosystem, modernizing legacy processes and accelerating automation, with onsite interview options in

Qualifications

• 10+ years of data engineering experience with large-scale data solutions.
• Advanced hands-on Python, PySpark, SQL/Spark SQL skills.
• 8+ years with Azure data services and Databricks; 5+ years with GCP.

Responsibilities

• Design and develop data pipelines and data products at scale.
• Test, debug, and support reliable data solutions across Azure and GCP.
• Collaborate to onboard clients into Connected PBM Ecosystem and drive automation.

Skills

Python

PySpark

SQL

Spark SQL

REST APIs

Kubernetes

Kafka

Event-driven

Distributed systems

Data analytics mindset

Healthcare domain

PBM domain

Generative AI

RAG

Education

Cloud/data engineering certifications (Azure, Databricks)

Tools

Databricks

Azure data services

GCP

Job description

Job Description

Insight Global is seeking a Senior Data Engineer for a long-term contract opportunity supporting a large healthcare client's Pharmacy Benefit Management (PBM) business within its Analytics & Behavioral Change organization. This team sits at the intersection of technology, finance, and business strategy, using data and analytics to drive automation and business insights.

This individual will contribute to the Connected PBM Ecosystem, a strategic portfolio initiative focused on onboarding the next generation of clients into the ecosystem, modernizing legacy and manual processes, and accelerating automation and access to business insights.

This is a hands‑on engineering role responsible for understanding requirements, designing and developing new data pipelines, enhancing existing solutions, testing, debugging, and supporting reliable data products at scale. The environment spans Azure and GCP, with significant use of Databricks, Python, PySpark, Spark SQL, and related data engineering frameworks.

The team also leverages Claude Code for AI‑assisted development. Knowledge of Generative AI, agentic development, RAG, and broader AI concepts is preferred, as upcoming initiatives are expected to incorporate GenAI capabilities and provide opportunities to drive additional automation and efficiency.

This is a fully remote role with the potential for ongoing annual extensions and full‑time conversion. When feasible, the client prefers to conduct technical interviews onsite in Chicago, NYC, or Irving, TX. Candidates who cannot interview onsite will be required to complete ID verification and provide verifiable managerial references as part of Insight Global's prescreening process.

Skills and Requirements

• 10+ years of Data Engineering experience, with a strong track record of designing, building, and supporting large‑scale, reliable data solutions
• Advanced hands‑on experience with Python, PySpark, and SQL/Spark SQL
• 8+ years of experience with Azure data services and Databricks
• 5+ years of hands‑on experience with GCP
• Strong experience designing and building microservices‑based architectures, such as REST APIs, containerization, Kubernetes, Kafka, event‑driven architectures, and or scalable distributed systems
• Strong data analytics mindset with the ability to translate business requirements into scalable technical solutions
• Healthcare industry experience
• Pharmacy Benefit Manager (PBM) / Pharmacy Benefit Management domain experience
• Experience with Generative AI, agentic development, and RAG architectures
• Ability to interview in person in Chicago, NYC, or Irving, TX
• Relevant cloud, data engineering, or Databricks certifications

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].