Data Engineer

InductiveHealth Informatics, LLC.; Atlanta (GA); Hybrid; USD 130,000 - 145,000; Full time

Benefits offered by this job

Virtual first culture

Flexible PTO

401(k) matching

Medical coverage

Disability insurance

Life Insurance

Home office setup support

Job summary

InductiveHealth Informatics, LLC. is seeking a Senior Data Engineer to design and operate secure, high-performance data pipelines for real-time and batch public health data.

You will architect scalable solutions and ensure data reliability and compliance across Azure and AWS, partnering with DevOps and product teams to migrate legacy systems. The ideal candidate has hands-on experience with NiFi, Kafka, Python, SQL, and strong documentation skills within a fast-paced, mission-driven environment.

Qualifications

• 3+ years building enterprise data pipelines (or 7+ years in related roles)
• Hands-on with NiFi, Kafka, Python, and SQL in cloud environments
• Experience deploying pipelines in Azure or AWS with IAM, encryption, and secrets management

Responsibilities

• Shaping the future of the data interoperability platform

Skills

Data pipelines

Cloud data platforms

Collaboration

Documentation

Education

Bachelor's degree in CS/IS/Data Eng

Tools

NiFi

Kafka

Python

SQL

Azure

AWS

Job description

Mission + People + Culture

With a corporate Mission to stop disease through technology, InductiveHealth is the market leader in software-as-a-service (SaaS) solutions to public health agencies. Our People come from all backgrounds and walks of life ranging from world class experts in epidemiology, informatics, and disease surveillance to engineers and product teams building high performance, modern solutions. Mission + People are unified around a virtual first Culture centered around teamwork, relentless focus on client outcomes, and individual accountability.

Why work at InductiveHealth?

• 1. Motivation: We value initiative-takers and self-starters who want to contribute to the success of our Team and client outcomes.
• 2. Curiosity: Seeking to understand and comprehend is critical - we expect and encourage questions to master job duties and grow professionally.
• 3. Organization: We are a Team. This means we hold each other accountable and have high expectations for performance and outcomes.
• 4. Feedback: "Open and honest" is part of our corporate values that builds a culture of professional growth to support client success.
• 5. Impact: Your individual contributions will stop the spread of disease and improve individual, community, and population health outcomes.

This role is central to building our future-state architecture by modernizing how public health data moves, transforms, and informs decision-making at scale. You will contribute to the design and implementation of next-generation pipelines, ensure data reliability and compliance, and partner with integration teams on the migration from legacy systems.

As part of a collaborative, agile team, you'll work closely with data architects, integration engineers, data scientists, and product stakeholders to deliver solutions that directly impact public health outcomes. The ideal candidate thrives in complex data environments, is motivated by meaningful mission-driven work, and brings strong technical expertise and a collaborative mindset to help advance our interoperability platform.

What You’ll Be Doing

• Play a key role in shaping the future of our data interoperability platform.
• Design and operate secure, high-performance data pipelines for real-time and batch public health data flows.
• Architect and implement scalable solutions that move sensitive health data reliably and meet strict security and compliance standards.
• Build and optimize ETL/ELT pipelines using NiFi, Kafka, Python, and SQL.
• Build and maintain CI/CD pipelines for NiFi flows, Python, and SQL using GitHub and GitHub Actions, including flow versioning through NiFi Registry and automated promotion across dev, test, and production.
• Deploy and operate data pipelines on Azure and AWS, partnering with DevOps/SRE to integrate them into existing cloud infrastructure and tooling.
• Apply CI/CD best practices: pull request reviews, branch protection, automated testing and validation, parameterized environment configuration, and versioned releases with rollback.
• Collaborate with interoperability, product, and data science teams to migrate legacy pipelines to modern architectures.
• Fine-tune data lakes and ensure smooth data exchange across systems.
• Define monitoring and alerting strategies (e.g., Grafana dashboards and alerts) and create runbooks to support operational teams.
• Troubleshoot production issues to maintain stable and performant pipelines.
• Drive continuous improvement across the data ecosystem through collaboration, innovation, and strong execution.
• Contribute directly to building and delivering high-quality, scalable integrations that drive rapid product progress.
• Collaborate closely with teammates to share knowledge and ensure smooth, efficient development workflows.

What We're Looking For

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 3+ years of experience implementing enterprise-grade data pipelines, or 7+ years of related professional experience (e.g., software, data, or integration engineering) that includes building and operating production data pipelines.
• Hands-on expertise with NiFi, Kafka, Python, and SQL, including designing, operating, and optimizing ETL/ELT pipelines in the cloud.
• Proven ability to build robust, production-grade pipelines from the ground up and work confidently with distributed data systems.
• Hands-on experience deploying and operating data pipelines in Azure or AWS, including secure handling of sensitive data (IAM/RBAC, encryption, secrets management).
• Experience implementing CI/CD best practices for data pipelines with GitHub and GitHub Actions, including NiFi flow versioning and promotion (NiFi Registry), automated testing, and peer-reviewed releases.
• Able to partner with DevOps/SRE to integrate pipelines into existing tooling (not responsible for overall platform design).
• Experience using or integrating with OpenSearch/Elasticsearch.
• Practical experience using relational databases and existing schemas (implementing against established data models; extending under guidance).
• Strong understanding of data security and compliance requirements for sensitive data.
• Excellent cross-functional collaborator with clear communication and strong technical documentation skills, able to translate complex engineering concepts into clear strategies for cross-functional partners.
• A curious, proactive problem solver with a growth mindset who thrives in fast-paced, agile environments and is motivated by mission-driven work and complex interoperability challenges.

What Would Make You Stand Out

• Deep technical expertise paired with a strong understanding of public health data environments.
• Experience with healthcare data standards such as HL7 v2.x, FHIR, and terminologies like LOINC, CVX, SNOMED, and ICD-10.
• Proven success building event-driven architectures with Kafka or implementing data de-identification strategies.
• Hands-on experience with integration engines (e.g., Rhapsody, Mirth) and containerized deployments (e.g., Docker, Kubernetes).
• Experience with infrastructure as code (Terraform, Bicep, or CloudFormation) and automated deployment of NiFi or Kafka environments.
• Experience with monitoring and observability for data pipelines using Grafana (plus cloud-native tools such as Azure Monitor or CloudWatch).
• Demonstrated ability to scale data platforms in production environments.
• Familiarity with Master Patient Index (MPI) solutions or data deduplication frameworks.
• Bring a proactive mindset: anticipating challenges, designing with scalability and security in mind, and delivering solutions that accelerate time to product.

$130,000 - $145,000 a year

Benefits and Perks:InductiveHealth offers competitive benefits and perks including:

• Virtual first, remote organization and culture
• Flexible Paid Time Off (PTO)
• 401(k) retirement plan with corporate matching
• Medical, prescription, vision, and dental coverage (multiple plans based on your needs)
• Short Term and Long Term Disability (for employee)
• Life Insurance (for employee)
• New Team Member support for home office setup

Benefits and Perks: InductiveHealth offers competitive benefits and perks including:

• Virtual first, remote organization and culture
• Flexible Paid Time Off (PTO)
• 401(k) retirement plan with corporate matching
• Medical, prescription, vision, and dental coverage (multiple plans based on your needs)
• Short Term and Long Term Disability (for employee)
• Life Insurance (for employee)
• New Team Member support for home office setup

Target Salary Bands:Each team member’s compensation decisions are based on several inputs, and we expect many of the candidates who are offered positions to fall within the advertised salary band. We recognize that the team member hired may be less (or more) experienced than the posted job description therefore impacting compensation decisions.

About InductiveHealth: InductiveHealth (www.inductivehealth.com) was co-founded by Matthew Dollacker and Stephen Macauley in 2013. Today, InductiveHealth is headquartered in Atlanta, Georgia and has over 80 team members across the United States supporting state, tribal, local, and territorial (STLT) public health agencies in addition to Federal agencies such as the Centers for Disease Control and Prevention (CDC). In early 2021, InductiveHealth became the exclusive commercial partner of Johns Hopkins University Applied Physics Laboratory (JHU/APL) for the Electronic Surveillance System for the Early Notification of Community-based Epidemics (ESSENCE) syndromic surveillance solution. To accelerate growth in the wake of the COVID-19 pandemic, InductiveHealth become a portfolio company of Diversis Capital (https://www.diversis.com/) in early 2022.

About InductiveHealth: InductiveHealth (www.inductivehealth.com) was co-founded by Matthew Dollacker and Stephen Macauley in 2013. Today, InductiveHealth is headquartered in Atlanta, Georgia and has over 80 team members across the United States supporting state, tribal, local, and territorial (STLT) public health agencies in addition to Federal agencies such as the Centers for Disease Control and Prevention (CDC). In early 2021, InductiveHealth became the exclusive commercial partner of Johns Hopkins University Applied Physics Laboratory (JHU/APL) for the Electronic Surveillance System for the Early Notification of Community-based Epidemics (ESSENCE) syndromic surveillance solution. To accelerate growth in the wake of the COVID-19 pandemic, InductiveHealth become a portfolio company of Diversis Capital (https://www.diversis.com/) in early 2022.

All responses to applications will come from [e-mail] or from the domain @inductivehealth.com.

All responses to applications will come from [e-mail] or from the domain @inductivehealth.com.

InductiveHealth is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to their race, color, religion, sex, sexual orientation, gender identity or expression, age, national origin, or disability.

InductiveHealth is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to their race, color, religion, sex, sexual orientation, gender identity or expression, age, national origin, or disability.