Lead Data Engineer

Arcadia Solutions, LLC; United States; On-site; USD 150,000 - 175,000; Full time

Benefits offered by this job

Flexible remote work

Employee development programs

Community initiatives

Job summary

A leading healthcare data firm is seeking a Lead Data Engineer to automate data flow between clinical platforms and their analytic solution. The role requires 5-8 years of experience, strong skills in SQL, Python, and Spark, and knowledge of healthcare data. The position offers a salary between $150,000 - $175,000 annually, along with the opportunity to work with a dedicated team in a flexible and remote-friendly environment.

Qualifications

• 5-8 years of relevant post-graduate experience or graduate level degree.
• Experience in SQL, Python, and Spark.
• Knowledge of healthcare data and analytics.

Responsibilities

• Drive development of data pipeline connectors.
• Improve data pipeline design and documentation.
• Contribute to multiple implementations simultaneously.

Skills

SQL

Python

Spark

Healthcare Data

Healthcare Analytics

Education

Graduate level degree or equivalent experience

Tools

AWS (S3 and EC2)

Kafka

Nifi

Java

Job description

Overview

Arcadia is dedicated to happier, healthier days for all. We believe that there is a better healthcare world – one powered by data. Our platform transforms complex, diverse data into a unified foundation for health, helping organizations deliver better care, boost revenue, and lower costs. We’re a team of fiercely driven individuals committed to making healthcare more sustainable—and we’re looking for passionate people to help us get there.

For more information, visit arcadia.io.

Why This Role Is Important to Arcadia

The Arcadia Data Engineering team onboards and supports the data feed integrations between Client Claim and Clinical data management platforms and our Healthcare Solution Platform. Our customers are top Healthcare providers and payers, and we help them integrate their internal systems with our analytic platform. The Data Engineering team is responsible for the data architecture that drives the partnership with customers and other internal organizations to drive success through adoption of cutting edge analytic solutions that leverage new age technologies and best practices. Our Data Engineers require both SQL Database knowledge and design, along with multiple programming languages.

As a Lead Data Engineer, you will drive the successful development of solution architecture and the completion of data pipeline connectors that automate the flow of data between client Claim and Clinical data platforms and our analytic health solution platform. Your efforts will be critical to driving the long-term partnership between Arcadia and our customers.

What Success Looks Like

In 3 months

• Learn the different areas of the data connector life cycle, and develop a working knowledge of the technical stacks, storage platforms, data models, and Arcadia's development cycle
• Familiarize yourself with the existing data pipeline and associated product capabilities
• Set to work on new ingestion pipelines with full bandwidth available (as formal training will end)

In 6 months

• Meaningfully contribute to team efficiency by building or rolling out new functionality to enhance team speed
• Build a backlog of development projects that you can start executing on in the next 6 months
• Build strong relationships with engineering organization that supports the data engineering stack so that you can help drive stack improvements
• Set your own personal vision of development and career aspirations and set a working path forward with leadership to work on how we can help you attain those goals
• Contribute to scrum ceremonies and ceremonies within the dev cycles while successfully updating status and progress in Jira

In 12 months

• Demonstrate impact to larger team’s ability to get the work done faster
• Continue to work with Product, Engineering or Implementation to build out tools for better data integration capabilities
• Work on standardizing data connector development with better abstraction patterns
• Become a SME (subject matter expert) on Arcadia’s data stack

What You\'ll Be Doing

• As a Lead Data Engineer, you will drive the successful development of solution architecture and the completion of data pipeline connectors that automate the flow of data between client data platforms and our analytic health solution platform. Your outcomes are critical to driving the long-term partnership between Arcadia and our customers.
• Improving the process of how we design and document data pipelines
• Identifying high leverage improvement projects and driving them to completion
• Support of our processes in partaking in peer code reviews, sprint planning, product grooming, maintaining Jira tasks and peer test reviews
• You will be expected to contribute to multiple implementations simultaneously, which will include both new customer setup as well as support and enhancements for existing customers

Delivery

• Responsible for delivery of work on expected timelines
• Able to identify risk to project success and communicate to leadership
• Works mostly independently on delivery with decreasing involvement from engineering and more senior team members
• Able to apply critical thinking and problem solving skills to propose solutions for complex problems within day to day work

Technical Domain Knowledge:

• Develop a deep understanding of our systems so you can work on projects to improve them
• Developing ability to understand technical issues and communicate potential solutions to team members or engineering team

Business Domain Knowledge:

• Developing working knowledge of the business of healthcare data and how it interacts within the Arcadia products
• Understanding of shared value contracts that our customers are in and how data is impacted by them
• Developing knowledge of industry data expected values such as PMPM by LOBs, MM trends, etc.

Communication Skills:

• Developing internal and external professional communication skills including presentation of issues using appropriate industry vocabulary

Team Projects:

• Responsible for contributing to the advancement of team processes and internal

What You\'ll Bring

• Senior Experience Level of 5-8 years post-grad with relevant industry experience or graduate level degree.

TECH

• As a Lead Data Engineer you will be expected to problem solve coding issues and enhancements with frameworks that are built in Spark, while also leveraging technical skills to partake in idea sessions on process improvement and POC design of how to carry out a solution
• SQL: 5+ years (Preferred)
• Python: 3+ years (Preferred)
• Spark: 4+ years (Preferred)
• Database Architecture: 2-3 years (Preferred)
• Cloud Architecture: 1-2 years (Preferred)

DATA

• As a Lead Data Engineer you will be expected to problem solve some basic data analysis issues and work the data to create analytic enhancements
• Healthcare Data: 2-4 years (Preferred)
• Healthcare Analytics: 1-3 years (Preferred)

Would Love For You To Have

• AWS (S3 and EC2): 2-3 years
• Nifi: 3- 5 years
• Kafka: 3-5 years
• Java : 3-5 years
• Healthcare Analytics: 3-5 years

What You\'ll Get

• Chance to be surrounded by a team of extremely talented and dedicated individuals driven to succeed
• Be a part of a mission driven company that is transforming the healthcare industry by changing the way patients receive care
• A flexible, remote friendly company with personality and heart
• Employee driven programs and initiatives for personal and professional development
• Be a member of the Arcadian and Barkadian Community

$150,000 - $175,000 a year

About Arcadia

Arcadia.io helps innovative providers and payers across the country transform healthcare to reduce cost while improving patient health. We do this by aggregating large amounts of disparate data, applying algorithms to identify opportunities to provide better patient care, and making those opportunities actionable by physicians at the point of care in near-real time. We are growing fast and have emerged as a market leader in the highly competitive population health management software market and have been recognized by industry analysts for our leadership.

Protect Yourself

If you have concerns about the authenticity of a job offer or recruitment-related communication, verify by contacting Arcadia directly at the provided number. For more information, visit our website.

This position is responsible for following all Security policies and procedures in order to protect all PHI under Arcadia's custodianship as well as Arcadia Intellectual Properties. For any security-specific roles, the responsibilities would be further defined by the hiring manager.