Senior Data Engineer

Selby Jennings; Brookfield (IL); On-site; USD 15,000 - 180,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to join their dynamic team. In this exciting role, you will be responsible for creating innovative data solutions, ensuring data governance, and implementing robust security protocols. You will work on building scalable data pipelines and collaborating with various stakeholders to deliver impactful data solutions. This position offers the opportunity to work with cutting-edge technologies and contribute to meaningful projects that enhance healthcare data management. If you are passionate about data and eager to make a difference, this role is perfect for you!

Qualifications

• Experience in building Databricks Data Warehouses and Lakehouse solutions.
• Strong knowledge of data governance and security protocols.
• Proficient in architecting and managing scalable data pipelines.

Responsibilities

• Create and maintain data platforms for healthcare data solutions.
• Architect scalable ETL pipelines and monitor their performance.
• Collaborate with teams to gather requirements and deliver data solutions.

Skills

Data Warehouse Creation

Data Governance

Data Security Protocols

ETL Solutions

Data Modeling

Collaboration with Stakeholders

Process Improvement

Tools

Databricks

Terraform

AWS DMS

AWS Glue

Fivetran

SQL

Python

Scala

Job description

Job Description

This range is provided by Selby Jennings. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$15,000.00/yr - $180,000.00/yr

What you will be doing:

1. Data Platform: Creation of a Databricks Data Warehouse(s) and Lakehouse solutions for a healthcare data focused enterprise.
   Data Governance: Configuring and maintaining Unity Catalog to enable enterprise data lineage and data quality.
   Data Security: Building out Data Security protocols and best practices, including management of identified and de-identified (PHI/PII) solutions.
   External Data Products: Building data solutions for clients while upholding the best standards for reliability, quality, and performance.
   ETL: Building solutions within Delta Live Tables and automating transformations.
   Medallion Architecture: Building out performant enterprise-level medallion architecture(s).
   Streaming and Batch Processing: Building fit-for-purpose near real-time streaming and batch solutions.
   Large Data Management: Developing efficient enterprise solutions for structured and unstructured healthcare data.
   Platform Engineering: Building Infrastructure as Code using Terraform and Asset Bundles.
   Costs: Collaborating with the business to develop cost-effective and transparent Data solutions.
2. Pipeline/ETL Management: Architecting, building, and maintaining scalable data pipelines, monitoring performance, and implementing improvements.
   Experience with migration tools (e.g., AWS DMS, AWS Glue, Fivetran, Integrate.io).
   Building infrastructure for data extraction, transformation, and loading using SQL, Delta Live Tables, Python, Scala, and cloud technologies.
3. Data Modeling: Leading design, implementation, and maintenance of standards-based (FHIR, OMOP, etc.) data models.
   Ensuring models meet business needs and comply with data privacy regulations.
4. Collaboration: Partnering with internal and external stakeholders to deliver meaningful data solutions.
   Working with Data, Development, Analysts, Data Science, and Business teams to gather requirements and communicate technical concepts effectively.
5. Processes and Tools: Improving internal processes, automating manual tasks, optimizing data delivery, and redesigning infrastructure for scalability.
   Building analytics tools for operational insights and supporting product development for clinical, analytics, and data science teams.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Finance

Referrals increase your chances of interviewing at Selby Jennings by 2x.

Additional Opportunities

Set job alerts for “Data Engineer” roles in various locations and salary ranges, including Chicago, IL and the Greater Chicago Area.