Senior Data Engineer: Real-Time Pipelines & Dashboards

Highmark Health; Pennsylvania; Hybrid; USD 103,000 - 165,000; Full time

Job summary

Highmark Health is seeking a Senior Data Engineer to design and operate real-time and analytical data pipelines powering enterprise reporting and decision-making. You will ingest, model, and optimize streaming and batch data in Azure Data Explorer, enabling fast, reliable analytics at scale.

You will translate engineered data into business-ready insights by building curated datasets, analytics, and Power BI/Tableau dashboards for internal teams and leadership, partnering with security and risk

Qualifications

• 5 years in design and analysis of algorithms, data structures, and scalable systems
• 5 years in data engineering, ETL development, or data management
• 5 years of SQL and experience with DB technologies (e.g., MySQL, PostgreSQL, MongoDB)
• 5 years of data warehousing concepts and experience with Snowflake, Redshift, or BigQuery

Responsibilities

• Design, develop, and maintain data processes across multiple systems
• Develop and maintain data models, databases, and data warehouses for BI/analytics
• Collaborate with IT, product, analytics, and business teams to gather requirements
• Monitor progress and report issues to lead developers regularly
• Implement and manage data governance, quality, and regulatory compliance
• Collaborate on data security measures including access controls and masking
• Mentor junior engineers as needed
• Perform data analysis to support decision-making
• Stay updated on data engineering trends and tools
• Perform other duties as assigned

Skills

KQL

SQL

Python

Real-time data

Data analytics

Data governance

Stakeholder collaboration

Power BI

Tableau

Mentoring

Education

Bachelor’s degree in CS/IS/Data Science/related field

Master’s degree preferred

Tools

Azure Data Factory

Azure Data Explorer

Kafka

Cribl

Power BI

Tableau

SQL databases

Job description

Highmark Health is seeking a Senior Data Engineer to design and operate real-time and analytical data pipelines powering enterprise reporting and decision-making. You will ingest, model, and optimize streaming and batch data in Azure Data Explorer, enabling fast, reliable analytics at scale.

You will translate engineered data into business-ready insights by building curated datasets, analytics, and Power BI/Tableau dashboards for internal teams and leadership, partnering with security and risk