Senior Data Engineer – Real-Time Data & Visualization Focus

enGen; Meadville (Crawford County); Remote; USD 120,000 - 150,000; Full time

Job summary

A leading data solutions company is looking for a Senior Data Engineer with a focus on real-time data and visualization. This role involves designing, developing, and maintaining data pipelines, collaborating with cross-functional teams, and ensuring data governance. Qualified candidates should have over five years of experience in data engineering, proficiency in SQL and cloud platforms, and strong skills in data visualization tools like Power BI and Tableau. This is a remote position based in the U.S.

Qualifications

• 5+ years of experience in data engineering or ETL development.
• Experience with SQL and database technologies.
• Proficiency in data warehousing and associated solutions.

Responsibilities

• Design and maintain reliable real-time data pipelines.
• Collaborate with teams to gather requirements for data solutions.
• Implement data governance practices to ensure data quality.

Skills

Data pipeline design

Data visualization

Analytical thinking

Collaboration

Education

Bachelor's degree in Computer Science

Tools

SQL

Power BI

Tableau

Apache Airflow

AWS Glue

Azure Data Factory

Job description

Senior Data Engineer – Real-Time Data & Visualization Focus at enGen

This remote U.S. position focuses on designing, developing, and maintaining efficient, reliable real‑time data pipelines and high‑quality data storage solutions. You will ingest and transform data from diverse sources using cloud platforms (Azure, GCP, AWS), databases (BigQuery, Azure Data Explorer), and streaming technologies (Cribl, Kafka, Azure Event Hubs). A primary responsibility is creating impactful visualizations and dashboards for internal and enterprise reporting using Power BI and Tableau to translate business needs into actionable insights.

ESSENTIAL RESPONSIBILITIES

• Design, develop, and maintain robust data processes and solutions to ensure efficient movement and transformation of data across multiple systems.
• Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs.
• Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs.
• Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to leadership regularly.
• Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.
• Collaborate on design and implementation of data security measures, including access controls, encryption, and data masking.
• Mentor other associate and intermediate data engineers as needed.
• Perform data analysis and provide insights to support decision‑making across various departments.
• Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed.
• Other duties as assigned or requested.

REQUIRED EXPERIENCE

• 5+ years in design and analysis of algorithms, data structures, and design patterns for scalable, highly available systems.
• 5+ years in a data engineering, ETL development, or data management role.
• 5+ years in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).
• 5+ years in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery).

PREFFERED EXPERIENCE

• 7+ years with data pipeline and workflow management tools (e.g., Apache Airflow, AWS Glue, Azure Data Factory).
• 7+ years defining system architectures and optimizing short‑term execution while planning for long‑term technical capabilities.
• 7+ years working with a variety of technology systems, designing solutions or developing data solutions in healthcare.
• 7+ years with cloud platforms (AWS, Azure, GCP) and their respective data services.
• 7+ years in data governance, data quality, and data security best practices.
• 7+ years translating requirements, design mockups, prototypes or user stories into technical designs.
• 7+ years producing fault‑tolerant, efficient, maintainable data code.
• 7+ years structuring and transforming data from multiple source systems.
• 7+ years creating data visualizations and dashboards using Power BI or Tableau for internal and external audiences.
• 7+ years using Cribl as a streaming and transformation solution.

SKILLS

• Demonstrated ability to achieve stretch goals in a highly innovative and fast‑paced environment.
• Adaptability and strong ability to take on diverse tasks and projects.
• Analytical thinking with a focus on detail and accuracy.
• Interest and ability to learn other data development technologies/languages as needed.
• Technical proficiency with a range of data tools and technologies.
• Strong track record in designing and implementing large‑scale data sources.
• Strong sense of ownership, urgency, and drive.
• Demonstrated passion for user experience and improving usability.
• Team collaboration and effective cross‑functional work.
• Experience mentoring junior data engineers and developing their skills and leadership.

EDUCATION

• Required: Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field.
• Preferred: Master’s degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field.

TRAVEL REQUIREMENT

• 0% – 25% travel.

Highmark Health and its affiliates prohibit discrimination against qualified individuals based on veteran or disability status and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

For accommodation requests, please contact HR Services Online at [e-mail].