Senior Data Engineer

Health-E Commerce; United States; On-site; USD 130,000 - 165,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with company match

Parental & bonding leave

Flexible PTO

Wellness stipend

Professional development

Job summary

Health-E Commerce is seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and infrastructure in a data-driven environment. You will collaborate with analysts and stakeholders to translate data needs into technical solutions, implementing governance, quality, and security practices.

You’ll design complex data models on Azure Synapse, utilize Azure DevOps for CI/CD, and manage Apache Spark pools for high-performance processing.

Qualifications

• Minimum 5+ years in data engineering, focusing on pipelines and infrastructure.
• Strong proficiency with Azure Synapse Analytics, Azure DevOps, and Spark pools.
• Expertise in Python, SQL and Java programming.
• Senior knowledge of data modeling, warehousing, and ETL concepts.
• Effective communication with non-technical stakeholders.

Responsibilities

• Design, develop, and maintain robust data pipelines and infrastructure.
• Collaborate with analysts to translate data requirements into technical solutions.
• Implement data governance, security, and quality assurance practices.
• Explore new technologies to enhance data capabilities.
• Model data on Azure Synapse for warehousing; use Azure DevOps for CI/CD.
• Manage and optimize Apache Spark pools for performance.
• Develop ETL pipelines using Python scripts.
• Ensure data quality and integrity across platforms.
• Collaborate with cross-functional teams to translate business needs.
• Stay updated on Azure data services and industry trends.

Skills

Azure Synapse Analytics

Azure DevOps

Apache Spark pools

Python

SQL

Java

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Azure Synapse Analytics

Azure DevOps

Apache Spark

Python scripting

Job description

About The Role

We are seeking an experienced Senior Data Engineer to join our growing Data & Analytics team. This role will be responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support our organization’s data needs.

Specific Responsibilities

• Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
• Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
• Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
• Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
• Design and implement complex data models on Azure Synapse Analytics to support data warehousing Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management.
• Manage and optimize Apache Spark pools for high-performance data processing tasks.
• Develop and maintain ETL processes and data pipelines using Python scripting.
• Ensure data quality and integrity across all platforms and systems.
• Collaborate with cross-functional teams to translate business needs into technical specifications.
• Stay current with industry trends and advancements in Azure data services.

What You'll Need

• Bachelor’s degree in Computer Science, Engineering, or related field
• Minimum of 5+ years experience in data engineering roles, with a strong focus on building and maintaining data pipelines and infrastructure
• Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools.
• Expertise in Python scripting and other programming languages such as SQL and Java
• Senior level knowledge of data modeling, processes, and data warehouse concepts
• Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders
• Experience with data modeling, warehousing, and building ETL pipelines
• Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services

Compensation, Benefits, & Additional Details

Health-E Commerce's compensation philosophy is grounded in market data and internal equity to ensure fairness and consistency across the team. Individuals new to the company should generally expect offers to fall between the entry point and midpoint of the salary range. Our goal is to provide an offer that supports growth potential within the role and allows for future salary progression.

• Compensation: $130,000 - 165,000
• Discretionary Annual Bonus Eligibility: Up to 10%
• Medical, Dental, Vision, and 401K with a company match
• Dependent Care, FSA & HSA accounts
• Paid Parental & Bonding Leave
• Flexible PTO & office closure on all major holidays
• Monthly wellness & internet reimbursements
• Professional development including certification support & leadership coaching
• Mental Health resources
• 100% remote within the United States
• Must be able to work EST hours

Candidate Privacy Notice