Senior Data Engineer - Remote, Azure & Spark Pipelines

FSAStore.com; United States; Remote; USD 130,000 - 165,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401K with company match

Dependent Care, FSA & HSA accounts

Paid Parental & Bonding Leave

Flexible PTO & holidays

Monthly wellness & internet reimburse

Professional development & leadership

Mental Health resources

100% remote within the United States

Must be able to work EST hours

Job summary

Health-E Commerce is seeking a Senior Data Engineer to join the Data & Analytics team. You will design, develop, and maintain scalable data pipelines and infrastructure to support data needs across the organization.

Key responsibilities include building robust data pipelines, collaborating with analysts, implementing data governance, and exploring new technologies. The role emphasizes Azure Synapse Analytics, Azure DevOps, and Apache Spark pools to drive data warehousing and processing.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Minimum 5+ years experience in data engineering roles, focusing on building and maintaining data pipelines and infrastructure.
• Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools.
• Expertise in Python scripting and other programming languages such as SQL and Java.
• Senior level knowledge of data modeling, processes, and data warehouse concepts.
• Strong communication skills to convey technical concepts to non-technical stakeholders.
• Experience with data modeling, warehousing, and building ETL pipelines.
• Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services.

Responsibilities

• Design, develop, and maintain robust data pipelines and infrastructure.
• Collaborate with analysts to understand data requirements and translate into technical solutions.
• Implement data governance, security, and quality assurance practices.
• Explore and evaluate new technologies to enhance data infrastructure.
• Design and implement complex data models on Azure Synapse Analytics to support data warehousing.
• Utilize Azure DevOps for CI/CD and agile project management.
• Manage and optimize Apache Spark pools for high-performance processing.
• Develop and maintain ETL processes and pipelines using Python.
• Ensure data quality and integrity across platforms and systems.
• Collaborate with cross-functional teams to translate business needs into technical specs.
• Stay current with Azure data services trends.

Skills

Azure Synapse Analytics

Azure DevOps

Apache Spark

Python

SQL

Java

Data modeling

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Azure Data Factory

Azure Data Lake Storage

Job description

Health-E Commerce is seeking a Senior Data Engineer to join the Data & Analytics team. You will design, develop, and maintain scalable data pipelines and infrastructure to support data needs across the organization.

Key responsibilities include building robust data pipelines, collaborating with analysts, implementing data governance, and exploring new technologies. The role emphasizes Azure Synapse Analytics, Azure DevOps, and Apache Spark pools to drive data warehousing and processing.