Senior Data Engineer

Healthfirst, Inc.; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Healthfirst, Inc. is seeking a Senior Data Engineer to implement data integration, cleansing, and transformation in a remote environment. This full-time role collaborates with stakeholders to support data architecture.

You will develop data acquisition strategies, set standards for storage and movement, and build workflows to improve data utility across the enterprise. 8+ years of IT experience and Python/PySpark are expected.

Qualifications

• 8+ years of IT experience.
• Proficient in Python and PySpark.
• Experience with ETL tools like Glue or DBT.
• Familiar with data warehousing concepts and big data (EMR, Hadoop).
• Proficiency with cloud platforms AWS, GCP or Azure.

Responsibilities

• Develop and execute data acquisition strategies according to best practices.
• Author artifacts defining standards for data storage, processing, and movement, mapping them to business processes.
• Identify trends in datasets and create workflows and algorithms to enhance data utility for the enterprise.

Skills

Python

PySpark

Data integration

Data cleansing

Data transformation

Tools

AWS

GCP

Azure

AWS Glue

DBT

EMR

Hadoop

Job description

Leading data management strategies, the full-time Senior Data Engineer will implement data integration, cleansing, and transformation processes while collaborating with stakeholders to support data architecture in a remote environment.

Key responsibilities

• Develop and execute data acquisition strategies according to best practices
• Author artifacts defining standards for data storage, processing, and movement, mapping them to business processes
• Identify trends in datasets and create workflows and algorithms to enhance data utility for the enterprise

Required qualifications

• 8+ years of overall IT experience
• Enterprise experience with scripting languages, primarily Python and Pyspark
• Experience in data ingestion methodologies using ETL tools like Glue or DBT
• Familiarity with data warehousing concepts and big data technologies such as EMR and Hadoop
• Proficiency in cloud infrastructure platforms like AWS, GCP, or Azure