Remote Senior Data Engineer – AWS Data Pipelines

MACHINE LEARNING TECHNOLOGIES LLC; Harrisburg (Dauphin County); Remote; USD 101,000 - 144,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Harrisburg, PA (Remote) seeks an experienced Data Engineer to support the Pennsylvania Longitudinal Data System (PALDS). The role designs scalable data pipelines, builds AWS-based data solutions, and enables data-driven research, reporting, and decision making.

You will implement data quality, governance, and validation, develop dashboards and analytics models, and collaborate with data scientists, analysts, and stakeholders on data migration and system

Qualifications

• 5+ years of experience with AWS cloud data services.
• 5+ years of programming experience with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL database experience.
• 5+ years of experience with Git, CI/CD, and data modeling.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Knowledge of data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools such as Informatica, MuleSoft, Talend, or TIBCO.
• Strong analytical, problem-solving, and communication skills.
• Required: Experience working with student-level higher education data and linking it with employment and wage datasets.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Skills

AWS

Python

SQL

Data modeling

Git CI/CD

Hadoop Spark

REST APIs

Data governance

Data quality

Communication

Tools

Airflow

Informatica

MuleSoft

Talend

TIBCO

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Harrisburg, PA (Remote) seeks an experienced Data Engineer to support the Pennsylvania Longitudinal Data System (PALDS). The role designs scalable data pipelines, builds AWS-based data solutions, and enables data-driven research, reporting, and decision making.

You will implement data quality, governance, and validation, develop dashboards and analytics models, and collaborate with data scientists, analysts, and stakeholders on data migration and system