Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Harrisburg (Dauphin County); Remote; USD 101,000 - 144,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Harrisburg, PA (Remote) seeks an experienced Data Engineer to support the Pennsylvania Longitudinal Data System (PALDS). The role designs scalable data pipelines, builds AWS-based data solutions, and enables data-driven research, reporting, and decision making.

You will implement data quality, governance, and validation, develop dashboards and analytics models, and collaborate with data scientists, analysts, and stakeholders on data migration and system

Qualifications

• 5+ years of experience with AWS cloud data services.
• 5+ years of programming experience with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL database experience.
• 5+ years of experience with Git, CI/CD, and data modeling.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Knowledge of data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools such as Informatica, MuleSoft, Talend, or TIBCO.
• Strong analytical, problem-solving, and communication skills.
• Required: Experience working with student-level higher education data and linking it with employment and wage datasets.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Skills

AWS

Python

SQL

Data modeling

Git CI/CD

Hadoop Spark

REST APIs

Data governance

Data quality

Communication

Tools

Airflow

Informatica

MuleSoft

Talend

TIBCO

Job description

Job Overview

• Job ID: J54873
• Job Title: Data Engineer
• Location: Harrisburg, PA (Remote)
• Duration: 24 Months + Extension
• Domain Exposure: Real Estate
• Client: To Be Discussed Later
• Employment Type: W-2, 1099, C2C
• Work Authorization: US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
• Bill Rate: $89/hour (C2C)

Job Description

Is seeking an experienced Data Engineer & Insights Analyst to support the Pennsylvania Longitudinal Data System (PALDS). The candidate will design and maintain scalable data pipelines, develop AWS-based data solutions, integrate complex datasets, ensure data quality, and build analytics solutions to support research, reporting, and data-driven decision-making.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Required Skills

• 5+ years of experience with AWS cloud data services.
• 5+ years of programming experience with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL database experience.
• 5+ years of experience with Git, CI/CD, and data modeling.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Knowledge of data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools such as Informatica, MuleSoft, Talend, or TIBCO.
• Strong analytical, problem-solving, and communication skills.
• Required: Experience working with student-level higher education data and linking it with employment and wage datasets.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.