Remote Data Engineer—AWS, Pipelines & Analytics

Quantum Technologies LLC; Harrisburg (Dauphin County); Remote; USD 101,000 - 144,000; Full time

Job summary

Quantum Technologies. LLC is seeking an experienced Data Engineer to support the Pennsylvania Longitudinal Data System (PALDS).

You will design and maintain scalable data pipelines, develop AWS-based data solutions, and build analytics solutions for research, reporting, and decision-making. You will work with data scientists and stakeholders to ensure data quality, governance, and effective data migration and modernization initiatives.

Qualifications

• Minimum 5 years with AWS cloud data services.
• Proficient in Python, R, Java, Scala, or C++.
• Strong SQL and relational/NoSQL database experience.
• Experience with Git, CI/CD, and data modeling.
• AWS, Hadoop, Spark, Kafka, and Airflow knowledge.
• Understanding data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools (Informatica, MuleSoft, Talend, TIBCO).
• Excellent analytical, problem-solving, and communication skills.
• Experience with student-level higher education data linking datasets.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Lambda).
• Develop data workflows using Airflow or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Skills

AWS cloud data services

Python

SQL

Git & CI/CD

Hadoop/Spark

Data Governance

REST APIs

Analytics & Communication

Education data linkage

Tools

Informatica

MuleSoft

Talend

TIBCO

Airflow

Job description

Quantum Technologies. LLC is seeking an experienced Data Engineer to support the Pennsylvania Longitudinal Data System (PALDS).

You will design and maintain scalable data pipelines, develop AWS-based data solutions, and build analytics solutions for research, reporting, and decision-making. You will work with data scientists and stakeholders to ensure data quality, governance, and effective data migration and modernization initiatives.