Data Engineer

Quantum Technologies LLC; Harrisburg (Dauphin County); Remote; USD 101,000 - 144,000; Full time

Job summary

Quantum Technologies. LLC is seeking an experienced Data Engineer to support the Pennsylvania Longitudinal Data System (PALDS).

You will design and maintain scalable data pipelines, develop AWS-based data solutions, and build analytics solutions for research, reporting, and decision-making. You will work with data scientists and stakeholders to ensure data quality, governance, and effective data migration and modernization initiatives.

Qualifications

• Minimum 5 years with AWS cloud data services.
• Proficient in Python, R, Java, Scala, or C++.
• Strong SQL and relational/NoSQL database experience.
• Experience with Git, CI/CD, and data modeling.
• AWS, Hadoop, Spark, Kafka, and Airflow knowledge.
• Understanding data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools (Informatica, MuleSoft, Talend, TIBCO).
• Excellent analytical, problem-solving, and communication skills.
• Experience with student-level higher education data linking datasets.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Lambda).
• Develop data workflows using Airflow or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Skills

AWS cloud data services

Python

SQL

Git & CI/CD

Hadoop/Spark

Data Governance

REST APIs

Analytics & Communication

Education data linkage

Tools

Informatica

MuleSoft

Talend

TIBCO

Airflow

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Data Engineer
Location: Harrisburg, PA(Remote)
Duration: 24 Months + Extension
Bill Rate: $89/hour (C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

Is seeking an experienced Data Engineer & Insights Analyst to support the Pennsylvania Longitudinal Data System (PALDS). The candidate will design and maintain scalable data pipelines, develop AWS-based data solutions, integrate complex datasets, ensure data quality, and build analytics solutions to support research, reporting, and data-driven decision-making.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Required Skills

• 5+ years of experience with AWS cloud data services.
• 5+ years of programming experience with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL database experience.
• 5+ years of experience with Git, CI/CD, and data modeling.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Knowledge of data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools such as Informatica, MuleSoft, Talend, or TIBCO.
• Strong analytical, problem-solving, and communication skills.
• Required: Experience working with student-level higher education data and linking it with employment and wage datasets.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.