Data Engineer

Valiant Technologies LLC; Harrisburg (Dauphin County); Hybrid; USD 101,000 - 144,000; Full time

Job summary

Valiant Technologies LLC in Harrisburg, PA is seeking an experienced Data Engineer & Insights Analyst to support the PALDS project. You will design and maintain scalable data pipelines, build AWS-based data solutions, integrate complex datasets, ensure data quality, and support data-driven decision-making.

The role requires strong SQL and Python skills, experience with AWS services (S3, Redshift, Glue), and collaboration with data scientists and stakeholders.

Qualifications

• 5+ years of hands-on experience with AWS cloud data services.
• 5+ years of programming with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL databases.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Experience with REST APIs and data integration tools.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Skills

Analytical skills

Communication skills

Problem solving

Data engineer experience

Tools

AWS cloud services

Python

SQL

Relational/NoSQL databases

Git & CI/CD

Airflow

Hadoop

Spark

Kafka

REST APIs

Informatica

MuleSoft

Talend

TIBCO

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Data Engineer
Location: Harrisburg, PA(Remote)
Duration: 24 Months + Extension
Bill Rate: $89/hour (C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

Is seeking an experienced Data Engineer & Insights Analyst to support the Pennsylvania Longitudinal Data System (PALDS). The candidate will design and maintain scalable data pipelines, develop AWS-based data solutions, integrate complex datasets, ensure data quality, and build analytics solutions to support research, reporting, and data-driven decision-making.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Required Skills

• 5+ years of experience with AWS cloud data services.
• 5+ years of programming experience with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL database experience.
• 5+ years of experience with Git, CI/CD, and data modeling.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Knowledge of data governance, metadata management, and data quality.
• Experience with REST APIs and integration tools such as Informatica, MuleSoft, Talend, or TIBCO.
• Strong analytical, problem-solving, and communication skills.
• Required: Experience working with student-level higher education data and linking it with employment and wage datasets.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.