Senior Data Engineer — AWS Pipelines & Analytics

Valiant Technologies LLC; Harrisburg (Dauphin County); Hybrid; USD 101,000 - 144,000; Full time

Job summary

Valiant Technologies LLC in Harrisburg, PA is seeking an experienced Data Engineer & Insights Analyst to support the PALDS project. You will design and maintain scalable data pipelines, build AWS-based data solutions, integrate complex datasets, ensure data quality, and support data-driven decision-making.

The role requires strong SQL and Python skills, experience with AWS services (S3, Redshift, Glue), and collaboration with data scientists and stakeholders.

Qualifications

• 5+ years of hands-on experience with AWS cloud data services.
• 5+ years of programming with Python, R, Java, Scala, or C++.
• 5+ years of SQL and relational/NoSQL databases.
• Experience with Hadoop, Spark, Kafka, and Airflow.
• Experience with REST APIs and data integration tools.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Build cloud-based solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, and Lambda.
• Develop data workflows using Airflow, AWS Step Functions, or similar tools.
• Integrate, transform, and analyze large datasets using SQL and Python.
• Develop dashboards, reports, and analytical models.
• Implement data quality, governance, monitoring, and validation frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Support data migration, modernization, and system integration initiatives.

Skills

Analytical skills

Communication skills

Problem solving

Data engineer experience

Tools

AWS cloud services

Python

SQL

Relational/NoSQL databases

Git & CI/CD

Airflow

Hadoop

Spark

Kafka

REST APIs

Informatica

MuleSoft

Talend

TIBCO

Job description

Valiant Technologies LLC in Harrisburg, PA is seeking an experienced Data Engineer & Insights Analyst to support the PALDS project. You will design and maintain scalable data pipelines, build AWS-based data solutions, integrate complex datasets, ensure data quality, and support data-driven decision-making.

The role requires strong SQL and Python skills, experience with AWS services (S3, Redshift, Glue), and collaboration with data scientists and stakeholders.