Data Engineer

S R International Inc

Philadelphia (Philadelphia County)

Remote

USD 110,000 - 135,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Commonwealth of Pennsylvania is seeking an experienced Data Engineer & Insights Analyst to support the PALDS program. The role designs and maintains data pipelines, integrates complex datasets, and develops analytics to support executive decision-making across state government agencies.

This role requires strong technical expertise in AWS, SQL, Python, big data tech, data modeling, and data integration, plus the ability to work with large, confidential datasets in a remote setting.

Qualifications

  • 5+ years AWS cloud experience across S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
  • 5+ years programming with Python, R, Java, C++, or Scala.
  • 5+ years SQL and relational/NoSQL databases (Oracle, SQL Server, PostgreSQL, Cassandra).
  • 5+ years Git, version control, and CI/CD pipelines.
  • Strong data modeling knowledge (dimensional, Data Vault, star/snowflake).
  • Experience with AWS Glue Data Catalog and data cataloging.
  • Understanding data governance, lineage, and quality frameworks.
  • REST API design/integration experience.
  • Big data tech: Hadoop, Spark, Kafka; data orchestration with Airflow/Azkaban/Luigi.
  • Data integration tools: Informatica, MuleSoft, Talend, TIBCO.
  • Streaming tech: Storm or Spark Streaming; advanced SQL with large datasets.
  • Strong analytical, problem-solving, PM and organizational skills; cross-functional collaboration.

Responsibilities

  • Design, build, and maintain scalable data pipeline architectures.
  • Develop cloud-based data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda).
  • Build and maintain data orchestration workflows with Airflow, AWS Step Functions, or similar.
  • Extract, transform, and load data from multiple sources using SQL and big data tech.
  • Develop analytics environments for statistical analysis, predictive modeling, ML, and research.
  • Collaborate with data scientists, policy/research analysts to enable reproducible research.
  • Identify and resolve data quality issues with validation and monitoring.
  • Automate processes and improve data delivery, scalability, and efficiency.
  • Develop dashboards, reports, analytical models, and decision-support tools.
  • Build monitoring, alerting, and logging for data pipelines; support data modernizations.

Skills

Strong analytical
Problem-solving
Project management
Organizational skills
Cross-functional collaboration

Tools

AWS
S3
EC2
Glue
EMR
RDS
Redshift
Athena
Lambda
DynamoDB
Python
R
Java
C++
Scala
SQL
Oracle
SQL Server
PostgreSQL
Cassandra
Git
CI/CD
REST APIs
Hadoop
Spark
Kafka
Airflow
Azkaban
Luigi
Informatica
MuleSoft
Talend
TIBCO
Storm
Spark Streaming

Job description

Job Title: Data Engineer & Insights Analyst

Job Code: PA 815653

Client: Commonwealth of Pennsylvania - EISO / PALDS

Location: Remote

Duration: 11/23/2026 - 12/31/2026

Work Hours: Monday-Friday, 8:00 AM-4:30 PM

Work Arrangement: Remote

Closing Date: 11/10/2026 at 4:00 PM

Interview Process: Two rounds - First round via MS Teams; second round in person in Harrisburg, PA for finalists.

Position Overview

The Commonwealth of Pennsylvania is seeking an experienced Data Engineer & Insights Analyst to support the Pennsylvania Longitudinal Data System (PALDS).

The selected candidate will design and maintain data pipelines, integrate and transform complex datasets, improve data quality, and develop analytics solutions to support program delivery, operational improvements, and executive decision-making across state government agencies.

This role requires strong technical expertise in AWS, SQL, Python, big data technologies, data modeling, and data integration, along with the ability to work with large, complex, and confidential datasets. The candidate will also support data conversions related to system modernization and replacement initiatives.

Required Skills
  • 5+ years of hands-on experience with AWS cloud services, including S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
  • 5+ years of programming/scripting experience with Python, R, Java, C++, or Scala.
  • 5+ years of experience with SQL and relational/NoSQL databases, including Oracle, SQL Server, PostgreSQL, and Cassandra.
  • 5+ years of experience with Git, version control, and CI/CD pipelines.
  • Strong knowledge of data modeling, including dimensional modeling, Data Vault, and star/snowflake schemas.
  • Experience with AWS Glue Data Catalog, metadata management, and data cataloging.
  • Understanding of data governance, data lineage, and data quality frameworks.
  • Experience designing and integrating REST APIs.
  • Hands-on experience with big data technologies such as Hadoop, Spark, and Kafka.
  • Experience with data pipeline orchestration tools such as Apache Airflow, Azkaban, or Luigi.
  • Experience with data integration platforms such as Informatica, MuleSoft, Talend, or TIBCO.
  • Experience with stream-processing technologies such as Storm or Spark Streaming.
  • Advanced SQL knowledge and experience working with large, complex datasets.
  • Strong analytical, problem-solving, project management, and organizational skills.
  • Experience supporting cross-functional teams in a dynamic environment.
Key Responsibilities
  • Design, build, and maintain scalable data pipeline architectures.
  • Develop cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda.
  • Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
  • Extract, transform, integrate, and load data from multiple sources using SQL and big data technologies.
  • Develop and optimize data environments supporting statistical analysis, predictive modeling, machine learning, and research.
  • Collaborate with data scientists, research analysts, and policy analysts to support reproducible research and data-driven decision-making.
  • Identify and resolve data quality issues through validation, monitoring, and root-cause analysis.
  • Automate manual processes and improve data delivery, infrastructure scalability, and operational efficiency.
  • Develop dashboards, reports, analytical models, and decision-support tools.
  • Build monitoring, alerting, and logging frameworks for data pipelines.
  • Support data conversions associated with system modernization and replacement projects.
  • Ensure compliance with data governance, privacy, security, and Commonwealth policies.
  • Collaborate with executive, data, design, and support teams to address technical issues and improve data systems.
Preferred Skills

The job description does not specify a separate preferred-skills list. The technologies and experience listed under Required Qualifications and Required/Desired Skills should be treated as the stated requirements.

Primary Skills
  • AWS
  • Python
  • Java
  • R
  • SQL
  • Oracle
  • SQL Server
  • PostgreSQL
  • Cassandra
  • Data Modeling
  • AWS Glue
  • S3
  • EC2
  • EMR
  • RDS
  • Redshift
  • Athena
  • Lambda
  • DynamoDB
  • Git
  • CI/CD
  • REST APIs
  • Hadoop
  • Spark
  • Kafka
  • Airflow
  • Azkaban
  • Luigi
  • Informatica
  • MuleSoft
  • Talend
  • TIBCO
  • Storm
  • Spark Streaming

This is a remote position.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

S R International Inc • United States

Remote
USD 120,000 - 170,000
Senior Data Engineer
Senior Data Engineer

S R INTERNATIONAL INC • United States

Remote
USD 130,000 - 170,000
Data Engineer
Data Engineer

Apollo Technology Solutions LLC • Harrisburg

Remote
USD 110,000 - 150,000
Data Engineer & Insights Analyst
Data Engineer & Insights Analyst

Mbi Llc • Harrisburg

On-site
USD 90,000 - 130,000
Data Engineer & Insights Analyst
Data Engineer & Insights Analyst

ZealHire Inc. • Harrisburg

On-site
USD 90,000 - 150,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Harrisburg

Hybrid
USD 101,000 - 144,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Harrisburg

Remote
USD 101,000 - 144,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Harrisburg

Remote
USD 105,000 - 141,000
Data Engineer
Data Engineer

Robotic Process Automation LLC • Harrisburg

Remote
USD 105,000 - 141,000
AWS Data Engineer
AWS Data Engineer

Ethereum Technologies LLC • Exton (PA)

On-site
USD 84,000 - 120,000