Senior Data Engineer - Cloud Data Pipelines (Remote)

S R International Inc; United States; Remoto; USD 130.000 - 170.000; Tempo pieno

Descrizione del lavoro

Commonwealth of Pennsylvania is seeking a Senior Data Engineer & Analytics Consultant to support the PALDS initiative. The role focuses on transforming complex data into reliable, actionable insights for program delivery and executive decision-making across state government agencies.

You will design and develop data pipelines, integrate data from multiple sources, address data quality issues, and build analytics solutions while handling large, confidential datasets. This is a remote position.

Competenze

• 5+ years of cloud data services experience, especially AWS.
• 5+ years programming in Python/Java/Scala and SQL.
• Strong data modeling, governance, and API integration skills.
• Experience with CI/CD and data pipeline orchestration tools.

Mansioni

• Design, build, and maintain scalable data pipelines in the cloud.
• Develop AWS-based data solutions using S3, Glue, Redshift, EMR, Athena.
• Create and manage data orchestration workflows with Airflow/Azkaban.
• Integrate multi-source data for analytics, dashboards, and models.
• Collaborate with data scientists and policy analysts on analysis.
• Implement ETL, data quality checks, monitoring, and alerting.
• Support data modernization, governance, and security requirements.
• Deliver executive-ready analytics and decision-support outputs.

Conoscenze

AWS

Python

Java/Scala

SQL

Data Modeling

REST APIs

Airflow

Hadoop/Spark

CI/CD

Data Governance

Strumenti

Airflow

Azkaban

Luigi

Informatica

Descrizione del lavoro

Commonwealth of Pennsylvania is seeking a Senior Data Engineer & Analytics Consultant to support the PALDS initiative. The role focuses on transforming complex data into reliable, actionable insights for program delivery and executive decision-making across state government agencies.

You will design and develop data pipelines, integrate data from multiple sources, address data quality issues, and build analytics solutions while handling large, confidential datasets. This is a remote position.