Senior Cloud Data Engineer & Insights Analyst

Mbi Llc; Harrisburg (Dauphin County); In loco; USD 90.000 - 130.000; Tempo pieno

Descrizione del lavoro

The Commonwealth of Pennsylvania seeks a Data Engineer & Insights Analyst to join the PALDS analytics team. You will transform complex data into trusted information to support program delivery, operational improvements, and executive decisions across agencies.

Responsibilities include building data pipelines, designing cloud-based AWS solutions, developing dashboards, ensuring data quality and governance, and partnering with data scientists and policy analysts to generate actionable insights.

Competenze

• Advanced SQL knowledge and proficiency with relational databases.
• Experience building and optimizing big data pipelines and datasets.
• Dashboards, reports, models for executives and non-technical users.
• Experience with student-level higher education data for outcomes.
• Root-cause analysis on data and processes.
• Strong analytic skills with unstructured data.
• Data transformation, metadata, and workload management.
• Ability to manipulate large, disconnected datasets.
• Experience with message queuing, stream processing, scalable stores.
• Project management and cross-functional collaboration.

Mansioni

• Create and maintain optimal data pipeline architecture.
• Design and implement cloud-based data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Lambda, etc.).
• Build and maintain data orchestration workflows (Airflow, Step Functions, etc.).
• Assemble large, complex data sets meeting business requirements.
• Engineer analytics environments for statistics, ML, and evidence-building.
• Partner with data scientists and policy analysts for reproducible research.
• Identify and implement internal process improvements and scalable infra.
• Build data extraction, transformation, and loading pipelines from diverse sources using SQL and big data tech.
• Create analytics tools and dashboards to support education and workforce metrics.
• Develop data pipeline monitoring, alerting, and logging frameworks.
• Implement data quality checks and validation across pipelines.
• Develop dashboards, models, and decision-support products.
• Collaborate with executives, data, design, and support teams on data needs.
• Ensure compliance with policies, governance, privacy, and interagency sharing.

Conoscenze

AWS S3

AWS EC2

AWS Glue

AWS EMR

AWS RDS

AWS Redshift

AWS Athena

AWS Lambda

DynamoDB

Python

R

Java

C++

Scala

Oracle

MS SQL Server

PostgreSQL

Cassandra

Git

CI/CD

Dimensional modeling

Data vault

Star schema

Snowflake schema

Data Catalog

AWS Glue

Data governance

Data lineage

Data quality

REST APIs

API design

Hadoop

Spark

Kafka

Azkaban

Luigi

Airflow

Informatica

MuleSoft

Talend

TIBCO

Storm

Spark-Streaming

Strumenti

AW S

GLUE Data Catalog

Descrizione del lavoro

The Commonwealth of Pennsylvania seeks a Data Engineer & Insights Analyst to join the PALDS analytics team. You will transform complex data into trusted information to support program delivery, operational improvements, and executive decisions across agencies.

Responsibilities include building data pipelines, designing cloud-based AWS solutions, developing dashboards, ensuring data quality and governance, and partnering with data scientists and policy analysts to generate actionable insights.