Data Engineer & Insights Analyst: Cloud Pipelines

My3tech; Pennsylvania; In loco; USD 90.000 - 140.000; Tempo pieno

Descrizione del lavoro

My3Tech is seeking a Data Engineer & Insights Analyst to transform complex data into trusted information for program delivery and executive decision-making in state government agencies. The role involves building data pipelines, integrating data from multiple sources, and ensuring data quality and governance across projects.

The ideal candidate will design cloud-based data solutions using AWS services, develop analytics products, and collaborate with data scientists, policy analysts, and

Competenze

• Advanced SQL knowledge and proficiency with relational databases and query authoring.
• Experience building and optimizing big data pipelines and datasets.
• Ability to design dashboards and reports for executive and non-technical users.
• Experience with student-level higher education data and outcomes measurement is a plus.
• Root-cause analysis on data and processes to improve business questions.
• Strong analytical skills with unstructured data and data quality frameworks.
• Experience with cloud data services (AWS) and data governance concepts.
• Familiarity with data modeling (dimensional, data vault, star/snowflake).
• Proficiency in Python, R, Java, or Scala and version control (Git).
• Experience with data integration tools and streaming systems (Kafka, Spark).

Mansioni

• Create and maintain optimal data pipeline architecture.
• Design and implement cloud-based data solutions using AWS services.
• Build and maintain data orchestration workflows (Airflow or similar).
• Assemble large, complex data sets meeting business requirements.
• Engineer analytics environments supporting statistics and ML.
• Collaborate with data scientists and policy analysts for reproducible research.
• Identify and implement internal process improvements for data delivery.
• Develop dashboards, reports, models, and decision-support products.
• Monitor data pipelines with logging, alerts, and quality checks.
• Ensure compliance with governance, privacy, and interagency agreements.

Conoscenze

Advanced SQL

Big data pipelines

Dashboard design

Data analysis

Python

REST API design

Spark

Airflow

AWS services

Git & CI/CD

Strumenti

AWS S3

Glue

Redshift

EMR

Athena

Kinesis

Lambda

Airflow

Hadoop

Kafka

Descrizione del lavoro

My3Tech is seeking a Data Engineer & Insights Analyst to transform complex data into trusted information for program delivery and executive decision-making in state government agencies. The role involves building data pipelines, integrating data from multiple sources, and ensuring data quality and governance across projects.

The ideal candidate will design cloud-based data solutions using AWS services, develop analytics products, and collaborate with data scientists, policy analysts, and