Data Engineer & Insights Analyst for PALDS

Novalink Solutions; Harrisburg (Dauphin County); On-site; USD 90,000 - 130,000; Full time

Job summary

Novalink Solutions in Harrisburg, PA seeks a Data Engineer & Insights Analyst to transform complex data into trusted information for state government programs. You will build scalable data pipelines, design cloud data solutions on AWS, and enable analytics that support policy decisions and operational improvements.

Collaborate with data scientists and policy analysts, ensure data quality and governance, and drive modernization efforts across data platforms.

Qualifications

• Advanced SQL knowledge and proficiency with relational databases and query authoring.
• Experience building and optimizing large data pipelines, architectures, and datasets.
• Advanced dashboards, reports, and models for executive and non-technical users.
• Experience with student-level higher education data and linking to employment/wage data.
• Root-cause analysis across data and processes to drive improvements.
• Strong analytics with unstructured data and data quality frameworks.
• Experience with data modeling techniques (dimensional, data vault, star/snowflake).
• Familiarity with data cataloging/metatada management (AWS Glue Data Catalog).
• Understanding of data governance, lineage, and quality frameworks.
• Knowledge of REST API design and integration patterns.
• Experience with Spark, Hadoop, Kafka; Airflow and data pipeline tooling.
• Experience with data integration tools (Informatica, MuleSoft, Talend, TIBCO).
• Experience with stream processing systems (Storm, Spark-Streaming).
• Experience with visualization/data delivery for decision support.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Design and implement cloud-based data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda).
• Build and maintain data orchestration workflows with Airflow, AWS Step Functions, or equivalent.
• Assemble large, complex data sets meeting business requirements.
• Engineer analytics environments supporting statistical analysis, ML, and evidence-building.
• Collaborate with data scientists and policy analysts to ensure reproducible research.
• Identify and implement internal process improvements for data delivery and scalability.
• Develop data ingestion ETL and loading for diverse data sources with SQL and big data tech.
• Create analytics tools using pipelines to inform education, workforce outcomes, and operations.
• Develop monitoring, alerting, and logging for data pipelines.
• Implement data quality checks and validation across pipelines.
• Develop dashboards, reports, and decision-support products.
• Support stakeholders with data infrastructure needs and issue resolution.
• Ensure compliance with governance, privacy, security, and interagency sharing rules.
• Create data tools to assist analytics teams in building data products.

Skills

Advanced SQL

Big data pipelines

Dashboard design

Data modeling

Data governance

REST API design

Big data tools

Tools

AWS

Airflow

Git

CI/CD

ETL tools

Job description

Novalink Solutions in Harrisburg, PA seeks a Data Engineer & Insights Analyst to transform complex data into trusted information for state government programs. You will build scalable data pipelines, design cloud data solutions on AWS, and enable analytics that support policy decisions and operational improvements.

Collaborate with data scientists and policy analysts, ensure data quality and governance, and drive modernization efforts across data platforms.