Senior Data Engineer: Cloud Pipelines & Analytics

Lancesoft; Harrisburg (Dauphin County); On-site; USD 83,000 - 152,000; Full time

Job summary

Lancesoft seeks a Sr. Data Engineer to design and implement cloud-based data solutions in Harrisburg, PA. The role focuses on building scalable data pipelines using AWS services and orchestration tools, with collaboration across data scientists and policy teams.

Responsibilities include data quality, monitoring, and developing analytical products to support education and workforce outcomes. On-site in Harrisburg; 40 hours/week for approximately 5 weeks.

Qualifications

• Advanced SQL knowledge with relational DBs.
• Experience building big data pipelines and data sets.
• Dashboards, reports, and analytics for exec/non-tech users.
• Experience with student-level higher education data linkages (desired).
• Root-cause analysis on data and processes.

Responsibilities

• Create and maintain data pipeline architecture.
• Build cloud data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda).
• Develop data orchestration workflows (Airflow, Step Functions).
• Develop dashboards and analytical models to support decision making.

Skills

Advanced SQL

Python/Java/Scala

REST API

CI/CD

Airflow

Big data fundamentals

Tools

AWS

S3

Redshift

Glue

EMR

Athena

Kinesis

Lambda

Airflow

Job description

Lancesoft seeks a Sr. Data Engineer to design and implement cloud-based data solutions in Harrisburg, PA. The role focuses on building scalable data pipelines using AWS services and orchestration tools, with collaboration across data scientists and policy teams.

Responsibilities include data quality, monitoring, and developing analytical products to support education and workforce outcomes. On-site in Harrisburg; 40 hours/week for approximately 5 weeks.