Data Engineer & Insights Analyst

Skywalk Global; Harrisburg (Dauphin County); Sur place; USD 83 000 - 131 000; Plein temps

Résumé du poste

Skywalk Global in Harrisburg, PA seeks a Data Engineer/Insights Analyst to transform complex data into trusted insights for program delivery and executive decision-making.

The role involves designing data pipelines, integrating multiple sources, and ensuring data quality while supporting modernization efforts for the Commonwealth's longitudinal data architecture.

Qualifications

• Advanced SQL knowledge and proficiency with relational databases.
• Experience building and optimizing big data pipelines, architectures, and datasets.
• Advanced knowledge designing dashboards, reports, analytical models, and decision‑support products for executives.
• Experience working with student‑level higher education data and linking sources to measure outcomes.
• Experience performing root‑cause analyses on data and processes to identify improvements.
• Strong analytics skills for unstructured datasets.

Responsabilités

• Create and maintain optimal datapipeline architecture.
• Design and implement cloud data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda).
• Build and maintain data orchestration workflows (Airflow, AWS Step Functions).
• Assemble large, complex datasets meeting business requirements.
• Engineer analytical environments for statistical analysis and modeling.
• Partner with data scientists and analysts to ensure reproducible research and modeling.
• Identify internal improvements to automate delivery and scale infrastructure.
• Build infrastructure for extracting/loading data from diverse sources via SQL and big data tech.
• Develop dashboards, reports, and other decision-support products.
• Collaborate with executives and policy teams to support data needs.

Connaissances

AWS

SQL

Data Developer

Data Warehouse

Data Analytics

Report building

Quality Assurance

Data mapping

S3

Glue

Redshift

EMR

Athena

Kinesis

Lambda

Apache Airflow

AWS Step Functions

message queuing

stream processing

Description du poste

Job Type

Contractor

Job Location

Harrisburg, PA

Primary Skills

AWS, SQL, Data Developer, Data Warehouse, Data Analytics, report building, Quality Assurance, validation and data mapping, S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, Apache Airflow, AWS Step Functions, message queuing, stream processing

Duration

11/23/2026 - 12/31/2026

Job Summary

Workwillberemote.Tworoundsofinterviews,thefirstviaTeams.Second-roundinterviewsforfinalistswillbein-personinHarrisburg.TheCommonwealthofPennsylvaniaislookingforaDataEngineer&InsightsAnalysttojoinitsteamofanalyticsprofessionalstosupportthePennsylvaniaLongitudinalDataSystem(PALDS).Thispositionwillberesponsiblefortransformingcomplexdataintotrusted,usableinformationtosupportprogramdelivery,operationalimprovements,andexecutivedecision-makinginstategovernmentagencies.TheDataEngineer&InsightsAnalystwillunderstandpolicy-relevantresearchquestions,evaluateavailabledatasources,anddevelopanalyticsproductstodeliveractionableinsights.Additionally,theDataEngineer&InsightsAnalystwilldesignandbuilddatapipelines,integrateandtransformdatafrommultiplesources,identifyandaddressdataqualityissues,andestablishcontrolstosupportresponsibleuseofdata.Thisrolerequiresbothtechnicaldepthandstronganalyticaljudgment,includingtheabilitytoworkwithlarge,complex,andconfidentialdatasets.Thesuccessfulcandidatemustbeself-directedandcomfortablesupportingthedataneedsofmultipleteams,systems,andproducts.Theymustalsobecomfortablewithsupportingdataconversionsassociatedwithsystemmodernizationand/orreplacementefforts.TherightcandidatewillbeexcitedbytheprospectofoptimizingtheCommonwealth'slongitudinaldataarchitecturetosupportournextgenerationofdatainitiatives.

Responsibilities

• Createandmaintainoptimaldatapipelinearchitecture.
• Designandimplementcloud-baseddatasolutionsusingAWSservicessuchasS3,Glue,Redshift,EMR,Athena,Kinesis,andLambda.
• BuildandmaintaindataorchestrationworkflowsusingtoolssuchasApacheAirflow,AWSStepFunctions,orsimilarservices.
• Assemblelarge,complexdatasetsthatmeetfunctional/non-functionalbusinessarearequirements.
• Engineeranalyticaldataenvironmentsthatsupportadvancedstatisticalanalysis,predictivemodeling,machinelearning,andevidence‑buildingactivities.
• Partnerwithdatascientists,researchanalysts,andpolicyanalyststoensureenterprisedataassetssupportreproducibleresearchandstatisticalmodeling.
• Identify,design,andimplementinternalprocessimprovements:e.g.automatingmanualprocesses,optimizingdatadelivery,re‑designinginfrastructureforgreaterscalability.
• Buildtheinfrastructurerequiredforoptimalextraction,transformation,andloadingofdatafromawidevarietyofdatasourcesusingSQLand'bigdata'technologies.
• Buildanalyticstoolsthatutilizethedatapipelinetoprovideactionableinsightsintoeducationandworkforceoutcomes,operationalefficiency,andotherkeybusinessperformancemetrics.
• Developandmaintaindatapipelinemonitoring,alerting,andloggingframeworks.
• Implementdataqualitychecksandvalidationframeworksacrosspipelines.
• Developdashboards,reports,analyticalmodels,and/orotherdecision‑supportproducts.
• WorkwithstakeholdersincludingtheExecutive,Data,Design,andSupportteamstoassistwithdata-relatedtechnicalissuesandsupporttheirdatainfrastructureneeds.
• EnsurecompliancewithapplicableCommonwealthpolicies,datagovernancestandards,privacyrequirements,securitycontrols,andinteragencydata-sharingagreements.
• Createdatatoolsforanalyticsanddatascientistteammembersthatassisttheminbuildingandoptimizingdataproductsneededtosupportongoingoperationsanddata-informeddecision-making.
• Workwithdataandanalyticsprofessionalstostriveforgreaterfunctionalityinourdatasystems.

Required Qualifications

• AdvancedSQLknowledgeandproficiencyworkingwithrelationaldatabases,queryauthoring(SQL),aswellasworkingfamiliaritywithavarietyofdatabases.
• Experiencebuildingandoptimizing'bigdata'datapipelines,architectures,anddatasets.
• Advancedknowledgeandproficiencydesigning,building,andrefiningdashboards,reports,analyticalmodels,anddecision-supportproductsforexecutiveandnon-technicalusers.
• Experienceworkingwithstudent-levelhighereducationdata,includingestablishinglinkagestoothersources(e.g.employmentandwagedata)tomeasureoutcomesand/orgenerateinsightsfordecision-making).
• Experienceperformingroot-causeanalysisoninternalandexternaldataandprocessestoanswerspecificbusinessquestionsandidentifyopportunitiesforimprovement.
• Stronganalyticskillsrelatedtoworkingwithunstructureddatasets.
• Experiencebuildingprocessessupportingdatatransformation,datastructures,metadata,dependency,andworkloadmanagement.
• Asuccessfulhistoryofmanipulating,processing,andextractingvaluefromlarge,disconnecteddatasets.
• Workingknowledgeofmessagequeuing,streamprocessing,andhighlyscalable'bigdata'datastores.
• Strongprojectmanagementandorganizationalskills.
• Experiencesupportingandworkingwithcross-functionalteamsinadynamicenvironment.

Proficiencyinobject-oriented/objectfunctionscriptinglanguages:e.g.Python,R,Java,C++,ScalaRequired5Years

ExperiencewithversioncontrolsystemssuchasGitandCI/CDpipelinesRequired5Years

FamiliaritywithdatacatalogingandmetadatamanagementtoolssuchasAWSGlueDataCatalog.Required5Years

Understandingofdatagovernance,datalineage,anddataqualityframeworks.

Required5Years

KnowledgeofRESTAPIdesignandintegrationpatterns.Required5Years

Experiencewithbigdatatools:e.g.Hadoop,Spark,Kafka.Required5Years

Experiencewithdatapipelineandworkflowmanagementtools:e.g.Azkaban,Luigi,Airflow.Required5Years

ExperiencewithdataintegrationservicessolutionsfromvendorssuchasInformatica,MuleSoft,Talend,andTIBCO.Required5Years

Experiencewithstream-processingsystems:e.g.Storm,Spark-Streaming.