Senior Data Engineer, Microsoft Fabric & AI

GS1; Ewing Township (NJ); On-site; USD 120,000 - 160,000; Full time

Job summary

GS1 Global Office is seeking a Senior Data Engineer to design, build and support scalable enterprise data and analytics solutions using Microsoft Fabric, Azure data services and Power BI.

You will develop AI-enabled data pipelines that connect enterprise data with Claude AI and other approved tools, providing leadership and reusable engineering standards across GS1 Global Office and Member Organisations.

Qualifications

• Bachelor's degree or equivalent professional experience in data engineering, BI, or analytics.
• 5+ years of experience in data engineering, BI or analytics with production solutions.
• Strong hands-on experience with Microsoft Fabric or significant Azure data platform experience (Synapse/Databricks).
• Strong experience building Power BI reports, semantic models and datasets.
• Advanced SQL skills and Azure data services expertise.
• Experience with ETL/ELT tooling and data orchestration (Azure Data Factory, Fabric Pipelines).
• Experience with dimensional modeling, data warehousing and enterprise semantic models (DAX).
• Proficiency in Python and/or PySpark for data processing and automation.
• Experience building or supporting RAG pipelines and LLM APIs (Claude/OpenAI).
• Experience with embeddings, vector search or vector databases and data integration.

Responsibilities

• Design, build and maintain scalable data pipelines using Microsoft Fabric and Azure data services.
• Create Lakehouse, Data Warehouse and semantic models with reusable patterns.
• Develop reliable data integration using Fabric Data Pipelines and ADF.
• Support migration and modernization of analytics services on Azure.
• Deliver Power BI dashboards, reports, datasets and semantic models.
• Implement data validation, observability and governance across pipelines.

Skills

Data engineering

ETL/ELT

Microsoft Fabric

Azure data services

Power BI

Python/PySpark

Data modeling

DAX

Cloud architecture

Governance

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Microsoft Fabric DataPipelines

Databricks

Claude AI

Azure Synapse

Power BI Administration

Git CI/CD

Job description

RoleSummary

GS1 Global Office is seeking a Senior Data Engineer, Microsoft Fabric & AIto join the Business Intelligence and Data Analytics team. The role will design, build and support secure, scalable enterprise data and analytics solutions using Microsoft Fabric, Azure data services and Power BI. It will also develop AI-enabled data pipelines that connect approved enterprise data with large language model platforms, including Claude AI and other approved enterprise AI tooling.

This is a senior, hands-on individual-contributor role combining data engineering, business intelligence, AI-enabled solution development and production support. The role will provide technical leadership, establish reusable engineering standards and work with stakeholders across GS1 Global Office and Member Organisations to translate business needs into reliable, well-governed data products.

Responsibilities

Dataengineeringandarchitecture

• Design,developandmaintainscalabledatapipelinesusingMicrosoftFabricandAzuredataservices.
• BuildandsupportLakehouse,DataWarehouseandsemanticmodelsolutionsusingappropriatearchitectureandreusabledesignpatterns.
• DevelopreliabledataintegrationprocessesusingMicrosoftFabricDataPipelines,AzureDataFactory,APIsandotherapprovedintegrationmethods.
• SupportmigrationandmodernisationinitiativesinvolvingMicrosoftFabricandAzureanalyticsservices.
• Optimisedataprocessingperformance,scalability,maintainabilityandcostefficiency.
• Contributetoenterprisedataarchitecturedecisionsandtheevolutionofshareddatamodelsandanalyticsstandards.

AI-enableddatasolutions

• Design and build retrieval-augmented generation pipelines that securely connect approved enterprise data to Claude AI and other approved large language model platforms.
• Developdatapreparation,chunking,embedding,indexingandretrievalprocessesthatsupportaccurateandtraceableAI-enabledsearchandanalytics.
• SupporttheresponsibleadoptionofapprovedenterpriseAIanddevelopmenttools,includingClaudeAIandClaudeCode,withsecuredata-handlingandaccesspatterns.
• Evaluate and prototype AI-enabled analytics use cases with senior leaders and technical stakeholders, considering business value, architecture, risk and guardrails.
• MonitorandimproveAIpipelinereliability,quality,performanceandcostinlinewithGS1governancestandards.
• Maintainappropriatedocumentation,traceabilityandhumanoversightforAI-enabledsolutions.

Businessintelligenceandreporting

• DevelopandmaintainPowerBIdashboards,reports,datasetsandsemanticmodelsthatprovideclearandactionableinsights.
• Supportoperationalreporting,data-qualityreportingandprioritisedadhocanalyticsrequests.
• Workwithbusinessstakeholderstounderstandrequirements,defineacceptancecriteriaandtranslateneedsintosustainablereportingsolutions.
• Promoteconsistentdefinitions,measuresandreportingpracticesacrosstheorganisation.

Dataquality,securityandgovernance

• Implementdatavalidation,observability,monitoringandqualitycontrolsacrossdatapipelinesandanalyticssolutions.
• Supportmetadatamanagement,datalineage,documentation,retentionandgovernancerequirements.
• DesignsolutionsinaccordancewithGS1informationsecurity,dataprivacy,access-controlandresponsibleAIrequirements.
• Implementrole-basedaccesscontrols,dataclassificationandauditabilityappropriatetothesensitivityandintendeduseofthedata.
• Identifyandescalatedata-quality,security,privacy,model-riskandgovernanceconcerns.

Engineeringqualityandproductionsupport

• Developautomatedtestingandvalidationfordatapipelines,semanticmodels,reportsandAI-enabledsolutions.
• UseGit,sourcecontrol,CI/CDandenvironment-managementpracticestosupportreliabledeploymentacrossdevelopment,testandproductionenvironments.
• Monitor critical solutions, resolve production incidents and troubleshoot pipeline failures, refresh errors, reporting issues, RAG pipeline errors and performance bottlenecks.
• Conductroot-causeanalysisandimplementpreventativeimprovements.
• Maintain technical documentation, operational runbooks and recovery procedures, and contribute to release validation and business-continuity activities.

Technicalleadershipandcollaboration

• Providetechnicalleadershipondataarchitecture,solutiondesign,engineeringstandardsandresponsibleAIimplementation.
• Reviewcodeandsolutiondesigns,shareknowledgeandcoachotherteammembersindataengineeringandanalyticspractices.
• PartnerwithProductOwners,DataEngineers,QA,SoftwareEngineeringandbusinessstakeholdersacrossagloballydistributedorganisation.
• Communicatetechnicaloptions,dependencies,risksandcostsclearlytotechnicalandnon-technicalaudiences.
• Assess trade-offs and make recommendations that balance business value, usability, security, scalability, cost and maintainability.
• Contributetoplanning,architecturediscussions,continuousimprovementandworkloadprioritiesacrosstheBIDAteam.

EducationandExperience

• Bachelor’sdegreeincomputerscience,dataengineering,informationsystemsorarelatedfield,orequivalentrelevantprofessionalexperience.
• Atleastfiveyearsofrelevantexperienceindataengineering,businessintelligenceoranalytics,includingresponsibilityforproductionsolutions.
• StrongpracticalexperiencewithMicrosoftFabric,orsignificantexperiencewithAzureSynapse,Databricksorcomparablemoderncloudanalyticsplatforms.
• StrongexperiencedevelopingPowerBIreports,semanticmodelsanddatasets.
• AdvancedSQLskillsandexperiencewithAzureSQLorcomparablerelationaldatabaseservices.
• PracticalexperiencebuildingETLorELTsolutionsusingAzureDataFactory,MicrosoftFabricDataPipelinesorcomparableorchestrationtools.
• Experiencewithdimensionalmodelling,datawarehousingandenterprisesemanticmodels,includingDAX.
• ProficiencywithPythonand/orPySparkfordataprocessingandautomation.
• PracticalexperiencebuildingorsupportingRAGpipelinesandworkingwithlargelanguagemodelAPIs,suchasClaude,OpenAIorcomparableplatforms.
• Experiencewithembeddings,vectorsearchorvectordatabases,prompt-basedretrievalpatternsandstructuredandunstructureddataintegration.
• Experiencewithsourcecontrol,automatedtesting,CI/CDandproductionmonitoring.
• Experienceimplementingdatasecurity,role-basedaccesscontrolsandprivacyrequirementsinclouddataandanalyticsenvironments.

Preferredexperience

• MicrosoftFabricorrelatedMicrosoftdata-platformcertification.
• ExperiencewithMicrosoftPurview,OneLake,AzureDevOpsorGitHub.
• ExperiencewithPowerBIadministration,tenantgovernanceorcapacitymanagement.
• Experiencewithlarge-scaleanalyticaldatasetsandcloudcostoptimisation.
• ExperiencewithClaudeAI,ClaudeCodeorcomparableenterpriseAIcodingandknowledge-worktools.
• KnowledgeofAIgovernance,responsibleAI,modelevaluationandenterprisedata-privacypractices.
• Experienceworkinginaglobal,federatedormatrixedorganisation.

Skills

• Stronganalyticalandproblem-solvingskills,withtheabilitytodiagnosecomplextechnicalanddata-qualityissues.
• Abilitytoworkindependentlywhilecollaboratingeffectivelyacrosstechnicalteams,functions,locationsandcultures.
• Strongcommunicationandstakeholder-engagementskills,includingtheabilitytoexplaintechnicaltopicsclearlytonon-technicalaudiences.
• Soundjudgementwhenworkingwithsensitive,confidentialorrestrictedinformation.
• Abilitytomanagecompetingprioritiesandswitcheffectivelybetweenengineering,reportingandoperational-supportactivities.
• Pragmatic,hands-onandfocusedonreliableoutcomesandmeasurablevalue.
• Commitmenttodocumentation,knowledgesharing,continuousimprovementandongoinglearning.
• FluentwrittenandspokenEnglish.

TravelRequirements

This role may require occasional international travel and regular collaboration across European and United States time zones.

GS1isanEqualOpportunityEmployer. We are committed to providing equal employment opportunities and a respectful, inclusive workplace. We do not unlawfully discriminate on any ground protected by applicable law. Reasonable accommodations are available during the recruitment process and employment.