Data Engineer for AI Pipelines on Azure

GEI Consultants, Inc.; Rancho Cordova (CA); Hybrid; USD 90,000 - 150,000; Full time

Benefits offered by this job

Hybrid work schedules

Cell phone stipends

Tuition reimbursement

401(k)

Job summary

GEI Consultants, Inc. is seeking a Data Engineer to design, build, and maintain data pipelines and integrations that power GEI’s AI solutions and digital initiatives.

The role ensures enterprise data is accessible, reliable, and governed so AI capabilities can be deployed and scaled with confidence. You will work hands-on drafting ingestion pipelines, managing data stores, implementing quality and governance controls, and supporting retrieval patterns like RAG.

Qualifications

• 4+ years of data engineering experience in production pipelines.
• Proficiency in Python and SQL; PySpark/Spark preferred.
• Experience with Azure data services (ADF, Synapse, Data Lake, SQL).
• Familiarity with Azure AI Search, Cosmos DB, or similar services.
• Experience building ETL/ELT pipelines for structured, semi-structured, and unstructured data.
• Knowledge of data modeling, schema design, and indexing for analytics/AI.
• Familiarity with Terraform and CI/CD for data pipelines.
• Knowledge of data governance, cataloging, lineage, and privacy.
• Security best practices: encryption, RBAC, private networking.
• Nice to have Databricks Delta Lake/Unity Catalog and certifications.

Responsibilities

• Design, build, and maintain data pipelines that ingest, transform, and deliver enterprise data to AI solutions and business applications.
• Develop and manage integrations across enterprise data sources using APIs, Graph connectors, event-driven architectures, and batch/streaming patterns.
• Build and maintain data stores and indexing infrastructure that support retrieval-augmented generation (RAG) and other AI consumption patterns.
• Implement data quality, validation, and lineage controls to ensure accuracy and trustworthiness of data feeding AI workflows.
• Support and optimize data models underpinning Power BI dashboards and AI-enabled analytics.
• Collaborate with AI Engineers to define data contracts and ensure pipeline outputs meet solution requirements for schema, latency, and freshness.
• Instrument data pipelines for monitoring, alerting, cost control, and performance optimization.
• Implement data governance and security controls including access management, encryption, and compliance with organizational data policies.
• Identify data-related risks and support mitigation strategies in collaboration with architecture and platform teams.

Skills

Python

SQL

PySpark

Azure data services

Data modeling

CI/CD

Data governance

Data retrieval patterns

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

Azure SQL

Databricks Delta Lake

Unity Catalog

PySpark

Terraform

Azure DevOps

Job description

GEI Consultants, Inc. is seeking a Data Engineer to design, build, and maintain data pipelines and integrations that power GEI’s AI solutions and digital initiatives.

The role ensures enterprise data is accessible, reliable, and governed so AI capabilities can be deployed and scaled with confidence. You will work hands-on drafting ingestion pipelines, managing data stores, implementing quality and governance controls, and supporting retrieval patterns like RAG.