Senior Data Engineer - AI-Ready Pipelines & Governance

Pyramid Consulting, Inc.; Chandler (AZ); Hybrid; USD 77,000 - 110,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Paid sick leave

Job summary

Pyramid Consulting, Inc. in Chandler, AZ is seeking a Senior Data Engineer for an 18+ months contract in a hybrid work setup. You will design and maintain scalable data pipelines, develop AI-ready data models, and implement data governance to ensure accuracy and security across the enterprise.

The role emphasizes Spark, Python, and data quality, with collaboration across product, architecture, and governance teams to deliver reliable data assets for AI-driven initiatives.

Qualifications

• 5+ years of Spark experience
• 5+ years of total Data Engineer experience
• 3+ years of Data Modelling experience
• Experience in financial services is a plus

Responsibilities

• Design, develop, and maintain scalable data pipelines to ingest, process, transform, and integrate data from multiple sources using Python, SQL, ETL/ELT frameworks.
• Build reliable data processing workflows to support AI, analytics, automation, and enterprise applications.
• Develop and maintain data models, storage architectures, and data transformation frameworks for AI/GenAI consumption.
• Ensure data governance, metadata management, data quality, lineage, and accessibility across enterprise data.
• Support RAG, embeddings, vector databases, semantic search, and context retrieval use cases.
• Establish reusable data engineering patterns, documentation standards, and best practices while monitoring data health and pipeline performance.

Skills

Spark

Python

Data Modelling

Data Quality

Job description

Pyramid Consulting, Inc. in Chandler, AZ is seeking a Senior Data Engineer for an 18+ months contract in a hybrid work setup. You will design and maintain scalable data pipelines, develop AI-ready data models, and implement data governance to ensure accuracy and security across the enterprise.

The role emphasizes Spark, Python, and data quality, with collaboration across product, architecture, and governance teams to deliver reliable data assets for AI-driven initiatives.