Senior Data Engineer

Pyramid Consulting, Inc; Chandler (AZ); Ibrido; USD 77.000 - 110.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health insurance

401(k) plan

Paid sick leave

Descrizione del lavoro

Pyramid Consulting, Inc. is seeking a Senior Data Engineer for a Chandler, AZ hybrid contract role. The engagement spans 18+ months and focuses on building scalable data pipelines, AI-ready data preparation, and governance across enterprise sources.

You will collaborate with engineering, analytics, and governance teams to deliver reliable data assets for AI-driven initiatives. The role requires strong Spark experience, data modeling skills, and 5+ years in data engineering.

Competenze

• 5+ years of Spark experience.
• 5+ years of data engineering experience.
• 3+ years of data modeling experience.

Mansioni

• Design, develop, and maintain scalable data pipelines.
• Work with Python, SQL, ETL/ELT frameworks.
• Develop data models and AI-ready data preparation.
• Establish data governance, metadata management.
• Monitor data quality and pipeline performance.
• Collaborate with cross-functional teams to enable AI-driven solutions.

Conoscenze

Spark

Data Engineering

Data Modeling

Descrizione del lavoro

Immediate need for a talented Senior Data Engineer. This is a 18+ months contract opportunity with long-term potential and is located in Chandler, AZ (Hybrid).

Job ID: 26-34069

Pay Range: $68/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

• Data Engineering & Pipeline Development: Design, develop, and maintain scalable data pipelines to ingest, process, transform, and integrate structured and unstructured data from multiple enterprise sources using Python, SQL, ETL/ELT frameworks, and data integration technologies.
• Build reliable data processing workflows to support AI, analytics, automation, and enterprise applications.
• Data Architecture & AI-Ready Data Preparation: Develop and maintain data models, storage architectures, and data transformation frameworks to organize and prepare enterprise data for AI/GenAI consumption.
• Work with operational documentation, network configurations, technical standards, policies, logs, telemetry, and runbooks to create structured, searchable, and reusable knowledge assets.
• Support RAG, embeddings, vector databases, semantic search, and context retrieval use cases.
• Data Governance & Metadata Management: Implement data governance standards and frameworks covering data quality, metadata management, data lineage, data ownership, stewardship, data classification, retention, and lifecycle management.
• Establish standards for data definitions, documentation, traceability, and accessibility to ensure enterprise data is accurate, consistent, secure, and suitable for downstream AI applications.
• Data Quality, Validation & Monitoring: Develop automated data quality checks, validation rules, data profiling, monitoring frameworks, and preventative/detective controls to ensure data accuracy, completeness, consistency, and freshness.
• Identify upstream data issues, perform root cause analysis, implement remediation strategies, and continuously optimize data pipelines and transformation processes.
• Cross-Functional Collaboration & Continuous Improvement: Collaborate with engineering, architecture, product, network operations, and governance teams to understand business and technical requirements and translate operational knowledge into reliable data assets.
• Establish reusable data engineering patterns, documentation standards, and best practices while monitoring data health, pipeline performance, governance compliance, and overall readiness of data for AI-driven solutions.

Key Requirements and Technology Experience:

• 5+ Years of Spark
• 5+ years of total Data Engineer experience
• 3+ years of Data Modelling experience

Our client is a leading Financial Industry, and we are currently interviewing to fill this and other similar contract positions.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.