Data Engineering Architect/Lead

QualityAI

United States

Remote

USD 135,000 - 145,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

401k matching
Healthcare benefits
HSA matching
Learning & development
Employee perks discounts

Job summary

QualityAI in the United States is seeking a Data Engineering Architect/Lead to translate the EDL vision into concrete designs and work packages, handing them to the engineering team to meet phase deadlines. You will own outcomes end to end, remain hands-on when needed, and raise the technical bar across the project.

You will collaborate with project managers, governance teams and offshore engineers to design data products, semantic structures and scalable pipelines using Python, PySpark, SQL on

Qualifications

  • 8+ years hands-on experience in data engineering, data architecture or data lake delivery.
  • At least 1 year experience building products using AI coding tools like Claude code or Codex.
  • Knowledge around AI frameworks for Agent observability and knowledge layer design.
  • Expert in Python, PySpark, SQL with production experience on AIDP, Databricks or Snowflake.

Responsibilities

  • Translate architectural direction into implementable designs and tasks for delivery.
  • Hands-on work ~50% to review, unblock and raise technical standards.
  • Lead onshore and offshore engineers and coordinate with project managers on planning and risks.
  • Design data products, governance, and semantic structures for the data platform.

Skills

Data engineering
Python
PySpark
SQL
AI coding tools
Team leadership

Tools

Databricks
Snowflake
OCI
Terraform
Kubernetes
GitHub Actions

Job description

Are you interested in working with the World’s leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at QualityAI! We are looking for Data Engineering Architect/Lead to join our growing team in United States Location - US Remote

Top 3 Must Haves
  • hands-on experience in data engineering, data architecture or data lake delivery, including 2+ years leading technical teams.
  • Expert in Python, PySpark, SQL, Object oriented programming with production experience on AIDP, Databricks or Snowflake.
  • Uses AI coding tools daily to build production systems and can write the specs and context that make them work well.
Preferred Skills
  • Oracle Cloud Infrastructure (OCI), Golden Gate and Autonomous Database.
  • Data contracts, Data Mesh and governed data marketplace implementation.
  • Healthcare domains: claims, provider, member, product, finance, acquisition integration.
  • Platform depth in Terraform, asset bundles, GitHub Actions and Kubernetes.
  • Experience running distributed onshore and offshore teams.
Role Summary

Take the EDL vision and high architecture as defined, turn it into concrete low-level designs, work packages, explain and hand them to the engineering team, and work with the project managers to deliver on phase deadlines. Hands on ~ 50%, deep enough to review, unblock and set the technical bar. Owns outcomes end to end, finds and fixes problems, and multiplies that reach with AI native way of working.

Responsibilities
  • Translate vision into design. Take the architectural direction and produce implementable designs, strategize and translate to tasks. Keep the vision and high-level design intact through delivery without redefining the vision or reducing the scope.
  • Build with AI every day using Claude Code, Codex or similar. Write the markdown specs, skills and context files that make coding effective, and review what they produce to a production standard.
  • Stay hands on with the Data Lakehouse foundation. Python, PySpark, Delta Lake and medallion design on AIDP (OCI).
  • Design data products and semantic structures. Blueprints covering scope, canonical entities, certified metrics, quality rules, lineage, access and publication criteria.
  • Set standards for keys, naming conventions, configuration, reference data and metadata, and keep them aligned to the business glossary.
  • Understand agentic architecture. How agents consume data and tools, callable services for AI systems, MCP style interfaces, agent traces and observability, and facilitate data access for agents.
  • Lead and delegate. Break work down, assign it, review it and coach onshore and offshore engineers. Partner with project managers on planning, estimates and risks.
  • Know the platform and governance side. Terraform, asset bundles, CI/CD and environment promotion.
  • Turn governance policies such as PHI protection, masking, classification and data quality into controls engineers can actually implement.
  • Oracle Golden gate CDC process, creating unified data models on EDL, create pipelines, conformed dimensions and Gold layer delivery to semantic models.
Required Qualifications
  • 8+ years hands-on experience in data engineering, data architecture or data lake delivery, including 2+ years leading technical teams.
  • At least 1 year experience building products using AI coding tools like Claude code or Codex.
  • Knowledge around AI frameworks for Agent observability, MCP server development or knowledge layer design (ontologies, knowledge graphs).
  • Expert in Python, PySpark, SQL, Object oriented programming with production experience on AIDP, Databricks or Snowflake.
  • Has designed conceptual, logical, physical and dimensional models and delivered them as governed Gold assets used by BI semantic layers.
  • Uses AI coding tools daily to build production systems and can write the specs and context that make them work well.
  • Has built REST services and callable tools consumed by applications or AI agents.
  • Has delivered under regulated data controls (PHI, HIPAA or equivalent) and against fixed phase deadlines.
Preferred Qualifications or knowledge
  • Oracle Cloud Infrastructure (OCI), Golden Gate and Autonomous Database.
  • Data contracts, Data Mesh and governed data marketplace implementation.
  • Healthcare domains: claims, provider, member, product, finance, acquisition integration.
  • Platform depth in Terraform, asset bundles, GitHub Actions and Kubernetes.
  • Experience running distributed onshore and offshore team.
Benefits

Why QualityAI? Be a part of a company who strives to support for diversity and inclusion in the workplace – we are one, we are many at QualityAI. Celebrate culture, share knowledge with engineers from around the globe, and inspire each other through our differences. We have more than 40% women and around 120 different nationalities. Local and global opportunities – we offer you internal rotation and international mobility opportunities to grow your career. Clear view of your career and progression with the company – QualityAI is growing massively (since 2021 – tripled our employees base – we now have more than 8,000 engineers) and giving you the opportunity to grow with us. Work hard and play harder with our flexible and casual culture. Take a break from work and join an employee event, or enjoy the amenities and games provided from one of our Employees Centers. Save your earnings and prepare for your future by enrolling in our 401k plan where QualityAI will match your contributions accelerating your savings plan. Take care of health with enrollment into one of our competitive healthcare benefits. QualityAI will match towards your HSA if you choose to participate. Never stop experimenting and learning with QCraft – our Learning & Development platform: 50,000+ courses, 300+ virtual labs, mentorship and leadership programs, professional tribes, sponsored certifications, and much more. Earn bonuses via our Client Referral and Employee Referral Program’s. Refer and earn – tap your network for net-worth. We recognize our employees work via our Qudos platform - You can earn bonuses and spot awards by celebrating your and your peers’ achievements. Planning a vacation? Looking for car insurance? Get access to QualityAI Employee Perks for discounts on anything from travel to electronics. With so many offerings the savings are endless! A Competitive pay, the salary range for the role is $135,000 - $145,000. Visit our website at https://www.quality-ai.com/

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineering Architect/Lead
Data Engineering Architect/Lead

Quality Ai • United States

Remote
USD 135,000 - 145,000
401k plan with company match
Healthcare benefits
Global mobility opportunities
Senior IT Project Manager - ITSM
Senior IT Project Manager - ITSM

Quality Ai • United States

On-site
USD 140,000 - 150,000
Diversity & inclusion
Global mobility opportunities
Career progression
+3
Data Management Specialist
Data Management Specialist

QualityAI • Miami (FL)

On-site
USD 140,000 - 160,000
Diversity & inclusion
International mobility
Career progression
+3
#24023 - Lead Onshore Full-Stack Developer
#24023 - Lead Onshore Full-Stack Developer

QualityAI • United States

Remote
USD 120,000 - 130,000
Client Referral Program
Employee Referral Program
Global rotation and internationalmob"
+1
ETL Manual Tester
ETL Manual Tester

Quality Ai • United States

Remote
USD 90,000 - 100,000
Competitive compensation
Remote work within US
401(k) plan
+2
Transformation Delivery Director
Transformation Delivery Director

Quality Ai • United States

Hybrid
USD 130,000 - 160,000
Diversity & inclusion
Internal rotation
Career progression
+4
VP of AI Center of Excellence (CoE)
VP of AI Center of Excellence (CoE)

Quality Ai • United States

Hybrid
USD 180,000 - 220,000
Competitive pay
Annual bonus
Global opportunities
+2
Senior IT Project Manager - CyberSec
Senior IT Project Manager - CyberSec

Quality Ai • United States

On-site
USD 140,000 - 150,000
Global opportunities
Diversity & inclusion
Employee events
+3
C# Developer
C# Developer

QualityAI • United States

Remote
USD 90,000 - 130,000
Performance Architect
Performance Architect

Quality Ai • United States

On-site
USD 130,000 - 170,000
Diversity & inclusion
Internal rotation
Career progression
+3