Senior Data Architect - Lakehouse & Real-Time Data

SHR Consulting Group; United States; On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company contribution

Paid time off and eleven federal holli

Certification reimbursement and培训

Life and disability insurance

Job summary

SHR Consulting Group, LLC is seeking a senior Lead Data Architect to provide enterprise data architecture leadership for a FEMA effort. The role designs cloud data platforms, data pipelines, and governance to scale with data sources, volume, and AI/ML workloads.

You will advance Medallion Lakehouse patterns, real-time streaming, and secure data sharing, working with government stakeholders and engineering teams.

Qualifications

• Extensive experience designing enterprise-scale cloud data platforms.
• Demonstrated experience with Databricks Lakehouse or comparable enterprise cloud data platforms.
• Strong hands-on knowledge of Medallion architecture.
• Demonstrated expertise designing scalable real-time streaming topologies.
• Experience designing data architectures within Federal cloud or similarly regulated environments.
• Strong understanding of enterprise data integration, data modeling, lineage, metadata management, governance, and access controls.
• Experience designing architectures supporting high-volume batch and streaming workloads.
• Ability to troubleshoot complex data pipeline and architecture failures.
• Experience establishing reusable enterprise architecture patterns and technical standards.
• Strong written and verbal communication skills with the ability to communicate architecture decisions to both technical teams and Government leadership.

Responsibilities

• Lead the design and evolution of FEMA’s enterprise data architecture.
• Design enterprise-wide cloud data platforms and scalable data-processing architectures.
• Develop and govern Medallion/Lakehouse architecture patterns.
• Design and oversee metadata-driven ingestion frameworks.
• Design scalable real-time and streaming architectures.
• Establish architectural patterns supporting growth in data sources, data volume, velocity, concurrency, and users.
• Ensure new pipelines, integrations, and data products conform to FEMA’s architecture standards.
• Define reusable architecture and integration patterns rather than one-off implementations.
• Oversee end-to-end data lineage from source systems through curated data layers and downstream consumption.
• Support technical implementation of FEMA data governance requirements, including metadata management, data classification and tagging, cataloging, fine-grained access controls, and data lineage.

Skills

Databricks

Medallion architecture

Real-time streaming

Cloud data platforms

Data governance

Data integration

Python / PySpark

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Python

SQL

CI/CD

DevSecOps

Job description

SHR Consulting Group, LLC is seeking a senior Lead Data Architect to provide enterprise data architecture leadership for a FEMA effort. The role designs cloud data platforms, data pipelines, and governance to scale with data sources, volume, and AI/ML workloads.

You will advance Medallion Lakehouse patterns, real-time streaming, and secure data sharing, working with government stakeholders and engineering teams.