Lead Data Architect

SHR Consulting Group; United States; On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company contribution

Paid time off and eleven federal holli

Certification reimbursement and培训

Life and disability insurance

Job summary

SHR Consulting Group, LLC is seeking a senior Lead Data Architect to provide enterprise data architecture leadership for a FEMA effort. The role designs cloud data platforms, data pipelines, and governance to scale with data sources, volume, and AI/ML workloads.

You will advance Medallion Lakehouse patterns, real-time streaming, and secure data sharing, working with government stakeholders and engineering teams.

Qualifications

• Extensive experience designing enterprise-scale cloud data platforms.
• Demonstrated experience with Databricks Lakehouse or comparable enterprise cloud data platforms.
• Strong hands-on knowledge of Medallion architecture.
• Demonstrated expertise designing scalable real-time streaming topologies.
• Experience designing data architectures within Federal cloud or similarly regulated environments.
• Strong understanding of enterprise data integration, data modeling, lineage, metadata management, governance, and access controls.
• Experience designing architectures supporting high-volume batch and streaming workloads.
• Ability to troubleshoot complex data pipeline and architecture failures.
• Experience establishing reusable enterprise architecture patterns and technical standards.
• Strong written and verbal communication skills with the ability to communicate architecture decisions to both technical teams and Government leadership.

Responsibilities

• Lead the design and evolution of FEMA’s enterprise data architecture.
• Design enterprise-wide cloud data platforms and scalable data-processing architectures.
• Develop and govern Medallion/Lakehouse architecture patterns.
• Design and oversee metadata-driven ingestion frameworks.
• Design scalable real-time and streaming architectures.
• Establish architectural patterns supporting growth in data sources, data volume, velocity, concurrency, and users.
• Ensure new pipelines, integrations, and data products conform to FEMA’s architecture standards.
• Define reusable architecture and integration patterns rather than one-off implementations.
• Oversee end-to-end data lineage from source systems through curated data layers and downstream consumption.
• Support technical implementation of FEMA data governance requirements, including metadata management, data classification and tagging, cataloging, fine-grained access controls, and data lineage.

Skills

Databricks

Medallion architecture

Real-time streaming

Cloud data platforms

Data governance

Data integration

Python / PySpark

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Python

SQL

CI/CD

DevSecOps

Job description

SHR Consulting Group, LLC is a small business delivering enterprise IT, cybersecurity, and program management services to the Department of Defense and federal civilian agencies. We support mission-critical infrastructure at the Pentagon and across the National Capital Region, and we invest in our people through competitive compensation, professional certification support, and long-term career growth on stable, multi-year programs.

We are seeking a senior Lead Data Architect as a Key Personnel for a bid opportunity to provide enterprise data architecture leadership for a FEMA effort.

The Lead Data Architect will establish and evolve the overarching data architecture while ensuring that pipelines, integrations, data products, external sharing mechanisms, and AI/ML data services remain scalable, secure, maintainable, and aligned with FEMA's enterprise architecture.

This position is CONTINGENT UPON CONTRACT AWARD. Candidates selected for consideration must be willing to authorize the submission of their resume and qualifications in support of our proposal response.

Key Responsibilities

• Lead the design and evolution of FEMA’s enterprise data architecture.
• Design enterprise-wide cloud data platforms and scalable data-processing architectures.
• Develop and govern Medallion/Lakehouse architecture patterns.
• Design and oversee metadata-driven ingestion frameworks.
• Design scalable real-time and streaming architectures.
• Establish architectural patterns supporting growth in data sources, data volume, velocity, concurrency, and users.
• Ensure new pipelines, integrations, and data products conform to FEMA’s architecture standards.
• Define reusable architecture and integration patterns rather than one-off implementations.
• Oversee end-to-end data lineage from source systems through curated data layers and downstream consumption.
• Support technical implementation of FEMA data governance requirements, including:
  • Metadata management
  • Data classification and tagging
  • Cataloging
  • Fine-grained access controls
  • Data lineage and provenance
• Develop architecture supporting secure external data exchange and ingestion.
• Architect data services supporting AI/ML workloads, including feature pipelines, curated datasets, embedding/vector stores, and retrieval pipelines as required.
• Support platform capacity planning, performance engineering, elastic scaling, workload isolation, and cost optimization.
• Troubleshoot complex enterprise pipeline and architecture issues.
• Provide architecture guidance and technical leadership to engineering teams and Government stakeholders.
• Maintain architecture documentation sufficient for Government personnel or successor contractors to operate and extend the platform.

Required Qualifications

• Extensive experience designing enterprise-scale cloud data platforms and architectures.
• Demonstrated experience with Databricks Lakehouse or comparable enterprise cloud data platforms.
• Strong hands‑on knowledge of Medallion architecture.
• Demonstrated expertise designing scalable real-time streaming topologies.
• Experience designing data architectures within Federal cloud or similarly regulated environments.
• Strong understanding of enterprise data integration, data modeling, lineage, metadata management, governance, and access controls.
• Experience designing architectures supporting high-volume batch and streaming workloads.
• Ability to troubleshoot complex data pipeline and architecture failures.
• Experience establishing reusable enterprise architecture patterns and technical standards.
• Strong written and verbal communication skills with the ability to communicate architecture decisions to both technical teams and Government leadership.

Highly Desired Technical Experience

• Databricks
• Python / PySpark
• SQL
• Lakehouse / Medallion architecture
• Structured Streaming or comparable streaming frameworks
• Data catalogs and lineage
• API and data-exchange architectures
• CI/CD and DevSecOps
• Data security and fine-grained access control
• FinOps and cloud architecture optimization

Preferred Qualifications

• FEMA or DHS experience.
• Experience architecting enterprise Federal data modernization programs.
• Experience integrating large numbers of heterogeneous modern and legacy source systems.
• Experience designing governed data foundations supporting AI/ML applications.
• Knowledge of NIST, FISMA, FedRAMP, DHS 4300A, and Federal data/privacy requirements.
• Databricks architecture or engineering certifications.

Clearance Requirements

• Must be able to obtain and maintain the Government-required suitability/fitness determination and IT access authorization.
• Competitive salary commensurate with experience and clearance level.
• Comprehensive medical, dental, and vision coverage.
• 401(k) with company contribution.
• Paid time off and eleven federal holidays.
• Certification reimbursement and training
• Life and disability insurance.

SHR Consulting Group, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.