Data Platform Architect

hatch I.T.

Falls Church (VA)

On-site

USD 150,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

401k matching
Healthcare insurance

Job summary

Expression seeks an experienced Data Platform Architect to guide data pipelines, analytics, and ML workloads in Databricks and Palantir Foundry, delivering production-ready solutions for mission environments.

You will work across teams to establish standards, automate testing and deployment, enable self‑service ML, and ensure security, governance, and data quality across the platform.

Qualifications

  • 5+ years of technical experience, including 3+ years designing or implementing production solutions on Databricks, Palantir Foundry, or similar modern data platforms.
  • Strong experience with Python, SQL, PySpark, and Spark SQL for scalable data-processing workflows.
  • Experience with Palantir Foundry or comparable enterprise analytics platforms, including pipeline development, governed data delivery, lineage, and operational analytics.
  • Experience designing and operationalizing data pipelines, transformation workflows, and data products supporting structured and unstructured data.
  • Hands-on knowledge of Databricks platform capabilities such as Delta Lake, Workflows, MLflow, Unity Catalog, or similar platform-native services.

Responsibilities

  • Provide hands-on architectural guidance to teams implementing data pipelines, analytics workflows, data products, and AI/ML capabilities in Databricks and Palantir Foundry.
  • Guide selection and implementation of platform-native capabilities for data ingestion, transformation, orchestration, model execution, analytics, and data-product delivery.
  • Advise teams on appropriate use of Databricks, Foundry, and integrated cross-platform architectures.
  • Guide the transition of prototypes and notebook-based solutions into reliable, maintainable production workflows.
  • Establish and maintain technical standards for project structure, code organization, pipeline design, workflow orchestration, testing, metadata, lineage, documentation, and platform implementation.
  • Develop reusable templates, reference architectures, and implementation patterns that improve consistency and accelerate delivery.
  • Promote scalable approaches including medallion architecture, governed data publishing, reusable transformation logic, and shared analytics and ML components.
  • Conduct technical reviews and provide actionable guidance to improve scalability, maintainability, reliability, and supportability.
  • Guide CI/CD implementation for jobs, pipelines, notebooks, packaged code, models, and data products.
  • Establish operational practices for deployment, environment promotion, monitoring, alerting, rollback, release management, observability, lineage, and data-quality validation.
  • Promote reproducible MLOps practices for model training, validation, packaging, registration, deployment, monitoring, batch inference, and lifecycle management using MLflow, Databricks workflows, and related capabilities.
  • Design scalable ML inference approaches supporting production workloads and establish monitoring for model performance, data drift, and system health.
  • Support self-service ML capabilities that enable data scientists to efficiently deploy and monitor models.
  • Define integration patterns for onboarding data sources, managing schema evolution, and connecting Databricks and Foundry with enterprise systems, applications, data warehouses, streaming platforms, APIs, and BI tools.
  • Guide implementation of secure access controls, governed data sharing, metadata management, data catalogs, lineage, traceability, and audit-ready workflows.
  • Establish data-quality standards and automated testing approaches for analytical and ML workloads.
  • Partner with stakeholders to define data definitions, business logic, governance requirements, and compliant handling of structured and unstructured data.
  • Advise teams on Spark optimization, workload design, workflow dependencies, storage and compute utilization, and other platform-performance considerations.
  • Identify and help resolve architecture, integration, reliability, and performance issues affecting production jobs, data products, and operational analytics.
  • Design data models supporting machine learning, analytics, and business intelligence requirements, including integrations with Tableau, Power BI, and Qlik Sense.
  • Build and support integrations with MAVEN Smart Systems/Palantir Foundry environments and other enterprise systems.
  • Collaborate with engineers, data scientists, BI analysts, product managers, platform and security teams, and mission stakeholders to align architecture decisions with delivery priorities.
  • Participate in design sessions, technical reviews, sprint activities, demonstrations, and cross-team problem solving.
  • Maintain technical documentation supporting implementation consistency, reuse, operational handoff, and long-term supportability.

Skills

Python
SQL
PySpark
Spark SQL

Tools

Databricks
Palantir Foundry
MLflow
Unity Catalog
Git CI/CD

Job description

hatch I.T. is partnering with Expression to find a Data Platform Engineer. See details below:

About The Role:

Expression is seeking an experienced Data Platform Architect to provide architectural guidance, technical standards, and operational support for teams delivering secure, scalable data, analytics, and AI/ML solutions in mission environments.

The Data Platform Architect will work across engineering, data science, analytics, platform, and mission teams to guide implementation in Databricks and Palantir Foundry. This role will help delivery teams structure data pipelines, data products, analytics and ML workflows, and platform assets so solutions are consistent, reusable, governed, supportable, and production-ready.

The successful candidate will provide hands‑on guidance spanning data integration, DataOps, DevOps, MLOps, governance, security, compliance, performance optimization, and platform operations while helping teams move solutions from prototypes into reliable production environments.

Location and Clearance:
  • Clearance: Secret/Top Secret clearance required
  • Location: Falls Church, VA
About the Company:

Founded in 1997 and headquartered in Washington DC, Expression provides data fusion, data analytics, software engineering, information technology, and electromagnetic spectrum management solutions to the U.S. Department of Defense, Department of State, and national security community. Expression’s “Perpetual Innovation” culture focuses on creating immediate and sustainable value for their clients via agile delivery of tailored solutions built through constant engagement with their clients. Expression was ranked #1 on the Washington Technology 2018's Fast 50 list of fastest growing small business Government contractors and a Top 20 Big Data Solutions Provider by CIO Review.

Responsibilities:
  • Provide hands‑on architectural guidance to teams implementing data pipelines, analytics workflows, data products, and AI/ML capabilities in Databricks and Palantir Foundry.
  • Guide selection and implementation of platform‑native capabilities for data ingestion, transformation, orchestration, model execution, analytics, and data‑product delivery.
  • Advise teams on appropriate use of Databricks, Foundry, and integrated cross‑platform architectures.
  • Guide the transition of prototypes and notebook‑based solutions into reliable, maintainable production workflows.
  • Establish and maintain technical standards for project structure, code organization, pipeline design, workflow orchestration, testing, metadata, lineage, documentation, and platform implementation.
  • Develop reusable templates, reference architectures, and implementation patterns that improve consistency and accelerate delivery.
  • Promote scalable approaches including medallion architecture, governed data publishing, reusable transformation logic, and shared analytics and ML components.
  • Conduct technical reviews and provide actionable guidance to improve scalability, maintainability, reliability, and supportability.
  • Guide CI/CD implementation for jobs, pipelines, notebooks, packaged code, models, and data products.
  • Establish operational practices for deployment, environment promotion, monitoring, alerting, rollback, release management, observability, lineage, and data‑quality validation.
  • Promote reproducible MLOps practices for model training, validation, packaging, registration, deployment, monitoring, batch inference, and lifecycle management using MLflow, Databricks workflows, and related capabilities.
  • Design scalable ML inference approaches supporting production workloads and establish monitoring for model performance, data drift, and system health.
  • Support self‑service ML capabilities that enable data scientists to efficiently deploy and monitor models.
  • Define integration patterns for onboarding data sources, managing schema evolution, and connecting Databricks and Foundry with enterprise systems, applications, data warehouses, streaming platforms, APIs, and BI tools.
  • Guide implementation of secure access controls, governed data sharing, metadata management, data catalogs, lineage, traceability, and audit‑ready workflows.
  • Establish data‑quality standards and automated testing approaches for analytical and ML workloads.
  • Partner with stakeholders to define data definitions, business logic, governance requirements, and compliant handling of structured and unstructured data.
  • Advise teams on Spark optimization, workload design, workflow dependencies, storage and compute utilization, and other platform‑performance considerations.
  • Identify and help resolve architecture, integration, reliability, and performance issues affecting production jobs, data products, and operational analytics.
  • Design data models supporting machine learning, analytics, and business intelligence requirements, including integrations with Tableau, Power BI, and Qlik Sense.
  • Build and support integrations with MAVEN Smart Systems/Palantir Foundry environments and other enterprise systems.
  • Collaborate with engineers, data scientists, BI analysts, product managers, platform and security teams, and mission stakeholders to align architecture decisions with delivery priorities.
  • Participate in design sessions, technical reviews, sprint activities, demonstrations, and cross‑team problem solving.
  • Maintain technical documentation supporting implementation consistency, reuse, operational handoff, and long‑term supportability.
Qualifications:
  • 5+ years of technical experience, including 3+ years designing or implementing production solutions on Databricks, Palantir Foundry, or similar modern data platforms.
  • Strong experience with Python, SQL, PySpark, and Spark SQL for scalable data‑processing workflows.
  • Experience with Palantir Foundry or comparable enterprise analytics platforms, including pipeline development, governed data delivery, lineage, and operational analytics.
  • Experience designing and operationalizing data pipelines, transformation workflows, and data products supporting structured and unstructured data.
  • Hands‑on knowledge of Databricks platform capabilities such as Delta Lake, Workflows, MLflow, Unity Catalog, or similar platform‑native services.
  • Familiarity with DataOps, DevOps, and MLOps practices, including CI/CD, version control, testing, deployment, monitoring, and operational support.
  • Strong understanding of data quality, metadata management, lineage, access control, and governance within secure or regulated environments.
  • Experience troubleshooting architecture, integration, performance, and operational issues across distributed data platforms.
  • Ability to establish technical standards, guide architecture and implementation decisions, and clearly communicate technical concepts to technical and non‑technical stakeholders.
Preferred Qualifications:
  • Deep Databricks expertise, including medallion architecture, Delta optimization, workload tuning, cluster and job strategy, and production ML enablement.
  • Experience implementing solutions in Palantir Foundry, including data‑pipeline organization, governed data assets, operational workflows, and integrations.
  • Experience with Git‑based CI/CD pipelines, infrastructure and deployment tooling, and cloud‑native platform services.
  • Experience supporting the ML lifecycle, including model packaging, registration, deployment, monitoring, and inference‑workflow integration.
  • Knowledge of enterprise data integration, API‑based data exchange, and secure cross‑platform interoperability.
  • Experience with Advana/MAVEN Smart System (Palantir Foundry) or similar DoD enterprise analytics environments.
  • Prior experience supporting Department of Defense, Intelligence Community, or other Federal mission environments.

Expression offers competitive salaries and benefits, such as:

  • 401k matching
  • PPO and HDHP medical/dental/vision insurance
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Platform Architect
Data Platform Architect

Hatch IT • Falls Church (VA)

On-site
USD 140,000 - 190,000
401k matching
PPO and HDHP medical/dental/vision
Data Platform Architect
Data Platform Architect

Eliassen Group • Washington

On-site
USD 110,000 - 117,000
Data Engineer
Data Engineer

Hatch IT • Washington

On-site
USD 120,000 - 180,000
401k matching
Medical/dental/vision insurance (PPO/H
Education reimbursement
+4
Senior Data Engineer
Senior Data Engineer

INTELLITECH LLC • Virginia

Hybrid
USD 120,000 - 180,000
Senior Data Platform Architect: Databricks & Foundry
Senior Data Platform Architect: Databricks & Foundry

Hatch IT • Falls Church (VA)

On-site
USD 140,000 - 190,000
401k matching
PPO and HDHP medical/dental/vision
Senior Data Engineer
Senior Data Engineer

Expression Networks • Arlington (VA)

On-site
USD 130,000 - 180,000
401k matching
Medical/dental/vision insurance
Education reimbursement up to $10,000/
+3
Senior Data Engineer
Senior Data Engineer

Expression • Arlington (VA)

On-site
USD 140,000 - 190,000
401k matching
PPO/HDHP medical/dental/vision
Education reimbursement up to $10,000/
+3
Data Engineer
Data Engineer

Expression Networks • Arlington (VA)

On-site
USD 120,000 - 170,000
401k matching
Medical/dental/vision insurance
Education reimbursement up to $10,000/
+5
Data Solution Architect
Data Solution Architect

FCCI • Sarasota (FL)

Hybrid
USD 134,000 - 207,000
Senior Databricks Solution Architect
Senior Databricks Solution Architect

Prodapt • Richardson (TX)

On-site
USD 180,000 - 260,000