Data Architect

Halo Media; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Halo Media is seeking an experienced Data Architect to lead the design and evolution of a modern data platform for healthcare applications. You will define architecture, establish engineering practices, and provide technical leadership to ensure scalable, reliable data solutions.

You will mentor engineers and collaborate with product and client teams to translate business needs into robust architectures. You will design cloud-native architectures on AWS, build data pipelines with Databricks,

Qualifications

• 7+ years in Data Engineering or Data Architecture.
• 5+ years with Azure Databricks.
• Expert-level Python and SQL.
• Strong Apache Spark experience.
• Cloud-native solutions on AWS.
• AWS S3, Glue, Athena experience.
• Airflow experience.
• Strong data modeling and ETL/ELT design.
• Proven leadership and mentoring.
• Excellent English communication.

Responsibilities

• Design and evolve scalable cloud-native data architectures on AWS.
• Define data models, integration patterns, and standards.
• Lead design of data pipelines using Databricks, Spark, Python, SQL.
• Establish best practices for data quality, governance, scalability, observability.
• Mentor Data Engineers through reviews and guidance.
• Partner with product managers and stakeholders to translate needs into solutions.
• Design ingestion, transformation, orchestration for large datasets.
• Collaborate on AI-ready data platforms for RAG and Generative AI.
• Drive decisions improving reliability and long-term scalability.

Skills

Databricks

Python

SQL

Apache Spark

AWS

Airflow

Data modeling

ETL/ELT

Data architecture

Mentoring

Client communication

English (Advanced)

Tools

Docker

Kubernetes

Pinecone

Weaviate

Chroma

Qdrant

Milvus

LangChain

LlamaIndex

CI/CD

Infrastructure as Code

Job description

We are looking for an experienced Data Architect to lead the design and evolution of a modern data platform supporting critical business applications within the healthcare industry.

This is a highly strategic role where you will define the data architecture, establish engineering best practices, and provide technical leadership to ensure scalable, reliable, and high-quality data solutions. You will work closely with engineering teams, product stakeholders, and client leadership to transform complex business requirements into robust data architectures.

Beyond designing data pipelines, you will serve as the technical authority for data engineering decisions, helping shape the long-term architecture while mentoring engineers and driving engineering excellence.

Responsibilities

• Design and evolve scalable, cloud-native data architectures on AWS.
• Define data models, integration patterns, and architecture standards across multiple data sources.
• Lead the design of modern data pipelines using Databricks, Spark, Python, and SQL.
• Establish best practices for data quality, governance, scalability, performance, and observability.
• Guide Data Engineers through technical leadership, architecture reviews, and mentoring.
• Partner with product managers, business stakeholders, and client teams to understand business needs and translate them into technical solutions.
• Design efficient ingestion, transformation, and orchestration strategies for large-scale datasets.
• Collaborate on AI-ready data platforms supporting Retrieval-Augmented Generation (RAG) and Generative AI initiatives.
• Drive technical decisions that improve reliability, maintainability, and long-term scalability of the platform.

Requirements

• 7+ years of experience in Data Engineering, Data Architecture, or related roles.
• 5+ years of work experience with Azure Databricks
• Strong hands-on experience with Databricks.
• Expert-level Python and SQL.
• Strong experience with Apache Spark.
• Experience building cloud-native solutions on AWS.
• Experience with AWS services such as S3, Glue, Athena, and related data services.
• Experience with workflow orchestration tools such as Airflow.
• Strong understanding of data modeling, ETL/ELT design, and distributed data processing.
• Experience designing highly scalable and reliable data platforms.
• Strong communication skills with experience working directly with clients and business stakeholders.
• Experience leading technical initiatives and mentoring engineering teams.
• Advanced English Level.

Preferred Skills

• Experience with AI/ML data platforms.
• Familiarity with Retrieval-Augmented Generation (RAG) architectures.
• Experience working with Vector Databases (Pinecone, Weaviate, Chroma, Qdrant, Milvus, or similar).
• Knowledge of LangChain, LlamaIndex, or similar frameworks.
• Experience with Docker and Kubernetes.
• Experience implementing CI/CD and Infrastructure as Code.
• Background working in consulting or client-facing environments.