Senior Data Engineer: Scalable AI-Ready Data Pipelines

Vatica Health; Richmond (VA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Bonus potential

401k plans

Room for growth and advancement

Comprehensive Medical, Dental, Vision

Job summary

Vatica Health is seeking a Senior Data Engineer to design, build, and operate data pipelines and APIs that power our data-driven products. You will own data movement from ingestion to consumption, ensuring reliability, security, and availability for multiple teams.

You will partner with product, analytics, data science, and ML teams to translate business needs into scalable production solutions, and you will mentor engineers while helping establish engineering standards and best practices.

Qualifications

• 8–10 years of professional data engineering experience
• Strong Python and advanced SQL with production data pipelines
• Experience with at least one workflow orchestration platform and big data processing frameworks
• Experience with REST APIs, cloud platforms, and data modeling
• Knowledge of AI/ML workflows, LLM APIs, embeddings, and vector databases
• Experience with Git, CI/CD, Docker, and Terraform
• Strong problem-solving and stakeholder communication

Responsibilities

• Design, build, and maintain batch and streaming data pipelines
• Develop ETL/ELT processes for scalable, reliable data flows
• Build and operate AWS cloud solutions (EC2, ECS, Lambda, API Gateway, SQS)
• Manage data workflows with scheduling, retries, alerts, and backfills
• Establish monitoring, logging, and observability for production operations
• Develop secure REST APIs and Python data services using FastAPI or Flask
• Implement API authentication, authorization, versioning, error handling, and rate limiting
• Create data foundations for ML and generative AI including embeddings and retrieval
• Integrate AI tools and LLM APIs into document processing workflows
• Ensure data quality, lineage, security, privacy, and compliance
• Lead architecture and code reviews; mentor engineers and communicate recommendations

Skills

Python

SQL

Data pipelines

REST APIs

AI/ML workflows

Workflow orchestration

Git

CI/CD

Docker

Terraform

Education

Bachelor's or Master's in CS/Engineering

Tools

AWS

Job description

Vatica Health is seeking a Senior Data Engineer to design, build, and operate data pipelines and APIs that power our data-driven products. You will own data movement from ingestion to consumption, ensuring reliability, security, and availability for multiple teams.

You will partner with product, analytics, data science, and ML teams to translate business needs into scalable production solutions, and you will mentor engineers while helping establish engineering standards and best practices.