Principal Data Engineer: AI-Driven Data Platforms Lead

Menlo Ventures; Laguna Beach (CA); On-site; USD 210,000 - 290,000; Full time

Benefits offered by this job

Health, Dental, Vision

PTO & Holidays

401K

Job summary

True Anomaly is seeking a Principal Data Engineer to architect and deliver scalable data platforms for space domain applications. You will write production-grade code, design data models, and lead engineering efforts across teams, driving reliability, performance and governance.

The role emphasizes hands-on leadership, Python/SQL expertise, and experience with Snowflake or Databricks, AWS/Azure/GCP, and AI-assisted tooling to accelerate pipelines and improve code quality.

Qualifications

• 10+ years of experience in data engineering and software engineering.
• Strong hands-on Python and SQL experience.
• 3+ years of experience with Snowflake, Databricks, or both.
• Strong understanding of data engineering, data architecture, data modelling and ELT/ETL.
• Strong understanding of software engineering practices including Git, testing, CI/CD and code reviews.

Responsibilities

• Design, develop and maintain scalable data pipelines and data products using Python, SQL and modern data engineering practices, supporting batch, streaming, analytics, and AI/ML workloads
• Build and optimize ELT/ETL processes and data models using cloud data platforms with a focus on performance, scalability, reliability and cost efficiency
• Establish and apply engineering best practices for data quality, testing, monitoring, observability, CI/CD, version control, security, and production reliability
• Own data engineering projects end‑to‑end, from technical design and development through deployment, production support, troubleshooting, and continuous improvement
• Collaborate across engineering, AI/ML, analytics, product and business teams to translate requirements into reliable, scalable data solutions and products and contribute to technical design decisions
• Leverage AI‑assisted engineering tools while contributing to data engineering technical excellence through code reviews, reusable frameworks, documentation, knowledge sharing, and mentoring other data engineers
• Mentor Junior and Senior Data Engineers and provide technical guidance across the engineering teams

Skills

Python

SQL

Data engineering

Leadership

Tools

Snowflake

Databricks

Airflow

dbt

Kafka

AWS

Azure

GCP

Job description

True Anomaly is seeking a Principal Data Engineer to architect and deliver scalable data platforms for space domain applications. You will write production-grade code, design data models, and lead engineering efforts across teams, driving reliability, performance and governance.

The role emphasizes hands-on leadership, Python/SQL expertise, and experience with Snowflake or Databricks, AWS/Azure/GCP, and AI-assisted tooling to accelerate pipelines and improve code quality.