Senior Data Platform Engineer — Scalable ML Data Pipelines

DatologyAI; Redwood City, Northern (CA, KY); Hybrid; USD 180,000 - 300,000; Full time

Benefits offered by this job

Health benefits

401(k) plan

Unlimited PTO

Parental Leave

Wellness stipend

Learning stipend

Lunch provided

Relocation assistance

Job summary

DatologyAI is seeking an experienced Data Platform Engineer to join our core Engineering team in San Mateo, CA. As a senior hire, you will lead the development of our data platform and drive technical decisions with the founders, shaping the direction of our product and data infrastructure.

You will design and deploy scalable data processing solutions, partner with researchers and engineers, and ensure the system is reliable, secure, and trusted by customers.

Qualifications

• 4+ years of experience in data engineering, owning production systems end-to-end with scalable processing and storage.
• Proficiency in Python, Scala, or Java.
• Experience as a technical lead of a Data Engineering, Platform, or Infrastructure team.
• Experience building ML/DL systems or data infrastructure for large-scale model training.
• High bar for design, correctness, and testing.
• Low ego, high ownership and collaboration.

Responsibilities

• Design, build and maintain scalable data processing solutions with reliability and security.
• Architect and deploy back-end systems powering the data curation platform.
• Partner with researchers and engineers to add features and capabilities.
• Ensure systems are reliable, secure, and trustworthy for customers.

Skills

Python

Scala/Java

Data pipelines

Leadership

Airflow

Tools

Spark

Flink

HDFS

S3

Snowflake

Hive

Airflow

Dagster

Job description

DatologyAI is seeking an experienced Data Platform Engineer to join our core Engineering team in San Mateo, CA. As a senior hire, you will lead the development of our data platform and drive technical decisions with the founders, shaping the direction of our product and data infrastructure.

You will design and deploy scalable data processing solutions, partner with researchers and engineers, and ensure the system is reliable, secure, and trusted by customers.