Lead AI/ML Data Engineer - Scalable Pipelines

Blackline Systems Inc; Los Angeles (CA); On-site; USD 245,000 - 307,000; Full time

Job summary

BlackLine is seeking a Lead Data Engineer to design, build, and optimize data pipelines powering AI‑driven accounting agents. You’ll lead scalable data infrastructure and collaborate with data science, security, and product teams to set governance and performance standards.

Responsibilities include building PySpark ETL pipelines, connecting to client data sources via APIs, and ensuring data accuracy, reliability, and observability at scale. Experience with ML/LLM systems is a plus.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field.
• Strong programming skills in Python, Java, or Scala.
• Experience with ML frameworks (TensorFlow, PyTorch, scikit‑learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow).
• Proven experience operating production pipelines for ML/LLM systems across cloud ecosystems (GCP, AWS, Azure).
• Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management.
• Proficiency in containerization technologies (Docker, Kubernetes).

Responsibilities

• Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance.
• Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine’s internal connector ecosystem.
• Monitor pipeline performance, automate testing, and validate data accuracy.
• Lead incident response and reliability strategies for ML/AI systems.
• Architect and standardize model registries and feature stores to support version tracking, lineage, and reproducibility across environments.

Skills

Python

Java

Scala

CI/CD

DevSecOps

Prometheus

Grafana

New Relic

Docker

Kubernetes

Airflow

Kubeflow

Vertex AI

MLflow

Education

Bachelor’s or Master’s in Computer Science, Machine Learning, Data Science, or related field

Tools

TensorFlow

PyTorch

scikit-learn

LangChain

LangGraph

ADK

Job description

BlackLine is seeking a Lead Data Engineer to design, build, and optimize data pipelines powering AI‑driven accounting agents. You’ll lead scalable data infrastructure and collaborate with data science, security, and product teams to set governance and performance standards.

Responsibilities include building PySpark ETL pipelines, connecting to client data sources via APIs, and ensuring data accuracy, reliability, and observability at scale. Experience with ML/LLM systems is a plus.