AI/ML Ops Engineer: Scalable Data Pipelines

Blackline Systems Inc; New York (NY); On-site; USD 145,000 - 182,000; Full time

Benefits offered by this job

Incentive programs

Pay transparency

Job summary

BlackLine is seeking a Software Engineer, AI/ML Ops to design, build, and optimize data pipelines powering its next-generation AI-driven accounting agents. You will lead scalable, high-performance data infrastructure and collaborate across teams.

You will work with Python/Scala/Java, ML frameworks, and modern orchestration tools to operate production pipelines for ML/LLM systems across GCP, AWS and Azure, with a focus on reliability, governance, and cost-efficiency.

Qualifications

• 2+ years of programming experience in Python, Java or Scala.
• Experience with ML frameworks: TensorFlow, PyTorch, scikit-learn.
• Proficient with orchestration tools: Airflow, Kubeflow, Vertex AI, MLflow.
• Production ML/LLM pipelines across cloud platforms (GCP, AWS, Azure).
• Familiarity with LangChain, LangGraph, ADK.
• CI/CD, IaC, and DevSecOps practices.
• Observability stacks: Prometheus, Grafana, New Relic.
• Governance for Responsible AI, auditability, and cost metering.
• Containerization with Docker and Kubernetes.

Responsibilities

• Data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance.
• Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine’s internal connector ecosystem
• Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
• Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
• Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies.

Skills

Python

Java

Scala

TensorFlow

PyTorch

scikit-learn

Airflow

Kubeflow

Vertex AI

MLflow

GCP

AWS

Azure

LangChain

LangGraph

ADK

CI/CD

IaC

DevSecOps

Prometheus

Grafana

New Relic

Responsible AI

Auditability

Cost metering

Docker

Kubernetes

Tools

FiveTran

Plaid

Job description

BlackLine is seeking a Software Engineer, AI/ML Ops to design, build, and optimize data pipelines powering its next-generation AI-driven accounting agents. You will lead scalable, high-performance data infrastructure and collaborate across teams.

You will work with Python/Scala/Java, ML frameworks, and modern orchestration tools to operate production pipelines for ML/LLM systems across GCP, AWS and Azure, with a focus on reliability, governance, and cost-efficiency.