Lead Data Engineer for AI & ML Pipelines

BlackLine; Los Angeles (CA); On-site; USD 245,000 - 307,000; Full time

Job summary

BlackLine seeks a Lead Data Engineer to design, build, and optimize data pipelines powering AI-driven accounting agents. Lead PySpark ETL development, establish robust client data integrations via APIs and connectors, and ensure data accuracy and reliability at scale.

You will collaborate with data science, security, and product teams to set governance standards, mentor engineers, and drive end-to-end ML model deployment and observability.

Qualifications

• Experience building large-scale PySpark ETL pipelines.
• Strong data modeling and data quality focus.
• Experience integrating client data via APIs and connectors.
• Ability to mentor engineers and lead design reviews.

Responsibilities

• Lead the design and maintenance of scalable data pipelines.
• Manage integrations with client data sources via APIs and connectors.
• Ensure reliability through monitoring, testing, and data validation.
• Collaborate with ML/AI teams to deploy models and governance.

Skills

PySpark

ETL pipelines

APIs integration

Data quality

ML/AI data workflows

Cross-team collaboration

Education

Bachelor’s or Master’s in CS/related field

Tools

FiveTran

Plaid

Internal connector ecosystem

Job description

BlackLine seeks a Lead Data Engineer to design, build, and optimize data pipelines powering AI-driven accounting agents. Lead PySpark ETL development, establish robust client data integrations via APIs and connectors, and ensure data accuracy and reliability at scale.

You will collaborate with data science, security, and product teams to set governance standards, mentor engineers, and drive end-to-end ML model deployment and observability.