Lead Data Platform Engineer - Compliance & Cloud Ops

Vertexinc

United States

Remote

USD 140,000 - 230,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Vertex Inc. is seeking a senior engineering leader to own and operate a data platform that underpins regulatory and compliance workflows.

You will translate platform direction into engineering plans, guide day-to-day execution, and balance new capabilities with reliability, cost, and maintainability. You will lead data and backend teams, drive ETL/ELT pipelines with Python, SQL, Airflow and Spark, and ensure production workloads on AWS and Kubernetes meet security and compliance requirements.

Qualifications

  • Seven years building and operating production data-intensive or backend systems.
  • Hands-on skills in Python, SQL, Airflow, and Spark or PySpark, plus experience with Node.js and TypeScript services.
  • Experience operating large-scale batch or event-driven pipelines and production workloads on AWS (S3, RDS/Aurora, EMR, IAM).
  • Experience running production services on Kubernetes.
  • Leadership through engineering delivery cycles, incident management, and operational ownership.
  • Understanding of data modeling, schema evolution, idempotency, and multi-tenant systems; able to work with regulated or compliance-driven data.

Responsibilities

  • Lead delivery planning, sprint execution, and technical quality across data and backend engineering work.
  • Guide development of ETL/ELT pipelines, Spark or PySpark jobs, Python services, and Node.js and TypeScript workflow services.
  • Own operational readiness, including on-call practices, runbooks, incident response, root-cause analysis, and remediation.
  • Manage technical debt alongside feature work, prioritizing reliability, platform sustainability, and cost improvements.
  • Partner with architecture, product, subject matter, and operations teams to align implementation with platform strategy and compliance needs.
  • Support engineers through technical direction and delivery leadership.

Skills

Python
SQL
Airflow
Spark/PySpark
Node.js
TypeScript

Tools

AWS (S3, RDS/Aurora, EMR)
Kubernetes

Job description

Vertex Inc. is seeking a senior engineering leader to own and operate a data platform that underpins regulatory and compliance workflows.

You will translate platform direction into engineering plans, guide day-to-day execution, and balance new capabilities with reliability, cost, and maintainability. You will lead data and backend teams, drive ETL/ELT pipelines with Python, SQL, Airflow and Spark, and ensure production workloads on AWS and Kubernetes meet security and compliance requirements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Staff Data Engineer: Scalable Data Platforms
Remote Senior Staff Data Engineer: Scalable Data Platforms

Vertexinc • United States

Remote
USD 150,000 - 190,000
Lead Software Engineer
Lead Software Engineer

Vertexinc • United States

Remote
USD 140,000 - 230,000
Senior Data Platform Engineer
Senior Data Platform Engineer

Codevertex Innovations • United States

Remote
USD 140,000 - 200,000
Lead Data Platform Engineer
Lead Data Platform Engineer

Elastic • United States

Remote
USD 113,000 - 179,000
Health coverage
Flexible locations & schedules
Generous vacation days
+2
Lead Data Engineer
Lead Data Engineer

Harnham • United States

On-site
USD 150,000 - 210,000
Lead Data Platform Architect, DGX Cloud
Lead Data Platform Architect, DGX Cloud

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Equity
Benefits package
Global Data Platform VP Equity & Cloud Architect
Global Data Platform VP Equity & Cloud Architect

Wyatt Partners • West Allis (WI)

On-site
USD 180,000 - 250,000
Equity
Bonus
Lead Data Platform Engineer (Cloud)
Lead Data Platform Engineer (Cloud)

Epsilon • Wakefield (MA)

On-site
USD 140,000 - 210,000
Flexible time off
Comprehensive health coverage
401(k)
+4
Lead Data Platform Architect (Remote)
Lead Data Platform Architect (Remote)

Laplace Apply • United States

Remote
USD 180,000 - 240,000
Remote Lead Data Engineer: Architect Data Platforms
Remote Lead Data Engineer: Architect Data Platforms

Lakeview Loan Servicing • Oregon

Hybrid
USD 220,000 - 260,000
Annual bonus
Medical benefits from day one
Company-matched 401(k)