Senior AI-Driven Data Engineer: PySpark, Java & Data Mesh

ARCHER; Jersey City (NJ); Presencial; USD 180.000 - 240.000; Tempo integral

Benefícios oferecidos por esta vaga

Health Care Coverage

On-Site Health And Wellness Centers

Retirement Savings Plan

Backup Childcare

Tuition Reimbursement

Mental Health Support

Financial Coaching

Resumo da vaga

ARCHER is seeking a senior expert to lead modernization of analytics and data engineering on our strategic data mesh. You will define an AI-driven data product lifecycle and build human-in-the-loop agents for data quality, schema changes, incident triage, and governance.

You will provide technical leadership, improve engineering practices with approved AI-assisted tools, and deliver scalable analytics platforms with strong monitoring, lineage, and regulatory controls.

Qualificações

• Requires 5+ years of applied software engineering leadership delivering AI-first analytics and data engineering at scale.
• Hands-on experience with modern big data platforms and Python/PySpark or Java.
• Expertise in AI/ML, data governance, CI/CD, secure AI-assisted development, and the software development lifecycle.

Responsabilidades

• Lead modernization of analytics and data engineering on the data mesh.
• Define an AI-driven data product lifecycle and build human-in-the-loop agents for data quality, schema changes, incident triage, and governance.
• Provide technical leadership and improve engineering practices with AI-assisted tools; deliver scalable analytics platforms with strong monitoring and lineage.

Conhecimentos

Python

PySpark

Java

Machine Learning

Natural Language Processing

Large Language Models

Data Governance

Data Mesh

Data Lakehouse

AI-first analytics

CI/CD

Ferramentas

Apache Spark

Databricks

Snowflake

Apache Iceberg

CI/CD (tooling)

Descrição da vaga

ARCHER is seeking a senior expert to lead modernization of analytics and data engineering on our strategic data mesh. You will define an AI-driven data product lifecycle and build human-in-the-loop agents for data quality, schema changes, incident triage, and governance.

You will provide technical leadership, improve engineering practices with approved AI-assisted tools, and deliver scalable analytics platforms with strong monitoring, lineage, and regulatory controls.