Senior Lead Data & AI Platform Engineer

ARCHER; Jersey City (NJ); In loco; USD 180.000 - 260.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health Care Coverage

On-Site Health And Wellness Centers

Retirement Savings Plan

Backup Childcare

Tuition Reimbursement

Mental Health Support

Financial Coaching

Descrizione del lavoro

ARCHER is seeking a senior data platform engineer to lead the design and delivery of scalable data pipelines and governance capabilities. The role focuses on building an Agentic AI lakehouse to automate provisioning and operations, partnering with product, analytics, and business teams to deliver secure, reliable production solutions.

You will work with Python/Java/SQL, Databricks, Spark, Airflow, and cloud data services on distributed platforms, driving data modeling, optimization, and CI/CD

Competenze

• Requires 5+ years of applied software engineering experience.
• Strong programming skills in Python, Java, or SQL.
• Hands-on experience with distributed data processing, Databricks, orchestration, cloud data services, and production data platforms.
• Understanding of data modeling, query optimization, CI/CD, resiliency, and security.
• Experience with Agentic AI, LLMs, RAG, MCP, vector databases, and embedding-based retrieval.

Mansioni

• Lead the design and delivery of scalable data pipelines and governed data platforms.
• Drive an Agentic AI lakehouse initiative to automate provisioning and operations.
• Collaborate with product, analytics, and business teams to deliver secure, reliable production solutions.

Conoscenze

Distributed data processing

Data modeling

CI/CD

Security

Agentic AI

LLMs

RAG

Vector databases

Embedding-based retrieval

Python

Java

SQL

Strumenti

Databricks

Apache Spark

Apache Flink

Apache Airflow

AWS Data Services

Kubernetes

Terraform

Descrizione del lavoro

ARCHER is seeking a senior data platform engineer to lead the design and delivery of scalable data pipelines and governance capabilities. The role focuses on building an Agentic AI lakehouse to automate provisioning and operations, partnering with product, analytics, and business teams to deliver secure, reliable production solutions.

You will work with Python/Java/SQL, Databricks, Spark, Airflow, and cloud data services on distributed platforms, driving data modeling, optimization, and CI/CD