Senior Lead Data Platform Engineer (Streaming & AI)

ARCHER; Wilmington (DE); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health Coverage

On-Site Wellness Centers

Retirement Savings

Backup Childcare

Tuition Reimbursement

Mental Health Support

Financial Coaching

Job summary

ARCHER leads the development of high-throughput streaming and large-scale batch data platforms. You will steer the technical direction, build reusable and secure data solutions, and champion governance across teams.

The role requires strong Java, Python and Scala skills and hands-on experience with AWS, Databricks, Snowflake, Spark, Kafka and Cassandra. You will mentor engineers and partner with product, architecture and deployment teams to deliver trusted data solutions.

Qualifications

• Requires 5+ years of applied software engineering experience.
• Strong Java, Python and Scala skills with data platform experience.
• Hands-on AWS, Databricks, Snowflake, Spark, Kafka and Cassandra.

Responsibilities

• Lead the technical direction and hands-on development of scalable data platforms.
• Mentor engineers and establish governance practices.
• Partner with product, architecture, modeling and deployment teams to deliver data solutions.

Skills

Java

Python

Scala

AWS

Databricks

Snowflake

Apache Spark

Kafka

Cassandra

Data Engineering

Real-Time Processing

Batch Processing

Data Governance

Data Quality

Agile/Scrum

Generative AI

Job description

ARCHER leads the development of high-throughput streaming and large-scale batch data platforms. You will steer the technical direction, build reusable and secure data solutions, and champion governance across teams.

The role requires strong Java, Python and Scala skills and hands-on experience with AWS, Databricks, Snowflake, Spark, Kafka and Cassandra. You will mentor engineers and partner with product, architecture and deployment teams to deliver trusted data solutions.