Senior Data Platform Engineer - Remote Lakehouse & AI

EA | Risk; Chicago (IL); Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health benefits

Flexible time off

401(k) match

Job summary

EA Risk seeks a data platform lead to own the emerging data platform, guiding its design with an external partner and CTO. You will help steer a lakehouse architecture using Databricks and drive ongoing operation and expansion to support reporting and governance.

You will leverage AI tools to accelerate engineering while ensuring data quality, access controls, and secure, scalable data delivery across the business.

Qualifications

• Experience building and operating production data pipelines.
• Strong SQL skills and Python or equivalent data-engineering language.
• Understanding of data modeling, orchestration, testing, and cloud infrastructure.
• Ability to evaluate technical proposals and work with an external delivery partner.
• Ownership mindset for reliability, usability, and operating costs.
• Substantial current use of AI tools in your work.

Responsibilities

• Define platform requirements, evaluate technology and architecture decisions, and guide the partner’s work.
• Create a clear path from partner delivery to internal ownership and handover.
• Develop and maintain integrations across business systems and datasets.
• Build reliable pipelines and well-defined datasets for reporting and applications.
• Establish monitoring, data quality checks, lineage, and recovery processes.
• Collaborate with business owners to reconcile records and definitions.
• Implement data access and governance in partnership with IT and security.
• Extend the platform as new data sources are introduced.
• Apply AI tools to accelerate engineering while validating transformations.

Skills

SQL

Python

Data modeling

Orchestration

Cloud infrastructure

AI tools usage

Tools

Databricks

Job description

EA Risk seeks a data platform lead to own the emerging data platform, guiding its design with an external partner and CTO. You will help steer a lakehouse architecture using Databricks and drive ongoing operation and expansion to support reporting and governance.

You will leverage AI tools to accelerate engineering while ensuring data quality, access controls, and secure, scalable data delivery across the business.