Senior Data Engineer: Lead Scalable Pipelines & Platform

Core Specialty Insurance Holdings, Inc.; Cincinnati (OH); On-site; USD 140,000 - 170,000; Full time

Job summary

Core Specialty Insurance Holdings, Inc. is seeking a Senior Data Engineer to own and scale our data platform. You will design data pipelines, improve AI/ML data readiness, and mentor the team while ensuring robust, scalable solutions across the analytics stack.

This role emphasizes hands-on engineering with leadership duties, performance tuning, and cross-functional collaboration with product and engineering teams.

Qualifications

• Bachelor's degree in related field or equivalent experience.
• 7+ years of data engineering experience on large-scale platforms.
• Experience owning complex projects from design through delivery.
• Experience with AI/ML data platforms (feature stores, governed datasets, streaming access).
• Experience with Terraform and GitHub Actions for CI/CD.
• Proficient in modular code with notebooks.
• Hands-on with Snowflake or Databricks and Azure Synapse Analytics/MS Fabric.
• Mentoring or guiding other engineers.
• Experience in Property & Casualty insurance data domain preferred.

Responsibilities

• Design, build, and optimize data pipelines and platform components for analytics and AI/ML use cases.
• Own high-complexity engineering initiatives from design to rollout.
• Identify and resolve performance, scalability, and reliability bottlenecks.
• Improve data models, governance, and access patterns for AI/ML readiness.
• Diagnose and resolve production issues, including on-call support.
• Write clean, well-tested code and infrastructure-as-code.

Skills

Python

Scala

SQL

Data pipelines

Distributed processing

Cloud platforms

Data governance

Mentoring

IaC

CI/CD

Education

Bachelor's degree in related field

Equivalent experience

Tools

Snowflake

Databricks

Azure Synapse Analytics

MS Fabric

Job description

Core Specialty Insurance Holdings, Inc. is seeking a Senior Data Engineer to own and scale our data platform. You will design data pipelines, improve AI/ML data readiness, and mentor the team while ensuring robust, scalable solutions across the analytics stack.

This role emphasizes hands-on engineering with leadership duties, performance tuning, and cross-functional collaboration with product and engineering teams.