Senior Data Engineer: Lead, Build & Scale Data Pipelines

Core Specialty Insurance Holdings, Inc.; Dallas (TX); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

Life insurance

Short and long-term disability

401(k) with 100% match up to 6%

Job summary

Core Specialty Insurance Holdings, Inc. is seeking a Senior Data Engineer to lead and build data pipelines, optimize a large-scale data platform, and mentor teammates.

This hands-on role requires strong technical leadership and ownership of end-to-end data solutions across analytics and AI/ML workflows. Reporting to the Director of Data Engineering, you will collaborate with a small, focused team to design reliable data products, enhance governance, and ensure scalable infrastructure in our

Qualifications

• 7+ years in data engineering on large-scale platforms.
• Experience with data pipelines, governance, and AI/ML data readiness.
• Experience with IAC and CI/CD for data systems (Terraform, GitHub Actions).
• Hands-on with Snowflake or Databricks and Azure Synapse Analytics/MS Fabric.
• Experience mentoring or guiding engineers.

Responsibilities

• Design, build, and optimize data pipelines, ingestion frameworks, and platform components.
• Own high-complexity engineering initiatives from design through rollout.
• Identify and resolve performance, scalability, and reliability bottlenecks.
• Improve data models, governance, and access patterns for AI/ML readiness.
• Diagnose production issues and provide on-call support.
• Write clean, well-tested code and infrastructure-as-code.

Skills

Data pipeline design

Distributed data processing

Python/Scala/SQL

Data governance & security

Mentoring

Code reviews

Education

Bachelor's degree in related field

Tools

Snowflake

Databricks

Azure Synapse Analytics

MS Fabric

Terraform

GitHub Actions

Job description

Core Specialty Insurance Holdings, Inc. is seeking a Senior Data Engineer to lead and build data pipelines, optimize a large-scale data platform, and mentor teammates.

This hands-on role requires strong technical leadership and ownership of end-to-end data solutions across analytics and AI/ML workflows. Reporting to the Director of Data Engineering, you will collaborate with a small, focused team to design reliable data products, enhance governance, and ensure scalable infrastructure in our