Senior Data Engineer — Lead Pipelines & Platform

Core Specialty; Dallas, Northern (TX, KY); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) with company match

Employee Assistance Plan

Health Savings Account

Flexible Spending Account

Health Reimbursement Account

Wellness program

Job summary

Core Specialty is seeking a Senior Data Engineer to play a leading, hands-on role on our Data Engineering team. You will design and build data pipelines and platform improvements, mentor engineers, and serve as a technical reference for architecture decisions.

You will own high-complexity initiatives, optimize pipelines for performance and scalability, and help prepare data for analytics and AI/ML use cases using Snowflake, Databricks, and cloud data platforms.

Qualifications

• Bachelor's degree or equivalent experience.
• 7+ years of data engineering on large-scale platforms.
• Experience enabling downstream AI/ML use cases (feature stores, governed datasets).
• Experience with IAC and CI/CD for data systems (Terraform, GitHub Actions).
• Hands-on coding in Python/Scala/SQL and data modeling.

Responsibilities

• Design, build, and optimize data pipelines and platform components for analytics and AI/ML use cases.
• Take ownership of high-complexity initiatives from design to rollout.
• Identify and resolve performance, scalability, and reliability bottlenecks.

Skills

Data pipeline design

Distributed data processing

Cloud data platforms

Python/Scala/SQL

Data governance

Terraform/GitHub Actions

Code + IaC

Mentoring

Education

Bachelor's degree or equivalent experience

Tools

Snowflake

Databricks

Azure Synapse Analytics

MS Fabric

Terraform

GitHub Actions

Job description

Core Specialty is seeking a Senior Data Engineer to play a leading, hands-on role on our Data Engineering team. You will design and build data pipelines and platform improvements, mentor engineers, and serve as a technical reference for architecture decisions.

You will own high-complexity initiatives, optimize pipelines for performance and scalability, and help prepare data for analytics and AI/ML use cases using Snowflake, Databricks, and cloud data platforms.