Lead Data Engineer: Architect Data Pipelines & Models

8th Light, Inc.; Northern (KY); Hybrid; USD 133,000 - 166,000; Full time

Benefits offered by this job

O'Reilly learning access

Learning stipend

Coworking support

Flexible PTO

Parental leave

Job summary

8th Light, Inc. is seeking a data engineering lead to guide client engagements and shape how data is modeled and moved across projects. You’ll set direction, build scalable pipelines, and lead architecture discussions to balance tradeoffs.

You’ll collaborate with client teams, mentor colleagues, and contribute to our culture while delivering high-quality analytic data solutions using cloud platforms like Snowflake, Databricks, and AWS/GCP.

Qualifications

• 6+ years of data engineering experience leading data pipelines.
• Owns the data layer from raw sources to analytics-ready data.
• Proficient in Python/Scala/Java for data workflows.
• Experience with ETL/ELT, data warehousing, and data modeling.
• Delivered projects on AWS, Azure, or GCP.

Responsibilities

• Make immediate contributions to projects and build trust with clients.
• Design and build data pipelines and schemas that scale with data growth.
• Lead data architecture and modeling discussions, weighing tradeoffs.
• Work to balance technology choices while delivering high-quality work within deadlines.
• Mentor teammates and contribute to team health and 8th Light’s culture.
• Maintain relationships with client technical leaders.
• Document outcomes and drive action items forward.

Skills

Healthcare data

CI/CD pipelines

Infrastructure as Code

Real-time streaming data

Containerization

Cloud/data platform certifications

Tools

Snowflake

Databricks

Azure Data Factory

AWS Redshift

Google BigQuery

Job description

8th Light, Inc. is seeking a data engineering lead to guide client engagements and shape how data is modeled and moved across projects. You’ll set direction, build scalable pipelines, and lead architecture discussions to balance tradeoffs.

You’ll collaborate with client teams, mentor colleagues, and contribute to our culture while delivering high-quality analytic data solutions using cloud platforms like Snowflake, Databricks, and AWS/GCP.