Lead Data Engineer – Real-Time Pipelines & ML Infra

Dailywire; Nashville (TN); On-site; USD 160,000 - 230,000; Full time

Job summary

Daily Wire is seeking a Principal Data Engineer to architect and build systems connecting subscribers, content, advertising, and digital products. This hands-on role spans backend services, event-driven pipelines, cloud infra, analytics, and personalization to strengthen data foundations and AI-driven discovery.

The ideal candidate brings a strong software engineering background, 10+ years in data-intensive platforms, and expertise in Snowflake, dbt, and AWS.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 10+ years of experience in software engineering, data engineering, analytics infrastructure, or data-intensive platform development.
• Advanced experience with Snowflake and dbt, including warehouse design and data transformations.
• Proven experience building and operating enterprise-grade platforms on AWS, including SageMaker and Personalize.
• Hands-on experience with IaC, CI/CD, observability, and production operations.
• Experience with streaming/messaging tech such as Kafka, AWS Kinesis, or Apache Flink.
• Experience building ML pipelines for training, serving, recommendations, and content personalization.
• Knowledge of event-time processing, windowing, and schema evolution.
• Experience with analytics/reporting tools like Tableau.
• Preferred experience in media/streaming, advertising, or high-growth consumer products.

Responsibilities

• Architect and drive the long-term vision for the enterprise data ecosystem, including ingestion, storage, and real-time analytics.
• Lead design and implementation of distributed systems, high-availability APIs, and real-time data pipelines.
• Build production-grade backend services and data workflows using Python or Go and advanced SQL.
• Design and scale Snowflake data warehouses and layered dbt models for reliable data products.
• Partner with product and analytics leaders to establish event schemas and unified semantic layers.
• Architect and operate production ML infrastructure and low-latency inference systems for content discovery.
• Establish architectural and operational standards for testing, observability, security, and cost efficiency.
• Provide technical leadership across AWS cloud, containerized services, architecture reviews, and incident response.

Skills

Python

Go

SQL

Software design

Leadership

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Snowflake

dbt

AWS

SageMaker

Personalize

Kafka

Kinesis

Flink

Job description

Daily Wire is seeking a Principal Data Engineer to architect and build systems connecting subscribers, content, advertising, and digital products. This hands-on role spans backend services, event-driven pipelines, cloud infra, analytics, and personalization to strengthen data foundations and AI-driven discovery.

The ideal candidate brings a strong software engineering background, 10+ years in data-intensive platforms, and expertise in Snowflake, dbt, and AWS.