Staff Data Engineer — AI Data Platform Leader (Remote)

Cribl; City of Albany (NY); Remote; USD 170,000 - 220,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision plan

Life insurance

Paid time off

401(k)

Equity

Fertility benefit

Job summary

Cribl, the AI-era data observability software leader, is hiring a Staff Data Engineer to guide the Data Engineering team in building scalable analytics platforms on Snowflake, dbt, and AWS. You will own architecture, drive efficient data pipelines, and mentor engineers while collaborating with IT, security, and business teams to optimize costs and performance.

You’ll lead self-hosted orchestration and contribute to secure, compliant engineering practices, shaping the platform roadmap and

Qualifications

• Deep Snowflake expertise including data modeling, performance tuning, and cost/security design.
• Demonstrated technical leadership as a tech lead or staff-level engineer.
• Excellent cross-functional collaboration and communication across data, engineering, and business teams.
• Track record mentoring junior engineers through coaching and code review.
• Strong Python and SQL fundamentals with ELT and data modeling experience.
• Hands-on experience with self-hosted orchestration (Prefect preferred; Airflow/Dagster acceptable).

Responsibilities

• Serve as a technical lead for the Data Engineering team.
• Own architecture and design decisions for core data systems and drive reliable, production-grade outcomes.
• Partner with stakeholders across functions (Data Analysts, SREs, IT Engineers, and business teams).
• Clarify requirements, validate outputs, and communicate risks, tradeoffs, and timelines proactively.
• Own and operate our self-hosted orchestration platform.
• Run and evolve our self-managed Prefect deployment and its build/worker system.
• Own the operational hygiene, upgrade path, and cost/footprint tradeoffs of running orchestration on a hybrid, self-hosted model.
• Own Cribl's Snowflake environment.
• Serve as the subject-matter expert on data modeling, performance, and cost optimization, and own RBAC/permissions design, permissions tooling, and governance.
• Build, operate, and monitor the core data tech stack. This covers data pipelines, ingestion services, integrations, and the warehouse, ensuring data is accurate, timely, and trusted, with logging, alerting, and observability as first-class concerns.
• Advance the modern data stack.
• Drive our dbt practice forward, including the in-flight dbt Fusion migration, and own warehouse cost/performance at scale.
• Develop cloud-native services and infrastructure on AWS. This includes our ingest/API services (event-driven ingestion, upsert patterns, package reuse) and the IaC that supports them.
• Advance our infrastructure-as-code practice (Terraform or similar).
• Build reusable modules, clean deployment patterns, CI integration, and strong operational hygiene, including self-hosted/hybrid deployment patterns.
• Partner with the Data Engineering manager to set technical direction.
• Shape the platform roadmap, engineering standards, and build-vs-buy/architectural tradeoffs.
• Mentor and grow data engineers through code review, pairing, design feedback, and coaching that levels up junior and mid-level engineers.
• Support Cribl's growing data science and agentic initiatives.
• Prepare model-ready datasets, expose features, and integrate AI/LLM workflows into production.
• Contribute to secure, compliance-minded engineering practices in collaboration with IT/Security.

Skills

Snowflake

Python

SQL

Data modeling

ETL patterns

AWS

Terraform

CI/CD

Tools

Prefect

dbt

Airflow

Dagster

Job description

Cribl, the AI-era data observability software leader, is hiring a Staff Data Engineer to guide the Data Engineering team in building scalable analytics platforms on Snowflake, dbt, and AWS. You will own architecture, drive efficient data pipelines, and mentor engineers while collaborating with IT, security, and business teams to optimize costs and performance.

You’ll lead self-hosted orchestration and contribute to secure, compliant engineering practices, shaping the platform roadmap and