Remote Staff Data Engineer: LLM Data Platform Architect

Search Partner Group, LLC; United States; On-site; USD 220,000 - 240,000; Full time

Benefits offered by this job

Full benefits

Medical, Dental, Vision coverage

401(k) with company match

Parental leave

Monthly home office stipend

Annual company event

Collaborative culture

Job summary

Search Partner Group, LLC is seeking a Staff Data Engineer to lead the evolution of large-scale data platforms in a remote U.S. environment. This senior IC role focuses on data architecture, cross-platform integration, and building LLM-powered data products.

The role emphasizes data engineering over ML model development, with preferred experience in streaming platforms or B2B SaaS environments, and collaboration across multiple teams.

Qualifications

• 8+ years in data engineering or data architecture.
• Proven experience in complex, multi-system environments.
• Strong Python production-level development (5+ years).
• Experience building LLM-powered data applications in production.
• Deep experience with large-scale data architecture (pipelines, modeling, warehousing).
• Strong communication skills to articulate architectural decisions.
• Mentored engineers and elevated team performance.

Responsibilities

• Design scalable, cross-platform data architecture across complex systems.
• Lead data platform integration for unified insights and product capabilities.
• Build and optimize large-scale batch and streaming pipelines and data models using Python.
• Develop production-grade Python code for data processing and LLM-enabled workflows.
• Design and deliver LLM-powered data products and applications.
• Set best practices for data modeling, pipeline design, and observability.

Skills

Python

Data architecture

Cross-platform integration

Mentoring engineers

Communication skills

LLM-powered systems

Tools

Snowflake

BigQuery

Kafka

Kubernetes

Airflow

Spark

Job description

Search Partner Group, LLC is seeking a Staff Data Engineer to lead the evolution of large-scale data platforms in a remote U.S. environment. This senior IC role focuses on data architecture, cross-platform integration, and building LLM-powered data products.

The role emphasizes data engineering over ML model development, with preferred experience in streaming platforms or B2B SaaS environments, and collaboration across multiple teams.