Senior Python Data Engineer for AI-Ready Data Ecosystem

ClickHouse; United States; On-site; USD 141,000 - 232,000; Full time

Benefits offered by this job

Remote-friendly

Healthcare contributions

Stock options

Flexible time off

Home office stipend

Global gatherings

Job summary

ClickHouse is seeking a Senior Software Engineer specializing in Python and the Data Ecosystem to own and evolve critical parts of our data engineering ecosystem. You will build tools for Data Engineers and Data Scientists to leverage ClickHouse’s speed and scale across their frameworks.

You will influence architecture, performance, and feature direction for Python connectors, SDKs, and integrations, collaborating with Open Source communities and product teams to drive impact in RAG pipelines,

Qualifications

• 7+ years of software development experience, including hands‑on time as a Data Engineer, Data Scientist, or ML Engineer.
• Deep, proven experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for at least one major platform (orchestration, BI, MLOps, or data transformation).
• Hands‑on experience applying AI/ML in production data‑engineering contexts: embedding generation, vector search, feature pipelines, or LLM-powered tooling that shipped and ran in production.
• Solid experience with the Python data ecosystem: Pandas, NumPy, Pydantic, and related libraries
• Strong database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases
• Solid experience with concurrent Python: threading, multiprocessing, and async patterns
• Outstanding written and verbal communication; comfortable collaborating across engineering functions and with open-source communities

Responsibilities

• Own and evolve ClickHouse's Python connector and SDK ecosystem, raising the bar on performance, reliability, and API design
• Build and maintain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt) to enterprise-grade quality standards
• Drive the AI/LLM integration strategy: designing connectors and patterns that make ClickHouse a natural fit in RAG architectures, ML feature pipelines, and LLM-powered data applications
• Engage actively with the open-source community: triage issues, support contributors, advocate for users, and shape the roadmap based on real-world feedback
• Collaborate with Product, Cloud, and other engineering teams to align integration work with broader platform priorities
• Bring a practitioner's perspective to roadmap decisions, grounding prioritization in genuine Data Engineer and Data Scientist workflows

Skills

Python

Data engineering

Data science

ML engineering

Pandas

NumPy

Pydantic

SQL

Async programming

Tools

Airflow

Dagster

Prefect

dbt

SQLMesh

LangChain

LlamaIndex

n8n

Job description

ClickHouse is seeking a Senior Software Engineer specializing in Python and the Data Ecosystem to own and evolve critical parts of our data engineering ecosystem. You will build tools for Data Engineers and Data Scientists to leverage ClickHouse’s speed and scale across their frameworks.

You will influence architecture, performance, and feature direction for Python connectors, SDKs, and integrations, collaborating with Open Source communities and product teams to drive impact in RAG pipelines,