Principal AI/Data Infra Architect | Kubernetes & Python

Remotedxb; Dubai; On-site; AED 600,000 - 900,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Life insurance

Disability insurance

Unlimited PTO

Parental leave

Equity

WFH stipend

Job summary

Unstructured is redefining enterprise data transformation in the era of LLMs and generative AI. The platform handles unstructured data at scale, with a focus on performance and reliability across distributed systems.

We seek a senior engineer to define end-to-end architecture, lead Python services, and steer Kubernetes and Postgres strategies for production-grade systems. Expect collaboration across infrastructure and product teams and exposure to cutting-edge AI workloads.

Qualifications

• 10+ years of software engineering experience in distributed systems, infrastructure, or data architecture.
• Expert-level Python skills for building frameworks and performance-critical services.
• Deep Kubernetes expertise including design, deployment, and debugging at scale.
• Fluency in Postgres including query planning, partitioning, and tuning.
• Experience in high-performance data or AI/ML systems involving retrieval pipelines or embeddings.
• Ability to thrive in fast-moving, ambiguous environments.

Responsibilities

• Define and evolve end-to-end architecture for the data transformation and retrieval platform.
• Build and scale distributed systems processing massive volumes of unstructured data.
• Serve as the company-wide authority on Kubernetes orchestration, cluster design, and reliability.
• Lead Python architecture and best practices for performance and maintainability.
• Design and optimize Postgres schemas, queries, and indexing strategies.
• Mentor senior engineers through design reviews and code guidance.
• Partner with infrastructure and product teams to translate research prototypes into production-grade systems.
• Evaluate emerging technologies in LLM infrastructure and orchestration.

Skills

Python

Kubernetes

PostgreSQL

Distributed systems

AI/ML systems

Retrieval pipelines

Tools

Open-source contributions

Job description

Unstructured is redefining enterprise data transformation in the era of LLMs and generative AI. The platform handles unstructured data at scale, with a focus on performance and reliability across distributed systems.

We seek a senior engineer to define end-to-end architecture, lead Python services, and steer Kubernetes and Postgres strategies for production-grade systems. Expect collaboration across infrastructure and product teams and exposure to cutting-edge AI workloads.