Generative AI Infra Engineer: Scalable LLM Serving

Teradata

Hyderabad City Taluka

On-site

PKR 1,800,000 - 3,600,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Teradata is seeking an AI Infrastructure Engineer to build the serving layer for large language models within the Vantage ecosystem. You will work on GPU-accelerated inference, Go and Rust services, and a cloud-native platform to ship models to production with confidence.

You will own systems end to end, from CUDA kernels to Kubernetes rollouts. You will collaborate with AI researchers and SREs to ensure reliability, scalability, and secure model isolation across on-prem and cloud environments.

Qualifications

  • 3+ years of professional software engineering in backend/distributed/AI infrastructure.

Responsibilities

  • Design and operate scalable, low-latency model-serving platforms for LLMs and generative models.
  • Develop high-performance control-plane and data-plane services in Go and Rust.
  • Optimize GPU inference for throughput, latency, and cost; implement batching, caching, and quantization.

Skills

Go
Rust
CUDA
Kubernetes
CI/CD
Python
gRPC
REST APIs
OpenTelemetry
Prometheus
Grafana
Distributed systems

Education

Bachelor's degree in Computer Science/Engineering
Master's preferred

Tools

Docker
Terraform
Helm
Argo CD
GitHub Actions
Jenkins

Job description

Teradata is seeking an AI Infrastructure Engineer to build the serving layer for large language models within the Vantage ecosystem. You will work on GPU-accelerated inference, Go and Rust services, and a cloud-native platform to ship models to production with confidence.

You will own systems end to end, from CUDA kernels to Kubernetes rollouts. You will collaborate with AI researchers and SREs to ensure reliability, scalability, and secure model isolation across on-prem and cloud environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer - Generative AI Model Serving (Go / Rust / GPU)
AI Infrastructure Engineer - Generative AI Model Serving (Go / Rust / GPU)

Teradata • Hyderabad City Taluka

On-site
PKR 1,800,000 - 3,600,000
Cloud AI Engineer - Scalable Infra & AI Tools
Cloud AI Engineer - Scalable Infra & AI Tools

Teradata • Hyderabad City Taluka

On-site
PKR 24,896,000 - 33,195,000
GenAI Engineer
GenAI Engineer

Enoves • Lahore

On-site
PKR 350,000 - 700,000
Senior GenAI Engineer: Scale LLMs & AI Apps
Senior GenAI Engineer: Scale LLMs & AI Apps

Tkxel LLC • Lahore

On-site
PKR 38,964,653 - 58,446,979
Senior AI Engineer - GenAI, LLMs & Production Apps
Senior AI Engineer - GenAI, LLMs & Production Apps

Datamatics Technologies • Karachi Division

On-site
PKR 1,800,000 - 3,600,000
Generative AI Engineer: Build & Productionize LLMs
Generative AI Engineer: Build & Productionize LLMs

Agentic Global Talent • Lahore

On-site
PKR 1,800,000 - 3,200,000
GenAI Engineer
GenAI Engineer

Tkxel LLC • Lahore

On-site
PKR 38,964,653 - 58,446,979
Senior Cloud AI Engineer
Senior Cloud AI Engineer

Teradata • Hyderabad City Taluka

On-site
PKR 24,896,000 - 33,195,000
Senior AI/ML Engineer
Senior AI/ML Engineer

Strategic Systems International • Lahore

On-site
PKR 1,800,000 - 2,600,000
Remote GenAI Engineer – Production AI & LLM Expert
Remote GenAI Engineer – Production AI & LLM Expert

Datamatics Technologies LLC • Karachi Division

Remote
PKR 33,195,000 - 49,793,000
Top locations