AI Chatbot Engineer: LLMs, GenAI & Performance

ThunderSoft; Bayan Lepas; On-site; MYR 120,000 - 180,000; Full time

Job summary

ThunderSoft is seeking an experienced software engineer to develop AI-powered chatbots, GenAI applications, and data pipelines using Python/C++ in a Penang-based role. You will design benchmarks, optimize GPU performance, and collaborate across AI/ML, software, hardware, and performance teams.

The role involves building LLM serving/inference frameworks, data pipelines, and frontend/backend components for AI solutions, with a focus on performance analysis and automation testing using Docker.

Qualifications

• 4+ years of software development experience, with strong Python and/or C++ skills.
• Experience in AI/ML, LLMs, Generative AI, RAG, and chatbot development.
• Experience with LLM serving/inference frameworks.
• Experience with databases and SQL.
• Experience with AI workload benchmarking and GPU performance analysis.
• Experience with Docker, automated testing, and performance analysis.
• Strong data analysis, visualization, debugging, and problem-solving skills.

Responsibilities

• Develop AI-powered chatbots, recommendation systems, and GenAI applications using LLMs and RAG.
• Build and integrate LLM serving/inference solutions, APIs, databases, and SQL-based data pipelines.
• Develop frontend and backend components for AI applications.
• Design and execute AI workload benchmarks and analyze GPU/system performance (latency, throughput, utilization, memory).
• Develop Python-based automation and testing frameworks using Docker/containerization.
• Create data visualizations and performance reports to identify bottlenecks and optimization opportunities.
• Collaborate with AI/ML, software, hardware, and performance engineering teams to deliver scalable AI solutions.

Skills

Python

C++

AI/ML

LLMs

Generative AI

RAG

Chatbot development

LLM serving/inference

Databases

SQL

GPU performance analysis

Docker

Automated testing

Performance analysis

Data analysis

Visualization

Debugging

Problem solving

Tools

Docker

SQL

Job description

ThunderSoft is seeking an experienced software engineer to develop AI-powered chatbots, GenAI applications, and data pipelines using Python/C++ in a Penang-based role. You will design benchmarks, optimize GPU performance, and collaborate across AI/ML, software, hardware, and performance teams.

The role involves building LLM serving/inference frameworks, data pipelines, and frontend/backend components for AI solutions, with a focus on performance analysis and automation testing using Docker.