Software Engineer (AI Chatbot)

ThunderSoft; Bayan Lepas; On-site; MYR 120,000 - 180,000; Full time

Job summary

ThunderSoft is seeking an experienced software engineer to develop AI-powered chatbots, GenAI applications, and data pipelines using Python/C++ in a Penang-based role. You will design benchmarks, optimize GPU performance, and collaborate across AI/ML, software, hardware, and performance teams.

The role involves building LLM serving/inference frameworks, data pipelines, and frontend/backend components for AI solutions, with a focus on performance analysis and automation testing using Docker.

Qualifications

• 4+ years of software development experience, with strong Python and/or C++ skills.
• Experience in AI/ML, LLMs, Generative AI, RAG, and chatbot development.
• Experience with LLM serving/inference frameworks.
• Experience with databases and SQL.
• Experience with AI workload benchmarking and GPU performance analysis.
• Experience with Docker, automated testing, and performance analysis.
• Strong data analysis, visualization, debugging, and problem-solving skills.

Responsibilities

• Develop AI-powered chatbots, recommendation systems, and GenAI applications using LLMs and RAG.
• Build and integrate LLM serving/inference solutions, APIs, databases, and SQL-based data pipelines.
• Develop frontend and backend components for AI applications.
• Design and execute AI workload benchmarks and analyze GPU/system performance (latency, throughput, utilization, memory).
• Develop Python-based automation and testing frameworks using Docker/containerization.
• Create data visualizations and performance reports to identify bottlenecks and optimization opportunities.
• Collaborate with AI/ML, software, hardware, and performance engineering teams to deliver scalable AI solutions.

Skills

Python

C++

AI/ML

LLMs

Generative AI

RAG

Chatbot development

LLM serving/inference

Databases

SQL

GPU performance analysis

Docker

Automated testing

Performance analysis

Data analysis

Visualization

Debugging

Problem solving

Tools

Docker

SQL

Job description

• Develop AI-powered chatbots, product recommendation systems, and GenAI applications using LLMs and RAG.
• Build and integrate LLM serving/inference solutions, APIs, databases, and SQL-based data pipelines.
• Develop frontend and backend components for AI applications.
• Design and execute AI workload benchmarks and analyze GPU/system performance, including latency, throughput, utilization, and memory.
• Develop Python-based automation and testing frameworks using Docker/containerization.
• Create data visualizations and performance reports to identify bottlenecks and optimization opportunities.
• Collaborate with AI/ML, software, hardware, and performance engineering teams to deliver scalable and optimized AI solutions.

Required Qualifications

• 4+ years of software development experience with strong Python and/or C++ skills.
• Experience in AI/ML, LLMs, Generative AI, RAG, and chatbot development.
• Experience with LLM serving/inference frameworks.
• Experience with databases and SQL.
• Experience with AI workload benchmarking and GPU performance analysis.
• Experience with Docker, automated testing, and performance analysis.
• Strong data analysis, visualization, debugging, and problem-solving skills.