HK GPU Principal Core Infrastructure Engineer

Oracle

Hong Kong

On-site

HKD 900,000 - 1,300,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Oracle is seeking a Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer) to design, implement, and maintain AI/ML infrastructure for customer deployments in Hong Kong. You will partner with data scientists, software engineers, and internal cloud services to deploy AI/ML solutions securely, efficiently, and at scale.

The role emphasizes end-to-end technical execution, including POCs, troubleshooting, and post-sales support.

Qualifications

  • Experience with scripting and automation using Ansible, Terraform, Python and/or Kubernetes.
  • Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (like Slurm, PBS, etc.) for managing distributed systems.
  • Solid understanding of networking concepts, security principles, and best practices.
  • Excellent problem-solving skills, with the ability to troubleshoot complex issues and drive resolution in a fast-paced environment.
  • Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams and convey technical concepts to non-technical stakeholders.
  • Strong documentation skills with experience documenting infrastructure designs, configurations, procedures, and troubleshooting steps to facilitate knowledge sharing, ensure maintainability, and enhance team collaboration.
  • Strong Linux skills with hands-on experience in Oracle Linux/RHEL/CentOS, Ubuntu, and Debian distributions, including system administration, package management, shell scripting, and performance optimization.

Responsibilities

  • Design, deploy, and manage infrastructure components to support AI/ML workflows.
  • Collaborate with scientists and engineers to understand infrastructure requirements.
  • Implement automation for provisioning, configuring, and monitoring AI/ML infrastructure.
  • Optimize infrastructure performance and resource utilization.
  • Ensure security and compliance across the AI/ML stack.
  • Troubleshoot performance, scalability, and reliability issues and mitigate downtime.
  • Document designs, configurations, and procedures for knowledge sharing.

Skills

Scripting basics
Automation tooling
Communication
Problem solving
Team collaboration

Education

Bachelor's degree in CS or related field
Master's degree in CS or related field

Tools

Terraform
Ansible
Python
Kubernetes
Docker
Slurm
PBS
OKE GPU

Job description

As a Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer), you will play a critical role in designing, implementing, and maintaining the infrastructure that supports our customers AI and machine learning initiatives.

You will work closely with customer technical teams (data scientists, software engineers, and Infra/IT professionals) and internal cloud services team to ensure their AI/ML solutions are deployed efficiently, securely, and at scale.

Your expertise will be crucial in optimizing our infrastructure for performance, reliability, and cost-effectiveness. In this hands‑on technical role you’ll troubleshoot issues for proof of concept (POC) and production deployments.

In this role, you will provide white‑glove service and support for our strategic customers, including Tier‑0 accounts and 200+ other GPU accounts. The role will focus on end‑to‑end technical customer execution, including POCs, technical troubleshooting, post‑sales customer management and support, adoption, expansion, GPU utilization, and AI infrastructure growth.

The role will also create software assets, including automated deployment stack tools for Slurm and OKE GPU, as well as other scripts and tools to help the team scale.

Responsibilities

Work with OCI Strategic customers to grow our business in pre/post sales stages in a technical infra expert role.

Take ownership of problems and work to identify solutions.

Ability to think through the solution and identify/document potential issues impacting your customers.

Design, deploy, and manage infrastructure components such as cloud resources, distributed computing systems, and data storage solutions to support AI/ML workflows.

Collaborate with scientists and software/infrastructure engineers to understand infrastructure requirements for training, testing, and deploying machine learning models.

Implement automation solutions for provisioning, configuring, and monitoring AI/ML infrastructure to streamline operations and enhance productivity.

Optimize infrastructure performance by tuning parameters, optimizing resource utilization, and implementing caching and data pre-processing techniques.

Ensure security and compliance standards are met throughout the AI/ML infrastructure stack, including data encryption, access control, and vulnerability management.

Troubleshoot infrastructure performance, scalability, and reliability issues and implement solutions to mitigate risks and minimize downtime.

Stay updated on emerging technologies and best practices in AI/ML infrastructure and evaluate their potential impact on our systems and workflows.

Document infrastructure designs, configurations, and procedures to facilitate knowledge sharing and ensure maintainability.

As a trusted customer advocate, you will help customers/partners understand best practices around advanced GPU solutions, and how to migrate their workloads to the cloud.

Educate customers of all sizes on the value proposition of Oracle Cloud and participate in deep architectural discussions to ensure solutions are designed for successful deployment in the cloud.

Act as a technical liaison between customers, core engineering teams, and support

Qualifications:

Experience in scripting and automation using tools like Ansible, Terraform, Python and/or Kubernetes.

Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (like Slurm, PBS, etc.) for managing distributed systems.

Solid understanding of networking concepts, security principles, and best practices.

Excellent problem-solving skills, with the ability to troubleshoot complex issues and drive resolution in a fast‑paced environment.

Strong communication and collaboration skills, with the ability to work effectively in cross‑functional teams and convey technical concepts to non‑technical stakeholders.

Strong documentation skills with experience documenting infrastructure designs, configurations, procedures, and troubleshooting steps to facilitate knowledge sharing, ensure maintainability, and enhance team collaboration.

Strong Linux skills with hands‑on experience in Oracle Linux/RHEL/CentOS, Ubuntu, and Debian distributions, including system administration, package management, shell scripting, and performance optimization.

Preferred Qualifications

Strong proficiency in at least one of the programming languages such as Python, Rust, Go, Java, or Scala

Proven experience designing, implementing, and managing infrastructure for AI/ML or HPC workloads.

Understanding machine learning frameworks and libraries such as TensorFlow, PyTorch, or sci‑kit‑learn and their deployment in production environments is a plus.

Familiarity with DevOps practices and tools for continuous integration, deployment, and monitoring (e.g., Jenkins, GitLab CI/CD, Prometheus).

Strong experience with High‑Performance Computing/GPU systems

ADDITIONAL INFORMATION:
Core Responsibilities
Strategic Thought Leadership:
  • You should also have a demonstrated ability to think strategically about business, products, and technical challenges.
Business Experience:
  • Understand the challenges in working with large customers.
Planning & Execution:
  • Manages and coordinates moderately complex tasks, monitoring timelines and deliverables to ensure timely completion and adherence to requirements for a moderately sized project or initiative. Efficiently delegates, monitors, and prioritizes work across multiple projects, providing technical oversight and adjusting plans to address shifts in resources or timelines.
  • Collaborates across the organization to align on expectations and achieve shared objectives. Leverages understanding of business leaders, stakeholders, and/or customers to ensure proposed solutions meet their needs. Supports inclusivity by actively seeking and listening to diverse perspectives, ensuring others feel heard and respected.
Problem Solving:
  • Identifies and addresses moderately complex issues by analyzing a wide range of data and/or information to identify solutions in accordance with standard practices. Proactively escalates unresolved or critical issues with a thorough assessment and suggests potential solutions. Reviews, contributes to, and documents problem solving strategies.
  • Pursues learning opportunities to expand knowledge and skills and/or tools in new areas and stays abreast of the latest industry trends and best practices. Proactively seeks and leverages ongoing feedback and training to improve skills. Coaches and mentors junior team members, fostering continuous learning and knowledge sharing within and across teams.
  • Develops ideas, recommends updates, and/or collaborates on the implementation of process improvements to increase the efficiency and effectiveness of processes, protocols, and workflows across teams, and evaluates the impact on key stakeholders. Solicits feedback from others on ideas for alternative approaches and methods for continued improvement.
Performance and Development:
  • Contributes to the talent development pipeline by participating in candidate interviews, assessing candidates, and providing hiring recommendations
Qualifications
Minimum Job Qualifications
Education and/or Experience:

11 years of experience in software development

OR

Bachelor's of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development

OR

Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development

OR

Master's of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development

OR

Master's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development

OR

Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 3 year of experience in software development.

Job Skills:

Same skills as prior level plus;

Data Analysis: Demonstrated ability to analyze and interpret data to produce actionable business insights.

Agile Methodologies: Demonstrated ability to use agile methodologies to drive continuous improvement and product delivery.

Automation: Demonstrated ability in or knowledge of automation, including designing, implementing, and managing automated tools, processes, or systems to streamline operations.

Compliance: Demonstrated knowledge of and adherence to regulatory, legal, and organizational compliance requirements.

Quality Assurance: Demonstrated ability in or knowledge of quality assurance, including ensuring adherence to standards and implementing quality control measures.

Scripting Languages: Demonstrated ability in or knowledge of scripting languages, including writing and maintaining scripts to improve system efficiency.

Software Test Plans: Demonstrated ability to develop and execute effective software test plans to validate product quality.

User Experience Development: Demonstrated ability in or knowledge of user experience development, including designing intuitive and effective user interfaces and content.

Code Review: Demonstrated ability to conduct in-depth code reviews for software quality assurance.

Embedded Systems: Demonstrated ability to develop embedded systems, balancing hardware and software for optimal performance.

Software Estimation: Demonstrated ability to provide accurate software effort and complexity estimates for project planning and scheduling.

3 year of academic or professional experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).

Testing and Automation Experience:

5 years of experience working in testing and automation at the system level.

Distributed Systems Experience:

4 year of experience working with delivering and operating large-scale distributed systems.

Preferred Job Qualifications

Education and/or Experience:

11 years of experience in software development

OR

Bachelor's of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development

OR

Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development

OR

Master's of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development

OR

Master's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development

OR

Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 3 years of experience in software development.

1 year of experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Core Infrastructure Engineer-GPU
Principal Core Infrastructure Engineer-GPU

Oracle • Hong Kong

Hybrid
HKD 900,000 - 1,500,000
Principal Core Infrastructure Engineer – GPU
Principal Core Infrastructure Engineer – GPU

Oracle • Hong Kong

On-site
HKD 900,000 - 1,200,000
Principal Cloud Architect – HPC/GPU & AI Platform Solutions
Principal Cloud Architect – HPC/GPU & AI Platform Solutions

Emerson Electric Co • Hong Kong

On-site
HKD 420,000 - 720,000
Principal Cloud Architect - HPC/GPU & AI Platform Solutions
Principal Cloud Architect - HPC/GPU & AI Platform Solutions

Oracle • Hong Kong

On-site
HKD 1,200,000 - 2,600,000
Senior GPU/HPC Infra Engineer for Cloud AI
Senior GPU/HPC Infra Engineer for Cloud AI

Oracle • Hong Kong

On-site
HKD 900,000 - 1,200,000
Senior Technical Account Manager
Senior Technical Account Manager

Oracle Systems Hong Kong Ltd • Hong Kong

On-site
HKD 900,000 - 1,200,000
Senior Support Engineer
Senior Support Engineer

Oracle Corporation • Sha Po Village

On-site
HKD 250,000 - 380,000
Principal AI/ML GPU Infra Engineer
Principal AI/ML GPU Infra Engineer

Oracle • Hong Kong

Hybrid
HKD 900,000 - 1,500,000
Systems Engineer
Systems Engineer

Tower Research Capital • Hong Kong

On-site
HKD 450,000 - 750,000
Generous PTO
Savings plans
Hybrid work
+6
Senior HPC/GPU & AI Platform Architect on OCI
Senior HPC/GPU & AI Platform Architect on OCI

Oracle • Hong Kong

On-site
HKD 1,200,000 - 2,600,000