Senior C++ Software Engineer with CUDA/GPU/TPU

EPAM Systems (Poland) sp. z o.o.; Kraków; Hybrid; PLN 240,000 - 320,000; Full time

Benefits offered by this job

Hybrid work model

Relocation opportunities

Employee stock purchase plan

Private medical care

Life insurance

Flexible working time

Well-being programs

Job summary

EPAM Systems (Poland) sp. z o.o. in Kraków is seeking a Senior C++ Software Engineer with CUDA/GPU/TPU to join the ML & AI team. You will write kernels in C++ for AI workloads and help advance the neural network stack for next‑generation accelerators.

The role involves collaborating with architecture and ASIC experts to optimize compilers and build ML models using PyTorch or TensorFlow. Strong English is required, with a hybrid work model and options to work remotely within Poland.

Qualifications

• 5+ years of experience in software engineering with a focus on ML/AI
• 5+ years of experience in C++ and CUDA/kernel programming
• English proficiency at B2 level or higher

Responsibilities

• Write kernels in C++ for various operations used across AI and ML workloads
• Develop and optimize the compiler and neural network stack supporting LLMs and CNNs
• Collaborate with experts in computer architecture, ASIC design and advanced systems to build next-generation computing solutions
• Design and implement AI/ML kernel operations tailored to GPU/AI-accelerator architectures
• Build and maintain ML models using PyTorch or TensorFlow
• Ensure kernel-level performance and correctness across modern neural network architectures such as transformers
• Take ownership of key technical decisions as a lead developer within the ML & AI team

Skills

C++

PyTorch

TensorFlow

Tools

Python

Job description

Senior C++ Software Engineer with CUDA/GPU/TPU

Locate yourself or provide an exact address

Car

-

Public transport

-

Bike

-

On foot

-

Expected

• C++
• PyTorch
• TensorFlow

Optional

• Python

About the project

• We are looking for a Senior C++ Software Engineer to join a team building the next generation of computers for artificial intelligence. The company brings together experts in computer architecture, ASIC design, advanced systems and neural network compilers, with the team focused on the compiler and neural network stack, including LLMs and CNNs. This is a key developer role within the ML & AI team.

Your responsibilities

• Write kernels in C++ for various operations used across AI and ML workloads
• Develop and optimize the compiler and neural network stack supporting LLMs and CNNs
• Collaborate with experts in computer architecture, ASIC design and advanced systems to build next-generation computing solutions
• Design and implement AI/ML kernel operations tailored to GPU/AI-accelerator architectures
• Build and maintain ML models using PyTorch or TensorFlow
• Ensure kernel-level performance and correctness across modern neural network architectures such as transformers
• Take ownership of key technical decisions as a lead developer within the ML & AI team

Our requirements

• 5+ years of experience in software engineering with a focus on ML/AI
• 5+ years of experience in C++ and CUDA/kernel programming
• Knowledge in GPU/AI-accelerator architectures
• Experience in building and working with ML models in PyTorch or TensorFlow
• Understanding of modern ML model architectures such as transformers
• English proficiency at B2 level or higher

Optional

• Proficiency in Python programming with hands‑on experience in developing, training and fine‑tuning deep learning models
• Proven LLM experience
• Skills in designing, implementing and iterating on neural network architectures to achieve optimal performance on diverse tasks
• Capability to investigate and troubleshoot model performance issues including gaps in compilation steps and kernels
• Demonstrated experience in designing, training and deploying neural networks for various applications
• Solid understanding of machine learning fundamentals including supervised and unsupervised learning techniques

What we offer

• We gather like‑minded people:
• Top tech minds driving innovation in AI, cloud and digital platform modernization
• Supportive team and agile, startup‑like culture
• Hybrid by design mode and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business‑driven relocation opportunities
• Thought leadership, mentoring, soft skills and well‑being programs
• We cover it all:
• Participation in the Employee Stock Purchase Plan with a 15% discount
• Referral bonuses up to $2,000
• Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
• Corporate, social and well‑being events
• Please, note:
• Benefits listed above are available to employees only
• We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
• We will reach out to selected candidates exclusively

Development opportunities we offer

• conferences in Poland
• external training
• industry‑specific e‑learning platforms
• intracompany training
• space for experimenting
• substantive support from technological leaders
• support of IT events
• technical knowledge exchange within the company

private medical care

life insurance

flexible working time

video games at work

coffee / tea

parking space for employees

employee referral program

charity initiatives

Recruitment stages

• 1
• 2
• Technical Interview (90 min)
• 3
• 4
• Meeting with the Project Team or Client (60 min, optional)