Senior HPC / CUDA Optimization Engineer

EPAM Systems; Polska; Hybrid; PLN 280,000 - 420,000; Full time

Benefits offered by this job

Hybrid work model

Remote within Poland

International travel opportunities

Relocation support

Health insurance

Stock purchase plan

Job summary

EPAM Systems is seeking an experienced HPC / CUDA Optimization Engineer to design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications. You will analyze GPU performance with profiling tools, and implement distributed multi-GPU solutions using MPI, NCCL, and NVSHMEM.

The role requires deep CUDA knowledge, strong C++ and Python skills, and the ability to work across cross-functional teams to deliver scalable software.

Qualifications

• 5+ years of C++ and Python development experience.
• Deep knowledge of CUDA, GPU architecture, memory hierarchy, and kernel optimization.
• Experience with GPU profiling and bottleneck analysis.
• Hands-on distributed and multi-GPU computing experience (MPI, NCCL, NVSHMEM).
• Experience developing high-load, performance-critical software.
• Strong debugging and software architecture skills.

Responsibilities

• Design, develop, and optimize CUDA kernels for large-scale applications.
• Analyze and improve GPU performance using profiling tools.
• Implement distributed and multi-GPU solutions with MPI/NCCL/NVSHMEM.
• Develop high-performance C++ and Python code for critical systems.
• Collaborate with cross-functional teams to architect scalable software.
• Debug complex performance and memory issues across GPUs and clusters.
• Apply HPC best practices and numerical methods to improve codebases.

Skills

5+ years C++/Python

CUDA optimization

GPU computing

Performance profiling

MPI/NCCL/NVSHMEM

Distributed systems

Debugging large codebases

Cross-functional collaboration

Tools

MPI

NCCL

NVSHMEM

CUDA toolkit

Job description

We are seeking an experienced HPC / CUDA Optimization Engineer with strong expertise in modern C++, CUDA, GPU computing, and performance optimization for large-scale scientific and engineering applications.

Responsibilities

• Design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications
• Analyze and improve GPU performance using profiling tools to identify and resolve bottlenecks
• Implement and optimize distributed and multi-GPU computing solutions using MPI, NCCL, and NVSHMEM
• Develop and maintain high-performance C++ and Python code for performance-critical, high-load systems
• Collaborate with cross-functional teams to architect scalable and efficient software solutions
• Debug complex performance and memory issues across GPU architectures and distributed systems
• Research and apply best practices in HPC, numerical methods, and GPU computing to improve existing codebases

Requirements

• 5+ years of professional experience with C++ and Python development
• Deep knowledge of CUDA, GPU architecture, PTX, memory hierarchy, and kernel optimization
• Experience with GPU profiling, performance analysis, and bottleneck identification
• Hands-on experience with distributed and multi-GPU computing (MPI, NCCL, NVSHMEM)
• Experience developing and optimizing performance-critical, high-load software systems
• Strong debugging and software architecture skills

Nice to have

• Knowledge of Oil & Gas domain is a huge bonus
• Experience with RTM/FWI, seismic imaging, or geoscience applications
• Development of HDF5-based data viewing and analysis tools
• Familiarity with scientific computing and numerical methods

We offer

• We gather like-minded people:
  • Top tech minds driving innovation in AI, cloud and digital platform modernization
  • Supportive team and agile, startup-like culture
  • Hybrid by design mode and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities
• We provide growth opportunities:
  • Career development programs
  • Thought leadership, mentoring, soft skills and well-being programs
  • Certification (Anthropic, Gemini, GCP, Azure, AWS)
  • English classes
• We cover it all:
  • Stable pay
  • Participation in the Employee Stock Purchase Plan with a 15% discount
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Referral bonuses up to $2,000
  • Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
  • Corporate, social and well-being events
• Please, note:
  • Benefits listed above are available to employees only
  • We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
  • We will reach out to selected candidates exclusively

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.