Senior HPC / CUDA Optimization Engineer

EPAM Systems, Inc.; Polska; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Health insurance

Multisport card

Shopping vouchers

Employee stock purchase plan (discount

Referral bonuses up to $2,000

Entertainment and relaxation zones at-

Job summary

EPAM Systems, Inc. seeks an experienced HPC / CUDA Optimization Engineer to design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications.

You will analyze GPU performance, implement multi-GPU solutions with MPI/NCCL/NVSHMEM, and collaborate across teams to deliver high-load, high-performance software. Role requires deep CUDA expertise, strong C++/Python skills, and hands-on experience with distributed computing.

Qualifications

• 5+ years of professional C++ and Python development.
• Deep knowledge of CUDA, GPU architecture, PTX, memory hierarchy, and kernel optimization.
• Experience with GPU profiling, performance analysis, and bottleneck identification.
• Hands-on experience with distributed and multi-GPU computing (MPI, NCCL, NVSHMEM).
• Experience developing and optimizing performance-critical, high-load software systems.

Responsibilities

• Design, develop, and optimize CUDA kernels for large-scale simulations and engineering applications.
• Analyze and improve GPU performance using profiling tools to identify and resolve bottlenecks.
• Implement and optimize distributed and multi-GPU computing solutions using MPI, NCCL, and NVSHMEM.
• Develop and maintain high-performance C++ and Python code for performance-critical, high-load systems.
• Collaborate with cross-functional teams to architect scalable and efficient software solutions.
• Debug complex performance and memory issues across GPU architectures and distributed systems.

Skills

C++

Python

CUDA

GPU optimization

Profiling

MPI

NCCL

NVSHMEM

HPC

Debugging

Tools

CUDA Toolkit

HDF5

Job description

We are seeking an experienced HPC / CUDA Optimization Engineer with strong expertise in modern C++, CUDA, GPU computing, and performance optimization for large-scale scientific and engineering applications.ResponsibilitiesDesign, develop, and optimize CUDA kernels for large-scale scientific and engineering applicationsAnalyze and improve GPU performance using profiling tools to identify and resolve bottlenecksImplement and optimize distributed and multi-GPU computing solutions using MPI, NCCL, and NVSHMEMDevelop and maintain high-performance C++ and Python code for performance-critical, high-load systemsCollaborate with cross-functional teams to architect scalable and efficient software solutionsDebug complex performance and memory issues across GPU architectures and distributed systemsResearch and apply best practices in HPC, numerical methods, and GPU computing to improve existing codebasesRequirements5+ years of professional experience with C++ and Python developmentDeep knowledge of CUDA, GPU architecture, PTX, memory hierarchy, and kernel optimizationExperience with GPU profiling, performance analysis, and bottleneck identificationHands-on experience with distributed and multi-GPU computing (MPI, NCCL, NVSHMEM)Experience developing and optimizing performance-critical, high-load software systemsStrong debugging and software architecture skillsNice to haveKnowledge of Oil & Gas domain is a huge bonusExperience with RTM/FWI, seismic imaging, or geoscience applicationsDevelopment of HDF5-based data viewing and analysis toolsFamiliarity with scientific computing and numerical methodsWe offerWe gather like-minded people:Top tech minds driving innovation in AI, cloud and digital platform modernizationSupportive team and agile, startup-like cultureHybrid by design mode and opportunity to work remotely within PolandChance to work abroad for up to 60 days annuallyBusiness-driven relocation opportunitiesWe provide growth opportunities:Career development programsThought leadership, mentoring, soft skills and well-being programsCertification (Anthropic, Gemini, GCP, Azure, AWS)English classesWe cover it all:Stable payParticipation in the Employee Stock Purchase Plan with a 15% discountBenefits package (health insurance, multisport, shopping vouchers)Referral bonuses up to $2,000Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and moreCorporate, social and well-being eventsPlease, note:Benefits listed above are available to employees onlyWe are open for working with Contractors. Terms of B2B cooperation agreements are agreed individuallyWe will reach out to selected candidates exclusivelyEPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.