Senior Staff Infrastructure Engineer

Samsung Electronics America

San Jose (CA)

On-site

USD 180,000 - 260,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Samsung Electronics America is seeking a senior infrastructure engineer for the AGI Computing Lab in San Jose. You will build workload-grounded models, define architecture decisions, and drive collaboration across compute, storage, networking, and software teams to optimize AI/ML workloads and overall platform reliability.

You will own CI/CD pipelines, mentor teammates, and engage with senior leadership to align on platform strategy and investments.

Qualifications

  • Degree in Computer Science, Computer Engineering, Electrical Engineering, or related field.
  • Bachelor’s degree with 15+ yrs experience or Master’s with 13+ yrs or PhD with 10+ yrs experience.

Responsibilities

  • Act as a key technical point of contact for infrastructure projects and coordinate efforts.
  • Own infrastructure initiatives from concept to completion and drive implementation.
  • Unify development lifecycle management with Jira, GitHub/GitLab, and end-to-end pipelines.
  • Translate lab requirements into actionable technical tasks and system improvements.
  • Develop and maintain CI/CD pipelines for the lab’s software stack.
  • Identify bottlenecks to improve build speed and reproducibility.
  • Manage Linux-based build workers and accelerator-backed test systems.
  • Improve failure analysis with logs, dashboards, and reporting.
  • Ensure system reliability with monitoring and high availability.
  • Lead cross-functional technical discussions with IT, Security, and other teams.
  • Create documentation and tools to enable developer self-service.

Skills

CI/CD pipelines
Python
Shell scripting
Linux
Git/GitHub
Jenkins
GitLab CI
GitHub Actions
Container technologies
Infrastructure automation
Performance optimization

Education

Bachelor’s in Computer Science/Engineering or related field
Master’s degree in related field
PhD in related field

Tools

Jenkins
GitLab CI
GitHub Actions

Job description

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.

Advancing the World’s Technology Together

Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future.

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

The AGI (Artificial General Intelligence) Computing Lab is dedicated to solving the complex system-level challenges posed by the growing demands of future AI/ML workloads. Our team is committed to designing and developing scalable platforms that can effectively handle the computational and memory requirements of these workloads while minimizing energy consumption and maximizing performance. To achieve this goal, we collaborate closely with both hardware and software engineers to identify and address the unique challenges posed by AI/ML workloads and to explore new computing abstractions that can provide a better balance between the hardware and software components of our systems. Additionally, we continuously conduct research and development in emerging technologies and trends across memory, computing, interconnect, and AI/ML, ensuring that our platforms are always equipped to handle the most demanding workloads of the future. By working together as a dedicated and passionate team, we aim to revolutionize the way AI/ML applications are deployed and executed, ultimately contributing to the advancement of AGI in an affordable and sustainable manner. Join us in our passion to shape the future of computing!

As AI models scale, memory — its capacity, bandwidth, cost, and placement — has become the central architectural constraint. The question is no longer whether to rethink memory system design, but how. A broad solution space exists: GPU-side shared memory architectures, DRAM and Flash as capacity tiers, fabric-attached pooling and disaggregation, and new interconnect approaches all represent credible paths. Each carries different tradeoff profiles across workloads, deployment contexts, and cost structures.

This role exists to bring rigor to that question. You will build workload-grounded models that evaluate the full solution space, quantify where each approach wins and why, and translate those findings into architecture decisions that directly shape product strategy and investment. You will work closely with architects across compute, networking, storage, and software, and present directly to senior technical leadership. This is a principal individual contributor role: you personally build the models, own the conclusions, and drive the decisions.

Location: Daily onsite presence at our San Jose, CA office / U.S. headquarters in alignment with our Flexible Work policy.

What You’ll Do

  • Technical Coordination: Act as a key technical point of contact for the infrastructure team; provide guidance on implementation and help coordinate efforts to ensure projects are completed successfully.
  • Drive Project Execution: Take ownership of infrastructure initiatives from concept to completion. Take the initiative to determine the most feasible path forward and drive the technical implementation.
  • Unify Development Lifecycle Management: Integrate Jira-based project tracking with GitHub and GitLab repositories and E2E pipelines across major workstreams to unify the management of requirements, feature development status, defect tracking, component dependencies, and integrated release cycles.
  • Translate Needs into Action: Work with engineering stakeholders to understand lab requirements and turn those needs into actionable technical tasks and system improvements.
  • Develop & Maintain CI/CD Pipelines: Build and optimize automated build, test, and release pipelines that support the lab’s entire software stack.
  • Optimize Build Productivity: Identify and resolve bottlenecks in build speed and environment reproducibility to improve overall engineering velocity.
  • Manage Compute & Test Resources: Handle the automation, configuration, and maintenance of Linux-based build workers and accelerator-backed test systems.
  • Improve Failure Analysis: Lead the effort to make test failures actionable by enhancing logs, dashboards, and reporting, while working to eliminate flaky tests.
  • Ensure System Reliability: Take responsibility for the stability and efficiency of the infrastructure, implementing monitoring and recovery procedures to ensure high availability.
  • Cross-Functional Collaboration: Lead technical discussions with IT, Security, and other engineering teams to align on networking, storage, and platform integration.
  • Enable Developer Self-Service: Create and maintain the documentation and tools that allow other engineers to onboard quickly and resolve environment issues independently.

What You Bring

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field with 15+ years of industry experience or Master's with 13+ years, or PhD's with 10+ years of industry experience.
  • Strong hands-on experience operating self-managed, on-premises Linux-based engineering infrastructure and troubleshooting issues across compute, storage, networking, and software environments.
  • Demonstrated experience designing and maintaining CI/CD systems using platforms such as Jenkins, GitLab CI, GitHub Actions, or equivalent.
  • Strong programming and automation skills in Python and shell scripting, with an emphasis on creating maintainable and tested software.
  • Proficiency with Git-based development workflows, automated testing, build systems, and artifact repositories.
  • Experience with reproducible environments, container technologies, and infrastructure/configuration automation.
  • A track record of improving infrastructure reliability, build/test performance, or developer productivity through measurable improvements.
  • The ability to take initiative, prioritize competing requirements, and collaborate effectively across software, hardware, and IT organizations.
  • A collaborative mindset, a desire to mentor others, and a curiosity about emerging technologies.

Preferred Qualifications

  • Experience supporting compiler, runtime, firmware, or systems-software development, including C/C++ build and test workflows.
  • Familiarity with LLVM/MLIR, CMake/Ninja, Bazel, or comparable toolchains and build systems.
  • Experience with GPU/AI accelerator systems, heterogeneous compute clusters, or hardware-in-the-loop testing.
  • Experience with cluster scheduling or orches
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Infrastructure Engineer
Senior Staff Infrastructure Engineer

Samsung Semiconductor Inc (US) • San Jose (CA)

On-site
USD 190,000 - 270,000
Senior Staff Performance Engineer
Senior Staff Performance Engineer

samsungsemiconductor • San Jose (CA)

On-site
USD 190,000 - 270,000
Senior Solutions Engineer, AI Infrastructure
Senior Solutions Engineer, AI Infrastructure

VAST Data, Inc. • New York (NY)

On-site
USD 150,000 - 200,000
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

OpenAI • Los Angeles (CA)

On-site
USD 230,000 - 405,000
Equity
Flexible work environment
Health benefits
Staff Engineer, Infrastructure – HPC & AI Compute
Staff Engineer, Infrastructure – HPC & AI Compute

Cssmerge • San Francisco (CA)

On-site
USD 190,000 - 240,000
Applied Researcher – AI Expert
Applied Researcher – AI Expert

Designworks Talent • Bellevue (WA)

Hybrid
USD 180,000 - 280,000
Technical Staff, Storage Architect
Technical Staff, Storage Architect

Dell Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Technical Staff, AI Architect
Technical Staff, AI Architect

Dell • Santa Clara (CA)

On-site
USD 260,000 - 380,000
Technical Staff, Storage Architect
Technical Staff, Storage Architect

Dell Inc. • Round Rock (TX)

On-site
USD 180,000 - 260,000