Senior Platform Engineer, Generative AI Infrastructure

BIP; New York (NY); Hybrid; USD 140,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Voluntary benefits

Disability insurance

HSA/FSAs

401k matching

Discretionary bonus

Employee referral bonus

Employee assistance program

PTO & holidays

Job summary

Business Integration Partners (BIP) is expanding its United States Capital Markets technology practice and seeks a Senior Platform Engineer (7–10+ years) to design, build, and operate infrastructure for enterprise Generative AI apps. You will drive scalable environments, CI/CD, and containerized architectures (Docker/Kubernetes) across dev/test/prod, collaborating with engineering and data teams.

The role supports remote/hybrid work and involves capacity planning, cost optimization, and ensuring

Qualifications

• 7–10+ years in platform/DevOps or similar roles.
• End-to-end platform environments from dev to prod.
• Strong understanding of hardware, software, networking dependencies.
• Experience with CI/CD pipelines and DevOps tooling.
• Experience with containerized and distributed architectures (Docker/Kubernetes).
• Familiarity with cloud and on-prem environments.
• Experience with relational and NoSQL databases and large data environments.
• Strong Unix/Linux scripting for automation.
• HA, load balancing, and DR strategies.

Responsibilities

• Design, implement, maintain scalable platform environments.
• Manage environment dependencies across layers (infrastructure, apps, data, networking).
• Build and maintain provisioning, configuration validation, monitoring, and deployment processes.
• Define standards for platform configuration, environment management, and governance.
• Maintain inventories of environments, configurations, and deployment artifacts.
• Support containerized deployment models and orchestration.
• Monitor performance and optimize latency, throughput, and efficiency.
• Collaborate with engineering to deploy apps in production and resolve issues.
• Capacity planning and cost optimization across environments.

Skills

Platform engineering

DevOps

CI/CD

Docker

Kubernetes

Cloud & on-prem

Unix/Linux scripting

High availability

Distributed systems

Tools

Docker

Kubernetes

CI/CD tooling

Terraform

AWS

GCP

Azure

Job description

Business Integration Partners (BIP) is Europe’s fastest growing digital consulting company and is on track to reach the Top 20 globally by 2030. With a growing presence across the United States—including New York, Charlotte, Chicago, and Houston—BIP operates at the intersection of business strategy, technology, and data to deliver impactful solutions for clients.

With more than 6,000 professionals worldwide, BIP partners with organizations across Financial Services, Insurance, Payments, and other industries. Our capabilities span Data & AI, Cybersecurity, Risk & Compliance, Digital Transformation, and Change Management. We combine deep industry expertise with engineering excellence to help clients modernize platforms, unlock data insights, and drive innovation.

As part of our continued expansion in the United States, BIP is strengthening its Capital Markets technology practice. Our teams work closely with trading, risk, and front-office technology organizations to modernize critical platforms, enhance analytics capabilities, and support complex financial product ecosystems.

Position Overview:

We are seeking an experienced Senior Platform Engineer with 7–10+ years of experience to support the design, build, and operational management of infrastructure powering enterprise Generative AI applications. This role will focus on building and maintaining scalable environments that support AI-driven workloads across development, testing, and production.

The ideal candidate will have strong experience in platform engineering, DevOps practices, containerized environments, and distributed systems, with the ability to support high-performance computing workloads and modern AI application stacks.

This individual will work closely with engineering, data science, and platform teams to ensure reliable, scalable, and efficient infrastructure supporting the development and deployment of advanced AI solutions.

Key Responsibilities:

• Design, implement, and maintain scalable platform environments supporting AI and data-driven applications from proof-of-concept through production deployment.
• Manage environment dependencies across infrastructure, applications, data services, and networking layers.

Infrastructure Automation & DevOps

• Build and maintain automated processes for provisioning, installation, configuration validation, monitoring, and deployment of platform components.
• Implement and support CI/CD pipelines to streamline development workflows and accelerate releases.
• Define and enforce standards for platform configuration, environment management, and infrastructure governance.
• Maintain version-controlled inventories of platform environments, configurations, and deployment artifacts.

Containerization & Distributed Systems

• Support containerized deployment models using technologies such as Docker and Kubernetes or similar orchestration platforms.
• Ensure scalability, reliability, and efficient resource utilization across distributed infrastructure environments.

Monitoring, Performance & Optimization

• Implement infrastructure monitoring solutions to track CPU, GPU, memory utilization, inference latency, and system performance.
• Identify performance bottlenecks and optimize infrastructure to improve throughput, efficiency, and latency.

Deployment & Operational Support

• Collaborate with engineering and operational teams to deploy applications and support production environments.
• Troubleshoot and resolve infrastructure, configuration, and environment-related issues.

Capacity Planning & Environment Allocation

• Manage environment capacity and allocate resources across teams based on project lifecycle requirements.
• Work with project teams to optimize infrastructure costs while maintaining performance and scalability.

Required Qualifications:

• 7–10+ years of experience in platform engineering, DevOps engineering, infrastructure engineering, or similar technical roles.
• Proven experience designing and maintaining end-to-end platform environments from development through production.
• Strong understanding of hardware, software, networking, and application configuration dependencies.
• Experience working with CI/CD pipelines and DevOps tooling.
• Experience supporting containerized and distributed application architectures using technologies such as Docker and Kubernetes or similar orchestration platforms.
• Experience working with microservices, serverless architectures, or loosely coupled distributed systems.
• Familiarity with both cloud-based and on-premises infrastructure environments.
• Experience working with relational and NoSQL databases, object storage, or large-scale data environments.
• Strong scripting skills in Unix/Linux environments, including automation and scheduling tools.
• Experience implementing high availability, load balancing, and disaster recovery strategies.

Preferred Qualifications:

• Experience supporting AI, machine learning, or Generative AI infrastructure environments.
• Familiarity with Python-based application stacks and AI frameworks such as TensorFlow or PyTorch.
• Experience managing GPU-based compute environments, including resource scheduling and scaling.
• Experience with inference optimization, performance tuning, and infrastructure monitoring for AI workloads.
• Prior experience supporting high-performance computing or data-intensive environments.Experience working in financial services or other highly regulated enterprise environments.

The base salary range for this role is $140,000 - $200,000, with flexibility for exceptional candidates

• Choice of medical, dental, vision insurance.
• Voluntary benefits.
• Short- and long-term disability.
• HSA and FSAs.
• Matching 401k.
• Discretionary performance bonus.
• Employee referral bonus.
• Employee assistance program.
• 11 public holidays.
• 20 days PTO.
• 7 Sick Days.
• PTO buy and sell program.
• Paid parental leave.
• Remote/hybrid work environment support.

For more information about BIP US, visit https://www.bip-group.com/en-us/.

It is BIP US Consulting policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship, or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.

BIP US provides a reasonable range of compensation for our roles. Actual compensation is influenced by a wide array of factors including but not limited to skill set, education, level of experience, and knowledge.