Senior AI Infra Engineer - Platform, Scale & Leadership

Bitwise; Laurel (MD); On-site; USD 282,000 - 332,000; Full time

Benefits offered by this job

PTO 3–5 weeks

Federal holidays

Snow days

401(k) match

Health insurance

Education assistance

Spot bonuses

Job summary

Bitwise is seeking a Senior Software Engineer – AI Infrastructure in Laurel, MD to design and operate scalable AI infrastructure. The role blends hands-on development with technical leadership on a small, integrated team embedded within a larger AI platform.

Expect architecture work, mentoring, and cross-team coordination to deliver robust AI services. Required: TS/SCI with polygraph; 12+ years experience; strong AWS and Kubernetes; experience with observability tools and LangChain.

Qualifications

• 12 years of experience or 4 additional years in lieu of a degree.
• Experience designing, building, and operating large-scale production systems.
• Deep expertise in systems integration across diverse technologies.
• Hands-on cloud engineering experience in AWS.
• Advanced proficiency with Kubernetes administration and deployment.
• Experience with observability tools and governance frameworks.
• Ability to lead initiatives and influence org change.
• Active TS/SCI clearance with polygraph.
• Experience with AI inference serving technologies.
• Familiarity with LangChain and vector embeddings.

Responsibilities

• Design, implement, and operate AI infrastructure for scalable inference.
• Lead production AI services and applications including RAG and agents.
• Serve as technical lead for AI infrastructure initiatives across teams.
• Mentor teammates and coordinate cross-team work.
• Define solutions for complex, underspecified systems and requirements.
• Establish policies, standards, and governance where gaps exist.

Skills

AWS

Kubernetes

Observability

LangChain

vLLM

Large-scale systems

Leadership

Education

B.S. in technical discipline

Tools

OpenTelemetry

Grafana

Prometheus

Vector databases

Job description

Bitwise is seeking a Senior Software Engineer – AI Infrastructure in Laurel, MD to design and operate scalable AI infrastructure. The role blends hands-on development with technical leadership on a small, integrated team embedded within a larger AI platform.

Expect architecture work, mentoring, and cross-team coordination to deliver robust AI services. Required: TS/SCI with polygraph; 12+ years experience; strong AWS and Kubernetes; experience with observability tools and LangChain.