Machine Learning Engineer (Junior)

Pangram Labs; New York (NY); On-site; USD 135,000 - 150,000; Full time

Job summary

Pangram Labs is hiring a strong junior Machine Learning Engineer to support the ML development cycle from data generation to deployment and monitoring of production ML systems in real customer environments. This is an in-person role at our Downtown Brooklyn, NYC office.

You will build data pipelines, manage distributed multi-GPU training, and optimize training and inference code, while collaborating across research and engineering boundaries.

Qualifications

• B.S. or M.S. in Computer Science or related areas.
• Practical experience with deep learning: internships, undergrad or masters' level research projects in an academic lab, Kaggle competitions, or interesting side projects.
• Strong programming skills in Python and modern ML frameworks.
• Excellent understanding of transformers and LLM fundamentals.
• Comfort working across research and engineering boundaries.

Responsibilities

• Build robust data pipelines that mine the Internet at scale and generate millions of synthetic text examples for training detection models.
• Manage distributed infrastructure for multi-GPU LLM training.
• Profiling and optimizing training and inference code.
• Deploy efficient inference pipelines for serving LLMs at scale.

Skills

Python

Deep learning

LLM fundamentals

Research & engineering collaboration

Education

B.S./M.S. in CS or related

Tools

CUDA

DeepSpeed

Ray

Spark/Beam

Airflow

Job description

Pangram Labs is hiring for a strong junior Machine Learning Engineer. In this role, you will build software to support the machine learning development cycle from data generation, to training models, to deployment and monitoring production machine learning systems in real customer environments. At Pangram, ML engineers are highly involved in the research effort, are involved in publishing research, and regularly contribute ideas and innovations to the team. However, formal research experience is not necessary. This is an in-person role in our office in Downtown Brooklyn, NYC.

Responsibilities

• Build robust data pipelines that mine the Internet at scale and generate millions of synthetic text examples for training detection models
• Manage distributed infrastructure for multi-GPU LLM training
• Profiling and optimizing training and inference code
• Deploy efficient inference pipelines for serving LLMs at scale

Requirements

• B.S. or M.S. in Computer Science or related areas
• Practical experience with deep learning: internships, undergrad or masters' level research projects in an academic lab, Kaggle competitions, or interesting side projects
• Strong programming skills in Python and modern ML frameworks
• Excellent understanding of transformers and LLM fundamentals
• Comfort working across research and engineering boundaries

Nice to have

• Experience with NVIDIA GPU programming and CUDA
• Experience with distributed training frameworks, such as DeepSpeed, FSDL, Ray
• Experience with inference frameworks like vLLM
• Experience with large-scale data processing (Spark, Beam) and orchestration (Airflow)
• Experience with MLOps and experiment tracking
• Experience with DevOps tools
• Familiarity with cloud-based infrastructure (AWS/GCP)

Compensation Range: $135K - $150K