Junior ML Engineer — LLM Data Pipelines & Deployment

Pangram Labs; New York (NY); On-site; USD 135,000 - 150,000; Full time

Job summary

Pangram Labs is hiring a strong junior Machine Learning Engineer to support the ML development cycle from data generation to deployment and monitoring of production ML systems in real customer environments. This is an in-person role at our Downtown Brooklyn, NYC office.

You will build data pipelines, manage distributed multi-GPU training, and optimize training and inference code, while collaborating across research and engineering boundaries.

Qualifications

• B.S. or M.S. in Computer Science or related areas.
• Practical experience with deep learning: internships, undergrad or masters' level research projects in an academic lab, Kaggle competitions, or interesting side projects.
• Strong programming skills in Python and modern ML frameworks.
• Excellent understanding of transformers and LLM fundamentals.
• Comfort working across research and engineering boundaries.

Responsibilities

• Build robust data pipelines that mine the Internet at scale and generate millions of synthetic text examples for training detection models.
• Manage distributed infrastructure for multi-GPU LLM training.
• Profiling and optimizing training and inference code.
• Deploy efficient inference pipelines for serving LLMs at scale.

Skills

Python

Deep learning

LLM fundamentals

Research & engineering collaboration

Education

B.S./M.S. in CS or related

Tools

CUDA

DeepSpeed

Ray

Spark/Beam

Airflow

Job description

Pangram Labs is hiring a strong junior Machine Learning Engineer to support the ML development cycle from data generation to deployment and monitoring of production ML systems in real customer environments. This is an in-person role at our Downtown Brooklyn, NYC office.

You will build data pipelines, manage distributed multi-GPU training, and optimize training and inference code, while collaborating across research and engineering boundaries.