LLM Data Engineer: Build Scalable Pipelines for Production AI

Zintro, Inc.; Boston (MA); On-site; USD 120,000 - 160,000; Full time

Job summary

Zintro, Inc. is seeking an experienced Data Engineer in Boston to design and maintain scalable data pipelines for LLM training and inference.

You will collaborate across teams to integrate LLMs like GPT and BERT into production environments and ensure robust data preprocessing and feature engineering for model training. The role emphasizes data quality, architecture, and performance monitoring, with a focus on leveraging tools such as Kafka, Spark, Hadoop, and Airflow to support ML workflows and

Qualifications

• Bachelor’s or Master’s in Computer Science, Engineering, or related field.
• Proven experience in large-scale data engineering with expertise in LLM technologies (GPT, BERT, T5) and NLP data preprocessing.
• Proficient in data tools like Apache Kafka, Spark, Hadoop, and Airflow.
• Strong programming skills in Python, Java, or Scala, with experience in Pandas, NumPy, and TensorFlow/PyTorch.
• Knowledge of relational and NoSQL databases, cloud platforms (AWS, GCP, Azure), and data versioning tools (MLflow, DVC).
• Understanding of data privacy, security, debugging, and performance optimization.
• Excellent communication skills, strong teamwork abilities, and keen attention to detail.

Responsibilities

• Design and optimize scalable data pipelines for LLM training and inference.
• Collaborate with cross-functional teams to integrate LLMs into production.
• Ensure data integrity, preprocessing, and feature engineering for model training.
• Develop efficient data architectures, monitor pipeline performance, and implement quality checks.
• Support versioning and stay updated on LLM and data engineering advancements.

Skills

Python

Java/Scala

Pandas

NumPy

TensorFlow/PyTorch

Data privacy & security

Data debugging & performance tuning

Communication & teamwork

Education

Bachelor’s or Master’s in CS/Engineering

Tools

Apache Kafka

Spark

Hadoop

Airflow

Job description

Zintro, Inc. is seeking an experienced Data Engineer in Boston to design and maintain scalable data pipelines for LLM training and inference.

You will collaborate across teams to integrate LLMs like GPT and BERT into production environments and ensure robust data preprocessing and feature engineering for model training. The role emphasizes data quality, architecture, and performance monitoring, with a focus on leveraging tools such as Kafka, Spark, Hadoop, and Airflow to support ML workflows and