LLM Engineer

TALENDICA; United States; Remote; USD 80,000 - 120,000; Part time

Job summary

A leading tech company is seeking MS Dynamics 365 Functional Resources with a focus on LLM development and optimization. This contract role involves fine-tuning large language models, ensuring robust data management, and coordinating with project leads. Ideal candidates will have advanced proficiency in Python, relevant advanced degrees, and experience in deploying NLP systems. The position is remote with a duration of 2-3 months.

Qualifications

• Intensive hands-on experience with custom LLM.
• Proven track record of deploying NLP or LLM systems in production.

Responsibilities

• Fine-tune and deploy large language models and perform NLP-related tasks.
• Establish evaluation metrics for NLP components.
• Coordinate with the Project Manager and AI Engineer for data management.

Skills

Proficiency in Python

Deep learning frameworks (e.g., PyTorch)

NLP techniques

Advanced fine-tuning strategies

Education

Master's/PhD in Computer Science/Engineering, Computational Linguistics

Tools

labelStudio

Job description

Direct message the job poster from TALENDICA

Hiring MS "Dynamics 365" AX AXapta D365 Functional Resources F&O, SCM, CRM, Project Manager

Remote

2-3 Months

Key Responsibilities

LLM Development & Optimization

• Fine-tune and deploy large language models (GPT, BERT, T5, etc.) and NLP-related tasks with vision language models (Florence-2, PaliGemma) for domain-specific tasks such as text classification, summarization, and entity extraction.
• Advanced NLP techniques, ensuring accurate text recognition of plan annotations (e.g., pipe materials, dimensions).

Annotation Workflow Integration

• Design custom techniques effective annotations to thereby achieve desired project goal.
• Automate or streamline annotation tasks wherever possible (e.g., partial auto-labeling) to reduce manual effort and error rates.
• Establish robust evaluation metrics (Perplexity, Precision, recall, F1-score, Levenshtein distance, character array, Bleu score ) for NLP components, including text extraction quality.
• Set up an iterative experimentation framework to track model versioning, data changes, and performance gains over time.

Data Management & Accountability

• Coordinate with the Project Manager and AI Engineer to ensure new data (annotated or collected) is properly versioned and accessible.
• Implement best practices for dataset growth, including tracking who annotated or curated the data and how these changes affect model performance.

Deployment & Scalability

• Integrate with existing infrastructure and pipelines, ensuring minimal disruption to ongoing model development.
• Optimize model sizes and queries to reduce latency between input and output (quantization, batch optimization, etc.)

Required Qualifications

• Master’s/Phd in Computer Science/Engineering, Computational Linguistics.
• Intensive hands on experience on custom LLM.

Technical Expertise

• Proficiency in Python and deep learning frameworks (PyTorch preferred).
• Proven track record of deploying NLP or LLM systems in production (Cloud or on-prem).
• Solid understanding of tokenization, embedding techniques, and advanced fine-tuning strategies.
• Experience in leveraging open, closed, or custom annotation tools (for example- labelStudio) to coordinate between multiple annotation formats and annotation teams

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Other

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at TALENDICA by 2x

Get notified about new Engineer jobs in United States.