Senior Software Engineer

TalentAlly; New York (NY); Remote; USD 150,000 - 210,000; Full time

Job summary

TalentAlly is seeking a mid‑to‑senior full‑stack AI engineer to design, train, and deploy production AI systems end‑to‑end. You will work across the full AI stack—machine learning, deep learning, and generative AI—building observable, safe, and scalable solutions.

You’ll deploy on Azure with Git-based workflows, CI/CD, and containerized services. Strong Python, ML libraries, and experience with LLMs and RAG are required for this remote role.

Qualifications

• Bachelor’s or Master’s degree or equivalent practical experience.
• 4+ years in software engineering with ML/AI production work.
• Strong Python and ML library proficiency.

Responsibilities

• Design, train, evaluate, and ship ML/DL models.
• Build LLM-powered applications with major providers.
• Develop RAG systems, embeddings, vectors, and re-ranking.
• Create agentic workflows with tooling orchestration.
• Apply prompt engineering and evaluation methods.
• Build data/feature pipelines on Azure, ensure quality and reproducibility.
• Operationalize models with MLOps: versioning, retraining, drift detection.
• Maintain CI/CD pipelines for AI services.
• Deploy services on Azure with containers (Docker) and Kubernetes.
• Ensure observability, safety, and compliance in production.

Skills

Python

PyTorch

TensorFlow

scikit-learn

pandas

NumPy

Git

CI/CD

Azure

Docker

Kubernetes

LLM-based apps

Prompt engineering

Education

Bachelor’s or Master’s in CS/ML

Tools

Claude Code

Cursor

Azure OpenAI

GitHub Actions

Azure DevOps

Docker

Terraform/Bicep

pgvector

Job description

Developer — AI Vibe Coding & Engineering Remote | Full-stack AI Engineer

Job Title: Developer, AI Vibe Coding & Engineering Location: Remote Employment Type: Full-time/ Contract Level: Mid-level

Role Summary

We are hiring a senior Developer for AI Development & Engineering to design, build, and operate production AI systems end to end. You will work across the full AI stack: classical machine learning, deep learning, and modern generative AI (LLMs, RAG, and agentic workflows). You will turn ambiguous business problems into AI capabilities our users trust, taking ownership from data through deployment, monitoring, and iteration. Our developers work fluidly across AI-assisted coding (Claude Code, Cursor) and traditional manual coding, deploying onto Azure with Git-based workflows and CI/CD. We expect strong software engineering instincts, comfort with experimentation, and a bias toward making AI systems observable, evaluable, and safe in production.

Key Responsibilities

• Design, train, evaluate, and ship machine learning and deep learning models (classification, regression, ranking, vision, NLP, time series) against well-defined business and scientific problems.


• Design and implement LLM-powered applications using major model providers (Claude/Anthropic, Azure OpenAI, OpenAI, or equivalents).


• Build retrieval-augmented generation (RAG) systems, including chunking strategies, embeddings, vector store selection (e.g., Azure AI Search, pgvector), and re-ranking.


• Develop agentic workflows with tool use and orchestration; implement guardrails, evaluation harnesses, and human-in-the-loop review where appropriate.


• Apply prompt engineering, fine-tuning, and structured output techniques; measure quality with offline evals and online metrics.


• Build and maintain robust data and feature pipelines on Azure; ensure data quality, lineage, and reproducibility.


• Productionize models with sound MLOps practices: versioning, automated retraining, drift detection, and rollback strategies.


• Use AI coding assistants (Claude Code, Cursor) effectively alongside traditional manual coding — choosing the right approach for each task and reviewing AI-generated code with rigor.


• Manage source code in Git using a clean branching strategy and pull-request-based review.


• Build and maintain CI/CD pipelines (e.g., Azure DevOps, GitHub Actions) for automated testing, packaging, and deployment of AI services.


• Deploy and operate services on Azure using containers (Docker), orchestration (Kubernetes/AKS), and infrastructure-as-code (Terraform or Bicep).


• Instrument AI systems with logging, tracing, and evaluation pipelines so that quality, latency, and cost can be observed and managed over time.


• Partner with security and compliance to address data privacy, PHI/PII handling, prompt injection, and model risk in regulated contexts.


• Work directly with product, scientific, and business stakeholders to scope problems, set realistic expectations, and choose the right level of AI sophistication for the job.


• Mentor engineers on AI-assisted development practices and on the patterns and pitfalls of LLM-based systems.


• Conduct rigorous design and code reviews; advocate for evaluation, safety, and observability as first-class concerns.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Mathematics, Statistics, or a related field — or equivalent practical experience.


• 4 + years of professional software engineering experience, with at least 2 years building and shipping ML or AI systems in production.


• Strong proficiency in Python and core ML libraries (PyTorch and/or TensorFlow, scikit-learn, pandas, NumPy).


• Hands-on experience deploying LLM-based applications using major model providers (Anthropic Claude, Azure OpenAI, OpenAI, or open-source models).


• Practical RAG and embeddings experience, including at least one production vector store.


• Demonstrated proficiency with AI coding tools such as Claude Code and Cursor, balanced with strong manual coding fundamentals.


• Solid command of Git, branching strategies, and pull-request-based code review.


• Hands-on experience building and operating CI/CD pipelines (e.g., Azure DevOps, GitHub Actions) for production workloads.


• Hands-on experience deploying services on Azure (AKS, App Service, Functions, Azure AI/ML services, or similar) and with containerization (Docker).


• Strong written and verbal communication; able to explain modeling decisions and trade-offs to non-technical stakeholders.


• Proven ability to thrive in a fully remote, globally distributed team.