Generative AI Engineer (Data/ML/GenAI)

Jobright.ai; Jersey City (NJ); On-site; USD 144,000 - 176,000; Full time

Benefits offered by this job

Medical insurance

Vision insurance

401(k)

Job summary

Jobright.ai is seeking a skilled Generative AI Engineer specializing in Data and Machine Learning to build and optimize LLM-powered systems. The role involves designing workflows, deploying secure services, and mentoring juniors while driving best practices. Ideal candidates will have extensive experience with Python, FastAPI, and other modern AI tools, alongside a strong foundation in ML operations.

Qualifications

• 6+ years across Data/ML/GenAI required.
• Experience designing and shipping LLM or GenAI apps to production.
• Strong skills in building reliable REST services and integrations.

Responsibilities

• Own E2E design for chat/agents and workflow automation.
• Build prompt stacks and implement multi-agent workflows.
• Ship FastAPI services and ensure resource reliability.

Skills

Python

FastAPI

OpenAI/Gemini

Docker

Kubernetes

Education

6+ years of experience in Data/ML/GenAI

Tools

FastAPI

Docker

Kubernetes

Job description

Join to apply for the Generative AI Engineer (Data/ML/GenAI) role at Jobright.ai

1 day ago Be among the first 25 applicants

Join to apply for the Generative AI Engineer (Data/ML/GenAI) role at Jobright.ai

Jobright is an AI-powered career platform that helps job seekers discover the top opportunities in the US. We are NOT a staffing agency. Jobright does not hire directly for these positions. We connect you with verified openings from employers you can trust.

Job Summary:

DATAECONOMY is seeking a Generative AI Engineer with extensive experience in Data, Machine Learning, and Generative AI to design and productionize LLM-powered systems. The role involves selecting and fine-tuning models, crafting workflows, and ensuring the deployment of secure, observable services while maintaining MLOps rigor.

Responsibilities:

• Own E2E design for chat/agents, structured generation, summarization/classification, and workflow automation. Choose the right model vs. non-LLM alternatives and justify trade-offs.

• Build prompt stacks (system/task/tool), synthetic data pipelines, and fine-tune or LoRA adapters; apply instruction tuning/RLHF where warranted.

• Implement multi-agent/tool-calling workflows using AutoGen, LangGraph, CrewAI (state management, retries, tool safety, fallbacks, grounding).

• Stand up retrieval stacks with vector DBs (Pinecone/Faiss/Weaviate/pgvector), chunking and citation strategies, reranking, and caching; enforce traceability.

• Ship FastAPI services, containerize (Docker), orchestrate (Kubernetes/Cloud Run), wire CI/CD and IaC; design SLAs/SLOs for reliability and cost.

• Instrument evals (unit/regression/AB), add tracing and metrics (Langfuse, LangSmith, OpenTelemetry), and manage model/version registries (MLflow/W&B).

• Implement guardrails (prompt injection/PII/toxicity), policy filters (Bedrock Guardrails/Azure AI Content Safety/OpenAI Moderation), access controls, and compliance logging.

• Build/maintain data ingestion, cleansing, and labeling workflows for model/retrieval corpora; ensure schema/version governance.

• Optimize with batching, streaming, JSON-schema/function calling, tool-use, speculative decoding/KV caching, and token budgets.

• Partner with product/engineering/DS; review designs/PRs, mentor juniors, and drive best practices/playbooks.

Qualifications:

Required:

• 6+ years across Data/ML/GenAI

• 1–2+ years designing and shipping LLM or GenAI apps to production

• Strong Python and FastAPI

• Proven experience building secure, reliable REST services and integrations

• Hands-on with OpenAI/Anthropic/Gemini/Llama families

• At least two of: AutoGen, LangGraph, CrewAI, LangChain, LlamaIndex, Transformers

• Practical experience implementing vector search and reranking

• Experience with offline/online evals (e.g., RAGAS, promptfoo, custom harnesses)

• Docker, Kubernetes (or managed equivalents), and one major cloud (AWS/Azure/GCP)

• CI/CD and secrets management

• Familiarity with tracing/metrics tools (e.g., Langfuse, LangSmith, OpenTelemetry)

• Working knowledge of data privacy, PII handling, content safety, and policy/controls for enterprise deployments

• Clear technical writing and cross-functional collaboration

• Ability to translate business goals into architecture and milestones

Preferred:

• Deeper experience with multi-agent planning/execution, tool catalogs, and failure-mode design

• Experience with pgvector/Elasticsearch/OpenSearch

• Comfort with relational/NoSQL/graph stores

• Human-in-the-loop pipelines, golden sets, regression suites, and cost/quality dashboards

Company:

Dataeconomy believes that the industry is pivotal, with considerable opportunities in re-imagining business models and scaling business. Founded in 2018, headquartered in Ohio, Illinois, USA, team size 201-500 employees, currently Growth Stage. DATAECONOMY has a track record of offering H1B sponsorships.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  Software Development

Referrals increase your chances of interviewing at Jobright.ai by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Get notified about new Generative AI Engineer jobs in Jersey City, NJ.

New York, NY $160,000.00-$160,000.00 6 days ago

Software Engineer, Infrastructure, Early Career

New York, NY $126,000.00-$170,000.00 10 hours ago

New York, NY $180,000.00-$280,000.00 3 days ago

New York, NY $130,000.00-$180,000.00 7 months ago

New York, NY $56.25-$137,000.00 4 days ago

New York, NY $99,500.00-$200,000.00 2 weeks ago

New York, NY $70,000.00-$150,000.00 3 days ago

New York, NY $120,000.00-$180,000.00 5 months ago

Want to work with us, but don't see the right job listed?

New York, NY $140,000.00-$200,000.00 3 weeks ago

New York, NY $125,000.00-$175,000.00 2 weeks ago

New York, NY $140,000.00-$140,000.00 2 months ago

Software Engineer, AI Intern (Summer 2026)

New York, NY $235,000.00-$255,000.00 1 week ago

New York, NY $163,200.00-$223,200.00 1 week ago

New York, NY $150,000.00-$283,000.00 4 days ago

New York, NY $100,000.00-$150,000.00 6 days ago

New York, NY $120,000.00-$220,000.00 2 months ago

Software Engineer, AI Intern (Winter 2026)

New York, NY $130,000.00-$240,000.00 2 weeks ago

New York, NY $145,000.00-$260,000.00 9 months ago

New York, NY $120,000.00-$140,000.00 1 month ago

Backend Software Engineer, CloudKitchens - New York City

New York, NY $190,000.00-$250,000.00 2 weeks ago

Don't see the right opportunity? Apply here!

New York, NY $150,000.00-$230,000.00 3 days ago

New York, NY $165,000.00-$165,000.00 1 year ago

New York, NY $108,000.00-$135,000.00 1 week ago

New York, NY $140,000.00-$170,000.00 3 months ago

New York, NY $100,000.00-$200,000.00 7 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.