Remote Prompt Engineer: LLM Systems Architect

Bright Vision Technologies; Woodbridge Township (NJ); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a senior Prompt Engineer to lead standardization of LLM-driven architectures across the organization. The role focuses on designing prompts, retrieval strategies, and agentic systems enabling scalable, secure AI products.

The ideal candidate ships LLM-powered products, mentors engineers, and drives responsible AI practices while collaborating with model teams on co-design and evaluation frameworks.

Qualifications

• Degree in CS, Computational Linguistics, or related field.
• 10+ years of software engineering experience with LLM-based applications.
• Experience shipping LLM-powered products to production.
• Deep familiarity with modern LLM APIs and agent frameworks.
• Strong Python skills and experience with modern app frameworks.
• Experience designing evaluation pipelines for non-deterministic systems.

Responsibilities

• Define organization-wide standards, patterns, and reference architectures for LLM-based applications.
• Design prompt structures, instruction templates, and retrieval strategies for production use cases.
• Architect agentic systems incorporating tool use, planning, memory, and multi-step reasoning.
• Lead the design of retrieval-augmented generation pipelines including chunking, indexing, and reranking strategies.
• Develop evaluation frameworks for prompt quality, agent reliability, and end-to-end task success.
• Build internal tooling and libraries that accelerate LLM application development across teams.
• Establish guardrails, safety filters, and policy enforcement patterns for LLM-powered products.
• Collaborate with model engineering teams on prompt-model co-design and fine-tuning opportunities.
• Conduct technical reviews of LLM application designs across multiple product teams.
• Mentor engineers and applied scientists on prompt engineering and LLM application architecture.
• Lead red-teaming exercises and continuously improve robustness against adversarial inputs.
• Track latency, cost, and quality trade-offs in LLM application design and recommend optimizations.
• Document patterns, anti-patterns, and lessons learned for broad internal reuse.
• Stay current with LLM capabilities, tooling, and research, and translate advances into practical guidance.

Skills

Prompt design patterns

Agent architectures

LLM application design

Mentoring engineers

Python programming

Communication skills

Safety and policy

Evaluation pipelines

Leadership

Education

Bachelor’s or Master’s degree in CS/Computational Linguistics

Tools

Vector databases

Retrieval systems

Job description

Bright Vision Technologies is seeking a senior Prompt Engineer to lead standardization of LLM-driven architectures across the organization. The role focuses on designing prompts, retrieval strategies, and agentic systems enabling scalable, secure AI products.

The ideal candidate ships LLM-powered products, mentors engineers, and drives responsible AI practices while collaborating with model teams on co-design and evaluation frameworks.