Prompt Engineer

Bright Vision Technologies; Woodbridge Township (NJ); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a senior Prompt Engineer to lead standardization of LLM-driven architectures across the organization. The role focuses on designing prompts, retrieval strategies, and agentic systems enabling scalable, secure AI products.

The ideal candidate ships LLM-powered products, mentors engineers, and drives responsible AI practices while collaborating with model teams on co-design and evaluation frameworks.

Qualifications

• Degree in CS, Computational Linguistics, or related field.
• 10+ years of software engineering experience with LLM-based applications.
• Experience shipping LLM-powered products to production.
• Deep familiarity with modern LLM APIs and agent frameworks.
• Strong Python skills and experience with modern app frameworks.
• Experience designing evaluation pipelines for non-deterministic systems.

Responsibilities

• Define organization-wide standards, patterns, and reference architectures for LLM-based applications.
• Design prompt structures, instruction templates, and retrieval strategies for production use cases.
• Architect agentic systems incorporating tool use, planning, memory, and multi-step reasoning.
• Lead the design of retrieval-augmented generation pipelines including chunking, indexing, and reranking strategies.
• Develop evaluation frameworks for prompt quality, agent reliability, and end-to-end task success.
• Build internal tooling and libraries that accelerate LLM application development across teams.
• Establish guardrails, safety filters, and policy enforcement patterns for LLM-powered products.
• Collaborate with model engineering teams on prompt-model co-design and fine-tuning opportunities.
• Conduct technical reviews of LLM application designs across multiple product teams.
• Mentor engineers and applied scientists on prompt engineering and LLM application architecture.
• Lead red-teaming exercises and continuously improve robustness against adversarial inputs.
• Track latency, cost, and quality trade-offs in LLM application design and recommend optimizations.
• Document patterns, anti-patterns, and lessons learned for broad internal reuse.
• Stay current with LLM capabilities, tooling, and research, and translate advances into practical guidance.

Skills

Prompt design patterns

Agent architectures

LLM application design

Mentoring engineers

Python programming

Communication skills

Safety and policy

Evaluation pipelines

Leadership

Education

Bachelor’s or Master’s degree in CS/Computational Linguistics

Tools

Vector databases

Retrieval systems

Job description

Prompt Engineer - Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Prompt Engineer

Location: 100% Remote (U.S.)

Position Type: Full-time, Direct W2

Salary Range: $100,000–$150,000 Annually

Experience Required: 10+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary

We are looking for a Prompt Engineer to define and lead the strategy, patterns, and tooling for designing prompts, agentic workflows, and LLM-based application architectures across the organization. The role combines deep practical mastery of modern LLMs with the discipline of building reusable design patterns, evaluation frameworks, and developer tooling that scale across many teams and use cases. The ideal candidate has shipped LLM-powered products in production, is fluent in prompt design patterns and agent architectures, and brings strong judgment about when and how to apply different LLM techniques responsibly.

Key Responsibilities

• Define organization-wide standards, patterns, and reference architectures for LLM-based applications.
• Design prompt structures, instruction templates, and retrieval strategies for diverse production use cases.
• Architect agentic systems incorporating tool use, planning, memory, and multi-step reasoning.
• Lead the design of retrieval-augmented generation pipelines including chunking, indexing, and reranking strategies.
• Develop evaluation frameworks for prompt quality, agent reliability, and end-to-end task success.
• Build internal tooling and libraries that accelerate LLM application development across teams.
• Establish guardrails, safety filters, and policy enforcement patterns for LLM-powered products.
• Collaborate with model engineering teams on prompt-model co-design and fine-tuning opportunities.
• Conduct technical reviews of LLM application designs across multiple product teams.
• Mentor engineers and applied scientists on prompt engineering and LLM application architecture.
• Lead red-teaming exercises and continuously improve robustness against adversarial inputs.
• Track latency, cost, and quality trade-offs in LLM application design and recommend optimizations.
• Document patterns, anti-patterns, and lessons learned for broad internal reuse.
• Stay current with LLM capabilities, tooling, and research, and translate advances into practical guidance.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related field.
• Ten or more years of software engineering experience, with significant time on LLM-based applications.
• Demonstrated experience shipping LLM-powered products to production.
• Deep familiarity with modern LLM APIs and agent frameworks.
• Strong understanding of retrieval-augmented generation, embeddings, and vector databases.
• Experience designing evaluation pipelines for non-deterministic systems.
• Strong Python skills and comfort with modern application frameworks.
• Solid grasp of responsible AI principles, including safety and policy considerations.
• Excellent written and verbal communication skills.
• Track record of mentoring engineers and influencing technical direction.

Preferred Qualifications

• Public writing, talks, or open-source contributions on LLM application development.
• Experience with multi-agent architectures and complex tool-use systems.
• Familiarity with fine-tuning workflows and when to choose them over prompting.
• Exposure to product domains such as customer support, coding assistants, or analytics agents.
• Experience integrating LLMs into enterprise software systems with strict compliance requirements.

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.