AI Engineer: Safe, Scalable LLM Solutions

EthicalHat Cyber Security Pvt. Ltd.; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

EthicalHat Cyber Security Pvt. Ltd. is seeking an engineer to build AI-powered applications and agents for tasks like support, analyst assistance, document processing, and automation.

You will move systems from implementation to evaluation and monitoring, focusing on security risks such as prompt injection and misuse. The role blends software engineering with practical measurement of quality, safety, latency, and cost, requiring hands-on experience with Python, LLM APIs, and retrieval systems.

Qualifications

• 2-3 years of software engineering experience, including at least 1 year building LLM/ML-powered features.
• Strong Python skills; TypeScript is useful.
• Hands-on experience with language-model APIs and prompt design.
• Experience building retrieval-augmented generation systems with a vector store.
• Understanding of prompt injection, data leakage, and hallucination risks and how to reduce them.
• Familiarity with evaluation practices for AI applications and comfort with Git, testing, and CI/CD.

Responsibilities

• Develop model-powered features and agents using model APIs and frameworks, including tool use and structured outputs.
• Design retrieval-augmented generation pipelines, covering document chunking, embeddings, retrieval, and re-ranking.
• Build tools and servers that give agents appropriately limited and validated access to other systems.
• Create evaluation datasets and automated checks for quality, safety, and cost, and run them in CI.
• Add safeguards such as input/output validation, permission-aware retrieval, and human approval for higher-risk actions.
• Instrument systems with tracing and monitoring, investigate failures, and compare models and prompts against real tasks.

Skills

Python

TypeScript

LLM/ML APIs

Prompt design

Retrieval-augmented gen

Vector stores

Prompt injection risks

Evaluation practices

Git

Testing/CI/CD

Tools

Git

CI/CD

VectorDB

Job description

EthicalHat Cyber Security Pvt. Ltd. is seeking an engineer to build AI-powered applications and agents for tasks like support, analyst assistance, document processing, and automation.

You will move systems from implementation to evaluation and monitoring, focusing on security risks such as prompt injection and misuse. The role blends software engineering with practical measurement of quality, safety, latency, and cost, requiring hands-on experience with Python, LLM APIs, and retrieval systems.