AI Engineer

Netrolynx AI; United States; On-site; USD 95,000 - 140,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Parental leave

Paid time off

401(k) retirement plan with company"s"

Job summary

Moody's Corporation is seeking a Quality Engineer focused on AI-enabled products to join our QA team. You will support quality assurance for software and AI systems, including large language models, ensuring outputs are accurate, relevant, and reliable.

Collaborate with cross-functional teams to develop testing strategies, document findings, and contribute to continuous QA improvements. This role suits someone passionate about AI and ethical AI use, eager to grow hands-on in AI product

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Basic understanding of software testing concepts including manual, exploratory, regression, API, and integration testing methodologies.
• Fundamental programming or scripting knowledge, preferably in Python, with familiarity in APIs, databases, JSON, version control, and defect tracking tools.
• Basic understanding of AI concepts, including large language models, with awareness of hallucinations and inconsistent outputs.
• Interest in prompt engineering, context engineering, and evaluating AI-enabled products.
• Strong analytical, communication, documentation, and problem-solving skills, with the ability to collaborate across teams.
• Curiosity and enthusiasm for learning about AI tools and responsible AI practices, including risk management and ethical considerations.

Responsibilities

• Performing manual, exploratory, regression, API, and integration testing within an Agile team environment, under close guidance.
• Testing software features that incorporate AI or large language model components, reviewing outputs for accuracy, relevance, and adherence to instructions.
• Creating basic test scenarios, prompts, and test data to evaluate AI behavior and identify issues such as hallucinations, incomplete responses, or inconsistencies.
• Applying prompt engineering and context engineering techniques during testing to optimize AI performance.
• Utilizing AI-assisted tools like Codex, Claude Code, and similar interfaces under the supervision of senior team members.
• Assisting with existing AI evaluation harnesses, test scripts, and regression checks to validate AI functionalities.
• Documenting defects with clear reproduction steps, expected, and actual results, and collaborating with engineering and product teams to resolve issues.
• Contributing to test documentation, reusable test cases, and ongoing enhancements to QA standards and processes.

Skills

Manual testing

Exploratory testing

Regression testing

API testing

Integration testing

Python

Analytical skills

Communication

Documentation

Problem solving

Cross-team collaboration

AI curiosity

Education

Bachelor's degree in Computer Science, Software Engineering, or a related field

Tools

APIs

Databases

JSON

Version control

Defect tracking tools

Job description

About The Company

Moody's Corporation is a renowned global leader in credit ratings, research, and risk analysis, committed to providing insightful and reliable information that helps organizations make informed decisions. With a rich history of innovation and integrity, Moody's empowers clients across various sectors to navigate complex financial landscapes confidently. The company fosters a culture of excellence, inclusivity, and continuous learning, emphasizing responsible practices and technological advancement to stay at the frontier of the industry.

Moody's Corporation is a renowned global leader in credit ratings, research, and risk analysis, committed to providing insightful and reliable information that helps organizations make informed decisions. With a rich history of innovation and integrity, Moody's empowers clients across various sectors to navigate complex financial landscapes confidently. The company fosters a culture of excellence, inclusivity, and continuous learning, emphasizing responsible practices and technological advancement to stay at the frontier of the industry.

About The Role

We are seeking a dedicated Quality Engineer with a focus on AI-enabled products to join our dynamic team at Moody's Corporation. This role offers an exciting opportunity to work at the intersection of traditional software testing and emerging artificial intelligence technologies. The successful candidate will support the quality assurance processes for software and AI systems, including large language models, ensuring their outputs are accurate, relevant, and reliable. You will collaborate closely with cross-functional teams to develop and execute testing strategies, document findings, and contribute to the continuous improvement of our QA practices. This position is ideal for individuals passionate about AI, eager to develop hands-on skills in AI product evaluation, and committed to maintaining high standards of quality and ethical AI use.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Basic understanding of software testing concepts, including manual, exploratory, regression, API, and integration testing methodologies.
• Fundamental programming or scripting knowledge, preferably in Python, with familiarity in APIs, databases, JSON, version control, and defect tracking tools.
• Basic understanding of AI concepts, including large language models, with awareness of common limitations such as hallucinations and inconsistent outputs.
• Interest in prompt engineering, context engineering, and evaluating AI-enabled products.
• Strong analytical, communication, documentation, and problem-solving skills, with the ability to collaborate effectively across teams.
• Curiosity and enthusiasm for learning about AI tools and responsible AI practices, including risk management and ethical considerations.

Responsibilities

As a Quality Engineer focused on AI products, your responsibilities will include supporting quality assurance efforts within an Agile environment by executing various testing activities, documenting findings, and contributing to process improvements. Specific duties include:

• Performing manual, exploratory, regression, API, and integration testing within an Agile team environment, under close guidance.
• Testing software features that incorporate AI or large language model components, reviewing outputs for accuracy, relevance, and adherence to instructions.
• Creating basic test scenarios, prompts, and test data to evaluate AI behavior and identify issues such as hallucinations, incomplete responses, or inconsistencies.
• Applying prompt engineering and context engineering techniques during testing to optimize AI performance.
• Utilizing AI-assisted tools like Codex, Claude Code, and similar interfaces under the supervision of senior team members.
• Assisting with existing AI evaluation harnesses, test scripts, and regression checks to validate AI functionalities.
• Documenting defects with clear reproduction steps, expected, and actual results, and collaborating with engineering and product teams to resolve issues.
• Contributing to test documentation, reusable test cases, and ongoing enhancements to QA standards and processes.

Benefits

Moody's Corporation offers a comprehensive benefits package designed to support the well-being and professional growth of our employees. Benefits include competitive medical, dental, and vision insurance plans, parental leave, paid time off, and a 401(k) retirement plan with both employee and employer contributions. Employees also have access to life, disability, and accident insurance, along with tuition reimbursement programs. The company fosters a collaborative and inclusive work environment that encourages innovation and continuous development, providing opportunities for career advancement and skill enhancement. Additionally, Moody's promotes work-life balance through flexible work arrangements and wellness initiatives, ensuring employees are supported both professionally and personally.

Equal Opportunity

Moody's Corporation is an equal opportunity employer committed to fostering an inclusive environment where all qualified applicants receive consideration for employment without regard to race, color, sex, gender, age, religion, national origin, ancestry, citizenship, marital or familial status, sexual orientation, gender identity or expression, genetic information, physical or mental disability, military or veteran status, or any other characteristic protected by law. The company provides reasonable accommodations for individuals with disabilities or sincerely held religious beliefs in accordance with applicable laws. We value diversity and are dedicated to creating a workplace that reflects the communities we serve. For inquiries related to accommodations or the application process, please contact us via the designated email. We also adhere to local regulations, including the San Francisco Fair Chance Ordinance, and promote transparency in pay and employment practices.