Senior QA Engineer - Data And AI

First Tech Federal Credit Union; Hillsboro (OR); Ibrido; USD 104.000 - 125.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical, dental, vision coverage

401(k) match

Paid Time Off

Paid federal holidays

Employee pricing on lending products

Descrizione del lavoro

First Tech Federal Credit Union is seeking a Senior Quality Engineer - AI & Automation to lead modern quality engineering across automated testing, AI-assisted testing, and intelligent quality validation. You will partner with engineering, product, data teams to raise quality and release confidence through automation and continuous testing.

The role emphasizes AI-enabled testing, scalable frameworks, and CI/CD integration to improve product quality and customer outcomes.

Competenze

• 5+ years of experience in Quality Assurance, Quality Engineering, Software Testing, or Test Automation for enterprise tech solutions.
• Experience designing automated testing frameworks and integrating tests into CI/CD using Selenium, Playwright, Cypress, Appium or equivalent.
• Experience testing cloud-native apps, APIs, microservices, event-driven architectures, and distributed systems.
• Experience testing Generative AI and LLM-based applications using platforms like OpenAI, Anthropic Claude, Bedrock, Azure AI, Vertex AI, or equivalent.
• Experience with AI evaluation/observability tools such as LangSmith, DeepEval, Ragas, Promptfoo, TruLens, MLflow Evaluation, or similar.
• Understanding of Retrieval-Augmented Generation, AI agents, vector databases, prompt engineering, and AI quality characteristics (accuracy, relevance, hallucination detection, bias testing, safety, performance).

Mansioni

• Design, implement, and maintain scalable test automation frameworks and CI/CD-compatible testing.
• Lead adoption of AI-assisted quality engineering practices to improve test creation and coverage.
• Define and execute testing strategies for AI-enabled applications and data platforms.
• Establish quality metrics, automation standards, and release-readiness criteria.
• Partner with engineering, product, and platform teams to identify quality risks and embed QA across SDLC.
• Evaluate new automation and AI testing technologies to improve effectiveness and efficiency.

Conoscenze

Selenium

Playwright

Cypress

Appium

Strumenti

Selenium

Playwright

Cypress

Appium

Descrizione del lavoro

Description

Position Summary:

The Senior Quality Engineer - AI & Automation extends traditional quality assurance responsibilities by leading modern quality engineering practices across automated testing, AI-assisted testing, and intelligent quality validation. The role partners with engineering, product, architecture, and data teams to improve software quality, release confidence, testing efficiency, and customer outcomes through automation, continuous testing, and emerging AI-enabled quality engineering capabilities.

Role Specific Essential Functions:

• Design, implement, and maintain scalable test automation frameworks and continuous testing capabilities that support CI/CD pipelines and enterprise quality objectives.
• Lead the adoption of AI-assisted quality engineering practices to improve test creation, defect detection, test coverage analysis, and quality insights.
• Define and execute testing strategies for AI-enabled applications, intelligent automation solutions, analytics platforms, and data-driven products to validate functionality, reliability, performance, security, and expected business outcomes.
• Establish quality metrics, automation standards, and release-readiness criteria that drive measurable improvements in product quality, testing efficiency, and delivery effectiveness.
• Partner with engineering, architecture, product, and platform teams to identify quality risks early and embed quality practices throughout the software development lifecycle.
• Evaluate emerging automation, AI-driven testing, and quality engineering technologies and recommend solutions that improve testing effectiveness, operational efficiency, and customer experience.

Role Specific Expectations and Qualifications:

• 5+ years of experience in Quality Assurance, Quality Engineering, Software Testing, or Test Automation supporting complex enterprise technology solutions.
• Experience designing and implementing automated testing frameworks and integrating automated testing into CI/CD pipelines using technologies such as Selenium, Playwright, Cypress, Appium, or equivalent automation platforms.
• Experience testing cloud-native applications, APIs, microservices, event-driven architectures, and distributed systems.
• Experience testing Generative AI and Large Language Model (LLM) based applications using platforms such as OpenAI, Anthropic Claude, Amazon Bedrock, Azure AI, Google Vertex AI, or equivalent AI technologies.
• Experience with AI evaluation and observability frameworks such as LangSmith, DeepEval, Ragas, Promptfoo, TruLens, MLflow Evaluation, or similar model testing and monitoring platforms.
• Understanding of Retrieval-Augmented Generation (RAG), AI agents, vector databases, prompt engineering, and AI quality characteristics including accuracy, relevance, hallucination detection, bias testing, safety validation, and model performance monitoring.

Location: Hillsboro, OR | Marlborough/Chelmsford, MA

Target Compensation: $104,000 - $125,000 + Annual Bonus

Schedule: Mon - Friday : 8am- 5pm(Hybrid)

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Who We Are:

Every great journey begins with a bold idea-and ours is no different. First Tech and DCU were founded on the belief that financial solutions should put people first. That belief has fueled decades of innovation and service, rooted in the tech sector and expanding to support members from all walks of life.

What makes First Tech different?

Employees are eligible for:

• Traditional medical, dental, and vision coverage
• Generous 401(k) match
• Paid Time Off: You'll accrue up to 15 days in your first year. In addition, you'll receive 40 hours of sick time and 3 personal days, which refresh annually
• Paid federal holidays
• Special employee pricing on lending products such as mortgage, auto, and personal loans (eligibility subject to standard account requirements and underwriting criteria)

Employment Statements:

First Tech is an equal opportunity employer, and we value diversity, inclusion, and equity at our company. We evaluate qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics.

First Tech is not currently offering Visa transfer/sponsorship for this position.