Senior QA Engineer - Data And AI

First Tech Federal Credit Union; Chelmsford (MA); Ibrido; USD 104.000 - 125.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical benefits

Dental & vision

401(k) match

PTO

Holidays

Loan pricing

Descrizione del lavoro

First Tech Federal Credit Union seeks a Senior Quality Engineer - AI & Automation to lead modern QA practices across automated testing, AI-assisted testing, and intelligent validation. You will partner with engineering, product, architecture, and data teams to raise software quality, confidence in releases, testing efficiency, and customer outcomes through automation and continuous testing.

The role focuses on scalable automation frameworks, AI-assisted quality adoption, and strategy for

Competenze

• 5+ years in Quality Assurance or Quality Engineering for enterprise solutions.
• Experience designing automated testing frameworks and CI/CD integration with Selenium/Playwright/Cypress.
• Experience testing cloud-native apps, APIs, microservices and data-driven products.
• Experience testing Generative AI and LLM-based applications with AI platforms.
• Familiarity with AI evaluation and observability platforms.

Mansioni

• Design, implement, and maintain scalable test automation frameworks and CI/CD pipelines.
• Lead AI-assisted quality engineering practices for better test coverage and quality insights.
• Define testing strategies for AI-enabled applications and data-driven products.
• Establish quality metrics and release-readiness criteria to improve delivery.
• Partner with multiple teams to embed quality throughout the SDLC.
• Evaluate new automation and AI testing tech to improve effectiveness.

Conoscenze

Quality Assurance

Automation Frameworks

AI-assisted testing

CI/CD

Cloud-native & APIs

Strumenti

Selenium

Playwright

Cypress

Appium

LangSmith

Descrizione del lavoro

Description

Position Summary:

The Senior Quality Engineer - AI & Automation extends traditional quality assurance responsibilities by leading modern quality engineering practices across automated testing, AI-assisted testing, and intelligent quality validation. The role partners with engineering, product, architecture, and data teams to improve software quality, release confidence, testing efficiency, and customer outcomes through automation, continuous testing, and emerging AI-enabled quality engineering capabilities.

Role Specific Essential Functions:

• Design, implement, and maintain scalable test automation frameworks and continuous testing capabilities that support CI/CD pipelines and enterprise quality objectives.
• Lead the adoption of AI-assisted quality engineering practices to improve test creation, defect detection, test coverage analysis, and quality insights.
• Define and execute testing strategies for AI-enabled applications, intelligent automation solutions, analytics platforms, and data-driven products to validate functionality, reliability, performance, security, and expected business outcomes.
• Establish quality metrics, automation standards, and release-readiness criteria that drive measurable improvements in product quality, testing efficiency, and delivery effectiveness.
• Partner with engineering, architecture, product, and platform teams to identify quality risks early and embed quality practices throughout the software development lifecycle.
• Evaluate emerging automation, AI-driven testing, and quality engineering technologies and recommend solutions that improve testing effectiveness, operational efficiency, and customer experience.

Role Specific Expectations and Qualifications:

• 5+ years of experience in Quality Assurance, Quality Engineering, Software Testing, or Test Automation supporting complex enterprise technology solutions.
• Experience designing and implementing automated testing frameworks and integrating automated testing into CI/CD pipelines using technologies such as Selenium, Playwright, Cypress, Appium, or equivalent automation platforms.
• Experience testing cloud-native applications, APIs, microservices, event-driven architectures, and distributed systems.
• Experience testing Generative AI and Large Language Model (LLM) based applications using platforms such as OpenAI, Anthropic Claude, Amazon Bedrock, Azure AI, Google Vertex AI, or equivalent AI technologies.
• Experience with AI evaluation and observability frameworks such as LangSmith, DeepEval, Ragas, Promptfoo, TruLens, MLflow Evaluation, or similar model testing and monitoring platforms.
• Understanding of Retrieval-Augmented Generation (RAG), AI agents, vector databases, prompt engineering, and AI quality characteristics including accuracy, relevance, hallucination detection, bias testing, safety validation, and model performance monitoring.

Location: Hillsboro, OR | Marlborough/Chelmsford, MA

Target Compensation: $104,000 - $125,000 + Annual Bonus

Schedule: Mon - Friday : 8am- 5pm(Hybrid)

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Who We Are:

Every great journey begins with a bold idea-and ours is no different. First Tech and DCU were founded on the belief that financial solutions should put people first. That belief has fueled decades of innovation and service, rooted in the tech sector and expanding to support members from all walks of life.

What makes First Tech different?

Employees are eligible for:

• Traditional medical, dental, and vision coverage
• Generous 401(k) match
• Paid Time Off: You'll accrue up to 15 days in your first year. In addition, you'll receive 40 hours of sick time and 3 personal days, which refresh annually
• Paid federal holidays
• Special employee pricing on lending products such as mortgage, auto, and personal loans (eligibility subject to standard account requirements and underwriting criteria)

Employment Statements:

First Tech is an equal opportunity employer, and we value diversity, inclusion, and equity at our company. We evaluate qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics.

First Tech is not currently offering Visa transfer/sponsorship for this position.