Software Engineer in Test

GreenSky®; Alpharetta (GA); On-site; USD 115,000 - 145,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

401k retirement plan

Job summary

GreenSky seeks a highly technical AI Software Engineer in Test (AI SEIT) to modernize quality engineering through automation, AI-assisted development, data validation, and intelligent testing practices. The role combines software engineering, QA discipline, and AI tooling to raise release confidence.

The candidate will design automated test frameworks, validate AI outputs, and implement scalable automation across web, mobile, API, and data platforms, collaborating with engineering and data teams.

Qualifications

• Bachelor32s or Master2s in Computer Science, Software Engineering, or a related field.
• 2+ years of hands-on experience in software development, test automation, or quality engineering.
• Experience building and maintaining automated test frameworks.
• Experience working in AI DLC, Agile delivery models, including Scrum and Kanban.
• 2 to 4+ years of database experience, preferably SQL.

Responsibilities

• Use AI tools to accelerate test automation development across web, mobile, API, data, and AI-enabled apps.
• Analyze codebases to identify test coverage gaps and improve automated regression.
• Debug test failures, analyze logs, and recommend code or test corrections.
• Create repeatable AI workflows for test generation and regression analysis.
• Provide verification criteria and build checks so AI agents can validate changes.
• Partner with teams to establish safe and governed AI-assisted test practices.
• Integrate automated tests into CI/CD pipelines and ensure rapid feedback.

Skills

Test automation

AI testing

Quality engineering

Data validation

Code review

Education

Bachelor32s or Master2s in Computer Science/Software Engineering

Tools

Selenium

Playwright

Cypress

REST Assured

JUnit

TestNG

PyTest

Job description

GreenSky, LLC, headquartered in Atlanta, is a leading technology company Powering Commerce at the Point of Sale® for a growing ecosystem of merchants, consumers, and banks. GreenSky’s highly scalable, proprietary and patented technology platform enables merchants to offer frictionless promotional payment options to consumers, driving increased sales volume and accelerated cash flow. The GreenSky® Program is operated on behalf of, and financing is offered and made by, federally insured, federal or state chartered financial institutions, which leverage GreenSky’s technology to offer loans to primarily super-prime and prime consumers nationwide. Since GreenSky's inception, nearly 6 million consumers have financed nearly $70 billion of commerce using GreenSky’s real time “apply and buy” technology.

This role requires unrestricted work authorization now and in the future, as visa sponsorship and sponsorship transfers are not available.

About the role:

We are seeking a highly technical and innovative AI Software Engineer in Test (AI SEIT) to help modernize quality engineering through test automation, AI-assisted development, data validation, and intelligent software testing practices.

The ideal candidate will combine strong software engineering skills, quality engineering discipline, data validation expertise, and practical AI tool adoption to improve application quality, delivery velocity, and release confidence.

Duties & Responsibilities:

• Use AI tools to accelerate test automation development, including generating, modifying, and refactoring test scripts across web, mobile, API, backend, and data platform applications.
• Leverage AI tools to analyze existing codebases, identify test coverage gaps, suggest edge cases, and improve automated regression coverage.
• Use AI to debug test failures, analyze stack traces, inspect logs, and recommend code or test corrections.
• Create repeatable AI workflows for test generation, defect triage, regression analysis, and automation maintenance.
• Provide verification criteria, test commands, build checks, and validation steps so AI agents can iteratively run checks and confirm whether changes pass or fail. Anthropic’s AI best practices recommend giving Claude a way to verify its work through tests, builds, linters, scripts, or similar pass/fail signals.
• Partner with engineering teams to establish safe and governed usage patterns for AI-assisted test development.

Test Automation Development:

• Design, develop, and maintain comprehensive automated test frameworks for web, mobile, backend, API, data, and AI-enabled applications.
• Build scalable automation solutions using tools and frameworks such as Selenium, Playwright, Cypress, REST Assured, JUnit, TestNG, PyTest, or equivalent technologies.
• Work closely with developers, QA engineers, product managers, and business analysts to ensure high test coverage and rapid feedback loops.
• Develop reusable automation components, shared libraries, test utilities, and framework standards.
• Maintain automation suites for functional, regression, integration, end-to-end, API, performance, security, and data validation testing.

AI, GenAI, and Model Validation:

• Develop test strategies for AI-enabled applications, Generative AI workflows, LLM-powered features, RAG solutions, conversational AI, and agentic systems.
• Validate AI outputs for accuracy, relevance, completeness, hallucination risk, toxicity, policy alignment, and business rule compliance.
• Create automated evaluation datasets, prompt test suites, golden answer sets, and scoring rubrics.
• Build regression testing approaches for prompts, model upgrades, agent workflows, and AI-assisted business processes.
• Support Responsible AI testing practices, including bias, fairness, explainability, traceability, and audit readiness.
• Partner with Architecture, Security, Data Science, and Engineering teams to define AI quality gates.

Code Quality Advocacy:

• Advocate for and contribute to code quality initiatives across development and QA teams.
• Participate in code reviews, test reviews, design discussions, and architecture reviews.
• Promote engineering best practices including clean code, maintainability, observability, testability, and secure coding.
• Use AI to assist with code review preparation, test refactoring, duplication detection, and documentation updates.
• Help teams shift quality left by embedding testability and automation requirements earlier in the development lifecycle.

CI/CD and Continuous Testing:

• Integrate automated tests into CI/CD pipelines using Jenkins, GitLab CI, Azure DevOps, or equivalent platforms.
• Ensure reliable regression execution and rapid feedback to development teams.
• Establish automated quality gates for build validation, test execution, code coverage, security checks, and release readiness.
• Use AI to troubleshoot failing pipeline jobs, analyze logs, and recommend fixes where appropriate.
• Collaborate with DevOps and Platform Engineering teams to improve deployment confidence and reduce release risk.

Requirement Analysis and Test Strategy:

• Collaborate with product managers, developers, QA analysts, architects, and stakeholders to understand user stories, business requirements, and acceptance criteria.
• Translate requirements into effective test strategies, test plans, automation scenarios, and validation criteria.
• Identify functional, technical, data, AI, integration, performance, and operational testing risks.
• Define test coverage expectations and traceability between requirements, test cases, defects, and release decisions.

Required Skills/Qualifications:

Education:

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, or a related technical discipline.

Experience:

• 2+ years of hands-on experience in software development, test automation, or quality engineering.
• Experience building and maintaining automated test frameworks.
• Experience working in AI DLC, Agile delivery models, including Scrum and Kanban.
• Experience with fast-paced delivery environments and short turnaround times.
• 2 to 4+ years of database experience, preferably SQL.
• Experience using AI-assisted coding tools such as Claude Code, Kiro, Copilot, or similar tools preferred.

Our compensation structure is designed to reflect the cost of labor across various U.S. geographic markets. The base salary for this role ranges from $115,000 per year to $145,000 per year. Compensation will be determined by several factors, including relevant knowledge, skills, and experience. This role is also eligible to receive an annual bonus within a comprehensive total rewards package, alongside a full suite of medical, dental, vision, disability insurance, life insurance, 401k retirement benefits, paid time off, paid holidays, and paid personal/sick time. For further details, please visit https://www.greensky.com/benefits.

GreenSky is an equal opportunity employer and will not discriminate against any employee or applicant on the basis of age, color, disability, gender, national origin, race, religion, sexual orientation, veteran status, or any classification protected by federal, state, or local law.