Quality & Release Engineering Leader

Bricklayer AI; Atlanta (GA); On-site; USD 170,000 - 200,000; Full time

Job summary

Bricklayer AI in Atlanta, GA is looking for a Quality & Release Engineering Leader to oversee the systems and processes that ensure the highest standards of quality for each release. This hands-on leadership role involves responsibilities in quality engineering, test automation, and mentoring engineers.

The ideal candidate will have over 8 years of experience in software quality and release engineering, with strong leadership skills to build and develop the Quality Engineering function as the company grows.

Qualifications

• 8+ years of experience in software quality engineering or related roles.
• 3+ years of technical leadership experience.
• Experience with CI/CD pipelines for automated testing.
• Strong API and integration testing skills.
• Excellent communication and collaboration skills.

Responsibilities

• Define and execute quality engineering strategy for the Bricklayer platform.
• Design automated testing frameworks across various layers.
• Own release readiness processes and manage deployment validation.
• Partner with AI Engineering to validate AI capabilities.
• Mentor engineers and establish best practices within the team.

Skills

Software quality engineering

Test automation

Agile methodologies

Performance testing

Leadership skills

Education

Degree in Computer Science or related field

Tools

Playwright

Cypress

Selenium

AWS

Job description

Bricklayer AI Inc. Quality & Release Engineering Leader Atlanta, GA · Full time

Bricklayer AI is seeking a Quality & Release Engineering Leader to establish and scale the systems, processes, and engineering practices that ensure every release of the Bricklayer platform meets the highest standards of quality, reliability, security, and customer readiness. This is a hands‑on leadership role responsible for quality engineering, test automation, release management, validation frameworks, performance testing, and AI workflow testing. The ideal candidate is equally comfortable designing automation frameworks, building quality processes, analyzing production defects, improving release velocity, and mentoring engineers. This role will begin as approximately 70% hands‑on contribution and 30% leadership, with responsibility for building the Quality & Release Engineering function as the company grows. You will work closely with Application Engineering, AI Engineering, Platform Engineering, Product Management, Customer Experience, and Security teams to ensure quality is embedded throughout the software development lifecycle.

Responsibilities

Quality Engineering Strategy

• Define and execute Bricklayer’s quality engineering strategy, standards, and roadmap
• Establish quality objectives, release criteria, and engineering best practices
• Create a culture where quality is owned throughout the software development lifecycle
• Develop and track quality metrics that drive continuous improvement

Test Automation & Validation

• Design and implement automated testing frameworks across application, API, integration, infrastructure, and agent workflow layers
• Establish automated regression testing and continuous validation processes
• Build test coverage strategies that balance speed, confidence, and engineering efficiency
• Drive automation‑first quality practices across engineering teams
• Continuously improve test coverage and reduce manual testing requirements

Release Engineering

• Own release readiness processes and production deployment validation
• Establish release quality gates within CI/CD pipelines
• Develop release management procedures that improve deployment confidence and reliability
• Coordinate release planning and cross‑functional validation activities
• Ensure production releases meet established quality and stability requirements

AI & Agent Validation

• Develop testing methodologies for autonomous AI agents, multi‑agent workflows, and AI‑assisted decision‑making
• Create frameworks to evaluate accuracy, consistency, repeatability, and reliability of agent outputs
• Validate model upgrades, prompt changes, workflow modifications, and orchestration logic
• Partner with AI Engineering to ensure AI‑powered capabilities remain predictable, explainable, and trustworthy

Performance & Reliability Testing

• Develop performance, scalability, resiliency, and load‑testing programs
• Validate platform behavior under production‑scale workloads
• Partner with Platform Engineering to identify reliability risks before deployment
• Establish testing procedures for high‑availability and fault‑tolerant systems

Quality Metrics & Continuous Improvement

• Define and monitor quality KPIs including:
  • Defect escape rate
  • Automated test coverage
  • Release stability
  • Mean time to detect issues
  • Mean time to resolution
  • Customer‑impacting incidents
• Lead root cause analysis and quality reviews following significant production issues
• Drive continuous improvement initiatives across engineering teams

Security & Compliance Validation

• Partner with Security and Platform Engineering teams to validate security controls
• Support SOC 2 Type II and future compliance initiatives
• Ensure testing and validation processes support enterprise customer expectations
• Participate in customer security reviews and quality‑related discussions when appropriate

Leadership & Team Development

• Build and scale the Quality & Release Engineering organization
• Mentor engineers and establish quality engineering best practices
• Recruit and develop high‑performing quality engineers
• Foster collaboration across Application Engineering, AI Engineering, Platform Engineering, Product Management, and Customer Experience teams

Qualifications

Required

• 8+ years of software quality engineering, release engineering, test automation, or related experience
• 3+ years of technical leadership experience
• Strong hands‑on experience designing and implementing automated testing frameworks
• Experience building quality engineering processes in SaaS environments
• Strong understanding of modern software development lifecycles, Agile methodologies, and DevOps practices
• Experience integrating quality controls and automated testing into CI/CD pipelines
• Strong API testing, integration testing, and distributed systems testing experience
• Experience with performance, load, scalability, and reliability testing
• Strong understanding of release management and deployment validation processes
• Experience working closely with software engineering teams in fast‑paced startup environments
• Excellent communication and leadership skills

Preferred

• Experience testing AI, machine learning, LLM, or agent‑based platforms
• Experience validating autonomous workflows and AI‑driven decision systems
• Experience with Playwright, Cypress, Selenium, Postman, k6, JMeter, Locust, or similar testing platforms
• Experience with AWS and cloud‑native SaaS architectures
• Experience in cybersecurity products or security operations platforms
• Familiarity with SOC 2 and enterprise compliance requirements
• Experience building quality engineering organizations from the ground up
• Degree in Computer Science, Engineering, or related field

Salary

$170,000 - $200,000 per year