Automation Engineer - AI Platform QA & Runtime Testing

Blitzy; Cambridge (MA); On-site; USD 120,000 - 145,000; Full time

Job summary

Blitzy, based in Cambridge, MA, is seeking an Automation Engineer to enhance and scale automated testing frameworks. This role is pivotal to ensure AI-generated applications meet quality standards in production environments. You'll work at the intersection of AI and quality assurance, developing intelligent test solutions and collaborating closely with our AI team.

This is a unique opportunity to contribute to a fast-growing company transforming software development with cutting-edge technology.

Qualifications

• 3+ years of experience with Playwright and automated testing frameworks.
• Strong expertise in Python (our primary automation language).
• Experience with CI/CD tools (GitHub Actions or similar).
• Proficiency in version control systems (Git).
• Experience testing distributed systems.
• Understanding of modern software development practices.
• Experience working with cloud platforms (GCP preferred).

Responsibilities

• Expand and maintain automated testing frameworks that validate AI-generated applications.
• Develop intelligent test suites that assess application functionality in production.
• Extend existing testing frameworks to increase coverage across multiple languages.
• Establish quality metrics and testing protocols for generated applications.
• Detect and flag runtime issues in deployed applications.
• Collaborate with AI team based on runtime performance data.
• Implement automated integration and end-to-end testing.
• Develop metrics to track runtime performance across customer deployments.

Skills

Experience with Playwright

Automated testing frameworks

Strong expertise in Python

CI/CD tools experience

Proficiency in version control systems

Testing distributed systems

Understanding of modern software practices

Experience with cloud platforms (GCP preferred)

Job description

Blitzy, based in Cambridge, MA, is seeking an Automation Engineer to enhance and scale automated testing frameworks. This role is pivotal to ensure AI-generated applications meet quality standards in production environments. You'll work at the intersection of AI and quality assurance, developing intelligent test solutions and collaborating closely with our AI team.

This is a unique opportunity to contribute to a fast-growing company transforming software development with cutting-edge technology.