Senior Performance Test Engineer

Automatic Data Processing, Inc.; Parsippany-Troy Hills (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

Agadia is seeking a Senior Performance Test Engineer to lead performance testing for its healthcare SaaS applications. You will analyze requirements, model workloads, build automated tests, and drive performance validation with cross-functional teams.

The role collaborates with Development, QA, DevOps, DBAs and Production Support to ensure scalable, reliable release readiness and report findings with concrete capacity recommendations.

Qualifications

• 5+ years hands-on load and performance testing of web apps and APIs.
• Strong proficiency in JMeter or k6 with script development and debugging.
• Understanding of latency percentiles, throughput, error rates, and resource utilization.

Responsibilities

• Collaborate with stakeholders to define acceptance criteria for performance.
• Develop performance test strategies based on architecture and production usage.
• Design realistic workload models with concurrent users and ramp-up.
• Plan and execute baseline, load, stress, and endurance tests; coordinate failover tests.
• Create and maintain reusable JMeter or k6 scripts with auth and data handling.
• Build modular suites for test data, credentials, and datasets; manage data isolation.
• Prepare synthetic data, validate, and cleanup test data while protecting credentials.
• Verify environment readiness, data volumes, and capacity for tests.
• Monitor results with Dynatrace or similar tools and correlate with logs and SQL activity.
• Investigate bottlenecks across layers and document remediation strategies.
• Provide capacity findings and recommendations for infrastructure planning.
• Integrate performance checks into Azure DevOps CI/CD pipelines and improve scripts.

Skills

Load testing

Performance testing

JMeter

k6

HTTP/REST APIs

SQL

Git

Azure DevOps

APM tooling

Tools

Dynatrace

IIS

Windows metrics

SQL Server

Azure DevOps

Git

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Senior Performance Test Engineer

Full Time Parsippany, NJ, US

2 days ago Requisition ID: 1023

Salary Range: $100,000.00 To $130,000.00 Annually

About Agadia

We specialize in healthcare management technology and offer a suite of utilization management software solutions for our clients. Our mission is to improve the quality of care and expedite the delivery of health care services by advancing and automating utilization management processes. We are based in Parsippany, NJ, with clients across the United States. As we grow, we are looking for a detail-oriented, self-motivated, independent Software Engineer to help analyze, design, and refine business requirements.

Agadia is seeking a Senior Performance Test Engineer to perform performance testing for its healthcare SaaS applications. The role covers requirements analysis, workload modeling, test automation, execution, bottleneck investigation, and reporting. The engineer will work with Development, QA, DevOps, Infrastructure, DBAs, and Production Support to validate performance, investigate regressions, and provide evidence for release and capacity decisions.

Roles and Responsibilities

• Collaborate with business and technical stakeholders to define measurable acceptance criteria for critical workflows, including response-time percentiles, throughput, error rates, and recovery behavior.
• Assess application architecture, dependencies, deployment topology, and production usage to develop performance test strategies, estimates, schedules, and entry and exit criteria.
• Design realistic workload models covering concurrent users, transaction arrival rates, customer mix, think time, pacing, peak periods, ramp-up and sustained load.
• Plan and execute baseline, load, stress, spike, endurance, and scalability tests; coordinate controlled failover and recovery tests with the responsible teams.
• Develop and maintain reusable JMeter or k6 scripts with authentication, session handling, dynamic value correlation, parameterization and assertions that verify successful business transactions.
• Build modular suites for case creation, review, sign-off, queue management and document management, with configurable customer profiles, user credentials and datasets.
• Prepare and manage approved synthetic or masked test data, including extraction, seeding, validation and cleanup; protect credentials and maintain customer data isolation.
• Validate test environment readiness, data volumes, cache state, and load-generator capacity; document differences that affect comparison with production.
• Monitor and correlate test results with Dynatrace or equivalent APM tooling, IIS and Windows metrics, application logs, and SQL Server activity.
• Investigate bottlenecks across application, API, database, and infrastructure layers, including slow queries, blocking, thread or connection pool contention, memory growth, and resource saturation.
• Compare releases against approved baselines, record reproducible performance defects, collaborate with engineering teams on remediation, and verify fixes through retesting.
• Provide measured capacity and scalability findings, with documented assumptions, to support infrastructure planning and growth forecasts.
• Integrate appropriate performance checks into Azure DevOps CI/CD pipelines and scheduled test runs; continuously improve scripts, framework reliability and reporting.
• Deliver technical reports and stakeholder summaries covering workload assumptions, results against targets, bottleneck evidence, business impact, limitations and release readiness recommendations.

Required Qualifications

• At least 5 years of hands-on experience in load and performance testing of web applications and APIs.
• Strong proficiency in JMeter or k6, including independent script development, debugging, maintenance, and command-line test execution.
• Sound understanding of performance testing concepts, workload modeling, and interpretation of latency percentiles, throughput, error rates, and resource utilization.
• Experience testing multi-tier applications, with working knowledge of HTTP/HTTPS, REST APIs, JSON, authentication, session management, and dynamic data correlation.
• SQL proficiency for test data preparation, validation, and investigation of database-related performance issues.
• Experience using an application performance monitoring tool, server metrics, and logs to investigate bottlenecks and support findings with evidence.
• Experience with Git, repeatable test execution, and performance regression analysis across software releases.
• Strong analytical, documentation, and communication skills, with the ability to manage testing priorities and explain findings to technical and business stakeholders.

Preferred Qualifications

• Experience with Dynatrace Managed and performance analysis of Windows Server, IIS, .NET, and SQL Server environments.
• Hands-on experience with both JMeter and k6, and integration of performance tests into Azure DevOps pipelines.
• Experience testing multi-tenant SaaS or healthcare applications and handling sensitive test data.
• Understanding Azure or AWS architecture, scalability, and migration performance validation; Azure experience is preferred.
• Exposure to background processing, caching, messaging, and failover or recovery validation.
• A maintained performance test strategy, workload model, and reusable regression suite.
• Release reports with clear pass or fail results, supporting evidence, test limitations, and unresolved performance risks.
• Verified remediation outcomes and capacity recommendations based on measured results.

Please note:The Salary range is based on our market pay structure & includes benefits (Medical, Dental, Vision, life Insurance, 401 & PTO, etc.), and will be determined based on the candidate's experience, qualifications, and evaluation. - Applicants must be legally authorized to work in the United States, and the company does not provide employment visa sponsorship now or in the future

Communicates effectively – Attentively listens to others, provides timely and helpful information and is effective in a range of professional settings. Gives and receives feedback in a productive, professional manner. Demonstrates excellent oral and written communication skills.

Manages Ambiguity - Operating effectively, even when things are not certain, or the way forward is not clear. Is flexible in approach and is able to adapt their approach to meet changing business needs.

Manages complexity - Makes sense of complex , high quantity, and sometimes contradictory information to effectively solve problems. Has strong organizational skills and is able to manage multiple activities at once. Has high attention to detail.

Ensures Accountability - Follows through on commitments and makes sure others do the same. Able to work independently as part of a small team.