Overview
DecisionPoint seeks a Performance & Resilience Test Engineer to evaluate the scalability, stability, responsiveness, failover behavior, and recovery capabilities of mission-critical software supporting the USMEPCOM ENLIST program. This role develops regression, API, integration, load, stress, endurance, and resilience tests; creates realistic workload models; and produces reproducible evidence of system behavior under normal, peak, degraded, and recovery conditions. The Performance & Resilience Test Engineer works with architects, software developers, API and integration engineers, infrastructure and cloud teams, database specialists, cybersecurity personnel, CI/CD engineers, operations teams, and Government stakeholders. The position identifies performance bottlenecks, validates failover and recovery procedures, and provides evidence-based recommendations supporting release readiness, capacity planning, and operational resilience.
This position is remote, with Chicago-area candidates preferred.
Note: By applying to this position, you acknowledge and consent to having your resume included in an active competitive government contract bid.
Duties & Responsibilities
- Develop and maintain performance, load, stress, spike, endurance, volume, scalability, failover, and recovery tests.
- Build automated regression, API, and integration tests supporting repeatable performance and resilience validation.
- Analyze mission workflows, usage patterns, transaction volumes, concurrency, data characteristics, interfaces, and operational objectives.
- Develop workload models that represent normal operations, peak demand, surge conditions, degraded environments, and recovery scenarios.
- Define test objectives, performance baselines, service thresholds, acceptance criteria, and measurable expected results.
- Develop test plans, scenarios, scripts, data, configurations, and execution schedules.
- Prepare representative test data for functional, high-volume, boundary, exception, failover, and recovery scenarios.
- Maintain repeatable processes for test-data creation, setup, refresh, reset, reconciliation, and cleanup.
- Execute tests in development, integration, test, staging, performance, or other Government-approved environments.
- Automate test execution through approved CI/CD pipelines where appropriate.
- Produce reproducible test results, logs, reports, metrics, graphs, and objective evidence.
- Measure and analyze response time, throughput, latency, concurrency, error rates, resource utilization, saturation, queue depth, and transaction completion.
- Establish performance baselines and compare results across builds, releases, configurations, environments, and infrastructure changes.
- Identify application, database, interface, network, cloud, infrastructure, configuration, or external-service bottlenecks.
- Correlate test results with application logs, infrastructure metrics, traces, events, and monitoring data.
- Work with technical teams to isolate root causes and recommend appropriate corrective actions.
- Validate failover behavior for applications, services, interfaces, databases, infrastructure components, and dependent capabilities.
- Test approved recovery procedures and confirm that services return to an acceptable operational state.
- Validate recovery sequencing, data consistency, transaction handling, dependency restoration, and post-recovery functionality.
- Evaluate behavior during component failures, network interruptions, service degradation, capacity constraints, and dependency outages.
- Verify that systems fail safely and provide appropriate errors, alerts, retries, timeouts, and recovery behavior.
- Support disaster-recovery, continuity, restoration, and operational-readiness exercises where applicable.
- Document performance defects, resilience gaps, capacity risks, recovery failures, and release impacts.
- Support defect triage, root-cause analysis, correction verification, and targeted regression testing.
- Coordinate with architects and engineering teams to evaluate scalability, capacity, extensibility, and recovery approaches.
- Coordinate with CI/CD engineers to integrate repeatable performance checks, thresholds, reports, and quality gates.
- Coordinate with operations teams to incorporate production observations and operational feedback into future testing.
- Support Government demonstrations, user acceptance testing, release testing, and operational validation.
- Provide performance and resilience results, residual risks, and release-readiness recommendations to technical and program stakeholders.
- Maintain test source code, scripts, configurations, data, and documentation in approved version-control repositories.
- Participate in sprint planning, backlog refinement, reviews, demonstrations, retrospectives, and release-readiness activities.
- Contribute to continuous improvement of performance engineering, workload modeling, observability, failover testing,