Full Chain Load Test Platform

Full Chain Load Test Platform Phase 1

Test Scenario(Suite)

P1: Can pick up multiple load test scripts

P1: Can set Virtual User distribution (in % format or in absolute value format ) across multiple load test scripts

P1: Can set different ramp up strategy/ramp down strategy/load test duration for different load test scripts

P2: Can schedule load test execution on a future date 

P2: Have GUI for configurating above settings

Test Planning

P2: Have centralized place to present planned load test

P2: Have booking system for coordination with multiple test engineers 

Test Preparation

P1: Can execute test data preparation/configuration scripts

P1: Load test env health check before load test

P1: Test Env Deployment

P1: Can deploy pre-defined # of apps/DB

P1: Can define server hardware spec (default is same as production) and roll out to load test env

P2: Have GUI for above settings

Test Execution

P1: Can increase traffic (# of virtual users) on the fly duration test exection

P2: Can decrease traffic (# of virtual users) on the fly duration test exection

Monitoring

P1: Resource consumption monitoring

P1: Test Client

P1: Application servers and DB

P2: Container level resource consumption

P1: Can persist monitoring raw data and load test result raw data in centralized place for analysis

P1: Alert when several metric(s) exceed threshold

P1: Action

P1: Keep Live data

Reporting

P1: Have portal to present load test result and test client/app/JVM/DB resource monitoring info

P1: Graphs

P1: Basic graphs: 0. Summary 1. Running Users over time. 2. Hits per second over time 3. Throughput over time 4. Average Response time over time. Reference: https://www.guru99.com/how-to-use-analyzer-in-loadrunner-12-0.html 

P2: Intelligent analysis