Mattermost Peer-to-Peer Forum

What is meant by 100 % error rate in Mattermost load test report


#1

Hello,
I tried Mattermost loadtest on 4cpu and 7.5GB server for 10000 users and got load test report as below:
--------- Loadtest Report ------------
Route: /channels/members/me/view
Total Hits: 8053
Error Rate: 64.91%
Max Response Time: 196ms
Min Response Time: 2ms
Mean Response Time: 14.20ms
Variance of Response Time: 92.79

Route: /channels/CID/members/me
Total Hits: 8053
Error Rate: 64.90%
Max Response Time: 148ms
Min Response Time: 1ms
Mean Response Time: 10.43ms
Variance of Response Time: 70.16

Route: /channels/CID/members
Total Hits: 62953
Error Rate: 95.51%
Max Response Time: 116ms
Min Response Time: 1ms
Mean Response Time: 5.90ms
Variance of Response Time: 3.01

Route: /channels/CID/stats
Total Hits: 8053
Error Rate: 64.90%
Max Response Time: 95ms
Min Response Time: 0ms
Mean Response Time: 4.41ms
Variance of Response Time: 27.14

Route: /channels/CID/posts
Total Hits: 8053
Error Rate: 64.90%
Max Response Time: 201ms
Min Response Time: 0ms
Mean Response Time: 5.12ms
Variance of Response Time: 37.94

Route: /teams/TID/posts/search
Total Hits: 293
Error Rate: 100.00%
Max Response Time: 0ms
Min Response Time: -1ms
Mean Response Time: 0.00ms
Variance of Response Time: 0.00

Route: /posts
Total Hits: 1160
Error Rate: 67.50%
Max Response Time: 488ms
Min Response Time: 12ms
Mean Response Time: 83.40ms
Variance of Response Time: 1394.27

Route: /files
Total Hits: 9
Error Rate: 0.00%
Max Response Time: 213ms
Min Response Time: 6ms
Mean Response Time: 46.89ms
Variance of Response Time: 4364.86

Route: /posts/PID/files/info
Total Hits: 7
Error Rate: 0.00%
Max Response Time: 14ms
Min Response Time: 1ms
Mean Response Time: 3.00ms
Variance of Response Time: 23.67

Route: /files/PID/thumbnail
Total Hits: 5
Error Rate: 0.00%
Max Response Time: 3ms
Min Response Time: 2ms
Mean Response Time: 2.20ms
Variance of Response Time: 0.20

Route: /users/status/ids
Total Hits: 30
Error Rate: 93.33%
Max Response Time: 9ms
Min Response Time: 1ms
Mean Response Time: 8.50ms
Variance of Response Time: 2.07

Score: 16.73
I got runtime error during loadtest all :invalid memory address or nil pointer dereference: goroutine and report is not saved in directory but it display in console.
I want to know what is 100% error rate mean and why it is giving 100% error rate


#2

@Himani Thanks for trying the loadtest tool!

It means every API call failed. Sounds like the server is not setup for scaling to that many users.

Can you try running through these installation instructions? https://github.com/mattermost/mattermost-load-test/blob/master/docs/install.rst

Also, if you can share logs from the loadtests, proxy, and app server, that would be helpful in investigating the issue.