- c5.xlarge AWS instance: 4 CPUs, 8 GB RAM
- Ubuntu 18.04
- Go 1.12
- Python 2.7
- Vips 8.7.4
All the tools were launched with their default settings except the following (where applicable):
- Concurrency was set to 8;
- Filesystem image source was configured. Where not applicable, local nginx was used as the image source.
We used Apache HTTP server benchmarking tool (a.k.a ab):
ab -n 1000 -c 4 $urlThe source image is a photo of Wat Arun (JPEG, 7360x4912, 29MB).
The tools were requested to resize it to fit 500x500.
-
imgproxy itself, v2.2.13
URL:
/unsigned/rs:fit:500:0/plain/local:///wat-arun.jpg -
thumbor, v6.7.0
URL:
/unsafe/500x0/wat-arun.jpg -
imaginary, master branch (519c5ff)
URL:
/fit?width=500&height=500&file=wat-arun.jpg -
Pilbox, v1.3.4
URL:
/?url=http%3A%2F%2Fimages.dev.com%2Fwat-arun.jpg&w=500&h=500&mode=clip -
picfit, master branch (fff7d2e)
URL:
/display/resize/500x0/wat-arun.jpg -
imageproxy, master branch (d4246a0)
URL:
/500x/http://images.dev.com/wat-arun.jpg
| Tool | Time taken for tests (sec) |
Requests per second | Time per request (sec, mean) |
Memory peak usage (MB) |
Result file size (KB) |
|---|---|---|---|---|---|
| imgproxy | 103.405 | 9.67 | 413.618 | 194 | 43.51 |
| thumbor | 160.505 | 6.23 | 642.021 | 461 | 45.10 |
| imaginary | 104.873 | 9.54 | 419.494 | 562 | 92.93 |
| Pilbox | 179.482 | 5.57 | 717.927 | 1060 | 95.64 |
| picfit | 1220.412 | 0.82 | 4881.646 | 1934 | 98.67 |
| imageproxy | 1209.361 | 0.83 | 4837.443 | 2392 | 98.74 |
Concurrency Level: 4
Time taken for tests: 103.405 seconds
Complete requests: 1000
Failed requests: 0
Total transferred: 44855000 bytes
HTML transferred: 44559000 bytes
Requests per second: 9.67 [#/sec] (mean)
Time per request: 413.618 [ms] (mean)
Time per request: 103.405 [ms] (mean, across all concurrent requests)
Transfer rate: 423.61 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 323 413 5.6 413 446
Waiting: 323 413 5.6 412 446
Total: 323 413 5.6 413 446
Percentage of the requests served within a certain time (ms)
50% 413
66% 414
75% 416
80% 417
90% 419
95% 422
98% 426
99% 429
100% 446 (longest request)
Memory peak usage: 194 [MB]
Result file size: 43.51 [KB]
Concurrency Level: 4
Time taken for tests: 160.505 seconds
Complete requests: 1000
Failed requests: 0
Total transferred: 46435000 bytes
HTML transferred: 46180000 bytes
Requests per second: 6.23 [#/sec] (mean)
Time per request: 642.021 [ms] (mean)
Time per request: 160.505 [ms] (mean, across all concurrent requests)
Transfer rate: 282.52 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 586 642 12.3 641 886
Waiting: 586 641 12.3 641 886
Total: 586 642 12.3 641 886
Percentage of the requests served within a certain time (ms)
50% 641
66% 644
75% 646
80% 647
90% 650
95% 652
98% 657
99% 658
100% 886 (longest request)
Memory peak usage: 461 [MB]
Result file size: 45.10 [KB]
Concurrency Level: 4
Time taken for tests: 104.873 seconds
Complete requests: 1000
Failed requests: 0
Total transferred: 95389568 bytes
HTML transferred: 95166000 bytes
Requests per second: 9.54 [#/sec] (mean)
Time per request: 419.494 [ms] (mean)
Time per request: 104.873 [ms] (mean, across all concurrent requests)
Transfer rate: 888.25 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 310 419 6.4 418 459
Waiting: 310 418 6.4 418 459
Total: 310 419 6.4 418 460
Percentage of the requests served within a certain time (ms)
50% 418
66% 420
75% 421
80% 422
90% 425
95% 428
98% 432
99% 437
100% 460 (longest request)
Memory peak usage: 562 [MB]
Result file size: 92.93 [KB]
Concurrency Level: 4
Time taken for tests: 179.482 seconds
Complete requests: 1000
Failed requests: 0
Total transferred: 98164000 bytes
HTML transferred: 97934000 bytes
Requests per second: 5.57 [#/sec] (mean)
Time per request: 717.927 [ms] (mean)
Time per request: 179.482 [ms] (mean, across all concurrent requests)
Transfer rate: 534.11 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 1
Processing: 456 717 232.5 658 1851
Waiting: 456 717 232.5 657 1851
Total: 457 717 232.5 658 1851
Percentage of the requests served within a certain time (ms)
50% 658
66% 663
75% 668
80% 674
90% 1176
95% 1278
98% 1340
99% 1618
100% 1851 (longest request)
Memory peak usage: 1060 [MB]
Result file size: 95.64 [KB]
Concurrency Level: 4
Time taken for tests: 1220.412 seconds
Complete requests: 1000
Failed requests: 0
Total transferred: 101206000 bytes
HTML transferred: 101038000 bytes
Requests per second: 0.82 [#/sec] (mean)
Time per request: 4881.646 [ms] (mean)
Time per request: 1220.412 [ms] (mean, across all concurrent requests)
Transfer rate: 80.98 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 2322 4875 118.6 4880 5265
Waiting: 2322 4874 118.6 4879 5265
Total: 2322 4875 118.6 4880 5265
Percentage of the requests served within a certain time (ms)
50% 4880
66% 4906
75% 4924
80% 4936
90% 4978
95% 5009
98% 5078
99% 5124
100% 5265 (longest request)
Memory peak usage: 1934 [MB]
Result file size: 98.67 [KB]
Concurrency Level: 4
Time taken for tests: 1209.361 seconds
Complete requests: 1000
Failed requests: 0
Total transferred: 101318000 bytes
HTML transferred: 101108000 bytes
Requests per second: 0.83 [#/sec] (mean)
Time per request: 4837.443 [ms] (mean)
Time per request: 1209.361 [ms] (mean, across all concurrent requests)
Transfer rate: 81.81 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 4520 4837 74.9 4838 5090
Waiting: 4520 4836 74.7 4837 5086
Total: 4520 4837 74.9 4838 5090
Percentage of the requests served within a certain time (ms)
50% 4838
66% 4865
75% 4884
80% 4895
90% 4931
95% 4960
98% 4993
99% 5026
100% 5090 (longest request)
Memory peak usage: 2392 [MB]
Result file size: 98.74 [KB]