π This project attempts to measure the minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.
So I think the minimum should not include:
- cost of template engine
- cost of database manipulation
- cost of debugging information
Benchmarking on components like template engines or ORM/Database libraries is out of the scope of this project.
For PHP 8.2
check out this link.
- Ubuntu 22.04 LTS x86_64
- PHP 8.3.0
- OPCache Off
- Apache 2.4.52
- WRK 4.2.0 (5 min)
- CPU Core i7-3770K/4.4Ghz
- Memory 16G
These are my benchmarks, not yours. I encourage you to run on your -production equivalent- environments.
framework | requests per second (rps) | relative (rps) | peak memory | relative (mem) |
---|---|---|---|---|
pure-php | 27,077.31 | 321.6 | 0.42 | 1.0 |
kumbia-1.1 | 5,921.29 | 70.3 | 0.54 | 1.3 |
fastroute-1.3 | 4,516.12 | 53.6 | 0.56 | 1.3 |
phroute-2.2 | 4,198.83 | 49.9 | 0.58 | 1.4 |
leaf-3.5 | 1,487.36 | 17.7 | 1.11 | 2.6 |
fatfree-3.8 | 1,453.82 | 17.3 | 1.72 | 4.1 |
slim-4.12 | 798.17 | 9.5 | 1.57 | 3.7 |
ubiquity-2.4.x.dev | 705.12 | 8.4 | 1.64 | 3.9 |
silex-2.3 | 543.66 | 6.5 | 2.20 | 5.2 |
yii-2.0-basic | 503.76 | 6.0 | 2.56 | 6.1 |
fuelphp-1.9 | 429.18 | 5.1 | 2.61 | 6.2 |
lumen-10.0 | 325.27 | 3.9 | 3.61 | 8.6 |
symfony-5.4 | 309.74 | 3.7 | 3.77 | 9.0 |
codeigniter-4.4 | 302.21 | 3.6 | 3.62 | 8.6 |
symfony-7.0 | 286.46 | 3.4 | 4.07 | 9.7 |
symfony-6.4 | 280.83 | 3.3 | 4.11 | 9.8 |
cakephp-4.5 | 246.72 | 2.9 | 4.63 | 11.0 |
cakephp-5.0 | 243.96 | 2.9 | 4.74 | 11.3 |
laravel-10.2 | 84.19 | 1.0 | 13.06 | 31.0 |
Check out the video for more information.
If you want to have benchmarks on PHP extension frameworks
like Phalcon
, you need to install the extension first, based on its own documentation.
1- Download & Setup:
# make sure to put it in the root of your web path
$ git clone https://github.com/myaaghubi/PHP-Frameworks-Bench.git
$ cd PHP-Frameworks-Bench
# optional
$ nano config
# run the setup & follow the progress
$ yes | bash setup.sh
2- Make sure everything is ok:
$ bash check.sh
# bash check.sh -t pure-php
# β pure-php
3- Run benchmarks:
# bash benchmark.sh --help
$ bash benchmark.sh
4- Check the results:
-
web:
-
terminal:
# bash results.sh --help bash results.sh
Results with docker may or may not be reliable but in a situation you can use it like:
1- Change the base
in config
on the right port(8080
considered):
base="http://127.0.0.1:8080/PHP-Frameworks-Bench"
...
2- Run/download the docker:
$ bash docker-apache.sh
3- Run the benchmark:
# run it in another terminal
$ bash benchmark.sh
# use bash benchmark.sh --help
$ bash benchmark.sh -f -rapache -t pure-php
# run composer update for frameworks
$ bash update.sh
# to clean them all
# trouble? run it then
# you can use `bash setup.sh` again
$ bash clean.sh
# clear the cache of frameworks
$ bash clear-cache.sh
# show the results table
$ bash results.sh
To specify frameworks, put them with -t ...
after each command:
# supported for `setup.sh`, `benchmark.sh`, `update.sh`, `clean.sh`, and `clear-cache.sh`
# bash benchmarks.sh --help
$ bash benchmark.sh -t laravel-10.2/ slim-4.12/ ...
...
Check out the Benchmarking Policy, to get more information watch the video OPCache On/Off.
- Use
composer
to install frameworks according to their official documentation. - Use the default configuration.
- Minimum changes on frameworks to have benchmarks.
- Don't remove any components/configurations even if there is no use for them.
- Include a
controller
class to get theHello World!
for each, based on the default template of each framework forcontrollers
. - Turn off the
debug
mode and set the environment toproduction
mode. - General optimization for the production environment, like
--optimize-autoloader
for thecomposer
.
Some frameworks are optimized more than others, so some developers may think using default configuration is not fair. The dept of optimizing a framework depends on the skills/experiences of the developer too, so it's the rabbit hole and nonsense for ranking. Please note optimizing for the Hello World
is not acceptable! Building the fastest Hello World
application is not the goal of this project. I think the default configuration of frameworks is a good starting point to have a ranking.
If you find something wrong in my code, feel free to send a PR
.
Don't forget to donate if you find it useful β πΊ πΈ π
ETH: 0x0ADd51D6855d2DF11BB5F331A3fa345c67a863b2
Note: This project is based on php-framework-benchmark, thanks to Kenjis. It is very old and abandoned, so I decided to split it from the origin and change/update it separately.
π Thanks to contributors:
π For frameworks, I considered the official repos:
- CakePHP
- CodeIgniter
- FastRoute
- FatFree
- FuelPHP
- KumbiaPHP
- Laminas
- Laravel
- Leaf
- Lumen
- PhRoute
- Silex
- Slim
- Symfony
- Ubiquity
- Yii
You are allowed to use this plugin/project under the terms of the GNU General Public License version 2.
Copyright (C) 2024 Mohammad Yaaghubi