Project Information Environment

Simulating Production Environments

For this project, we aimed to configure every framework according to the best practices for production deployments gleaned from documentation and popular community opinion. The goal is approximating a sensible production deployment as accurately as possible. We also want this project to be as transparent as possible, which is why we have posted our test suites on GitHub.

Environment Details

For language and framework specific details, view their README within their respective directory.

Hardware

Citrine (Self-hosted)

• BENCHMARK_ENV=Citrine
• Switched 10-gigabit ethernet

All 3 machines: tfb-server, tfb-database, tfb-client

• 28 HT Cores Intel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz
• 32GB RAM

Note: Hardware details used for the various rounds can be found on the results website

Azure

• BENCHMARK_ENV=Azure

All 3 machines: tfb-app-vm, tfb-data-vm, tfb-load-vm

• Standard_D3_v2 (4 vcpus, 14 GB memory)
• Default 30 GB of managed disk size (Standard HDD LRS)
• TFB run and Docker images both utilize the temporary storage (under /mnt) of the Standard_D3_v2, which has 200 GB of SSD for the temporary storage
• The network interface for each of the 3 VMs has the accelerated networking option enabled
• The 3 VMs communicate via a virtual internal network

More information coming soon...

Operating Systems

• Ubuntu Linux 16.04 64-bit

Load simulator

• Wrk