-
Notifications
You must be signed in to change notification settings - Fork 371
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add benchmark results to docs #3244
Changes from all commits
5720121
06aea48
e566726
3efd99d
33be2dc
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,106 @@ | ||
.. _nest_benchmark_results: | ||
|
||
NEST performance benchmarks | ||
=========================== | ||
|
||
|
||
NEST performance is continuously monitored and improved across various network sizes. | ||
Here we show benchmarking results for NEST version 3.8 on Jureca-DC. | ||
|
||
|
||
Strong scaling experiment of the Microcircuit model [1]_ | ||
--------------------------------------------------------- | ||
|
||
.. grid:: 1 1 1 1 | ||
|
||
.. grid-item:: | ||
:columns: 10 | ||
:class: sd-align-major-center | ||
|
||
.. image:: /static/img/mc_benchmark.png | ||
|
||
.. grid:: 1 1 1 1 | ||
|
||
.. grid-item:: | ||
:columns: 10 | ||
:class: sd-align-minor-center | ||
|
||
|
||
* The model has ~80 000 neurons and ~300 million synapses | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add: ", minimal delay 0.1ms"
|
||
* Increasing number of computing resources decrease simulation time | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add bullet item:
|
||
* The model runs faster than real time | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add reference [Z] at end of sentence so that the concept of "real time" can be looked up and there is a link for further information: Here is the reference: |
||
|
||
|
||
|
||
|
||
Strong scaling experiment of the Multi-area-model [2]_ | ||
------------------------------------------------------- | ||
|
||
.. grid:: 1 1 1 1 | ||
|
||
.. grid-item:: | ||
:class: sd-align-major-center | ||
:columns: 10 | ||
|
||
.. image:: /static/img/mam_benchmark.png | ||
|
||
|
||
.. grid:: 1 1 1 1 | ||
|
||
.. grid-item:: | ||
:columns: 10 | ||
:class: sd-align-minor-center | ||
|
||
* The model has ~4.1 million neurons and ~24 billion synapses | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add: ", minimal delay 0.1ms" 2 MPI processes per node, 64 threads per MPI process |
||
* Steady decrease of run time with additional compute resources | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add bullet item:
|
||
|
||
|
||
|
||
|
||
Weak scaling experiment of the HPC benchmark model [3]_ | ||
-------------------------------------------------------- | ||
|
||
.. grid:: 1 1 1 1 | ||
|
||
.. grid-item:: | ||
:columns: 10 | ||
:class: sd-align-major-center | ||
|
||
.. image:: /static/img/hpc_benchmark.png | ||
|
||
|
||
.. grid:: 1 1 1 1 | ||
|
||
.. grid-item:: | ||
:columns: 10 | ||
:class: sd-align-minor-center | ||
|
||
|
||
* The size of network scales proportionally with the computational resources used | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add: ", minimal delay 1.5ms" 2 MPI processes per node, 64 threads per MPI process |
||
* Largest network size in this diagram: ~5.8 million neurons and ~65 billion synapses | ||
* The figure shows that NEST can handle massive networks and simulate them efficiently | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add bullet item:
|
||
|
||
|
||
.. seealso:: | ||
|
||
Example networks: | ||
|
||
* :doc:`/auto_examples/Potjans_2014/index` | ||
* `Multi-area model <https://inm-6.github.io/multi-area-model/>`_ | ||
* :doc:`/auto_examples/hpc_benchmark` | ||
|
||
References | ||
---------- | ||
|
||
.. [1] Potjans TC. and Diesmann M. 2014. The cell-type specific cortical | ||
microcircuit: relating structure and activity in a full-scale spiking | ||
network model. Cerebral Cortex. 24(3):785–806. DOI: `10.1093/cercor/bhs358 <https://doi.org/10.1093/cercor/bhs358>`__. | ||
|
||
|
||
.. [2] Schmidt M, Bakker R, Hilgetag CC, Diesmann M and van Albada SJ. 2018. Multi-scale | ||
account of the network structure of macaque visual cortex. Brain Structure | ||
and Function. 223: 1409 https://doi.org/10.1007/s00429-017-1554-4 | ||
|
||
.. [3] Jordan J, Ippen T, Helias M, Kitayama I, Sato M, Igarashi J, Diesmann M, Kunkel S. 2018. | ||
Extremely scalable spiking neuronal network simulation code: From laptops to exacale computers. | ||
Frontiers in Neuroinformatics. 12. https://www.frontiersin.org/journals/neuroinformatics/articles/10.3389/fninf.2018.00002 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
replace: "for this version of NEST on JURECA-DC [x]."
Jureca is discribed in the large scale instrument Journal of Juelich. Please include the reference in the usual citation format. Here is the paper., it also has a doi: https://jlsrf.org/index.php/lsf/article/view/182/pdf
Add a sentence: "The benchmarking framework and the structure of the graphs is described in [Y]."
Give for [Y] the reference to the beNNch paper in the usual citation format:
Albers J, Pronold J, Kurth AC, Vennemo SB, Haghighi Mood K, Patronis A, Terhorst D, Jordan J, Kunkel S, Tetzlaff T, Diesmann M and Senk J (2022) A Modular Workflow for Performance Benchmarking of Neuronal Network Simulations. Front. Neuroinform. 16:837549. doi: 10.3389/fninf.2022.837549