You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The parameter settings take the form Set meaning implementation, where meaning is a note to the HSBencher infrastructure and implementation is how it gets accomplished, for example, Set (Threads 3) (RuntimeEnv "THREADS" "3")).
As pointed out by @BlairArchibald, really we want to be able to set any field of the output benchmark result in this way, not just "THREADS" and "VARIANT". In particular, while we can add Custom fields, we can't currently set their values in this way, only via harvesters.
Maybe DefaultParamMeaning should just be replaced with Maybe (String,String) which would set an arbitrary column, e.g. Just ("THREADS","3") or Just ("MYCOLUMN","foo")? It would be a little inelegant that certain strings are special (like "THREADS"), but that's already the case in having a built-in benchmark schema at all...
The text was updated successfully, but these errors were encountered:
…ark results
The idea is that a single process may now issue START_BENCHMARK/END_BENCHMARK tags
and thus report results for distinct benchmarks. These "sub-benchmarks" inherit all
the settings from the benchmark config that launched the process, but they may
override those settings by outputting tags.
Multilpe trials still work, and when each trial reports on multiple benchmarks, the
results are "zipped" together.
This is the major change that will enable #73.
Note, this commit creates a large amount of dead code. These disconnected functions
will be harvested in a dedicated future commit.
The parameter settings take the form
Set meaning implementation
, wheremeaning
is a note to the HSBencher infrastructure andimplementation
is how it gets accomplished, for example,Set (Threads 3) (RuntimeEnv "THREADS" "3"))
.As pointed out by @BlairArchibald, really we want to be able to set any field of the output benchmark result in this way, not just "THREADS" and "VARIANT". In particular, while we can add Custom fields, we can't currently set their values in this way, only via harvesters.
Maybe
DefaultParamMeaning
should just be replaced withMaybe (String,String)
which would set an arbitrary column, e.g.Just ("THREADS","3")
orJust ("MYCOLUMN","foo")
? It would be a little inelegant that certain strings are special (like "THREADS"), but that's already the case in having a built-in benchmark schema at all...The text was updated successfully, but these errors were encountered: