Hello,I had some time last week to ensure that the notebooks are as easy to view as possible. So now, the notebook containing *all* of the results can be accessed via the following link:
https://hub.mybinder.org/user/james-ennis-bst-marks-notebooks-9k0ybm2z/notebooks/all_results.ipynbI'm not sure how long it takes for this link to expire, but if it does, it's very easy to regenerate just go to https://mybinder.org/ and the copy and paste: https://github.com/james-ennis/bst-benchmarks-notebooks into the url field, with branch "master" and file "all_results.ipynb".
When the notebook has loaded please do the following: Click on "Kernel" -> "Restart and Run all".
You should now just see some comments and the 4 graphs. Each graph is interactive and I've provided some instructions regarding how the toolbar can be used to interact with each graph.
I'll also attach the weekly notebook, but I'd imagine this is now of less value considering we can just zoom into any time period.
-----All results were obtained on the same hardware (a Codethink dev machine configured to be a gitlab runner - not being used for anything else), and the results files are being appended to by a CI job. Specs as follows:
* Linux (Debian stable) * x86_64 * 16G RAM * 500Gb SSD * Intel i7-3770 * 8 cores @ 3.40 GHz -----Here are the times and max-rss (peak memory usage) results for a `bst show` of base-files/base-files.bst in the Debian-like project [0] (jennis/use_remote_file branch) [1] (Note that I've set the column width of the table to 72 in the hope that this will wrap nicely for everyone):
┌─────┬─────────────────┬─────────────────┬───────────────────────────┐ │ │ Show │ YAML cache show │ Show once built │ ├─────┼───────┬─────────┼───────┬─────────┼─────────────────┬─────────┤ │Dates│Time │Memory │Time │Memory │Show once built │Memory │ │ │(s) │(M) │(s) │(M) │(s) │(M) │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/14│49.23 │1089 │27.17 │1115 │32.82 │1117 │ │01/20│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/21│48.85 │1089 │27.35 │1115 │32.84 │1117 │ │01/27│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/28│49.50 │1088 │27.17 │1115 │32.76 │1117 │ │02/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/04│48.08 │561 │26.68 │588 │31.90 │589 │ │02/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/11│45.46 │408 │23.75 │435 │29.50 │437 │ │02/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/18│43.17 │417 │21.65 │443 │27.28 │445 │ │02/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/25│41.75 │493 │19.43 │519 │25.69 │625 │ │03/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/04│40.96 │517 │18.81 │543 │25.20 │696 │ │03/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/11│40.44 │519 │18.06 │545 │24.50 │698 │ │03/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/18│38.87 │521 │16.74 │547 │23.19 │696 │ │03/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/25│22.63 │422 │13.40 │433 │17.36 │563 │ │03/31│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │04/01│11.32 │352 │11.17 │352 │12.96 │470 │ │04/07│ │ │ │ │ │ │ └─────┴───────┴─────────┴───────┴─────────┴─────────────────┴─────────┘ -----Here are the times and max-rss results for a `bst build` (4, 8 and 12 builders) of base-files/base-files.bst in the Debian-like project [1].
┌─────┬─────────────────┬─────────────────┬───────────────────────────┐ │ │ 4 Builders │ 8 Builders │ 12 Builders │ ├─────┼───────┬─────────┼───────┬─────────┼─────────────────┬─────────┤ │Date │Time │Memory │Time │Memory │Show once built │Memory │ │ │(s) │(M) │(s) │(M) │(s) │(M) │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/14│1383.67│1119 │1078.76│1119 │735.41 │1119 │ │01/20│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/21│561.12 │1117 │602.20 │1117 │680.10 │1117 │ │01/27│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │01/28│560.7 │1117 │601.57 │1117 │678.03 │1117 │ │02/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/04│373.29 │590 │425.09 │589 │500.71 │590 │ │02/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/11│308.75 │436 │357.69 │436 │412.90 │436 │ │02/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/18│292.78 │445 │350.70 │445 │398.30 │445 │ │02/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │02/25│342.28 │521 │387.28 │521 │436.51 │521 │ │03/03│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/04│354.64 │544 │400.00 │544 │441.61 │544 │ │03/10│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/11│352.95 │546 │395.50 │546 │442.52 │546 │ │03/17│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/18│348.53 │549 │383.93 │549 │431.18 │549 │ │03/24│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │03/25│286.67 │435 │302.77 │435 │332.87 │435 │ │03/31│ │ │ │ │ │ │ ├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤ │04/01│249.50 │355 │255.38 │355 │284.80 │355 │ │04/07│ │ │ │ │ │ │ └─────┴───────┴─────────┴───────┴─────────┴─────────────────┴─────────┘Please see my previous email [2] if you're unable to open the weekly notebook.
Thanks, James [0] https://gitlab.com/jennis/debian-stretch-bst[1] https://gitlab.com/jennis/debian-stretch-bst/tree/jennis/use_remote_file [2] https://mail.gnome.org/archives/buildstream-list/2019-February/msg00046.html
Attachment:
weekly_results.ipynb
Description: Text document