[BuildStream] Weekly performance update for the Debian-like project



Hello,

Apologies that this email has come a day late.

The notebook containing *all* of the results should be available via following link:

https://mybinder.org/v2/gh/james-ennis/bst-benchmarks-notebooks/master?filepath=all_results.ipynb

If the link has expired, you'll need to go to https://mybinder.org/ and the copy and paste: https://github.com/james-ennis/bst-benchmarks-notebooks into the url field, with branch "master" and file "all_results.ipynb". Then "launch".

When the notebook has loaded please click on "Kernel" -> "Restart and Run all".

This will show the four interactive graphs and I've provided some instructions regarding how the toolbar can be used to interact with each graph.

-----

All results were obtained on the same hardware (a Codethink dev machine configured to be a gitlab runner - not being used for anything else), and the results files are being appended to by a CI job. Specs as follows:

* Linux (Debian stable)
* x86_64
* 16G RAM
* 500Gb SSD
* Intel i7-3770
* 8 cores @ 3.40 GHz

-----

Here are the times and max-rss (peak memory usage) results for a `bst show` of base-files/base-files.bst in the Debian-like project [0] (jennis/use_remote_file branch) [1] (Note that I've set the column width of the table to 72 in the hope that this will wrap nicely for everyone):

┌─────┬─────────────────┬─────────────────┬───────────────────────────┐
│     │      Show       │ YAML cache show │      Show once built      │
├─────┼───────┬─────────┼───────┬─────────┼─────────────────┬─────────┤
│Dates│Time   │Memory   │Time   │Memory   │Show once built  │Memory   │
│     │(s)    │(M)      │(s)    │(M)      │(s)              │(M)      │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│01/14│49.23  │1089     │27.17  │1115     │32.82            │1117     │
│01/20│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│01/21│48.85  │1089     │27.35  │1115     │32.84            │1117     │
│01/27│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│01/28│49.50  │1088     │27.17  │1115     │32.76            │1117     │
│02/03│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/04│48.08  │561      │26.68  │588      │31.90            │589      │
│02/10│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/11│45.46  │408      │23.75  │435      │29.50            │437      │
│02/17│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/18│43.17  │417      │21.65  │443      │27.28            │445      │
│02/24│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/25│41.75  │493      │19.43  │519      │25.69            │625      │
│03/03│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/04│40.96  │517      │18.81  │543      │25.20            │696      │
│03/10│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/11│40.44  │519      │18.06  │545      │24.50            │698      │
│03/17│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/18│38.87  │521      │16.74  │547      │23.19            │696      │
│03/24│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/25│22.63  │422      │13.40  │433      │17.36            │563      │
│03/31│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│04/01│11.32  │352      │11.17  │352      │12.96            │470      │
│04/07│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│04/08│11.27  │352      │11.13  │352      │13.08            │470      │
│04/14│       │         │       │         │                 │         │
└─────┴───────┴─────────┴───────┴─────────┴─────────────────┴─────────┘

-----

Here are the times and max-rss results for a `bst build` (4, 8 and 12 builders) of base-files/base-files.bst in the Debian-like project [1].

┌─────┬─────────────────┬─────────────────┬───────────────────────────┐
│     │   4 Builders    │   8 Builders    │        12 Builders        │
├─────┼───────┬─────────┼───────┬─────────┼─────────────────┬─────────┤
│Date │Time   │Memory   │Time   │Memory   │Show once built  │Memory   │
│     │(s)    │(M)      │(s)    │(M)      │(s)              │(M)      │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│01/14│1383.67│1119     │1078.76│1119     │735.41           │1119     │
│01/20│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│01/21│561.12 │1117     │602.20 │1117     │680.10           │1117     │
│01/27│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│01/28│560.7  │1117     │601.57 │1117     │678.03           │1117     │
│02/03│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/04│373.29 │590      │425.09 │589      │500.71           │590      │
│02/10│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/11│308.75 │436      │357.69 │436      │412.90           │436      │
│02/17│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/18│292.78 │445      │350.70 │445      │398.30           │445      │
│02/24│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│02/25│342.28 │521      │387.28 │521      │436.51           │521      │
│03/03│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/04│354.64 │544      │400.00 │544      │441.61           │544      │
│03/10│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/11│352.95 │546      │395.50 │546      │442.52           │546      │
│03/17│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/18│348.53 │549      │383.93 │549      │431.18           │549      │
│03/24│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│03/25│286.67 │435      │302.77 │435      │332.87           │435      │
│03/31│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│04/01│249.50 │355      │255.38 │355      │284.80           │355      │
│04/07│       │         │       │         │                 │         │
├─────┼───────┼─────────┼───────┼─────────┼─────────────────┼─────────┤
│04/08│233.83 │354      │249.45 │354      │267.39           │354      │
│04/14│       │         │       │         │                 │         │
└─────┴───────┴─────────┴───────┴─────────┴─────────────────┴─────────┘


Please see my previous email [2] if you're unable to open the weekly notebook.

Thanks,
James

[0] https://gitlab.com/jennis/debian-stretch-bst
[1] https://gitlab.com/jennis/debian-stretch-bst/tree/jennis/use_remote_file [2] https://mail.gnome.org/archives/buildstream-list/2019-February/msg00046.html

Attachment: weekly_results.ipynb
Description: Text document



[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]