[Notes] [Git][BuildStream/buildstream][valentindavid/git_describe

Valentin David pushed to branch valentindavid/git_describe_tracking at BuildStream / buildstream

Commits:

23140b6b

by Chandan Singh at 2018-10-25T15:25:22Z

sources: Don't redundantly document directory configuration

Instead of redundantly documenting "directory" configuration option in
each source plugin, refer to the built-in functionality documentation of
the Source class.

  * source.py: Add anchor for built-in functionality.
  * sources/plugins/*.py: Remove directory config option, and add reference to
    Source's built-in functionality.

Fixes #713.

db2a676e

by Chandan Singh at 2018-10-25T15:26:39Z

build elements: Add reference to BuildElement's built-in config

For each element plugin derived from BuildElement, add reference to the
built-in functionality documentation of BuildElement.

  * buildelement.py: Add anchor for built-in functionality.
  * plugins/elements/*.py: Add refence to BuildElement's built-in
    functionality for each build element.

Related to #713.

356d84cd

by Chandan Singh at 2018-10-25T16:59:13Z

Merge branch 'chandan/source-doc-directory' into 'master'

plugins: Don't redundantly document common configurations

Closes #713

See merge request BuildStream/buildstream!896

8c41b5b8

by Daniel Silverstone at 2018-10-26T09:02:30Z

_yaml.py: Do not insert into cache if retrieved from cache

We were unconditionally inserting into the yaml cache anything we had
retrieved from the yaml cache.  This had the side-effect of being expensive
on re-runs of commands where yaml hadn't changed.

Signed-off-by: Daniel Silverstone <daniel silverstone codethink co uk>

494d7018

by Jonathan Maw at 2018-10-26T09:26:36Z

Merge branch 'danielsilverstone-ct/do-not-reinsert-yaml' into 'master'

_yaml.py: Do not insert into cache if retrieved from cache

See merge request BuildStream/buildstream!902

80762ecb

by Benjamin Schubert at 2018-10-26T09:45:39Z

Check if command is a str and replace by list before checking existence

Currently we would make sure the sandbox had a command before
converting it to a list if it was given as a string. That meant that a string
command would never exist and the check be invalid.

This also adds the same logic in the dummy sandbox for consistency.

f131c407

by Benjamin Schubert at 2018-10-26T10:09:51Z

Merge branch 'bschubert/fix-command-sandbox' into 'master'

Check is command is a str and replace by list before checking existence

Closes #728

See merge request BuildStream/buildstream!898

54d89aa1

by Daniel Silverstone at 2018-10-26T10:20:36Z

_loader/loadelement.py: Use enumerate() in dependency extraction

In cases where elements end up with large numbers of dependencies,
the n-squared performance in `_extract_depends_from_node` can produce
significant delays during project load.  This patch corrects that.
In addition we were double-retrieving provenance which was unnecessary.

Signed-off-by: Daniel Silverstone <daniel silverstone codethink co uk>

e4c18ba4

by Phil Dawson at 2018-10-26T10:43:55Z

Merge branch 'danielsilverstone-ct/use-enumerate' into 'master'

_loader/loadelement.py: Use enumerate() in dependency extraction

See merge request BuildStream/buildstream!901

20e5c58a

by James Ennis at 2018-10-26T11:14:58Z

using_configuring_artifact_server.rst: Fix lines that are too long

320dae02

by James Ennis at 2018-10-26T11:37:42Z

docs: Add more information to "managing the cache with systemmd" section

1eb993bf

by James Ennis at 2018-10-26T12:02:49Z

Merge branch 'jennis/another_docs_patch' into 'master'

More information regarding the use of systemd to manage the cache

See merge request BuildStream/buildstream!904

f069d82f

by Daniel Silverstone at 2018-10-26T12:19:58Z

various: Move _sentinel from utils.py to _yaml.py

The `_sentinel` in `utils.py` was used only for yaml node tracking.
As such, simplify matters by removing it from `utils.py` and move it
to `_yaml.py` which means that we no longer need to try and avoid a
circular import issue by means of runtime importing.

Signed-off-by: Daniel Silverstone <daniel silverstone codethink co uk>

283887a5

by James Ennis at 2018-10-26T13:12:12Z

Merge branch 'danielsilverstone-ct/yaml-sentinel-rework' into 'master'

Move _sentinel from utils.py to _yaml.py

See merge request BuildStream/buildstream!903

2c6cb230
by Valentin David at 2018-10-26T14:21:18Z
```
Fix some ruamel warnings during tests
```

a8250ca4

by Valentin David at 2018-10-26T15:04:25Z

Merge branch 'valentindavid/ruamel_warnings' into 'master'

Fix some ruamel warnings during tests

See merge request BuildStream/buildstream!889

1b308fe3

by Daniel Silverstone at 2018-10-26T15:50:42Z

_stream.py: Preserve stdout FD across checkout-to-stdout

In order to support things which might need to use the stdout FD
after checkout has completed writing a tarball to it, preserve it
by means of `os.dup()` and `os.dup2()`

Signed-off-by: Daniel Silverstone <daniel silverstone codethink co uk>

65d90c31

by Daniel Silverstone at 2018-10-26T15:50:54Z

tests/testutils/runcli.py: Support binary-mode capture of stdout

In order to test things which write tarballs to stdout correctly,
we need to capture the binary output cleanly.  This ensures we're not
potentially mismatching encodings in and out.

Signed-off-by: Daniel Silverstone <daniel silverstone codethink co uk>

ed733f3e

by Daniel Silverstone at 2018-10-26T15:51:40Z

tests/frontend/buildcheckout.py: Enable test_build_checkout_tarball_stdout

With the new support for saving the stdout FDs cleanly, and binary mode
capture in runcli, enable the tarball-to-stdout test.

Signed-off-by: Daniel Silverstone <daniel silverstone codethink co uk>

e97d2a75

by Benjamin Schubert at 2018-10-29T10:17:07Z

Merge branch 'bschubert/fix-binary-output-capture' into 'master'

Don't close stdout when running 'checkout' to stdout

Closes #486

See merge request BuildStream/buildstream!905

1625de0e

by Tristan Van Berkom at 2018-10-29T11:49:33Z

doc/source/conf.py: Added `images` directory for statically included files

38507b4e

by Tristan Van Berkom at 2018-10-29T11:49:33Z

doc/source/format_intro.rst: Adding link anchor for include directives

26164bcd

by Tristan Van Berkom at 2018-10-29T13:57:51Z

MANIFEST.in: Include SVG and ODG files in source distributions

3a23c8f6

by Tristan Van Berkom at 2018-10-29T13:57:51Z

doc: Adding new architecture document with initial "Overview of modules" section

41d370f6

by Tristan Van Berkom at 2018-10-29T13:57:51Z

doc: Adding new architecture document describing the data model

bed7f7ac

by Tristan Van Berkom at 2018-10-29T13:57:51Z

doc: Adding new architecture document describing the dependency model

9bdf7f40

by Tristan Van Berkom at 2018-10-29T13:57:51Z

doc: Adding new architecture document about highlevel program flow

6b8bdf35

by Tristan Van Berkom at 2018-10-29T13:57:51Z

doc: Adding new architecture document about how the scheduler works.

b1fadaa5

by Tristan Van Berkom at 2018-10-29T13:57:51Z

doc: Moved cachekey and sandboxing writings into the architecture section

baf6b578

by Tristan Van Berkom at 2018-10-29T14:28:41Z

Merge branch 'tristan/architecture-docs' into 'master'

Tristan/architecture docs

See merge request BuildStream/buildstream!907

09ef8b25