[Notes] [Git][BuildStream/buildstream][jmac/remote_execution_rebase] 76 commits: HACKING.rst: Add running a single test example

[Jim MacArthur <gitlab mg gitlab com>]

Title: GitLab

Jim MacArthur pushed to branch jmac/remote_execution_rebase at BuildStream / buildstream

Commits:

• 4d2e8a14
  by Josh Smith at 2018-08-02T09:12:16Z

  HACKING.rst: Add running a single test example
  

• 039d43e4
  by Tom Pollard at 2018-08-02T10:02:08Z

  Merge branch 'Qinusty/docs_changes' into 'master'
  
  HACKING.rst: Add running a single test example
  
  See merge request BuildStream/buildstream!597

• e788bda4
  by Tiago Gomes at 2018-08-02T11:24:43Z

  plugin: bake API to get and validate a project path
  
  A project path is a path relative to a project directory.
  
  A project path can not also refer to the parent directory in the first
  path component, or point to symbolic links, fifos, sockets and
  block/character devices.
  

• 33292be4
  by Tiago Gomes at 2018-08-02T11:24:43Z

  local plugin: validate project paths
  
  The autotools example had to be copied over inside of the junction
  example, as referring to a path outside of the project directory is
  now disallowed.
  

• 00f170b8
  by Tiago Gomes at 2018-08-02T11:24:43Z

  patch plugin: validate project paths
  

• 4f0f4171
  by Tiago Gomes at 2018-08-02T11:24:43Z

  ostree plugin: validate project paths
  

• c4c0bb1e
  by Tiago Gomes at 2018-08-02T11:24:43Z

  project: validate project paths (element-path)
  

• 385aa592
  by Tiago Gomes at 2018-08-02T11:24:43Z

  project: validate project paths (local plugin paths)
  

• 731328ad
  by Tiago Gomes at 2018-08-02T11:24:43Z

  tests: add generate_file_types testing function
  

• b7362a32
  by Tiago Gomes at 2018-08-02T11:24:43Z

  tests: add additional tests to local plugin
  

• 7e3944dc
  by Tiago Gomes at 2018-08-02T11:24:43Z

  tests: add additional tests to patch plugin
  

• 9f0c8fcf
  by Tiago Gomes at 2018-08-02T11:24:43Z

  tests: test local plugins and element-path paths
  

• 8656a65d
  by Tiago Gomes at 2018-08-02T12:10:29Z

  Merge branch 'tiagogomes/issue-195' into 'master'
  
  Add validation for project paths
  
  See merge request BuildStream/buildstream!593

• 170f33a1
  by Valentin David at 2018-08-02T14:17:01Z

  Move tests.frontend.generate_junction to test.testutils
  

• 3bae4aeb
  by Valentin David at 2018-08-02T14:17:01Z

  Pass targets to Loader.load() instead of its constructor.
  
  This is required to be able to build a Loader before the list
  of targets is known.
  

• 483b0223
  by Valentin David at 2018-08-02T14:17:01Z

  Make Project owner of Loader.
  

• 19cd954b
  by Valentin David at 2018-08-02T14:17:01Z

  Refactor plugin factory creation
  

• 171e803f
  by Valentin David at 2018-08-02T14:18:10Z

  Add support for include '(@)' in project.conf and .bst files
  
  Fixes #331.
  

• 4e1160a9
  by Valentin David at 2018-08-02T15:17:03Z

  Merge branch 'valentindavid/331_include' into 'master'
  
  Add support for include in project.conf
  
  Closes #331
  
  See merge request BuildStream/buildstream!471

• 3782c15f
  by Ed Baunton at 2018-08-04T08:54:58Z

  element.py (docs): dashes not underscores for build and install root
  
  Fix small error in docs in relation to `get_variable` documentation.
  

• f918205a
  by Tristan Van Berkom at 2018-08-04T10:08:21Z

  Merge branch 'edbaunton/doc-typo' into 'master'
  
  element.py (docs): dashes not underscores for build and install root
  
  See merge request BuildStream/buildstream!577

• f69a0287
  by Mathieu Bridon at 2018-08-04T21:02:10Z

  doc: Build the docs without Buildstream installed
  

• bc63f278
  by Tristan Van Berkom at 2018-08-05T10:07:46Z

  __main__.py: Adding private entry point so we can run BuildStream without installing
  
  This is needed to build docs without installing BuildStream.
  

• 1618f405
  by Tristan Van Berkom at 2018-08-05T10:07:46Z

  doc: Fix junctions user guide to refer to doc/sessions, not doc/sessions-stored.
  

• 9e573eeb
  by Tristan Van Berkom at 2018-08-05T10:07:46Z

  doc: Some modifications to the bst2html program
  
    o Added feature to allow running shell commands
  
    o Removed unused codepaths to launch bst commands through the script,
      this program is anyway only used to parse and run the session files.
  
    o Fixed previous patch to run BuildStream uninstalled with
      the subprocess module, as running it in the same interpretor
      causes a bunch of problems.
  

• 19d2a072
  by Tristan Van Berkom at 2018-08-05T10:07:46Z

  doc/sessions/developing.run: Fix the session to actually run `patch` as a shell command
  
  Since we added support for shell commands in bst2html, this can now be fixed.
  
  This is a part of issue #553
  

• 9b937a97
  by Tristan Van Berkom at 2018-08-05T10:07:46Z

  HACKING.rst: It is not longer required to install BuildStream to build the docs.
  

• 63b33d07
  by Tristan Van Berkom at 2018-08-05T10:57:03Z

  Merge branch 'tristan/build-docs' into 'master'
  
  Build documentation without installing
  
  See merge request BuildStream/buildstream!605

• 942a06f4
  by Mathieu Bridon at 2018-08-06T09:53:03Z

  doc: Mention the Fedora packages
  
  These aren't official yet, but they should work.
  

• c04b8421
  by Mathieu Bridon at 2018-08-06T10:53:57Z

  Merge branch 'bochecha/fedora-packages' into 'master'
  
  doc: Mention the Fedora packages
  
  See merge request BuildStream/buildstream!604

• 12c79366
  by toscalix at 2018-08-06T10:56:40Z

  removed space in task template so checkboxes work as expected
  

• bd2b3d8d
  by Agustin Benito Bethencourt at 2018-08-06T11:49:12Z

  Merge branch 'toscalix' into 'master'
  
  removed space in task template so checkboxes work as expected
  
  See merge request BuildStream/buildstream!588

• d1b640d0
  by James Ennis at 2018-08-06T13:10:12Z

  install_linux_distro.rst: Fix broken links
  

• be163e8d
  by Jonathan Maw at 2018-08-06T14:01:58Z

  Merge branch 'jennis/fix_links_in_docs' into 'master'
  
  Fix two links in the installing docs
  
  See merge request BuildStream/buildstream!610

• 4d6dbabe
  by Tiago Gomes at 2018-08-06T15:03:25Z

  PullQueue: fix resource used
  
  Improve fetchers, builders and pushers documentation.
  
  Closes #550.
  

• a8073264
  by Tiago Gomes at 2018-08-06T16:55:03Z

  Merge branch 'tiagogomes/issue-550' into 'master'
  
  PullQueue: fix resource used
  
  Closes #550
  
  See merge request BuildStream/buildstream!611

• 3d26ff6e
  by Ed Baunton at 2018-08-07T05:04:50Z

  remote.py: Add support for marking downloaded files executable
  
  Add an optional flag to make files executable after having downloaded them.
  
  Instead of leaving the permissioning of downloaded file in remote.py up
  to the user's umask; expressly set permissions to 0644 or 0755 if
  executable.
  
  Bump format version to 13.
  

• 60a552a5
  by Tristan Van Berkom at 2018-08-07T06:13:53Z

  Merge branch 'edbaunton/executable-remote-source' into 'master'
  
  remote.py: Add support for marking downloaded files executable
  
  See merge request BuildStream/buildstream!581

• 01ff0177
  by Javier Jardón at 2018-08-07T07:29:30Z

  source/install_linux_distro.rst: Make clearer ArchLinux packages available
  

• 9b469fe6
  by Tristan Van Berkom at 2018-08-07T09:12:46Z

  Merge branch 'jjardon/doc_arch_releases' into 'master'
  
  source/install_linux_distro.rst: Make clearer ArchLinux packages available
  
  See merge request BuildStream/buildstream!613

• 289de2ef
  by Adam Jones at 2018-08-07T09:24:58Z

  Add systemd service file examples to artifacts documentation
  
  change code style to ini
  

• e42325b9
  by Javier Jardón at 2018-08-07T10:29:46Z

  Merge branch 'adamjones/systemd-cas' into 'master'
  
  Include systemd file examples for google-cas cache
  
  Closes #419
  
  See merge request BuildStream/buildstream!524

• 6d349610
  by Javier Jardón at 2018-08-07T10:53:23Z

  source/install_linux_distro.rst: Fix formatting
  

• 493d19d2
  by James Ennis at 2018-08-07T11:08:36Z

  install_linux_distro.rst: Change install instructions for python-arpy package on Arch
  
    - python-arpy is unobtainable via pacman
    - Also a minor change to how we display install instructions
    from Fedora's dnf package manager
  

• fc9869e2
  by James Ennis at 2018-08-07T11:56:21Z

  Merge branch 'jennis/change_arch_install_instructions' into 'master'
  
  Change install instructions for python-arpy package on Arch
  
  See merge request BuildStream/buildstream!614

• b030c005
  by Jim MacArthur at 2018-08-07T11:56:42Z

  Make Import a BST_VIRTUAL_DIRECTORY class
  

• 84c32d83
  by Jim MacArthur at 2018-08-07T11:56:42Z

  Convert uses of external_directory to get_underlying_directory()
  

• 3c01b4ef
  by Jim MacArthur at 2018-08-07T11:56:42Z

  _filebaseddirectory/directory.py: Move VirtualDirectoryError to Directory
  

• 7335d1b5
  by Jim MacArthur at 2018-08-07T11:56:42Z

  Move KeyStrength enum out to element_enums.py
  

• 93bd3086
  by Jim MacArthur at 2018-08-07T12:00:48Z

  Initial implementation of _casbaseddirectory.py
  

• 605bff3a
  by Jim MacArthur at 2018-08-07T12:00:48Z

  Directory API: add mark_changed
  

• ad29d959
  by Jim MacArthur at 2018-08-07T12:00:48Z

  Sandboxes: Call _vdir.mark_changed() at the end of run()
  

• fad1b257
  by Jim MacArthur at 2018-08-07T12:00:48Z

  filebaseddirectory: Update index after descend
  

• 0036d1f9
  by Jim MacArthur at 2018-08-07T12:00:48Z

  Sandbox: Return a CasBasedDirectory when an environment variable is set
  

• d4a0e6b0
  by Jim MacArthur at 2018-08-07T12:00:48Z

  Add basic storage test 'storage-test.py'
  

• c7b6a092
  by Jim MacArthur at 2018-08-07T13:45:28Z

  _casbaseddirectory: Alter _save to save the serialised digest object, not the text digest
  

• 42236933
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache: Restructure of push() - was e7e00999
  

• fb4de830
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache.py: modify _required_blobs so non-Directory objects have no dependencies rather than throwing an exception
  

• 27097246
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache.py: yBetter way of managing dependencies (was a77938b6)
  

• 684458e3
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache: Correction to earlier work - imports and info statement
  

• e5e90f67
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache: Reorder push/push_refs/verify, also fix return value of push
  

• 1470a8dc
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache: Add two methods to verify if a ref exists on the remote.
  
  These are necessary to tell if something has previous been pushed.
  push() returns false if the ref already exists on the remote,
  so we need another method to verify existence on the remote.
  

• 4c03ea92
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache.py: Add pull_key, a method to pull single objects without references.
  

• 7929bd75
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache: pep8
  

• fd55be59
  by Jim MacArthur at 2018-08-07T13:45:28Z

  cascache.py: pep8
  

• 4a4a1f47
  by Jim MacArthur at 2018-08-07T13:45:28Z

  sandbox.py: Allow setting the virtual directory (for use after remote execution has finished)
  

• 802b3cca
  by Jim MacArthur at 2018-08-07T13:45:29Z

  sandbox.py: Add set_output_directory to sandboxes and set it
  

• 74a77b52
  by Jim MacArthur at 2018-08-07T13:45:29Z

  sandbox.py: Fix error in comment for set_environment
  

• ec28899f
  by Jim MacArthur at 2018-08-07T13:45:29Z

  sandbox: pep8/fix vdir
  

• f93cce4f
  by Jim MacArthur at 2018-08-07T13:45:29Z

  _sandboxremote.py: New file.
  

• f8acd3f1
  by Jim MacArthur at 2018-08-07T13:45:29Z

  _platform/linux.py: Make Remote the default sandbox for Linux
  

• 320d94c6
  by Jim MacArthur at 2018-08-07T13:45:29Z

  Actually don't make Remote the default sandbox yet.
  
  This reverts commit e5fdde84c3f3bb2843a1f10234cb817a2aa5e6d3.
  

• 01178085
  by Jim MacArthur at 2018-08-07T13:45:29Z

  cascache.py: Make 'element' argument to push_refs optional
  

• 6e5ff2d2
  by Jim MacArthur at 2018-08-07T13:45:29Z

  element.py: Hack to get the updated virtual directory after remote execution updates it
  

• 74a5aaa6
  by Jim MacArthur at 2018-08-08T10:55:15Z

  Stage 1 updating to new Protobuf standard
  

• b610ab49
  by Jim MacArthur at 2018-08-08T10:55:29Z

  Make SandboxRemote the default for linux targets
  

30 changed files:

• .gitlab-ci.yml
• .gitlab/issue_templates/bst_task.md
• .pylintrc
• HACKING.rst
• buildstream/__init__.py
• + buildstream/__main__.py
• buildstream/_artifactcache/artifactcache.py
• buildstream/_artifactcache/cascache.py
• buildstream/_elementfactory.py
• buildstream/_exceptions.py
• buildstream/_frontend/app.py
• buildstream/_frontend/widget.py
• + buildstream/_includes.py
• buildstream/_loader/loader.py
• buildstream/_loader/metaelement.py
• buildstream/_loader/metasource.py
• buildstream/_options/optionpool.py
• buildstream/_pipeline.py
• buildstream/_platform/linux.py
• buildstream/_platform/platform.py
• buildstream/_platform/unix.py
• buildstream/_plugincontext.py
• buildstream/_project.py
• buildstream/_scheduler/queues/pullqueue.py
• buildstream/_sourcefactory.py
• buildstream/_stream.py
• buildstream/_versions.py
• buildstream/_yaml.py
• buildstream/buildelement.py
• buildstream/data/userconfig.yaml

The diff was not included because it is too large.

—
View it on GitLab.
You're receiving this email because of your account on gitlab.com. If you'd like to receive fewer emails, you can adjust your notification settings.