[Notes] [Git][BuildStream/buildstream][mac_fixes] 30 commits: Rework Skipped usage

[Phillip Smyth <gitlab mg gitlab com>]

Title: GitLab

Phillip Smyth pushed to branch mac_fixes at BuildStream / buildstream

Commits:

• ca811a4d
  by Josh Smith at 2018-09-19T09:25:21Z

  Rework Skipped usage
  
  The SKIPPED message type is now used to indicate the end of a task which
  was successful without having to perform the given task.
  
  This overhauls the use of `Queue.done()` and therefore queues do not
  need to provide a processed/skipped return value from `done()`. Instead
  this is replaced with the action of raising a `SkipJob` exception from
  within `Queue.process()`.
  

• 16fbc3e3
  by Josh Smith at 2018-09-19T09:25:21Z

  tests.py: Test skip on push
  
  Adds a test to ensure that BuildStream alerts the user of a skipped push
  when the remote already has the artifact cached.
  

• ab56f693
  by Josh Smith at 2018-09-19T09:25:21Z

  element.py: Remove redundant timed_activity
  
  This removes the timed_activity for an element _push action. This is
  unnecessary as the job is already being timed elsewhere.
  

• 198fbfe8
  by Josh Smith at 2018-09-19T09:25:21Z

  cascache.py: Move push/pull messaging to cascache
  
  Pulled/Pushed messages will no longer be produced from within
  element.py, instead they will be produced during CasCache push() and
  pull() appropriately.
  
  Message consistency has also been improved.
  

• 213f7794
  by Josh Smith at 2018-09-19T09:25:21Z

  cascache.py: Modify messaging API calls
  
  Both pulling and pushing INFO messages are now status messages.
  
  Calls to the messaging API through `self.context.message()` have now
  been switched to `element.info`.
  

• dddd6025
  by Qinusty at 2018-09-19T10:59:48Z

  Merge branch 'Qinusty/skipped-rework' into 'master'
  
  Add SkipJob for indicating a skipped activity
  
  See merge request BuildStream/buildstream!765

• 16d9c6e5
  by Tristan Van Berkom at 2018-09-19T11:08:33Z

  _frontend/status.py: Completely remove the blessings dependency from BuildStream
  
  This actually improves reliability of the status bar because we
  now disable it completely in the case that not all of the terminal
  escape sequences are supported on the given terminal.
  
  This replaces the few functions we were using, to move the cursor
  up one line, move it to the beginning of the line, and to clear a
  line, with low level functions provided by the curses module in
  the standard library.
  
  This change makes it easier for downstream distro package maintainers
  to package BuildStream, particularly on Fedora.
  
  Asides from changing _frontend/status.py, this commit includes the
  following changes:
  
    * _frontend/app.py: Use python isatty() function to determine if
                        we are connected to a tty, instead of relying
  		      on blessings.
  
    * setup.py: Remove the dependency on blessings.
  

• 7dd74b01
  by Tristan Van Berkom at 2018-09-19T11:27:55Z

  Merge branch 'tristan/remove-blessings' into 'master'
  
  _frontend/status.py: Completely remove the blessings dependency from BuildStream
  
  See merge request BuildStream/buildstream!808

• 335d5a45
  by Adam Jones at 2018-09-19T13:00:45Z

  Fix rst links for guideline links
  

• 667dd4ca
  by Javier Jardón at 2018-09-19T13:25:36Z

  Merge branch 'adamjones/contributing-links' into 'master'
  
  Fix rst link formatting for guideline links
  
  See merge request BuildStream/buildstream!811

• 68ef69e4
  by Tristan Van Berkom at 2018-09-21T05:20:46Z

  source.py: Fix re-instantiation
  
  This fixes an issue where the re-instantiated Source used with
  Source mirroring enabled is not completely initialized.
  
  Failing to load the ref from the project.refs file for instance,
  will result in a crash at `fetch` time.
  
  This fixes issue #666
  

• 662c729f
  by Tristan Van Berkom at 2018-09-21T05:59:30Z

  Merge branch 'tristan/fix-source-reinstantiation' into 'master'
  
  source.py: Fix re-instantiation
  
  Closes #666
  
  See merge request BuildStream/buildstream!817

• 461a0588
  by Jim MacArthur at 2018-09-21T10:53:11Z

  element.py: Remove early warning and check directory is not None
  
  The check for directory should have always been here. The early warning
  test doesn't work for `bst checkout` because caches haven't been configured
  at the point of the test, so I've had to remove it.
  

• aa9caaac
  by Jim MacArthur at 2018-09-21T10:53:11Z

  _sandboxremote.py: Ignore return value of push_directory
  
  The return value is always upload_vdir.ref.
  

• 2aae68c7
  by Jim MacArthur at 2018-09-21T10:53:11Z

  cascache.py: make push_remote raise exception if no push remotes exist
  
  Also add docstring to method and remove return value since it was useless
  

• ca1bb72c
  by Jim MacArthur at 2018-09-21T10:53:11Z

  tests/artifactcache/push.py: Ignore return value of push_directory
  

• 55c93a82
  by Jim MacArthur at 2018-09-21T11:26:55Z

  Merge branch 'jmac/remote_exec_checkout_fix' into 'master'
  
  Remote exec: Remove early warning and check directory is not None
  
  See merge request BuildStream/buildstream!800

• e209beb0
  by Chandan Singh at 2018-09-21T13:10:08Z

  _stream.py: Ensure source-bundle's source directory exists
  
  Currently, `source-bundle` command is entirely broken as it tries to stage the
  sources in a directory that doesn't exist. Fix it by ensuring that we create
  the necessary directories before calling any methods that try to use those
  directories.
  
  This fix comes with a regression test to ensure that the basic use-case
  of `source-bundle` continues to work in future.
  
  Fixes https://gitlab.com/BuildStream/buildstream/issues/651.
  

• 0b000518
  by Chandan Singh at 2018-09-21T13:56:55Z

  Merge branch 'chandan/fix-source-bundle' into 'master'
  
  Fix source-bundle command
  
  Closes #651
  
  See merge request BuildStream/buildstream!807

• ef26043a
  by Chandan Singh at 2018-09-21T17:14:16Z

  setup.py: Make website the primary homepage
  

• 1b2aed40
  by Chandan Singh at 2018-09-21T17:40:11Z

  Merge branch 'chandan/update-project-homepage' into 'master'
  
  setup.py: Make website the primary homepage
  
  See merge request BuildStream/buildstream!795

• 8eedddc4
  by knownexus at 2018-09-24T10:06:43Z

  Added `set_resource_limits()` to platform
  
  This has been moved from app.py
  As it will have different functionality depending on platform
  Once the Darwin (MacOS) platform is added
  
  Removed `resource.setrlimit()` functionality from app.py
  Added `resource.setrlimit()` functionality to platform.py as function
  

• 2374b334
  by knownexus at 2018-09-24T10:06:43Z

  Added FUSE check, as WSL does not support FUSE yet
  
  _platform/linux.py: Add FUSE check
  Without this check, WSL would error upon finding FUSE missing
  This must be bypassed to allow remote execution
  

• b283564e
  by knownexus at 2018-09-24T10:06:43Z

  Max-jobs is now defined on a platform basis
  
  This is due to Darwin (MacOS) having a different Max-Jobs limit
  _platform/platform.py: Adding max-jobs call
  
  _project.py: redirected 'max-jobs' to point at the platform
  

• e9925362
  by knownexus at 2018-09-24T10:09:59Z

  Artifact caches are now defined in platform.py
  
  This was done so a default exists, but allows platforms to override as needed
  
  _platform/platform.py: Added CAS call function
  
  _platform/linux.py: Added override to CAS call
  _platform/unix.py: Remove CAS call
  

• 96cb1955
  by knownexus at 2018-09-24T10:10:01Z

  Adding Dummy sandbox
  
  This is to allow platforms that do not support sandboxing
  To error is a controlled/known way
  

• d49af73a
  by knownexus at 2018-09-24T10:10:01Z

  Adding darwin.py (MacOS) platform
  
  Adding functionality to recognise Darwin as a platform in plaform.py
  

• 3eba7c7c
  by knownexus at 2018-09-24T10:10:01Z

  utils.py: reworked safe_remove
  
  non-Linux platforms don't return EISDIR when attempting to unlink a directory
  
  Stopped safe_remove attempting to unlink dirs
  Previously safe_remove would attempt to unlink a path
  Before attempting to remove it if it was a dir
  
  Now it checks for a dir before that step
  

• 22cd3b2a
  by James Ennis at 2018-09-24T10:10:01Z

  Sandbox: Ensure that we only import the sandbox subclasses when instantiate a sandbox
  
    - This patch was required due to not being able to execute `bst` on
    a Linux machine without Fuse or Bubblewrap available
  

• 6ee0ff3b
  by James Ennis at 2018-09-24T10:10:01Z

  _platform/linux.py: Ensure exception is not raised when performing sandbox availability check
  

30 changed files:

• CONTRIBUTING.rst
• buildstream/_artifactcache/cascache.py
• buildstream/_exceptions.py
• buildstream/_frontend/app.py
• buildstream/_frontend/status.py
• + buildstream/_platform/darwin.py
• buildstream/_platform/linux.py
• buildstream/_platform/platform.py
• buildstream/_platform/unix.py
• buildstream/_project.py
• buildstream/_scheduler/jobs/job.py
• buildstream/_scheduler/queues/buildqueue.py
• buildstream/_scheduler/queues/fetchqueue.py
• buildstream/_scheduler/queues/pullqueue.py
• buildstream/_scheduler/queues/pushqueue.py
• buildstream/_scheduler/queues/queue.py
• buildstream/_scheduler/queues/trackqueue.py
• buildstream/_stream.py
• buildstream/element.py
• buildstream/sandbox/__init__.py
• + buildstream/sandbox/_sandboxdummy.py
• buildstream/sandbox/_sandboxremote.py
• buildstream/source.py
• buildstream/utils.py
• setup.py
• tests/artifactcache/push.py
• + tests/frontend/project/elements/source-bundle/source-bundle-hello.bst
• + tests/frontend/project/files/source-bundle/llamas.txt
• tests/frontend/pull.py
• tests/frontend/push.py

The diff was not included because it is too large.

—
View it on GitLab.
You're receiving this email because of your account on gitlab.com. If you'd like to receive fewer emails, you can adjust your notification settings.