finn pushed to branch finn/internal-tutorial-fix at BuildGrid / buildgrid
Commits:
-
025bcdee
by Finn at 2018-10-10T19:23:05Z
-
1631a659
by Laurence Urhegyi at 2018-10-10T19:30:29Z
-
c2554302
by Laurence Urhegyi at 2018-10-10T19:33:44Z
-
a49581a6
by Laurence Urhegyi at 2018-10-10T19:35:05Z
-
f7f841c3
by Finn at 2018-10-11T17:08:06Z
3 changed files:
Changes:
| 1 |
- |
|
| 2 | 1 |
.. _about:
|
| 3 | 2 |
|
| 4 | 3 |
About
|
| ... | ... | @@ -14,13 +13,15 @@ BuildGrid is a Python remote execution service which implements Google's |
| 14 | 13 |
`Remote Execution API`_ and the `Remote Workers API`_. The project's goal is to
|
| 15 | 14 |
be able to execute build jobs remotely on a grid of computers in order to
|
| 16 | 15 |
massively speed up build times. Workers on the grid should be able to run with
|
| 17 |
-different environments. It is designed to work with clients such as `Bazel`_ and
|
|
| 18 |
-`BuildStream`_.
|
|
| 16 |
+different environments. It works with clients such as `Bazel`_,
|
|
| 17 |
+`BuildStream`_ and `RECC`_, and is designed to be able to work with any client
|
|
| 18 |
+that conforms to the above API protocols.
|
|
| 19 | 19 |
|
| 20 | 20 |
.. _Remote Execution API: https://github.com/bazelbuild/remote-apis
|
| 21 | 21 |
.. _Remote Workers API: https://docs.google.com/document/d/1s_AzRRD2mdyktKUj2HWBn99rMg_3tcPvdjx3MPbFidU/edit#heading=h.1u2taqr2h940
|
| 22 | 22 |
.. _BuildStream: https://wiki.gnome.org/Projects/BuildStream
|
| 23 | 23 |
.. _Bazel: https://bazel.build
|
| 24 |
+.. _RECC: https://gitlab.com/bloomberg/recc
|
|
| 24 | 25 |
|
| 25 | 26 |
|
| 26 | 27 |
.. _getting-started:
|
| ... | ... | @@ -49,7 +50,7 @@ Resources |
| 49 | 50 |
|
| 50 | 51 |
.. _Homepage: https://buildgrid.build
|
| 51 | 52 |
.. _GitLab repository: https://gitlab.com/BuildGrid/buildgrid
|
| 52 |
-.. _Bug tracking: https://gitlab.com/BuildGrid/buildgrid/issues
|
|
| 53 |
+.. _Bug tracking: https://gitlab.com/BuildGrid/buildgrid/boards
|
|
| 53 | 54 |
.. _Mailing list: https://lists.buildgrid.build/cgi-bin/mailman/listinfo/buildgrid
|
| 54 | 55 |
.. _Slack channel: https://buildteamworld.slack.com/messages/CC9MKC203
|
| 55 | 56 |
.. _invite link: https://join.slack.com/t/buildteamworld/shared_invite/enQtMzkxNzE0MDMyMDY1LTRmZmM1OWE0OTFkMGE1YjU5Njc4ODEzYjc0MGMyOTM5ZTQ5MmE2YTQ1MzQwZDc5MWNhODY1ZmRkZTE4YjFhNjU
|
| ... | ... | @@ -164,11 +164,11 @@ def run_command(context, input_root, commands, output_file, output_directory): |
| 164 | 164 |
for output_file_response in execute_response.result.output_files:
|
| 165 | 165 |
path = os.path.join(output_directory, output_file_response.path)
|
| 166 | 166 |
|
| 167 |
- if not os.path.exists(os.path.dirname(path)):
|
|
| 167 |
+ if not os.path.exists(os.path.dirname(output_directory)):
|
|
| 168 | 168 |
os.makedirs(os.path.dirname(path), exist_ok=True)
|
| 169 | 169 |
|
| 170 | 170 |
downloader.download_file(output_file_response.digest, path)
|
| 171 | 171 |
|
| 172 |
- if output_file_response.path in output_executeables:
|
|
| 173 |
- st = os.stat(path)
|
|
| 174 |
- os.chmod(path, st.st_mode | stat.S_IXUSR)
|
|
| 172 |
+ if output_file_response.path in output_executeables:
|
|
| 173 |
+ st = os.stat(path)
|
|
| 174 |
+ os.chmod(path, st.st_mode | stat.S_IXUSR)
|
| 1 |
- |
|
| 2 | 1 |
.. _external-resources:
|
| 3 | 2 |
|
| 4 | 3 |
Resources
|
| ... | ... | @@ -19,6 +18,9 @@ Remote execution and worker API useful links: |
| 19 | 18 |
- `bubblewrap repository`_
|
| 20 | 19 |
- `Buildfarm reference REAPI implementation`_
|
| 21 | 20 |
- `Buildbarn Golang REAPI implementation`_
|
| 21 |
+- `Demonstration of RECC with BuildGrid`_
|
|
| 22 |
+- `Demonstration of Bazel with BuildGrid`_
|
|
| 23 |
+- `Demonstration of BuildStream with BuildGrid`_
|
|
| 22 | 24 |
|
| 23 | 25 |
.. _REAPI design document: https://docs.google.com/document/d/1AaGk7fOPByEvpAbqeXIyE8HX_A3_axxNnvroblTZ_6s
|
| 24 | 26 |
.. _REAPI protobuf specification: https://github.com/bazelbuild/remote-apis/blob/master/build/bazel/remote/execution/v2/remote_execution.proto
|
| ... | ... | @@ -35,4 +37,7 @@ Remote execution and worker API useful links: |
| 35 | 37 |
.. _BuildBox repository: https://gitlab.com/BuildStream/buildbox
|
| 36 | 38 |
.. _bubblewrap repository: https://github.com/projectatomic/bubblewrap
|
| 37 | 39 |
.. _Buildfarm reference REAPI implementation: https://github.com/bazelbuild/bazel-buildfarm
|
| 38 |
-.. _Buildbarn Golang REAPI implementation: https://github.com/EdSchouten/bazel-buildbarn
|
|
| \ No newline at end of file | ||
| 40 |
+.. _Buildbarn Golang REAPI implementation: https://github.com/EdSchouten/bazel-buildbarn
|
|
| 41 |
+.. _Demonstration of RECC with BuildGrid: https://asciinema.org/a/0FjExIqrTGSlpSUIS8Ehf5gUg
|
|
| 42 |
+.. _Demonstration of Bazel with BuildGrid: https://asciinema.org/a/uVHFWOxpivwJ4ari23CEerR8N
|
|
| 43 |
+.. _Demonstration of BuildStream with BuildGrid: https://asciinema.org/a/QfkYGqhfhEQz4o8prlBdEBFP7
|