richardmaw-codethink pushed to branch master at BuildStream / buildstream
Commits:
-
8e64ccef
by James Ennis at 2018-11-07T11:06:11Z
-
09ab676d
by James Ennis at 2018-11-07T11:06:11Z
-
f514124f
by James Ennis at 2018-11-07T11:06:11Z
-
029ba17d
by richardmaw-codethink at 2018-11-07T11:32:20Z
3 changed files:
- doc/source/format_project.rst
- doc/source/using_config.rst
- doc/source/using_configuring_artifact_server.rst
Changes:
... | ... | @@ -190,19 +190,34 @@ for more detail. |
190 | 190 |
Artifact server
|
191 | 191 |
~~~~~~~~~~~~~~~
|
192 | 192 |
If you have setup an :ref:`artifact server <artifacts>` for your
|
193 |
-project then it is convenient to configure this in your ``project.conf``
|
|
193 |
+project then it is convenient to configure the following in your ``project.conf``
|
|
194 | 194 |
so that users need not have any additional configuration to communicate
|
195 | 195 |
with an artifact share.
|
196 | 196 |
|
197 | 197 |
.. code:: yaml
|
198 | 198 |
|
199 |
+ #
|
|
200 |
+ # Artifacts
|
|
201 |
+ #
|
|
199 | 202 |
artifacts:
|
203 |
+ # A remote cache from which to download prebuilt artifacts
|
|
204 |
+ - url: https://foo.com/artifacts:11001
|
|
205 |
+ server.cert: server.crt
|
|
206 |
+ # A remote cache from which to upload/download built/prebuilt artifacts
|
|
207 |
+ - url: https://foo.com/artifacts:11002
|
|
208 |
+ server-cert: server.crt
|
|
209 |
+ client-cert: client.crt
|
|
210 |
+ client-key: client.key
|
|
200 | 211 |
|
201 |
- # A url from which to download prebuilt artifacts
|
|
202 |
- url: https://foo.com/artifacts
|
|
212 |
+.. note::
|
|
213 |
+ |
|
214 |
+ You can also specify a list of different caches here; earlier entries in the
|
|
215 |
+ list will have higher priority than later ones.
|
|
216 |
+ |
|
217 |
+The use of ports are required to distinguish between pull only access and
|
|
218 |
+push/pull access. For information regarding the server/client certificates
|
|
219 |
+and keys, please see: :ref:`Key pair for the server <server_authentication>`.
|
|
203 | 220 |
|
204 |
-You can also specify a list of caches here; earlier entries in the list
|
|
205 |
-will have higher priority than later ones.
|
|
206 | 221 |
|
207 | 222 |
Remote execution
|
208 | 223 |
~~~~~~~~~~~~~~~~
|
... | ... | @@ -32,38 +32,75 @@ the supported configurations on a project wide basis are listed here. |
32 | 32 |
|
33 | 33 |
Artifact server
|
34 | 34 |
~~~~~~~~~~~~~~~
|
35 |
-The project you build will often specify a :ref:`remote artifact cache
|
|
36 |
-<artifacts>` already, but you may want to specify extra caches. There are two
|
|
37 |
-ways to do this. You can add one or more global caches:
|
|
35 |
+Although project's often specify a :ref:`remote artifact cache <artifacts>` in
|
|
36 |
+their ``project.conf``, you may also want to specify extra caches.
|
|
38 | 37 |
|
39 |
-**Example**
|
|
38 |
+Assuming that your host/server is reachable on the internet as ``artifacts.com``
|
|
39 |
+(for example), there are two ways to declare remote caches in your user
|
|
40 |
+configuration:
|
|
41 |
+ |
|
42 |
+1. Adding global caches:
|
|
40 | 43 |
|
41 | 44 |
.. code:: yaml
|
42 | 45 |
|
46 |
+ #
|
|
47 |
+ # Artifacts
|
|
48 |
+ #
|
|
43 | 49 |
artifacts:
|
44 |
- url: https://artifacts.com/artifacts
|
|
50 |
+ # Add a cache to pull from
|
|
51 |
+ - url: https://artifacts.com/artifacts:11001
|
|
52 |
+ server-cert: server.crt
|
|
53 |
+ # Add a cache to push/pull to/from
|
|
54 |
+ - url: https://artifacts.com/artifacts:11002
|
|
55 |
+ server-cert: server.crt
|
|
56 |
+ client-cert: client.crt
|
|
57 |
+ client-key: client.key
|
|
58 |
+ push: true
|
|
59 |
+ # Add another cache to pull from
|
|
60 |
+ - url: https://anothercache.com/artifacts:8080
|
|
61 |
+ server-cert: another_server.crt
|
|
62 |
+ |
|
63 |
+.. note::
|
|
45 | 64 |
|
46 |
-Caches listed there will be considered lower priority than those specified
|
|
47 |
-by the project configuration.
|
|
65 |
+ Caches declared here will be used by **all** BuildStream project's on the user's
|
|
66 |
+ machine and are considered a lower priority than those specified in the project
|
|
67 |
+ configuration.
|
|
48 | 68 |
|
49 |
-You can also add project-specific caches:
|
|
50 | 69 |
|
51 |
-**Example**
|
|
70 |
+2. Specifying caches for a specific project within the user configuration:
|
|
52 | 71 |
|
53 | 72 |
.. code:: yaml
|
54 | 73 |
|
55 | 74 |
projects:
|
56 | 75 |
project-name:
|
57 | 76 |
artifacts:
|
58 |
- - url: https://artifacts.com/artifacts1
|
|
59 |
- - url: ssh://user artifacts com/artifacts2
|
|
77 |
+ # Add a cache to pull from
|
|
78 |
+ - url: https://artifacts.com/artifacts:11001
|
|
79 |
+ server-cert: server.crt
|
|
80 |
+ # Add a cache to push/pull to/from
|
|
81 |
+ - url: https://artifacts.com/artifacts:11002
|
|
82 |
+ server-cert: server.crt
|
|
83 |
+ client-cert: client.crt
|
|
84 |
+ client-key: client.key
|
|
60 | 85 |
push: true
|
86 |
+ # Add another cache to pull from
|
|
87 |
+ - url: https://ourprojectcache.com/artifacts:8080
|
|
88 |
+ server-cert: project_server.crt
|
|
89 |
+ |
|
90 |
+ |
|
91 |
+.. note::
|
|
92 |
+ |
|
93 |
+ Caches listed here will be considered a higher priority than those specified
|
|
94 |
+ by the project. Furthermore, for a given list of URLs, earlier entries will
|
|
95 |
+ have higher priority.
|
|
96 |
+ |
|
97 |
+ |
|
98 |
+Notice that the use of different ports for the same server distinguishes between
|
|
99 |
+pull only access and push/pull access. For information regarding this and the
|
|
100 |
+server/client certificates and keys, please see:
|
|
101 |
+:ref:`Key pair for the server <server_authentication>`.
|
|
61 | 102 |
|
62 |
-Caches listed here will be considered higher priority than those specified
|
|
63 |
-by the project.
|
|
64 | 103 |
|
65 |
-If you give a list of URLs, earlier entries in the list will have higher
|
|
66 |
-priority than later ones.
|
|
67 | 104 |
|
68 | 105 |
Strict build plan
|
69 | 106 |
~~~~~~~~~~~~~~~~~
|
... | ... | @@ -98,6 +98,8 @@ Command reference |
98 | 98 |
:prog: bst-artifact-server
|
99 | 99 |
|
100 | 100 |
|
101 |
+.. _server_authentication:
|
|
102 |
+ |
|
101 | 103 |
Key pair for the server
|
102 | 104 |
~~~~~~~~~~~~~~~~~~~~~~~
|
103 | 105 |
|
... | ... | @@ -237,52 +239,12 @@ We can then check if the services are successfully running with: |
237 | 239 |
For more information on systemd services see:
|
238 | 240 |
`Creating Systemd Service Files <https://www.devdungeon.com/content/creating-systemd-service-files>`_.
|
239 | 241 |
|
240 |
-User configuration
|
|
241 |
-~~~~~~~~~~~~~~~~~~
|
|
242 |
-The user configuration for artifacts is documented with the rest
|
|
243 |
-of the :ref:`user configuration documentation <user_config>`.
|
|
244 |
- |
|
245 |
-Note that for self-signed certificates, the public key fields are mandatory.
|
|
246 |
- |
|
247 |
-Assuming you have the same setup used in this document, and that your
|
|
248 |
-host is reachable on the internet as ``artifacts.com`` (for example),
|
|
249 |
-then a user can use the following user configuration:
|
|
250 |
- |
|
251 |
-Pull-only:
|
|
252 |
- |
|
253 |
-.. code:: yaml
|
|
254 |
- |
|
255 |
- #
|
|
256 |
- # Artifacts
|
|
257 |
- #
|
|
258 |
- artifacts:
|
|
259 |
- |
|
260 |
- url: https://artifacts.com:11001
|
|
261 |
- |
|
262 |
- # Optional server certificate if not trusted by system root certificates
|
|
263 |
- server-cert: server.crt
|
|
242 |
+Declaring remote artifact caches
|
|
243 |
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
244 |
+Remote artifact caches can be declared within either:
|
|
264 | 245 |
|
265 |
-Pull and push:
|
|
266 |
- |
|
267 |
-.. code:: yaml
|
|
268 |
- |
|
269 |
- #
|
|
270 |
- # Artifacts
|
|
271 |
- #
|
|
272 |
- artifacts:
|
|
273 |
- |
|
274 |
- url: https://artifacts.com:11002
|
|
275 |
- |
|
276 |
- # Optional server certificate if not trusted by system root certificates
|
|
277 |
- server-cert: server.crt
|
|
278 |
- |
|
279 |
- # Optional client key pair for authentication
|
|
280 |
- client-key: client.key
|
|
281 |
- client-cert: client.crt
|
|
282 |
- |
|
283 |
- push: true
|
|
284 |
- |
|
285 |
-.. note::
|
|
246 |
+1. The :ref:`project configuration <project_essentials_artifacts>`, or
|
|
247 |
+2. The :ref:`user configuration <config_artifacts>`.
|
|
286 | 248 |
|
287 |
- Equivalent statements can be delcared in a project's configuration file
|
|
288 |
- (the ``project.conf``).
|
|
249 |
+Please follow the above links to see examples showing how we declare remote
|
|
250 |
+caches in both the project configuration and the user configuration, respectively.
|