[Notes] [Git][BuildStream/buildstream][jjardon/max-jobs] buildstream/_project.py: Restrict max-jobs

[Javier Jardón <gitlab mg gitlab com>]

Title: GitLab

Javier Jardón pushed to branch jjardon/max-jobs at BuildStream / buildstream

Commits:

• 3e5367af
  by Javier Jardón at 2018-08-09T12:59:10Z

  buildstream/_project.py: Restrict max-jobs
  
  even if the machine have mores cores available
  
  Patch taken from YBD: https://gitlab.com/baserock/ybd/blob/master/ybd/app.py#L227
  

1 changed file:

• buildstream/_project.py

Changes:

buildstream/_project.py

---

...	...	@@ -572,7 +572,10 @@ class Project():
572	572
573	573	# Extend variables with automatic variables and option exports
574	574	# Initialize it as a string as all variables are processed as strings.
575		- output.base_variables['max-jobs'] = str(multiprocessing.cpu_count())
	575	+ # Based on some testing (mainly on AWS), maximum effective
	576	+ # max-jobs value seems to be around 8-10 if we have enough cores
	577	+ # users should set values based on workload and build infrastructure
	578	+ output.base_variables['max-jobs'] = str(min(multiprocessing.cpu_count(), 8))
576	579
577	580	# Export options into variables, if that was requested
578	581	output.options.export_variables(output.base_variables)

—
View it on GitLab.
You're receiving this email because of your account on gitlab.com. If you'd like to receive fewer emails, you can adjust your notification settings.