[Notes] [Git][BuildStream/buildstream][jjardon/max-jobs] buildstream/_project.py: Restrict max-jobs

[Javier Jardón <gitlab mg gitlab com>]

Title: GitLab

Javier Jardón pushed to branch jjardon/max-jobs at BuildStream / buildstream

Commits:

• e5d8fd7e
  by Javier Jardón at 2018-08-09T13:30:34Z

  buildstream/_project.py: Restrict max-jobs
  
  even if the machine have mores cores available
  
  Patch taken from YBD: https://gitlab.com/baserock/ybd/blob/master/ybd/app.py#L227
  

1 changed file:

• buildstream/_project.py

Changes:

buildstream/_project.py

---

...	...	@@ -571,7 +571,10 @@ class Project():
571	571
572	572	# Extend variables with automatic variables and option exports
573	573	# Initialize it as a string as all variables are processed as strings.
574		- output.base_variables['max-jobs'] = str(len(os.sched_getaffinity(0)))
	574	+ # Based on some testing (mainly on AWS), maximum effective
	575	+ # max-jobs value seems to be around 8-10 if we have enough cores
	576	+ # users should set values based on workload and build infrastructure
	577	+ output.base_variables['max-jobs'] = str(min(len(os.sched_getaffinity(0)), 8))
575	578
576	579	# Export options into variables, if that was requested
577	580	output.options.export_variables(output.base_variables)

—
View it on GitLab.
You're receiving this email because of your account on gitlab.com. If you'd like to receive fewer emails, you can adjust your notification settings.