Re: [Vala] Parallel programming in Vala?

[Al Thomas <astavale yahoo co uk>]

> ________________________________
> From: Costas Smaragdakis <kesmarag gmail com>
> Sent: Tuesday, 27 May 2014, 13:50
> Subject: Re: [Vala] Parallel programming in Vala?
>
>
> I would like to share the processes on multiple computers through
> typical network.
> If you want a distributed computing environment then Hadoop may be worth considering. It seems to be in 
> demand at the moment so may help with a post-doctorate job too! Hadoop is distributed file system and Java 
> based distributed process control system.

Hadoop also has a process called streaming that allows data to be processed by arbitrary binaries and 
scripts, and this could include Vala produced binaries. Not sure how this fits into Hadoop2 though, but a few 
links that I have bookmarked:

http://wiki.apache.org/hadoop/HadoopStreaming
http://www.glennklockwood.com/di/hadoop-streaming.php

Some comments on its application to scientific computing:

http://hortonworks.com/blog/hadoop-in-perspective-systems-for-scientific-computing/
http://www.slideshare.net/hortonworks/large-scale-math-with-hadoop-mapreduce

And at the really rough edge you could even try GPU computing nodes with OpenCL and Vala:

http://www.slideshare.net/DevCentralAMD/is-4011-zubindowlaty
http://dummdida.blogspot.co.uk/2011/11/wrapping-opencl-with-vala.html
https://gitorious.org/valastuff/vapis/source/d879797216778030f3a281f6d27d157c7fa1f76d:vapis/OpenCL.vapi
http://blogs.igalia.com/elima/2013/05/06/introducing-gocl-a-gobject-wrapper-to-opencl/
https://github.com/elima/gocl

If you ever do this, then a blog post to the world would be very interesting on how far you got.

Al