GPars and Clusters

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

GPars and Clusters

Russel Winder-3
For a long while GPars only dealt with a single JVM, although there had
been experiments by Alex Tkachman to create distributed objects. As I
hope everyone is aware Rafał Sławik (as a GSoC project) took the
untouched for a long while work of Alex, and made it all work, giving
GPars remote actors, dataflow operators and agents.

The question arises whether GPars should integrate in some way with
Hadoop or Apache Spark as well as doing what it already does. Or maybe
Hadoop and Apache Spark usage from Groovy needs no extra support?
 
--
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:[hidden email]
41 Buckmaster Road    m: +44 7770 465 077   xmpp: [hidden email]
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

signature.asc (188 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: GPars and Clusters

Paolo Di Tommaso
This is intriguing, what's your idea? To allow dataflow operators and agents to be distributed on top of a Spark cluster? 

It may be really interesting from my point of view.


Cheers,
Paolo


On Tue, Jan 27, 2015 at 11:36 AM, Russel Winder <[hidden email]> wrote:
For a long while GPars only dealt with a single JVM, although there had
been experiments by Alex Tkachman to create distributed objects. As I
hope everyone is aware Rafał Sławik (as a GSoC project) took the
untouched for a long while work of Alex, and made it all work, giving
GPars remote actors, dataflow operators and agents.

The question arises whether GPars should integrate in some way with
Hadoop or Apache Spark as well as doing what it already does. Or maybe
Hadoop and Apache Spark usage from Groovy needs no extra support?

--
Russel.
=============================================================================
Dr Russel Winder      t: <a href="tel:%2B44%2020%207585%202200" value="+442075852200">+44 20 7585 2200   voip: [hidden email]
41 Buckmaster Road    m: <a href="tel:%2B44%207770%20465%20077" value="+447770465077">+44 7770 465 077   xmpp: [hidden email]
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder