Meandre

Meandre (NCSA pushed data-intensive computing infrastructure) relies on RDF to describe components, flows, locations and repositories. RDF has become the central piece that makes possible Meandre’s flexibility and reusability. However, one piece still remains largely sketchy and still has no clear optimal solution: How can we facilitate to anybody sharing, publishing and annotating flows, components, locations and repositories? More importantly, how can that be done in the cloud in an open-ended fashion and allow anybody to annotate and comment on each of the afore mentioned pieces? ...

Below you may find the slides I used during GECCO 2009 to present the paper titled “Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre”. An early preprint in form of technical report can be found as an IlliGAL TR No. 2009001 or the full paper at the ACM digital library

by Llorà, X. IlliGAL technical report 2009001. You can download the pdf here. Abstract: Data-intensive computing has positioned itself as a valuable programming paradigm to efficiently approach problems requiring processing very large volumes of data. This paper presents a pilot study about how to apply the data-intensive computing paradigm to evolutionary computation algorithms. Two representative cases—selectorecombinative genetic algorithms and estimation of distribution algorithms—are presented, analyzed, discussed. This study shows that equivalent data-intensive computing evolutionary computation algorithms can be easily developed, providing robust and scalable algorithms for the multicore-computing era. Experimental results show how such algorithms scale with the number of available cores without further modification. ...

Yesterday I just got to New Orleans for the Internet2 fall meeting. I was invited to give a talk about work we are doing on the SEASR project at NCSA. SEASR fosters collaboration through empowering scholars to share data and research in virtual work environments. The SEASR project is funded by the Andrew W. Mellon Foundation. The last part of the week I will be at San Francisco joining the Project Bamboo workshop, again representing the SEASR project seeking a better understanding of possible synergies. ...

One of the benefits of working with people smarter than you is the chance to never stop learning. My office mate, Bernie Ács, is an extraordinary source of experience and wisdom on production systems. Just right after coming back from vacation, he started unfolding a virtualized solution for high availability and load balancing of services. It is not me the one who should disclose the solution, but I just want to mention a piece of the puzzle that I found very interesting: ldirectord. In the words of the ldirectord developers: ...