The European Middleware Initiative (EMI) is a close collaboration of the three major middleware providers, ARC, gLite and UNICORE, and other specialized software providers like dCache. It will deliver a consolidated set of middleware components for deployment in EGI (as part of the Unified Middleware Distribution - UMD), PRACE and other DCIs, extend the interoperability and integration with emerging computing models, strengthen the reliability and manageability of the services and establish a sustainable model to support, harmonise and evolve the middleware, ensuring it responds effectively to the requirements of the scientific communities relying on it.
Please visit the contacts page.
EMI services used in neuro-scientific grand challenge
October 3, 2011
EMI  teamed-up with a number of projects in a large-scale trans-continental scientific computing challenge. LINGA (LInked Neuroscientific Grand chAllenge) is the first data and compute challenge involving neuro-scientific infrastructures from two continents – neuGRID  (Europe), CBRAIN  (North America) and LONI  (North America), and distributed computing infrastructures – EGI’s Life Science Computing Grid  (LSCG, Europe) and EMI resources  (Europe). Some 11,000 brain scans from distributed neuro-centers were analyzed using computationally demanding image processing applications for marker discovery in neuro-degenerative diseases like Alzheimer’s.
The challenge is not only due to the scale and distributed nature of the data sets or the complexity of the image processing applications in use; the participating infrastructures use different underlying compute management technologies. SHIWA  and outGRID  projects developed a framework that orchestrates these heterogeneous infrastructures such that their underlying compute solutions are harnessed to process brain scans coming from different sources and handle different ‘stages’ of the image processing applications. Processing is done in parallel and asynchronously, with the aggregated output further processed by LSGC. Two important components are extracted to explain the outputs’ variability and potential correlations between individuals’ characteristics and the disease development. If this activity was run in a single neuro-scientific centre, it would have taken 50 days. Through this collaboration, the challenge concluded in seven days using 3,000 CPUs per processing cycle. The LINGA challenge was presented at the EGI Technical Forum 2011  where it won the Best Demonstration competition.
For this scientific challenge, EMI has made available its demonstration testbed with the latest services from EMI 1 Kebnekaise. Specifically the EMI services EMI-BDII (top and site), EMI-CREAM, EMI-WMS and EMI-WN provided one set of the compute technologies leveraged by the SHIWA-outGRID framework. This collaboration has been an excellent opportunity for EMI to showcase its first release, EMI 1 Kebnekaise, and is a good demonstration of the stability and usability of EMI 1 services for large-scale scientific research.
For more information, please contact: