Saturday, April 4, 2009

MOINC - Yes. It Scales!


The MOINC gang was in high spirits after the successful completion of presentations and a fully set up demonstration of a MOINC deployment as part of our final year project evaluation. We were so overwhelmed by the way things went and we were certain that what we tried to achieve by coming up with the architectural prototype - MOINC was definitely going to drive future web services deployments big time!

With that highly ambitious perception, we wanted to try and press MOINC to its limits in a small environment within our control and actually see how scalable it can be. So, once the final year exams were over and before we set off on our industrial career paths, we thought to give it a shot using a number of computers from a lab of our department – the Department of Computer Science & Engineering (CSE), University of Moratuwa.

By the way, in case you are new to MOINC, in the most concise way I can put it, “it is an attempt to blend Web Services with Grid and Volunteer Computing concepts in order to make future Web Services deployments highly available and scalable while bringing the computing costs down and making use of unused computing power.” Hmm… I guess that covers it. :)

We got together on 13th March 2009 and managed to get access to the Advance Computing Laboratory of CSE which houses around 60 computers. In this phase our plan was to make as much as concurrent requests to a highly computationally intensive web service and see how the web services deployment can scale to cater the requests. We used a web service which performs an Insertion Sort on a collection of 75000 numbers.

We installed the MOINC Agent application on 20 computers in the lab, and ran the MOINC Server and service client on one laptop, the default WSAS node on another laptop and the URL repository and Server Manager on another laptop. The we gradually increased the number of concurrent requests and at the point of total failure to respond, we increased the grid size and restarted sending in requests in an increasing order.

The results were amazing, and turned out just the way we wanted!!! It was really electrifying for us to see the MOINC screen saver running on all monitors when the deployment was running on full capacity. We collected a set of statistics and will be coming up with a research paper about our working prototype pretty soon.

Check out what Hiranya has to say about our test session in his Tech Feast.

Here are few snaps of what happened on that day.

- MOINC Agents running...

- default WSAS node (running on my lappy ;))

- Just about to join the grid.

- 50% of the team. (L to R)Dinusha, Isuru, Rusiru, Aravinda (me) & Hiranya


Take a look at how scalability increases with the size of the grid.



My heartiest thanks go out to all the MOINC team members who turned up for the test and I would also like to thank Mrs. Vishaka Nanayakkara – Head, CSE and Mr. Ananda Fransiscu who is in charge of the Advance Computing Lab for all the support given to this test session.

MOINC has proven its capabilities, but this is not the end!

It has a long way to go. A VERY long way…! Oh yeah! ;)


3 comments:

Nimal said...

Cool stuff... Sounds really interesting..!

Anonymous said...

Wow... nice to hear... Great work Team Moinc.

Charith said...

Cool , Another great work from CSE SriLanka