PDA

View Full Version : TN-Grid (aka Gene@home)


Coleslaw
31st October 2016, 01:26 PM
http://gene.disi.unitn.it/test/index.php

About TN-Grid

TN-Grid is a platform that uses Internet-connected computers to do research in various scientific projects. You can participate by downloading and running a free program on your computer. TN-Grid is based at the Research Area of Trento of the National Research Council of Italy (CNR (http://www.cnr.it)) and currently hosted by the University of Trento (UNITN (http://www.unitn.it)). The first project we host is


gene@home (http://gene.disi.unitn.it/test/genehome/index.php), in collaboration with Fondazione Edmund Mach (FEM (http://www.fmach.it/)) and the Department of Information Engineering and Computer Science (DISI (http://www.disi.unitn.it/)) of UNITN.


They just gave us permission to include the project. We should still do a stress test challenge.

http://i1364.photobucket.com/albums/r723/cuarc001/DC-Vault/tn-grid%20vault%20approval_zpsnofcz2xx.png

They have posted their invite code on their home page for those having trouble joining.

I ran a lot of work testing this project and found the work to be quite stable. However, at that time they knew their servers couldn't handle a large load. They have made some changes and feel that they are now ready. I will post back soon with a challenge date for stress testing.

Since they have been testing genes in plants, I am recommending it be added to the physical sciences category. We are heavily light in the Bio/Medical category if anyone knows of any solid projects that may need included.

StyM
1st November 2016, 09:05 AM
added this to boinc http://gene.disi.unitn.it/test/index.php , but i'm not able to receive any task.

Coleslaw
1st November 2016, 04:08 PM
Have you already created an account from their website?

StyM
1st November 2016, 05:03 PM
everything is working now.

Beyond
2nd November 2016, 04:57 PM
Just created an account and have a few WUs running on various platforms. Will report back if/when they complete. Looking at other hosts the WUs appear to be reliable. I will say that it would be nice to have another Bio project. We're getting a little thin: down to just 3 after the demise of POEM.

Edit: I think the Bio and Medical Science category is far more appropriate than Physical Science for this project. Genes are biological entities and if we read the goals of the project:
This project investigates one of the important topics in bioinformatics, the causal relationships among genes. The algorithm presented in this research is tested on plants, namely Arabidopsis thaliana.
Some of the reasons that can be considered to help in this research are the following:
1) In the future, the algorithm is expected to be used in gene networks investigation on animals and eventually on humans. The result of this research could contribute to the development of medical science.

http://gene.disi.unitn.it/test/genehome/en/joinus/5reasons.php

Also some of the initial research has already been on E. coli, which is most likely aimed at usefulness for medical research:

http://gene.disi.unitn.it/test/forum_thread.php?id=121

http://gene.disi.unitn.it/test/forum_thread.php?id=115

Coleslaw
3rd November 2016, 12:49 PM
Yeah... I meant to edit that to Bio/Medical but the site was having problems and wouldn't allow it.

Beyond
4th November 2016, 06:29 PM
Just created an account and have a few WUs running on various platforms. Will report back if/when they complete. Looking at other hosts the WUs appear to be reliable. I will say that it would be nice to have another Bio project. We're getting a little thin: down to just 3 after the demise of POEM.
After completing 600+ WUs on 12 machines, this project seems exceptionally smooth. Various Intel and AMD platforms all work great. Website, UL and DL times are fast. I like it.

Coleslaw
4th November 2016, 09:41 PM
There is a PrimeGrid challenge and the WCG Birthday challenge coming up in a few weeks. I may issue the stress test for after the WCG challenge. I will post back when I decide.

Rusty
4th November 2016, 09:50 PM
Not sure WTF is going on with editing.

NMA
30th November 2016, 02:49 PM
Any update on this?

Coleslaw
1st December 2016, 12:57 PM
I'm planning on issuing a stress test challenge in January to avoid the holiday season and some of the challenges that normally take place in December. I will post again when I have a date set.

DigiK-oz
3rd December 2016, 10:19 AM
Looks like someone else beat you to it :p. Let's see if this will show us enough about stability and performance.

TN-Grid Platform: First international challenge on TN-Grid
The BOINC.Italy Team has opened the first international challenge on this project.

Title: "Despite my age I don't live in the past, but in the future" 4th Rita Levi-Montalcini memorial and 30 years from Nobel Prize.

Start 10 Dec 16.00 UTC - End 16 Dec 16.00 UTC

Check http://boincstats.com/en/stats/challenge/team/chat/831 for more info.
12/2/2016 5:08:39 PM more... (http://gene.disi.unitn.it/test/forum_thread.php?id=132)

Beyond
3rd December 2016, 02:40 PM
I've been running TN-Grid for a month now and have well over 6000 WUs completed. Only 1 error and that was my fault (swapping in a couple new GPUs that needed updated drivers). This is one of the most stable projects I've run: solid, fast connectivity, reliable, plenty of work. Not to mention that it seems to be a valuable project in the Bio category (where we're light). Lots of information in the forum and active participation by the scientists. They just installed a ram, CPU and storage upgrade on the server. If I had more than 2 thumbs they'd all be up. :)

Coleslaw
3rd December 2016, 08:24 PM
Looks good enough for me. Let's see if we can break them. :)

Beyond
25th December 2016, 03:30 PM
Looks like someone else beat you to it :p. Let's see if this will show us enough about stability and performance.

TN-Grid Platform: First international challenge on TN-Grid
The BOINC.Italy Team has opened the first international challenge on this project.

Title: "Despite my age I don't live in the past, but in the future" 4th Rita Levi-Montalcini memorial and 30 years from Nobel Prize.

Start 10 Dec 16.00 UTC - End 16 Dec 16.00 UTC

Check http://boincstats.com/en/stats/challenge/team/chat/831 for more info.
12/2/2016 5:08:39 PM more... (http://gene.disi.unitn.it/test/forum_thread.php?id=132)
Looks like the project came through the challenge with flying colors. Time to add it?

Merry Christmas everyone!!!

Coleslaw
26th December 2016, 03:04 PM
Rusty is working on it. We see no reason not to add it at this time. It will more than likely be added to the bio/medical for now. Based on their description, it could be moved to Misc. in the future depending on what they add to the project.

Beyond
26th December 2016, 04:21 PM
So far it's been GENE@HOME which is obviously a Bio project. I suppose that could change sometime in the future though.

Rusty
4th January 2017, 09:19 AM
I am so sorry guys. I have a lot of personal problems at home. I promise I will add it asap

DigiK-oz
4th January 2017, 04:37 PM
No worries Rusty, some things have priority, even over DC-Vault :p

Kidding...good luck in sorting out your personal issues.

Beyond
5th January 2017, 05:16 PM
No worries Rusty, some things have priority, even over DC-Vault :p
Kidding...good luck in sorting out your personal issues.
+1

Coleslaw
6th January 2017, 01:45 PM
Looks like Rusty got it added. Now just waiting for the stats to show.

Coleslaw
6th January 2017, 08:12 PM
And the stats are updating. Thanks Rusty .

iconized
9th February 2017, 12:53 PM
No work at the moment.

Beyond
9th February 2017, 02:59 PM
From the admin:
We are almost done with the Ec (Escherichia coli mono) experiment. As many of you have probably noticed we were switching to another organism (Vv, Vitis Vinifera). Complex organisms have a larger genome (our Ec dataset contains ~4000 genes, the Vv one ~28000). The application basically finds one-to-one interactions between all the genes of the dataset, so the output file is bigger on more complex organisms.

This is obviously a problem. A ~30 minutes run will produce a ~6 Mb output file (gzipped). Many people around the world simply don't have enough internet bandwidth to handle this. This is also a problem for us (more hard disk storage used).

The only way to solve this is to rethink the way the output file is built, maybe with some kind of filtering. But this means rewriting the application output code, i.e. it will take time to do this.

In the meanwhile we stopped the Vv experiment and are switching back to the dream5 experiment (see the science section of the forum) which is also based on Ec (smaller output file)

Thanks all for your understanding.

[edit] You may notice some workunits shortage in the meanwhile
http://gene.disi.unitn.it/test/forum_thread.php?id=157#884

Coleslaw
10th February 2017, 04:31 PM
Also from the admin
Yep, the work generator is running, making Vv workunits, but at this moment it is not able to handle all the requests. Its speed is about 332 new workunits every 9 minutes. I guess that we have to optimize it a little bit ....

Which is something we need to consider here. I think we should watch it a bit longer to see what they come up with or if they simply just take too long to address it.

This is what I have to watch out for, but it isn't a DC-Vault concern.
You have to think about the scale of things though.

Let's go with a user with 100 cores to offer(since I have around that many and that's how I did the math since it was easy),and each WU only takes 30 minutes and makes that 6MB output file.

That's 1.2GB to upload every hour. ~29GB every day. ~864GB per month.

For someone with a lot more compute power that could really scale out. It looks like you have ~500 cores,and while I'm sure that's spread out across projects if you only ran this project and those Vv WUs you would end up using terabytes of upload per month....and I'm pretty sure your ISP would be giving you a call at that point.


Not to mention what it would be like to the computer at the other end of that. The server status shows ~13K tasks underway,so imagining that as the core count of all end users,scale that out. That's terabytes of transfer PER DAY.'

Beyond
12th February 2017, 03:21 PM
Seems like new work generation is currently keeping up with demand. FWIW I haven't noticed any problem getting work all along. The RACs of various teams also seem to have been holding fairly stable. Sure is easier to get consistent work at TN-Grid than at some of the other Vault projects. SETI and GPUGrid work is often spotty and GoofyXGrid seems to have consistent problems generating work and keeping their server running (in fact it'd down again right now).

NMA
12th February 2017, 03:25 PM
I'm still having issues getting TN-Grid work. Some systems are working fine while others won't get any work.

DigiK-oz
13th February 2017, 01:11 PM
They are facing an issue causing a WU shortage. Should be fixed shortly according to admin.

Bill
3rd April 2017, 03:36 AM
New Updates on site from Admin regarding updates and volume increases. They have work available.

Bill F

Bill
25th May 2017, 11:55 PM
Well the project has had steady work and the testers and developers are working to optimize the current 1.02 App. Message board indicates that an upgraded App will be released at the end of May.

Credits have been steady and user base is increasing (still small for number of Active users).

So far I have had only one issue and that involved a batch of WU's that had download issues since then no issues.

Bill F