Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 21
Posts: 21   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 15759 times and has 20 replies Next Thread
fragiggle
Cruncher
Joined: Jan 7, 2014
Post Count: 12
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Ramdisk to decrease SSD usage

software: SoftPerfect RAM Disk
Cpu: i7 4771
Ram: Crucial sport ultra low profile, 8gb, 1600 single channel
My usual ram usage is just barely 4gb, so the absolute largest I could make the ramdisk was 3.5 gb. Boinc runs out of space on that rather quickly and I have tried to look this up but can't find it.
Is there a way to make Boinc or CEP2 only use the ramdisk for projects being worked on and store everything else on the SSD? like all of the tasks 'ready to start,' the qchem software, boinc install files and everything else that doesn't get modified very frequently.

I have ordered another 8 gb of ram and was intending on using 6GB of that for a ramdisk, but need an extra 4 for the program I ordered the ram for. So I am stuck again at 4 gb size limit.
[Oct 10, 2014 4:39:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

There are a number of recent discussion threads on the topic. Just enter ramdisk in the search box.

Splitting is not possible, that is, the boinc agent software can be installed in the normal place and the boinc datadir to your ramdisk, but no subdivision of the datadir.

Hopefully all coming and future projects make use of symbol linked set-up of task slots. This way only one master copy exists of the application software. Currently for cep2 a full copy is created for each task started. Mcm is the first one using symbol linking. Not paid attention if the coming ugm does too. Hope so.
[Oct 10, 2014 7:01:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KLiK
Master Cruncher
Croatia
Joined: Nov 13, 2006
Post Count: 3103
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

also, with 16GB on normal system...why would you need a SWAP file? so that would speed up the processes & r/w on SSD...
----------------------------------------
oldies:UDgrid.org & PS3 Life@home


non-profit org. Play4Life in Zagreb, Croatia
[Oct 10, 2014 8:05:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1294
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

fragiggle wrote:
software: SoftPerfect RAM Disk
Thanks for sharing this RAM Disk utility.
I was using RAMDisk from Dataram Corporation, but their free version is limited to 4GB.
With Dataram version I could run only 2 CEP's together and with some hanky panky 3, when I first loaded the tasks on the normal HD and moved them before the start to RAMDisk.
SoftPerfect doesn't have a limit (other then available RAM wink ).
Now I created a RAM of 6144MB and can run 6 CEP's together. Asking for a 7th task, I got:

RAM 261 World Community Grid 10 Oct 13:21:38 Message from server: The Clean Energy Project - Phase 2 needs 480.24MB more disk space. You currently have 2079.76 MB available and it needs 2560.00 MB.

With 7GB RAM Disk (16GB total available), I suppose you may run 8 CEP's (8 threads on the i7 HT on)
----------------------------------------

[Oct 10, 2014 11:40:33 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Yarensc
Advanced Cruncher
USA
Joined: Sep 24, 2011
Post Count: 134
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

why would you need a SWAP file? so that would speed up the processes & r/w on SSD...


Agreed, the extra RAM should eliminate (at least most of the time) the need for memory to be stored on the disk, removing most of the toll WCG would take on the SSD.
Now, if you wanted to run it on a RAMDisk anyways to remove the new WU and checkpoint I/O, I seem to recall and option that allows you can run two different clients. You could set one to use the RAMDisk and have its profile set to only CEP and half the cores with the other profile running your other projects on the SSD, also set to half the cores.

I believe this is what you want
<allow_multiple_clients>0|1</allow_multiple_clients>
allow multiple BOINC clients to run on a single host. Each must run in a different data directory.
http://boinc.berkeley.edu/wiki/Client_configuration
[Oct 10, 2014 5:42:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
fragiggle
Cruncher
Joined: Jan 7, 2014
Post Count: 12
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

also, with 16GB on normal system...why would you need a SWAP file? so that would speed up the processes & r/w on SSD...

Agreed, the extra RAM should eliminate (at least most of the time) the need for memory to be stored on the disk, removing most of the toll WCG would take on the SSD.

I thought this was true initially, though my ram usage never goes above 4gb with system processes included. As far as I can tell CEP2 does all the work directly to the file, not to one in ram. My Hard drive I/O is always completely packed. this is why I am going this route.

Thanks for sharing this RAM Disk utility

You're welcome,
It took me a tad to find one that would go over 4gb and have a huge speed increase over the other. here was my most helpful source
https://www.raymond.cc/blog/12-ram-disk-softw...est-read-and-write-speed/
[Oct 10, 2014 5:57:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

snip quote
I believe this is what you want
<allow_multiple_clients>0|1</allow_multiple_clients>
allow multiple BOINC clients to run on a single host. Each must run in a different data directory.
http://boinc.berkeley.edu/wiki/Client_configuration

That's indeed a roundabout way to split running tasks and their project data, but where cep2 is huge, the other projects are peanuts by comparison iow, complicating the installation and increasing processing overhead with little gain to show for. Not sure, but you have to meddle with rpc ports too, where 31416 is default, so you have to assign another, usually 31417 etc. At any rate, you could monitor both from one boinc manager by doing 127.0.0.1:31416 or 127.0.0.1:31417, something like that, or simultaneous with boinctasks.
[Oct 10, 2014 6:52:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Yarensc
Advanced Cruncher
USA
Joined: Sep 24, 2011
Post Count: 134
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

my ram usage never goes above 4gb with system processes included. As far as I can tell CEP2 does all the work directly to the file, not to one in ram. My Hard drive I/O is always completely packed. this is why I am going this route.


Is that your total RAM usage, or just what's actively in use? In the windows 7 task manager it only shows what's actively in use, often with just as much marked as inactive/can be written to disk. If you're on Windows 8 it has a bar for both in task manager. If your running Windows 7 you need to open resource monitor (there's a link on the performance tab in task manager).

I believe CEP should only write to disk when checkpointing and when WU's start/end(not counting the above RAM discussion of course).


Lavaflow: I don't know if the 2 client method is efficient or not, I've just seen it mentioned when people were trying to run RAMDisk's before. I assume somewhere on the Internet exists a guide to do it, including the good points you made.
----------------------------------------
[Edit 1 times, last edit by Yarensc at Oct 10, 2014 8:02:51 PM]
[Oct 10, 2014 7:59:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1294
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

With 7GB RAM Disk (16GB total available), I suppose you may run 8 CEP's (8 threads on the i7 HT on)
Nope! Requesting task 8:

CEP2 needs 167.24MB more disk space. You currently have 2392.76 MB available and it needs 2560.00 MB.
----------------------------------------

[Oct 10, 2014 8:05:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
fragiggle
Cruncher
Joined: Jan 7, 2014
Post Count: 12
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Ramdisk to decrease SSD usage

my ram usage never goes above 4gb with system processes included. As far as I can tell CEP2 does all the work directly to the file, not to one in ram. My Hard drive I/O is always completely packed. this is why I am going this route.


Is that your total RAM usage, or just what's actively in use? In the windows 7 task manager it only shows what's actively in use, often with just as much marked as inactive/can be written to disk. If you're on Windows 8 it has a bar for both in task manager. If your running Windows 7 you need to open resource monitor (there's a link on the performance tab in task manager).

I believe CEP should only write to disk when checkpointing and when WU's start/end(not counting the above RAM discussion of course).


Lavaflow: I don't know if the 2 client method is efficient or not, I've just seen it mentioned when people were trying to run RAMDisk's before. I assume somewhere on the Internet exists a guide to do it, including the good points you made.


You know what, I never realized that the standard task manager only shows actively used ram. I have been using the performance monitor and that is how I noticed the big SSD usage. I have now educated myself better on this issue and have discovered something interesting.
I have 16 gb ram installed now and felt like this was the perfect time to do some experimenting. without reformatting my pc I just suspened everything, i think i rebooted but didn't make a note of it and got this result.

then I let boinc run for a bit and got this

then I tried a few things starting it, then deleting everything and putting it on a ramdisk then my whole computer wouldn't turn on. booted into linux and just deleted the ramdisk and tried again didn't work so I backed up my user file and that's it and reformatted everything. tried installing all updates, my standard security software and drivers. rebooting then setting a 6 gb ramdisk, installed boinc and everything appeared to be working great, but then system instability occured and I recieved a blue screen of death followed by a no boot, so I tried deleting the ramdisk again, this time with success. Now i'm on this system and just installed boinc regularly. During this I lost the screenshots I thought I had saved but just weren't there. It showed that the pagefile on the drive became the most used when nothing else was in use.
I just took a screenshot of my current results and it kind of surprises me what I see.

Before the reformat the ram usage was about the same but the standby was much less. I have recently observed the standby take up all the remaining ram, which doesn't seem to be a problem with my systems stability. I think going over this with a ramdisk may be why I experienced such bad issues. or it might be the ramdisk software. I believe that if I had more ram, like 32gb, there would be absolutely no issue with this.
but like always, I love to hear other viewpoints. So far I'm just looking at upgrading ram again (edit: and doing a ramdisk of 8gb) so I won't have to buy a new SSD anytime soon
----------------------------------------
[Edit 1 times, last edit by fragiggle at Oct 11, 2014 8:38:59 PM]
[Oct 11, 2014 8:13:32 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 21   Pages: 3   [ 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread