Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
World Community Grid Forums
Category: Community Forum: Chat Room Thread: Ramdisk to decrease SSD usage |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 21
|
Author |
|
fragiggle
Cruncher Joined: Jan 7, 2014 Post Count: 12 Status: Offline Project Badges: |
software: SoftPerfect RAM Disk
Cpu: i7 4771 Ram: Crucial sport ultra low profile, 8gb, 1600 single channel My usual ram usage is just barely 4gb, so the absolute largest I could make the ramdisk was 3.5 gb. Boinc runs out of space on that rather quickly and I have tried to look this up but can't find it. Is there a way to make Boinc or CEP2 only use the ramdisk for projects being worked on and store everything else on the SSD? like all of the tasks 'ready to start,' the qchem software, boinc install files and everything else that doesn't get modified very frequently. I have ordered another 8 gb of ram and was intending on using 6GB of that for a ramdisk, but need an extra 4 for the program I ordered the ram for. So I am stuck again at 4 gb size limit. |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
There are a number of recent discussion threads on the topic. Just enter ramdisk in the search box.
Splitting is not possible, that is, the boinc agent software can be installed in the normal place and the boinc datadir to your ramdisk, but no subdivision of the datadir. Hopefully all coming and future projects make use of symbol linked set-up of task slots. This way only one master copy exists of the application software. Currently for cep2 a full copy is created for each task started. Mcm is the first one using symbol linking. Not paid attention if the coming ugm does too. Hope so. |
||
|
KLiK
Master Cruncher Croatia Joined: Nov 13, 2006 Post Count: 3103 Status: Offline Project Badges: |
also, with 16GB on normal system...why would you need a SWAP file? so that would speed up the processes & r/w on SSD...
---------------------------------------- |
||
|
Crystal Pellet
Veteran Cruncher Joined: May 21, 2008 Post Count: 1294 Status: Offline Project Badges: |
fragiggle wrote:
----------------------------------------software: SoftPerfect RAM Disk Thanks for sharing this RAM Disk utility.I was using RAMDisk from Dataram Corporation, but their free version is limited to 4GB. With Dataram version I could run only 2 CEP's together and with some hanky panky 3, when I first loaded the tasks on the normal HD and moved them before the start to RAMDisk. SoftPerfect doesn't have a limit (other then available RAM ). Now I created a RAM of 6144MB and can run 6 CEP's together. Asking for a 7th task, I got: RAM 261 World Community Grid 10 Oct 13:21:38 Message from server: The Clean Energy Project - Phase 2 needs 480.24MB more disk space. You currently have 2079.76 MB available and it needs 2560.00 MB. With 7GB RAM Disk (16GB total available), I suppose you may run 8 CEP's (8 threads on the i7 HT on) |
||
|
Yarensc
Advanced Cruncher USA Joined: Sep 24, 2011 Post Count: 134 Status: Offline Project Badges: |
why would you need a SWAP file? so that would speed up the processes & r/w on SSD... Agreed, the extra RAM should eliminate (at least most of the time) the need for memory to be stored on the disk, removing most of the toll WCG would take on the SSD. Now, if you wanted to run it on a RAMDisk anyways to remove the new WU and checkpoint I/O, I seem to recall and option that allows you can run two different clients. You could set one to use the RAMDisk and have its profile set to only CEP and half the cores with the other profile running your other projects on the SSD, also set to half the cores. I believe this is what you want <allow_multiple_clients>0|1</allow_multiple_clients> allow multiple BOINC clients to run on a single host. Each must run in a different data directory. http://boinc.berkeley.edu/wiki/Client_configuration |
||
|
fragiggle
Cruncher Joined: Jan 7, 2014 Post Count: 12 Status: Offline Project Badges: |
also, with 16GB on normal system...why would you need a SWAP file? so that would speed up the processes & r/w on SSD... Agreed, the extra RAM should eliminate (at least most of the time) the need for memory to be stored on the disk, removing most of the toll WCG would take on the SSD. I thought this was true initially, though my ram usage never goes above 4gb with system processes included. As far as I can tell CEP2 does all the work directly to the file, not to one in ram. My Hard drive I/O is always completely packed. this is why I am going this route. Thanks for sharing this RAM Disk utility You're welcome, It took me a tad to find one that would go over 4gb and have a huge speed increase over the other. here was my most helpful source https://www.raymond.cc/blog/12-ram-disk-softw...est-read-and-write-speed/ |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
snip quote
I believe this is what you want <allow_multiple_clients>0|1</allow_multiple_clients> allow multiple BOINC clients to run on a single host. Each must run in a different data directory. http://boinc.berkeley.edu/wiki/Client_configuration That's indeed a roundabout way to split running tasks and their project data, but where cep2 is huge, the other projects are peanuts by comparison iow, complicating the installation and increasing processing overhead with little gain to show for. Not sure, but you have to meddle with rpc ports too, where 31416 is default, so you have to assign another, usually 31417 etc. At any rate, you could monitor both from one boinc manager by doing 127.0.0.1:31416 or 127.0.0.1:31417, something like that, or simultaneous with boinctasks. |
||
|
Yarensc
Advanced Cruncher USA Joined: Sep 24, 2011 Post Count: 134 Status: Offline Project Badges: |
my ram usage never goes above 4gb with system processes included. As far as I can tell CEP2 does all the work directly to the file, not to one in ram. My Hard drive I/O is always completely packed. this is why I am going this route. Is that your total RAM usage, or just what's actively in use? In the windows 7 task manager it only shows what's actively in use, often with just as much marked as inactive/can be written to disk. If you're on Windows 8 it has a bar for both in task manager. If your running Windows 7 you need to open resource monitor (there's a link on the performance tab in task manager). I believe CEP should only write to disk when checkpointing and when WU's start/end(not counting the above RAM discussion of course). Lavaflow: I don't know if the 2 client method is efficient or not, I've just seen it mentioned when people were trying to run RAMDisk's before. I assume somewhere on the Internet exists a guide to do it, including the good points you made. [Edit 1 times, last edit by Yarensc at Oct 10, 2014 8:02:51 PM] |
||
|
Crystal Pellet
Veteran Cruncher Joined: May 21, 2008 Post Count: 1294 Status: Offline Project Badges: |
With 7GB RAM Disk (16GB total available), I suppose you may run 8 CEP's (8 threads on the i7 HT on) Nope! Requesting task 8:CEP2 needs 167.24MB more disk space. You currently have 2392.76 MB available and it needs 2560.00 MB. |
||
|
fragiggle
Cruncher Joined: Jan 7, 2014 Post Count: 12 Status: Offline Project Badges: |
my ram usage never goes above 4gb with system processes included. As far as I can tell CEP2 does all the work directly to the file, not to one in ram. My Hard drive I/O is always completely packed. this is why I am going this route. Is that your total RAM usage, or just what's actively in use? In the windows 7 task manager it only shows what's actively in use, often with just as much marked as inactive/can be written to disk. If you're on Windows 8 it has a bar for both in task manager. If your running Windows 7 you need to open resource monitor (there's a link on the performance tab in task manager). I believe CEP should only write to disk when checkpointing and when WU's start/end(not counting the above RAM discussion of course). Lavaflow: I don't know if the 2 client method is efficient or not, I've just seen it mentioned when people were trying to run RAMDisk's before. I assume somewhere on the Internet exists a guide to do it, including the good points you made. You know what, I never realized that the standard task manager only shows actively used ram. I have been using the performance monitor and that is how I noticed the big SSD usage. I have now educated myself better on this issue and have discovered something interesting. I have 16 gb ram installed now and felt like this was the perfect time to do some experimenting. without reformatting my pc I just suspened everything, i think i rebooted but didn't make a note of it and got this result. then I let boinc run for a bit and got this then I tried a few things starting it, then deleting everything and putting it on a ramdisk then my whole computer wouldn't turn on. booted into linux and just deleted the ramdisk and tried again didn't work so I backed up my user file and that's it and reformatted everything. tried installing all updates, my standard security software and drivers. rebooting then setting a 6 gb ramdisk, installed boinc and everything appeared to be working great, but then system instability occured and I recieved a blue screen of death followed by a no boot, so I tried deleting the ramdisk again, this time with success. Now i'm on this system and just installed boinc regularly. During this I lost the screenshots I thought I had saved but just weren't there. It showed that the pagefile on the drive became the most used when nothing else was in use. I just took a screenshot of my current results and it kind of surprises me what I see. Before the reformat the ram usage was about the same but the standby was much less. I have recently observed the standby take up all the remaining ram, which doesn't seem to be a problem with my systems stability. I think going over this with a ramdisk may be why I experienced such bad issues. or it might be the ramdisk software. I believe that if I had more ram, like 32gb, there would be absolutely no issue with this. but like always, I love to hear other viewpoints. So far I'm just looking at upgrading ram again (edit: and doing a ramdisk of 8gb) so I won't have to buy a new SSD anytime soon [Edit 1 times, last edit by fragiggle at Oct 11, 2014 8:38:59 PM] |
||
|
|