AOA Forums AOA Forums AOA Forums Folding For Team 45 AOA Files Home Front Page Become an AOA Subscriber! UserCP Calendar Memberlist FAQ Search Forum Home


Go Back   AOA Forums > General > ThunderRd's AOA FOLDING@HOME Team > nVidia/ATI GPU2 clients

nVidia/ATI GPU2 clients Folding clients that use GPUs on graphics cards running the GPU2 client


Reply
 
LinkBack Thread Tools Rating: Thread Rating: 2 votes, 5.00 average.
  #1 (permalink)  
Old 8th October, 2009, 04:55 AM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

64-bit LINUX setup guide for GPU2 client under WINE

(The finished version of the linux GPU2 folding guide. I've tested it on a couple of rigs and can verify it does work. TR, you can move it edit it as you see fit)

Ubuntu/Mint linux 64 bit instructions. 32 bit set up coming soon. Can be used for gentoo, arch and most other distros with some modifications. Under Gentoo you only need to install wine and start from that point in the guide as the rest is already in place. You will need to mask any nvidia-drivers newer than 180.60 to make it happen though. Under Arch you will need to install base-devel and wine.

Make sure you have an updated system with the 180 series nvidia drivers. Can be installed through the package manager. Do not install drivers newer than the 180 series if you plan to run GPU2. They do not work and will only give an UNSTABLE_MACHINE error

Open up a terminal

Code:
sudo apt-get install wine build-essential linux-headers-`uname -r`
Code:
mkdir -p ~/folding/gpu
Code:
cd ~/folding/gpu
Next we will grab the wrapper.
Code:
wget http://files.aoaforums.com/F3890-cudart.dll.so.zip
Extract the cudart.dll.so (notice the *, * is used as a wildcard so I am able to execute a command on stuff with long filenames without having to type it all out, you will see a better example a couple of posts down.
Code:
unzip F3890-cudart*
Download the cuda toolkit
Code:
wget http://developer.download.nvidia.com/compute/cuda/2_0/linux/toolkit/NVIDIA_CUDA_Toolkit_2.0_ubuntu7.10_x86.run
Install the toolkit, Do Not change the default installation location, just hit enter when prompted
Code:
sudo sh NVIDIA_CUDA_Toolkit_2.0_ubuntu7.10_x86.run
Create wine directories
Code:
wine notepad
Close the notepad window, we only needed it to put the wine directories in place.

Copy the cudart.dll to the newly created wine directory
Code:
cp -a cudart.dll.so ~/.wine/drive_c/windows/system32/nvcuda.dll
Copy cuda files to lib32 directory
Code:
sudo cp -a /usr/local/cuda/lib/* /usr/lib32
Download the windows gpu2 console version
Code:
wget http://www.stanford.edu/group/pandegroup/folding/release/Folding@home-Win32-GPU_XP-623.zip
Extract it, notice the wildcard being used to execute a command with minimal typing.
Code:
unzip Fold*
Run the following command and happy folding.
Code:
nice wine Folding@home-Win32-GPU.exe -verbosity 9 -forcegpu nvidia_g80
If you have to shut it down just hit control+c inside the open terminal, to start it back up. cd ~/folding/gpu and run the nice wine command above.

Special thanks go out to the many people on foldingforum.org that put in a lot of work to make this possible.

This sticky post by ccperf721p was copied from this thread:
http://www.aoaforums.com/forum/nvidia-ati-gpu-clients/47946-gpu-clients-in-linux-under-wine.html
That thread contains all posts made while developing/troubleshooting the instructions and is now closed to further posting. All further posts should be made here.

-TR
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP

Last edited by ThunderRd; 7th June, 2010 at 07:41 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 10th October, 2009, 05:01 PM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

The cudart.dll.so can be retrieved using wget from here: f@h - Cudart
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 10th October, 2009, 08:45 PM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

OUTSTANDING work Cliff! ":O}
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 10th October, 2009, 10:15 PM
PorPorMe's Avatar
Member
 
Join Date: January 2008
Location: Spokane, Wa
Posts: 3,131

Quote:
Originally Posted by Daniel ~ View Post
OUTSTANDING work Cliff! ":O}
I can do nothing but agree with that!
__________________
AOA Team fah

1ST Thermaltake V9 Case * Windows 7 x64 * Gigibyte GM-MA74GM-S2 * Phenom X4 9650 2.3Ghz @ 2.76GHz * G Skill 4 GB DDR2 * EVGA Geforce 9800GT 512GB * Antec 650w


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 11th October, 2009, 04:20 AM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

updated the instructions to use wget to retrieve the wrapper. Thank you Gizmo.
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 10th November, 2009, 09:59 PM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

Just got it kinda working on Fedora 11. The only change was that, with 64-bit F11, the libs are in /usr/lib rather than /usr/lib32 (F11 apparently uses lib and lib64)

However, I'm getting the following:
Quote:
[20:55:55] Entering M.D.
Reading file work/wudata_02.tpr, VERSION 3.1.4 (single precision)
Reading file work/wudata_02.tpr, VERSION 3.1.4 (single precision)
Reading sasa-enabled ir 0 0
Initializing Nvidia gpu library
Run: exception thrown during GuardedRun
[20:56:01] Run: exception thrown during GuardedRun
[20:56:01] Run: exception thrown in GuardedRun -- Gromacs cannot continue further.
Could this be due to some conflict with Compiz-Fusion?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 11th November, 2009, 03:36 AM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

I wish I knew more that could help you, but I reckon the community forum is the place to go.

Cliff's dad hasn't been well and the last time I was in touch with him a week or two ago he was really busy taking care of him, and working nights, so I'm not too sure when we will be hearing from him...
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 11th November, 2009, 05:54 AM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

I've been missing him myself...Sorry to hear of his Dad's illness...Hope he recovers soon...
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)  
Old 11th November, 2009, 06:32 AM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

I've been checking in from time to time, haven't had much time to type but it won't be much longer (I hope)..

I will look into the error Gizmo. So far I managed to dig up that there needs to be a symlink from libcuda.so -> libcuda.so.1

Normally it is already done when installing from the repo but I seem to remember that you install nvidia drivers outside of the repos.
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10 (permalink)  
Old 11th November, 2009, 03:11 PM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

Hey Cliff, good to hear from you. Take care and we'll be here when you get back...
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #11 (permalink)  
Old 11th November, 2009, 04:09 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

It's been a pretty rough month all around. The dad thing was expected, just not right now. I've had a ton of trouble with linux and I'm almost positive a certain distro (not gentoo) killed my laptop when it changed my configuration and allowed my laptop to turn off the fan without scaling back the cpu or video. Then there was the hal and xorg updates. I'm just about at the end of my rope with linux.. One thing I have always hated about linux, nothing is ever finished. Even when an app is perfect in every way, it must be screwed with..
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #12 (permalink)  
Old 11th November, 2009, 04:51 PM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

I'm playing around with 2 Linux distros that are new to me, one is the Sidux you have mentioned, and another one is called Yoper; it claims to be the world's fastest Linux distro. Don't know about that yet, but it's interesting to see the differences in the organization of different distros.

I have the new Gentoo release 10.1 downloaded and on the back burner. For now, I'm comfortable with Debian kin, so I'm staying with those until I feel strong enough to venture out...
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #13 (permalink)  
Old 11th November, 2009, 05:55 PM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

Quote:
Originally Posted by ccperf721p View Post
I will look into the error Gizmo. So far I managed to dig up that there needs to be a symlink from libcuda.so -> libcuda.so.1

Normally it is already done when installing from the repo but I seem to remember that you install nvidia drivers outside of the repos.
That's correct, Cliff; I install the nVidia drivers using the nVidia installer, though, which should be the same thing. I just verified that I do have the symlink.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #14 (permalink)  
Old 11th November, 2009, 05:58 PM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

I just tried disabling desktop effects. It didn't make any difference.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #15 (permalink)  
Old 13th November, 2009, 05:41 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

Seems I get done typing and hit submit just as there is a down on the site.

Quote:
Originally Posted by ThunderRd View Post
I'm playing around with 2 Linux distros that are new to me, one is the Sidux you have mentioned, and another one is called Yoper; it claims to be the world's fastest Linux distro. Don't know about that yet, but it's interesting to see the differences in the organization of different distros.

I have the new Gentoo release 10.1 downloaded and on the back burner. For now, I'm comfortable with Debian kin, so I'm staying with those until I feel strong enough to venture out...
The Gentoo live dvd has no installer, it's basically a snapshot of what was available in the portage tree on the 10 year anniversary. likewhoa is a good friend of mine and put in a lot of hard work on it, he's catching alot of grief for it as well. Even I fail to see the value in the gigabytes on the dvd, they just tried to put too many desktop environments on one live dvd.

Quote:
Originally Posted by Gizmo View Post
That's correct, Cliff; I install the nVidia drivers using the nVidia installer, though, which should be the same thing. I just verified that I do have the symlink.
I still don't have an answer, I will install Fedora, duplicate the problem and see if we can up with a solution.

I'm not having much fun with linux right now. I was on my arch install when all of the stuff in my etc/fstab stopped working like mounting usb drives, narrowed down to policykit, created some rules and deleted the entries in the fstab. Then sudo mount /dev/sdd1 /mnt/storage gave a permission denied error. su didn't do any good either. Rather than punch a hole in my screen, I started editing pkgbuilds in arch and ebuilds in gentoo, something I thought I was done with...

Like I have always said, if something in linux is working perfectly, it's not finished yet.
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #16 (permalink)  
Old 25th March, 2010, 02:53 AM
dabaerman's Avatar
Member
 
Join Date: October 2001
Location: Auburn, WA
Posts: 2,101

it took a while for me to figure out that it helps to have Win-XP installed in order to run the GPU client under wine. that prolly wont happen on this box. so waiting for a true linuxGPU client. I'll miss some points for a while until that happens.
will go to work on the linuxSMP client asap. and since it's a Quad, maybe two clients.

Ron
__________________
Folding 24/7 with AMD QuadCore CPU's & nVidia Cuda Powered GPU's

AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #17 (permalink)  
Old 28th March, 2010, 07:22 PM
dabaerman's Avatar
Member
 
Join Date: October 2001
Location: Auburn, WA
Posts: 2,101

Quote:
Originally Posted by ccperf721p View Post
(The finished version of the linux GPU2 folding guide. I've tested it on a couple of rigs and can verify it does work. TR, you can move it edit it as you see fit)

Create wine directories
Code:
wine notepad
Close the notepad window, we only needed it to put the wine directories in place.

Copy the cudart.dll to the newly created wine directory
Code:
cp -a cudart.dll.so ~/.wine/drive_c/windows/system32/nvcuda.dll

This sticky post by ccperf721p was copied from this thread:
http://www.aoaforums.com/forum/nvidia-ati-gpu-clients/47946-gpu-clients-in-linux-under-wine.html
The thread contains posts made while developing/troubleshooting the instructions and is closed to further posting.

-TR

TR,
did I miss something here? do I create the dir c/windows/system32? this box is only linux (Mint8) and I need a little more help getting the GPU folding again.

I'll get the SMP working first!

Ron
__________________
Folding 24/7 with AMD QuadCore CPU's & nVidia Cuda Powered GPU's

AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #18 (permalink)  
Old 29th March, 2010, 07:19 AM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

I don't have any experience with folding under WINE but I can explain the command.

Code:
cp -a cudart.dll.so ~/.wine/drive_c/windows/system32/nvcuda.dll
copies the file cudart.dll.so to the directory ~/.wine/drive_c/windows/system32, and renames it to nvcuda.dll.

That means it is in the /home/dabaerman directory (~) in a hidden directory named .wine (the "." means it's hidden).

In Mint, the easiest way to see it is to enable "show hidden files" in your Mint file manager, nautilus or whatever it is, or do it from the CL.

Code:
ls -a /home/dabaerman/
will show if you have the .wine directory.

If you have any problems ccperf is the guy to ask, or go onto the community forum in the thread posted at the top of this one.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com

Last edited by ThunderRd; 29th March, 2010 at 07:26 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #19 (permalink)  
Old 29th March, 2010, 02:38 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

When you run the command "wine notepad" it will create the directory
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #20 (permalink)  
Old 3rd April, 2010, 03:14 AM
dabaerman's Avatar
Member
 
Join Date: October 2001
Location: Auburn, WA
Posts: 2,101

when I type this command,

cp -a cudart.dll.so ~/.wine/drive_c/windows/system32/nvcuda.dll

I get an error msg. 'the directory does not exist'


continuing to apply patience as needed!!

Ron
__________________
Folding 24/7 with AMD QuadCore CPU's & nVidia Cuda Powered GPU's

AOA Team fah

Last edited by dabaerman; 3rd April, 2010 at 03:58 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
GPU2 Nvidia Linux Folding dsio nVidia/ATI GPU2 clients 35 8th October, 2010 05:37 PM
GPU clients in Linux under WINE ccperf721p nVidia/ATI GPU2 clients 103 10th October, 2009 09:41 AM
GPU2 client for nVidia cards gedon nVidia/ATI GPU2 clients 240 7th September, 2009 06:42 PM
Download - Wine 1.1.3 for Linux/FreeBSD danrok OS, Software, Firmware, and BIOS 7 26th August, 2008 07:46 PM
RDA+ setup guide rcoe EPoX MotherBoards 2 22nd February, 2003 09:08 PM


All times are GMT +1. The time now is 03:36 AM.


Copyright ©2001 - 2010, AOA Forums
Don't Click Here Don't Click Here Either

Search Engine Friendly URLs by vBSEO 3.3.0