AOA Forums AOA Forums AOA Forums Folding For Team 45 AOA Files Home Front Page Become an AOA Subscriber! UserCP Calendar Memberlist FAQ Search Forum Home


Go Back   AOA Forums > General > ThunderRd's AOA FOLDING@HOME Team > Windows/Linux SMP Clients

Windows/Linux SMP Clients Folding clients that can run on multiple CPUs


Reply
 
LinkBack Thread Tools Rate Thread
  #41 (permalink)  
Old 28th August, 2009, 04:18 PM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

Building 2.6.31 patched with RT, and make defconfig now.

Will post after I try it out.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #42 (permalink)  
Old 28th August, 2009, 05:23 PM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

Quote:
Originally Posted by ccperf721p View Post
The base system is pretty much much set, booted it for the first time about 20 minutes ago, basically all that means is that the easy part is over.
Oh.... I waiting for the hard part to be over... it's my nature...":O}
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #43 (permalink)  
Old 28th August, 2009, 06:10 PM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

Finished building the kernel with the default configuration after patching, and tried it out.

The client went directly to 99%-5%. But something interesting happened. I got a phone call while the client was running, and I didn't stop it. While I was gabbing, I noticed the the cores were at 90% each (this was about 5 minutes after starting it up). Then, right in front of my eyes, the opposite core went to 99%, and the other dropped to 5%. I continued to watch it for 1-15 minutes longer, and the fully loaded core kept switching from core to core every 5 minutes or so. How odd. I'll be damned if I know what's going on.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #44 (permalink)  
Old 28th August, 2009, 06:50 PM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

Quote:
Originally Posted by ccperf721p View Post
I was reading on /. that the linux kernel was over 10 million lines of code and getting bigger with every release.
Gotta wonder if that's the kernel on it's own, or kernel plus device drivers...

The latest Who Writes Linux (August 2009) indicates there's 11.5 million lines of code in the 2.6.30 kernel. The same kernel had 12993 lines of code added per day, and 4958 lines removed per day...
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #45 (permalink)  
Old 29th August, 2009, 01:09 AM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

It seems awesome to me they do as well as they do... but what's the rush? I think the community might be better served by a slower and more measured approach to their releases... But hey, it's their play ground I'm just a beneficiary...":O}
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #46 (permalink)  
Old 29th August, 2009, 04:42 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

Quote:
Originally Posted by ThunderRd View Post
Finished building the kernel with the default configuration after patching, and tried it out.

The client went directly to 99%-5%. But something interesting happened. I got a phone call while the client was running, and I didn't stop it. While I was gabbing, I noticed the the cores were at 90% each (this was about 5 minutes after starting it up). Then, right in front of my eyes, the opposite core went to 99%, and the other dropped to 5%. I continued to watch it for 1-15 minutes longer, and the fully loaded core kept switching from core to core every 5 minutes or so. How odd. I'll be damned if I know what's going on.
It's an one, well beyond my paygrade.

Quote:
Originally Posted by Daniel ~ View Post
It seems awesome to me they do as well as they do... but what's the rush? I think the community might be better served by a slower and more measured approach to their releases... But hey, it's their play ground I'm just a beneficiary...":O}
Some days linux is a beautiful thing, Others it feels like a million monkeys hammering on keyboards.
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #47 (permalink)  
Old 29th August, 2009, 05:11 PM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

Is this a "Sometimes your the monkey sometimes your the keyboard type of thing... because if it is I'm either short a trackball or a banana!
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #48 (permalink)  
Old 2nd September, 2009, 08:46 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

Not sure if you are familiar with the CK Patchset, it died at 2.6.22 after a falling out with the kernel devs. It was one of the best patchsets I found for the desktop back then..

Looks like Con Koliva is back at it with some new code.. I will be giving it a run this weekend just to see..

If interested you can go through the read me and see if it fits the bill for what you are doing.. Index of /patches/bfs
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #49 (permalink)  
Old 3rd September, 2009, 04:26 AM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

Yeah, I'm familiar with the Kolivas patches although he stopped development before I got interested in kernels. This is good news, though. It's my understanding that Linus has a real opposition to both the guy and his work, which is good for keeping everyone honest Apparently, the RT-Preempt Kernel was born out of the resistance to Con and his ideas, which Linus tossed aside, putting Ingo & Co. on the RT work.

What his previous patches did for older kernel versions is what I'm looking for...I may try this patch out to see if it looks good for me. It's still early, though. Expect it to be a bit buggy yet.

Compare notes in a week or so?

EDIT: Cliff, what kind of patch format is that? it's not .lzma or .bz2, what do we do with it?
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com

Last edited by ThunderRd; 3rd September, 2009 at 04:33 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #50 (permalink)  
Old 3rd September, 2009, 05:00 AM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

You would apply it the same as normal, just no need to unpack it..
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #51 (permalink)  
Old 3rd September, 2009, 06:04 AM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

Quote:
Originally Posted by ccperf721p View Post
You would apply it the same as normal, just no need to unpack it..
Not sure I understand. Normally I'd use something like this:
Code:
bzcat patch-2.6.30.x.bz2 | patch -p1
But what verb would I use here, with a .patch file? It can't be bzcat.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #52 (permalink)  
Old 3rd September, 2009, 06:21 AM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

Can you open the patch up and see regular text? Something like this:
Code:
--- bayes-learn.sh	2007-07-25 13:27:18.681173076 -0500
+++ bayes-learn-new.sh	2009-09-03 00:18:48.383255310 -0500
@@ -1,7 +1,6 @@
 #! /bin/bash
 
-WORKINGDIR="/home/vmail/aoaforums.com/$1"
-NEWMAILDIR="/.maildir/test/"
+WORKINGDIR="/home/v-mail/aoaforums.com/$1"
 BAYESTMPMAILDIR="/.maildir/bayestmp/"
 for i in $(ls -1 "$WORKINGDIR$NEWMAILDIR")
 do
@@ -11,3 +10,4 @@
 	/root/bayes_fixup.pl < "$WORKINGDIR$BAYESTMPMAILDIR$i" > "$WORKINGDIR$NEWMAILDIR$i"
 	rm "$WORKDINGDIR$BAYESTMPMAILDIR$i"
 done
+NEWMAILDIR="/.maildir/test/"
(The lines starting with - are the lines to be removed, the ones start with + are the lines to be added. The remaining lines are used for context matching.)

If you can, then it is just a standard patch file produced with diff -u. You can apply it directly, without using bzcat by:

Code:
patch -p1 < name-of-patch-file

Last edited by Gizmo; 3rd September, 2009 at 06:23 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #53 (permalink)  
Old 3rd September, 2009, 06:23 AM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

Command would be in this format
Code:
 patch < 2.6.30-sched-bfs-203.patch -p1

Edit: Gizmo beat me to it..
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP

Last edited by ccperf721p; 3rd September, 2009 at 06:25 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #54 (permalink)  
Old 3rd September, 2009, 01:15 PM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

Clear as day. I should have been able to figure that one out myself...
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #55 (permalink)  
Old 4th September, 2009, 06:47 PM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

@Cliff-
I compiled and booted today's version update 205. The first thing I noticed is that the Linux folding client, which ran between 90 and 95% or so on the previous kernels I've built, now runs at 100% CPU usage, absolutely pegged to the redline. At first glance, the XFCE desktop is quite responsive even with the client running.

This is a Good Thing, especially the 100% usage. I've always felt that the Linux client has been leaving cycles on the table somehow.

I'm going to let this run tonight and see what kind of improvement I'll have on frame times after it runs all night. Then, if it still looks promising I'll try to see if I can break it somehow.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com

Last edited by ThunderRd; 4th September, 2009 at 06:47 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #56 (permalink)  
Old 4th September, 2009, 07:18 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

That's the spirit. I keep a testbed install just for the sole purpose of breaking it when I get the chance..

What kind of load averages are you seeing?
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #57 (permalink)  
Old 5th September, 2009, 02:57 AM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

Some other things I might mention that could help your system out a little. Disable group cpu scheduler options in kernel, and you might also try using the deadline scheduler for I/O instead of the default CFQ. Gives me a little better "feel" set up this way. File transfers from one drive to another are a little better but the same when going same drive.

I don't how many apps you compile from source, but I have found gcc 4.3 and 4.4 to be noticeably slower than GCC 4.2 compiling and the resulting code isn't any faster either. Took a little bit of time to get that one straightened out.
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #58 (permalink)  
Old 5th September, 2009, 08:21 AM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

I'll take a look at those options later when I'm home.

I fired off an email to -ck to ask some questions about schedtool and SCHED_IDLEPRIO, since he mentions it in the FAQ in the section related to distributed computing programs. It did not work for me as he said it would, and behaved quite differently. 4 hours later I had an answer from the guy his'self.

He said he welcomes suggestions and comments, so if you have any, mail him.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #59 (permalink)  
Old 5th September, 2009, 07:30 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

CK's a good dude, I used to enjoy reading what he had to say on just about any subject. Down to earth and I could actually make sense of what he was talking about. Good to have him back looking at code again.

Since you are liking living dangerously, I think I will recompile & tar up the Gentoo install on my backup. It's right out there on the edge and quite fun to play with..
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #60 (permalink)  
Old 6th September, 2009, 11:05 AM
ThunderRd's Avatar
Irreverent Query Chairman
 
Join Date: June 2007
Location: NYC native in northern Thailand
Posts: 2,232

He has identified my problem with SCHED_IDLEPRIO as a bug but has triaged it for a later fix, says he'll get back to me. In the meantime it's working quite well without it; new versions in his site each day.

I started a thread about the bfs patch at the folding-community forum, and it is starting to get a head of steam going:

http://foldingforum.org/viewtopic.ph...30daf162154354

Other concur that that it increases their production as well.
__________________
#1: Tt Armor, ASUS Maximus Extreme, QX9650@4.1G, 8G Corsair Dominator GT DDR3-2000, Corsair HX1050, H2O-Swiftech, Gigabyte GTX470/Arctic Accelero Xtreme Plus II, Intel 520 SSD, Kingston SSD, 2xRaptor 150G RAID0, Win 7 Pro 64
#2: Tt Shark, ASUS P5Q Pro Turbo, Q6600@3.8G, 4G HyperX-1600, Corsair HX850, CoolerMaster V10, 2xASUS 9600GT, 2xRaptor 74G RAID0, OCZ Vertex 4 SSD, Gentoo/siduction Linux [64-bit]
#3, #4: Opteron 170@2.75G nude, A8N-SLI Deluxe, Gentoo

AOA Folding @HomeOur sister site: www.gamersonlinux.com

Last edited by ThunderRd; 7th September, 2009 at 11:28 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Gpu Client has uknown core PorPorMe ThunderRd's AOA FOLDING@HOME Team 1 3rd March, 2009 05:41 AM
ATI GPU folding client to be released OCT 2nd! Gizmo ThunderRd's AOA FOLDING@HOME Team 19 29th September, 2006 03:14 AM
Does the F@H client take advantage of my dual core CPU? Azriel ThunderRd's AOA FOLDING@HOME Team 12 18th November, 2005 04:52 AM
Folding client problem alexkerhead ThunderRd's AOA FOLDING@HOME Team 1 7th November, 2005 08:45 PM
Folding client userguide Allan ThunderRd's AOA FOLDING@HOME Team 0 19th July, 2002 01:52 PM


All times are GMT +1. The time now is 07:16 AM.


Copyright ©2001 - 2010, AOA Forums
Don't Click Here Don't Click Here Either

Search Engine Friendly URLs by vBSEO 3.3.0