AOA Forums AOA Forums AOA Forums Folding For Team 45 AOA Files Home Front Page Become an AOA Subscriber! UserCP Calendar Memberlist FAQ Search Forum Home


Go Back   AOA Forums > Hardware > Mobile Devices and Networking


Reply
 
LinkBack Thread Tools Rate Thread
  #1 (permalink)  
Old 18th March, 2011, 10:15 AM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

Benchmarking smartphones

Here's a question - what are the best ways of benchmarking smartphones?

I've seen the following that look interesting:
  • Sunspider JavaScript benchmark, which tests the JavaScript performance of the browser. Runs on anything that supports JavaScript.
  • GLBenchmark, which tests mobile OpenGL performance, and runs on Android, iOS, Linux and Symbian
  • Aurora Quadrant, tests CPU, memory, I/O, 2D and 3D graphics, but only runs on Android devices.
  • HTML5 test tests the HTML5 compliance of the device. There's a couple of areas I have issues with on this one, including WebGL which I consider to be one of the Internet's poorer ideas!

Think we should start by benchmarking devices we already have?

Edit below for results

Sunspider JavaScript on default browser ordered by fastest:

BlackBerry Bold 9900 (OS 7) 2764.2 +/- 4.4%
LG Optimus P920 3D (Stock 2.2) 4279.8 +/- 1.5%
HTC Evo (Stock 2.2 ROM) - 4368.8 +/- 2.9%
HTC Desire (Cyano 7.02.01) - 4437.9 +/- 2.8%
Dell Streak (Stock 2.2 ROM) - 5542.9ms +/- 0.9%
LG GT540 (Stock 2.1 ROM) - 45975.5ms +/- 1.1%
Nokia N97 (Unknown ROM) - failed to complete after hours.
__________________

Last edited by Aedan; 21st December, 2011 at 05:01 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 18th March, 2011, 01:42 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

I am up for that, just tell me which of this benches to use.
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 18th March, 2011, 03:37 PM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

What type of device do you have? Android, iPhone or something else?
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 21st March, 2011, 04:29 PM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

Using Sunspider JavaScript benchmark on a couple of Android devices:
Dell Streak (Stock 2.2 ROM): 5542.9ms +/- 0.9%
LG GT540 (Stock 2.1 ROM) : 45975.5ms +/- 1.1%
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 21st March, 2011, 05:19 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

N97 :d
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 21st March, 2011, 08:40 PM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

HTC Evo (Stock 2.2 ROM) - 4368.8 +/- 2.9%

I suspect the larger variance is due to me stopping the screen from blanking during the test (it would dim and I would touch the screen to bring it back up)
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 21st March, 2011, 08:42 PM
Gizmo's Avatar
Chief BBS Administrator
BassTeroids Champion, Global Player Champion, Aim & Fire Champion, Puzzle Maniax Champion, Othello Champion, Canyon Glider Champion, Unicycle Challenge Champion, YetiSports 9: Final Spit Champion, Zed Champion
 
Join Date: May 2003
Location: Webb City, Mo
Posts: 16,178
Send a message via ICQ to Gizmo Send a message via AIM to Gizmo Send a message via MSN to Gizmo Send a message via Yahoo to Gizmo Send a message via Skype™ to Gizmo

Interestingly, I had to run the SunSpider bench using the built-in browser, because Opera Mini hangs on the 'math spectral-norm' portion of the test.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 22nd March, 2011, 04:11 PM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

Quote:
Originally Posted by chrisbard View Post
N97 :d
You might be able to get the browser to run SunSpider.
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)  
Old 28th March, 2011, 06:41 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

It's doing a couple tests then a message: access-fannkuch and thats all
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10 (permalink)  
Old 29th March, 2011, 11:57 AM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

access-fannkuch is one of the many tests that it runs. It sounds like it's just taking some time to run them - you might have to set aside a block of time for the phone to do it. I know that one of the devices I tested took more than 10 minutes to complete the testing.
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #11 (permalink)  
Old 29th March, 2011, 06:04 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

AH lol ok I will try
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #12 (permalink)  
Old 29th March, 2011, 07:08 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

Half an hour later and is still fannkuch. I think it swears at me or something in german lol!
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #13 (permalink)  
Old 29th March, 2011, 09:35 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

Hours later same screen, same message, benchmark in progress!
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #14 (permalink)  
Old 30th March, 2011, 10:27 AM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

Ok, I guess we have to say that it either fails or takes too long!
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #15 (permalink)  
Old 8th July, 2011, 02:05 AM
danrok's Avatar
AOA Staff
 
Join Date: March 2003
Location: Great Britain
Posts: 18,917

Here we go...

LG Optimus P920 3D running Android 2.2.2.

Using Quadrant, scores overall 2089.
__________________
Desktop PC: AMD FX-8370E / Asus M5A99X Evo R2.0 Motherboard / 16GB DDR3 RAM / GeForce GTX 970
AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #16 (permalink)  
Old 8th July, 2011, 02:22 AM
danrok's Avatar
AOA Staff
 
Join Date: March 2003
Location: Great Britain
Posts: 18,917

Same phone, running Sunspider.

4279.8ms +/- 1.5%.
__________________
Desktop PC: AMD FX-8370E / Asus M5A99X Evo R2.0 Motherboard / 16GB DDR3 RAM / GeForce GTX 970
AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #17 (permalink)  
Old 8th July, 2011, 02:34 AM
danrok's Avatar
AOA Staff
 
Join Date: March 2003
Location: Great Britain
Posts: 18,917

Linpack processor benchmark.

Multi-thread score MFLOPS 68.121
__________________
Desktop PC: AMD FX-8370E / Asus M5A99X Evo R2.0 Motherboard / 16GB DDR3 RAM / GeForce GTX 970
AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #18 (permalink)  
Old 11th July, 2011, 03:24 PM
noob's Avatar
Member/Contributer
 
Join Date: June 2005
Location: Auckland NZ
Posts: 1,639

HTC Desire
ROM: CyanogenMod 7.02.01
CPU Governor: Performance
Max CPU: 998MHz

Sunspider 0.9.1:
Default Browser: 4437.9ms +/- 2.8%
Opera Mobile 11.10.ADR: 2903.2ms +/- 1.2%

Linpack:
Multithread: 30.162 MFLOPS, 5.59s, Norm Res: 3.24
Single: 35.328 MFLOPS, 2.37s, Norm Res 5.68

Quadrant - Free: 1093
Stock HTC Desire seems around 500
__________________
AOA Team fah

Corsair AX650
Asus P8H77-M PRO
i7 3770 (non K series)
- Noctua NH-L12 Low Profile CPU Cooler
2x8GB G.Skill Ripjaws X
Sapphire 7970
2 x SanDisk Extreme 120GB RAID 0
Western Digital Green 3TB
Asus Xonar Essence STX
TP Link TL-WN881ND
Fractal Design Arc Mini
- 2x Noctua NF-P12 120mm, 2x Noctua NF-P14 FLX 140mm, NZXT Sentry 2 LCD Fan Controller
Asus ML249H

Last edited by noob; 11th July, 2011 at 03:25 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #19 (permalink)  
Old 18th December, 2011, 01:26 AM
danrok's Avatar
AOA Staff
 
Join Date: March 2003
Location: Great Britain
Posts: 18,917

Quote:
Originally Posted by danrok View Post
Here we go...

LG Optimus P920 3D running Android 2.2.2.

Using Quadrant, scores overall 2089.
Now scoring 2366 with Gingerbread installed.
__________________
Desktop PC: AMD FX-8370E / Asus M5A99X Evo R2.0 Motherboard / 16GB DDR3 RAM / GeForce GTX 970
AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #20 (permalink)  
Old 21st December, 2011, 02:13 PM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

BlackBerry Bold 9900 OS
Sunspider 0.9.1: 2764.2ms +/- 4.4%
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Tags
benchmarks , smartphone



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Antivirus for Smartphones? Áedán Mobile Devices and Networking 11 6th July, 2011 02:37 PM
Smartphones 'open to SMS attacks' danrok Data Security 2 1st August, 2009 01:39 PM
Symbian Smartphones: 1 in 63 Infected Gizmo Mobile Devices and Networking 1 31st July, 2009 11:29 AM
What smartphones are you using then.... Lazgoat Mobile Devices and Networking 41 1st November, 2005 02:35 AM
benchmarking? serlv ThunderRd's AOA FOLDING@HOME Team 10 6th June, 2004 09:17 PM


All times are GMT +1. The time now is 04:33 PM.


Copyright ©2001 - 2010, AOA Forums
Don't Click Here Don't Click Here Either

Search Engine Friendly URLs by vBSEO 3.3.0