[Smalltalk home]

Benchmarks Results for PDA

Updated: February 27, 2003.

OS & Machine

PowerPC 750 233MHz, MacOS8.5.1J
Power Macintosh 8500/120, G3 233MHz, 176MB RAM, MacOS8.5.1J
[Pocket PostPet]
Casio Jx628 CE2.12B, VR4121 131MHz, 16MB ROM, 8MB RAM (user area 2MB)
[Pocket PostPet MMC 2.7VM]
Casio Jx628 CE2.12B, VR4121 131MHz, 16MB ROM, 8MB RAM (storage area 300KB) + 64MB MMC, Squeak VM: 2.7 (Squeak2.7-winCE-MIPS)
[Pocket PostPet MMC 2.9VM]
Casio Jx628 CE2.12B, VR4121 131MHz, 16MB ROM, 8MB RAM (storage area 250KB) + 64MB MMC, Squeak VM: 2.9 (2.9 MIPS_HPC)
[Pocket PostPet MMC 3.0VM]
Casio Jx628 CE2.12B, VR4121 131MHz, 16MB ROM, 8MB RAM (storage area 250KB) + 64MB MMC, Squeak VM: 3.0 (SqueakVM-alpha6-HPC-MIPS.exe)
[Compaq Presario 213 3.0VM]
Microsoft Windows(R) CE for Palm-size PC version 1.2 (Windows CE 2.11), VR4111 70MHz, 16MB RAM + 128MB CF, Squeak VM: 2.7 (SqueakVM-alpha6-HPC-MIPS.exe)
[NTT Docomo (Casio) GFort 3.0VM]
Microsoft(R) Windows(R) Powered PocketPC Japanese Edition (Windows CE 3.0), VR4122 150MHz, 32MB RAM + 128MB CF, Squeak VM: 3.0 (SqueakVM-alpha6-PocketPC-MIPS)
[Sharp Zaurus MI-E25DC 3.0VM]
SH3?, Squeak VM: 2.9a (wtii021012)
[Sharp Linux Zaurus SL-B500]
Linux (Embedix), Intel XScale PXA250 400MHz, 32MB + 256MB SD
[Compaq (HP) iPAQ H3970 3.0VM]
Microsoft(R) Windows(R) Powered Pocket PC Version 3.0.11232 (Build 11232), Intel(R) PXA250 400MHz, 64MB RAM + 256MB SD, Squeak VM: 3.0 (SqueakVM-alpha6-HPC-ARM)
[HP Jornada720 3.0VM]
Microsoft(R) Windows(R) Powered Handheld PC 2000 Japanese Edition (Windows CE 3.0), StrongARM SA1110 206MHz, 32MB RAM + 512MB CF, Squeak VM: 3.0 (SqueakVM-alpha6-HPC-ARM)
Pocket PostPet is a world smallest (320 * 240) and lowest price (!!!) Smalltalk machine, with color display and keyboard.

Pocket PostPet Pocket PostPet
W: 153 * D: 94 * H: 35mm, weight: 315g.
Presario 213 GFort


STones80 & Integer benchmark Results for PDA
Image classes space left slop stones smop stones slop + smop / 2 bench Fib bench mark tinyBenchmarks OS & Machine
bytecodes /sec sends /sec
2.7 * 1172   1.38 1.50 1.44 737026 16835000 16606123 717695 [MacOS8.5.1J]
NTT Docomo (Casio) Pocket PostPet
2.2 Mini 201 5,290,912               [Pocket PostPet]
2.7 Mini * 213 5,102,260 0.12 0.05 0.09 89179 1567000 1682793 79515 [Pocket PostPet]
2.7 without Morph * 507 3,857,448 0.13 0.05 0.09 80154 1878000 1136363 80866 [Pocket PostPet MMC 2.7VM]
3.0 without Morph * 612 2,203,376 0.069 0.080 0.075 66503 1955000 1836547 59205 [Pocket PostPet MMC 3.0VM]
3.0J without Morph * 641 861,832 0.072 0.076 0.074 65967 1644000 1189767 66463 [Pocket PostPet MMC 3.0VM]
3.0 without Morph, condensed source * 529 2,877,472 0.074 0.087 0.081 53258 1882000 1844167 51577 [Pocket PostPet MMC 3.0VM]
3.0J without Morph, condensed source * 556 1,249,704 0.067 0.077 0.072 63248 2434000 2515723 63473 [Pocket PostPet MMC 3.0VM]
3.0 without Morph, condensed source * 529 3,101,322 0.066 0.065 0.066 79168 1342000 1401541 86113 [Pocket PostPet MMC 2.9VM]
3.0J without Morph, condensed source * 556 1,368,376 0.068 0.070 0.069 78724 1502000 1532567 82428 [Pocket PostPet MMC 2.9VM]
Compaq Presario 213
2.7 without Morph 507 ? 0.132 0.055 0.094 82824 1858000 1857010 82653 [Compaq Presario 213 3.0VM]
3.0 without Morph 529 ? 0.078 0.094 0.086 70602 2167000 2169197 68336 [Compaq Presario 213 3.0VM]
NTT Docomo (Casio) GFort
3.0 without Morph ? ? 0.167 0.279 0.223 173207 4374000 4366812 167637 [NTT Docomo (Casio) GFort 3.0VM]
Sharp Zaurus MI-E25DC
Squeak3.0 of 4 February 2001 latest update: #3552 * 1548 2,700,488 0.10 0.25 0.18 103924 3067000 3053435 98416 [Sharp Zaurus MI-E25DC 2.9aVM]
Sharp Linux Zaurus SL-B500
Squeak3.0 of 4 February 2001 latest update: #3552 * 1548 1,125,428 0.33 0.37 0.35 241299 16666000 15818091 275209 [Sharp Linux Zaurus SL-B500 2.9aVM]
Compaq (HP) iPAQ H3970
Squeak3.0 of 4 February 2001 latest update: #3552 * 1548 2,715,448 0.17 0.14 0.16 402907 15576000 15009380 400801 [Compaq (HP) iPAQ H3970 3.0VM]
HP Jornada720
Squeak3.0 of 4 February 2001 latest update: #3552 * 1548 9,972,348 0.21 0.26 0.24 374485 10162000 10197578 364184 [HP Jornada 720 3.0VM]
*
2 test of SmopstoneBenchmark benchmark is intended to test the efficiency of recursively calling a block, that it isn't supported by conventional VM. So the result would be fairly pointless.

benchFib Handy send-heavy benchmark
	| r t |
	t _ Time millisecondsToRun: [r _ 26 benchFib].
	(r * 1000) // t
benchmark Handy bytecode-heavy benchmark
	5000000 // (Time millisecondsToRun: [10 benchmark]) * 1000
tinyBenchmarks
	0 tinyBenchmarks

details

Power Macintosh 8500/120, G3 233MHz
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     0.45    8425         1.28     add integers
         544     1.38     393         1.64     add floats
         960     0.32    2963         3.36     access strings
         320     0.86     371         1.05     create objects
         160     0.61     264         2.47     copy objects
         480     0.69     695         1.63     perform selectors
         896     3.93     228         0.31     evaluate blocks

         640     0.837    764         1.38     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

        1.95       1.62      generating fractonaccis
        0.23       4.95      generating primes*
        0.40       2.73      generating and parsing streams
        0.78       3.97      generating strings
      164.32       0.007     forming sets
        0.69       7.45      sorting strings
        1.49       3.77      sorcerer's apprentice*

        1.57       1.50      geometric mean *
Pocket PostPet
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     4.071    935         0.14     add integers
         544    15.71      35         0.14     add floats
         960     3.73     258         0.29     access strings
         320     9.76      33         0.09     create objects
         160    13.24      12         0.11     copy objects
         480     6.48      74         0.17     perform selectors
         896    39.45      23         0.03     evaluate blocks

         640     9.67      66         0.12     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       45.19       0.07      generating fractonaccis
        6.32       0.18      generating primes*
       15.27       0.07      generating and parsing streams
       26.22       0.11      generating strings
     6506.29       0.0002    forming sets
       21.27       0.24      sorting strings
       38.34       0.15      sorcerer's apprentice*

       48.97       0.05      geometric mean *
Pocket PostPet MMC 2.7VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.56    1071         0.16     add integers
         544    17.65      31         0.13     add floats
         960     3.78     254         0.29     access strings
         320     7.23      44         0.13     create objects
         160    11.44      14         0.13     copy objects
         480     7.69      62         0.15     perform selectors
         896    35.98      25         0.03     evaluate blocks

         640     9.17      70         0.13     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       47.28       0.07      generating fractonaccis
       11.54       0.10      generating primes*
       13.31       0.08      generating and parsing streams
       26.90       0.11      generating strings
     5753.83       0.0002    forming sets
       20.08       0.26      sorting strings
       37.78       0.15      sorcerer's apprentice*

       49.99       0.05      geometric mean *
Squeak 3.0 Pocket PostPet MMC 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.66    1042         0.158    add integers
         544    23.41      23         0.097    add floats
         960     3.24     296         0.336    access strings
         320    35.526      9         0.026    create objects
         160    20.282      8         0.074    copy objects
         480    43.472     11         0.026    perform selectors
         896    43.231     21         0.029    evaluate blocks

         640    16.79      38         0.069    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       73.39       0.045     generating fractonaccis
        8.98       0.123     generating primes*
       24.25       0.046     generating and parsing streams
       40.35       0.080     generating strings
       17.10       0.066     forming sets
       40.46       0.129     sorting strings
       42.22       0.125     sorcerer's apprentice*

       29.36       0.080     geometric mean *
Squeak 3.0J Pocket PostPet MMC 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.16    1204         0.182    add integers
         544    21.92      25         0.103    add floats
         960     3.23     297         0.337    access strings
         320    34.76       9         0.026    create objects
         160    21.96       7         0.068    copy objects
         480    36.54      13         0.031    perform selectors
         896    41.95      21         0.030    evaluate blocks

         640    15.95      40         0.072    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       78.55       0.040     generating fractonaccis
       10.33       0.109     generating primes*
       27.18       0.040     generating and parsing streams
       39.17       0.079     generating strings
       18.90       0.062     forming sets
       39.38       0.130     sorting strings
       45.61       0.123     sorcerer's apprentice*

       31.28       0.076     geometric mean *
Squeak 3.0 (condensed source) Pocket PostPet MMC 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     2.648   1438         0.218    add integers
         544    21.584     25         0.105    add floats
         960     3.792    253         0.287    access strings
         320    31.515     10         0.029    create objects
         160    21.88       7         0.068    copy objects
         480    35.1       14         0.032    perform selectors
         896    40.808     22         0.030    evaluate blocks

         640    15.491     41         0.074    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       66.724      0.047     generating fractonaccis
        8.419      0.133     generating primes*
       23.132      0.047     generating and parsing streams
       32.429      0.095     generating strings
       16.324      0.071     forming sets
       35.703      0.144     sorting strings
       44.007      0.127     sorcerer's apprentice*

       27.126      0.087     geometric mean *
Squeak 3.0J (condensed source) Pocket PostPet MMC 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.726   1022         0.155    add integers
         544    23.894     23         0.095    add floats
         960     3.571    269         0.305    access strings
         320    37.408      9         0.024    create objects
         160    24.591      7         0.061    copy objects
         480    38.112     13         0.030    perform selectors
         896    41.925     21         0.030    evaluate blocks

         640    17.319     37         0.067    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       74.344      0.042     generating fractonaccis
       10.464      0.107     generating primes*
       27.128      0.040     generating and parsing streams
       38.346      0.081     generating strings
       16.058      0.073     forming sets
       38.618      0.133     sorting strings
       49.014      0.114     sorcerer's apprentice*

       30.508      0.077     geometric mean *
Squeak 3.0 (condensed source) Pocket PostPet MMC 2.9VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     4.338    878         0.133    add integers
         544    23.525     23         0.096    add floats
         960     3.208    299         0.339    access strings
         320    32.827     10         0.028    create objects
         160    23.21       7         0.064    copy objects
         480    42.925     11         0.026    perform selectors
         896    44.921     20         0.028    evaluate blocks

         640    17.390     37         0.066    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       65.757      0.048     generating fractonaccis
       10.145      0.111     generating primes*
       19.913      0.055     generating and parsing streams
       38.66       0.080     generating strings
       24.424      0.048     forming sets
      155.0        0.033     sorting strings
       41.035      0.136     sorcerer's apprentice*

       36.092      0.065     geometric mean *
Squeak 3.0J (condensed source) Pocket PostPet MMC 2.9VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.019   1261         0.191    add integers
         544    24.954     22         0.091    add floats
         960     3.004    320         0.362    access strings
         320    35.114      9         0.026    create objects
         160    23.183      7         0.065    copy objects
         480    42.17      11         0.027    perform selectors
         896    51.582     17         0.024    evaluate blocks

         640    16.943     38         0.068    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       58.619      0.054     generating fractonaccis
       11.427      0.098     generating primes*
       21.884      0.050     generating and parsing streams
       35.648      0.087     generating strings
       20.758      0.056     forming sets
      129.532      0.040     sorting strings
       36.327      0.154     sorcerer's apprentice*

       33.861      0.070     geometric mean *
Squeak 2.7 Compaq Presario 213 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.523   1081         0.164    add integers
         544    10.776     50         0.210    add floats
         960     3.436    279         0.317    access strings
         320    10.451     31         0.087    create objects
         160     8.64      19         0.173    copy objects
         480     8.101     59         0.139    perform selectors
         896    40.547     22         0.031    evaluate blocks

         640     8.731     73         0.132    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       41.333      0.076     generating fractonaccis
        4.999      0.225     generating primes*
       14.533      0.075     generating and parsing streams
       19.049      0.162     generating strings
     5746.414      0.000     forming sets
       21.632      0.238     sorting strings
       39.302      0.143     sorcerer's apprentice*

       43.171      0.055     geometric mean*
Squeak 3.0 Compaq Presario 213 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.27    1165         0.176    add integers
         544    19.503     28         0.116    add floats
         960     3.512    273         0.310    access strings
         320    24.419     13         0.037    create objects
         160    22.339      7         0.067    copy objects
         480    29.927     16         0.038    perform selectors
         896    41.001     22         0.030    evaluate blocks

         640    14.722     43         0.078    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       61.986      0.051     generating fractonaccis
        9.394      0.120     generating primes*
       19.118      0.057     generating and parsing streams
       31.843      0.097     generating strings
       14.827      0.079     forming sets
       33.059      0.155     sorting strings
       36.932      0.152     sorcerer's apprentice*

       25.180      0.094     geometric mean*
Squeak 3.0 NTT Docomo (Casio) GFort 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     1.663   2290         0.347    add integers
         544    16.512     33         0.137    add floats
         960     1.712    561         0.636    access strings
         320    14.918     21         0.061    create objects
         160     7.636     21         0.196    copy objects
         480     4.671    103         0.242    perform selectors
         896    30.19      30         0.041    evaluate blocks

         640     6.913     93         0.167    geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       20.76       0.152     generating fractonaccis
        2.553      0.440     generating primes*
        6.09       0.179     generating and parsing streams
        9.995      0.309     generating strings
        5.092      0.229     forming sets
       13.055      0.394     sorting strings
       14.067      0.398     sorcerer's apprentice*

        8.427      0.279     geometric mean*
Zaurus MI-E25DC 2.9aVM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     3.21    1186         0.18     add integers
         544    32.59      17         0.07     add floats
         960     2.32     414         0.47     access strings
         320    21.45      15         0.04     create objects
         160    12.3       13         0.12     copy objects
         480    10.01      48         0.11     perform selectors
         896    54.35      16         0.02     evaluate blocks

         640    11.95      54         0.10     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       22.7        0.14      generating fractonaccis
        2.15       0.52      generating primes*
        7.53       0.14      generating and parsing streams
       10.03       0.31      generating strings
        5.87       0.20      forming sets
       25.63       0.20      sorting strings
       11.69       0.48      sorcerer's apprentice*

        9.40       0.25      geometric mean*
Sharp Linux Zaurus SL-B500
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     0.572   6657         1.01     add integers
         544    11.854     46         0.19     add floats
         960     0.38    2526         2.86     access strings
         320     5.731     56         0.16     create objects
         160     3.968     40         0.38     copy objects
         480     8.147     59         0.14     perform selectors
         896    12.889     70         0.10     evaluate blocks

         640     3.48     184         0.33     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       15.306      0.21      generating fractonaccis
        2.015      0.56      generating primes*
        4.968      0.22      generating and parsing streams
        6.681      0.46      generating strings
        3.27       0.36      forming sets
       10.29       0.50      sorting strings
       11.409      0.49      sorcerer's apprentice*

        6.30       0.37      geometric mean*
iPAQ H3970 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     0.635   5997         0.91     add integers
         544    23.818     23         0.10     add floats
         960     0.359   2674         3.03     access strings
         320    50.012      6         0.02     create objects
         160    16.999      9         0.09     copy objects
         480     3.471    138         0.33     perform selectors
         896    43.883     20         0.03     evaluate blocks

         640     6.84      93         0.17     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       41.625      0.08      generating fractonaccis
        6.124      0.18      generating primes*
       11.404      0.10      generating and parsing streams
       19.836      0.16      generating strings
        8.645      0.13      forming sets
       31.334      0.16      sorting strings
       24.806      0.23      sorcerer's apprentice*

       16.86       0.14      geometric mean*
Jornada 720 3.0VM
slopstones
        1000s    time    1000s of 
        itera-   sec-    iterations   slop- 
        tions    onds    per sec      stones   explanation 

        3808     1.051   3623         0.55     add integers
         544    16.031     34         0.14     add floats
         960     0.613   1566         1.78     access strings
         320    22.917     14         0.04     create objects
         160     7.41      22         0.20     copy objects
         480     2.781    173         0.41     perform selectors
         896    27.802     32         0.04     evaluate blocks

         640     5.410    118         0.21     geometric mean
smopstones
        time in    smop- 
        seconds    stones    explanation 

       22.905      0.14      generating fractonaccis
        3.024      0.37      generating primes*
        7.192      0.15      generating and parsing streams
       11.337      0.27      generating strings
        4.547      0.26      forming sets
       16.332      0.31      sorting strings
       13.6        0.41      sorcerer's apprentice*

        9.229      0.26      geometric mean*

Created: October 21, 2001
[Smalltalk home]