[Smalltalk home]

Benchmarks Results

Updated: Dec 11, 2000.
  1. STones80 benchmark
  2. VWNC3.0 performance comparison

OS & Machine

Test as below with Macintosh and Gateway Wintel Box.

[Windows3.1/DOS5.0] (reference machine)
Amax 486DX/33, 256K external cache, 16MB RAM,
Windows 3.1, DOS 5.0
[MacOS 9.0.4J]
PowerBook G3 500MHz, 256MB RAM,
MacOS9.0.4J, 12GB ATA Disk.
[MacOS 9.0.4J Cube]
Power Macintosh G4 Cube 450MHz, 320MB RAM,
MacOS9.0.4J, 20GB Ultra ATA Disk.
[MacOS 9.0.2J]
PowerBook G3 500MHz, 256MB RAM,
MacOS9.0.2J, 12GB ATA Disk.
[MacOS 9.0J]
PowerPC G4 350MHz, 224MB RAM,
MacOS9.0J, 10GB ATA Disk.
[MacOS 8.5.1J]
Power Macintosh 8500/120, G3 (PowerPC750/233) card, 176MB RAM,
MacOS8.5.1J, 2GB SCSI Disk.
[MacOS 8.1J]
Power Macintosh 8500/120, G3 (PowerPC750/233) card, 176MB RAM,
MacOS8.1J, 2GB SCSI Disk.
[MacOS 8J]
Power Macintosh 8500/120, G3 (PowerPC750/233) card, 176MB RAM,
MacOS8J, 2GB SCSI Disk.
[Windows95]
Gateway2000 G6/200, Pentium Pro 200MHz, 64MB RAM,
Windows95 4.00.950B, 2GB IDE Disk.
[Windows98]
IBM ThinkPad model 1479, Pentium Pro 366MHz, 192MB RAM,
Windows98 4.10.1998, 6GB IDE Disk.

STones80 benchmark

"STones80: low and medium level benchmarks" was originally written by Bruce Samuelson in 1993 for ST80, ObjectWorks R4.0, R4.1 and ST/V. For SmalltalkAgents ported by someone of QKS (?), for Squeak ported by me.

STones80 benchmark Results
environment slopstones smopstones slop + smop / 2 OS & Machine
VisualWorks 1.0 1.000 1.000 1.000 [Windows3.1/DOS5.0]
above is the definition of reference machine and environment from original source code.
VisualWorks 5i.1
(Non-Commercial)		 28.71 35.95 32.33 [MacOS 9.0.2J]
VisualWorks 5i.2
(Non-Commercial)		 25.28 35.82 30.55 [MacOS 9.0.4J]
VisualWorks 5i.2
(Non-Commercial)		 19.97 26.57 23.27 [MacOS 9.0.4J Cube]
VisualWorks 5i.1
(Non-Commercial)		 17.47 28.78 23.13 [Windows98]
VisualWorks 3.1
(Non-Commercial)		 16.85 23.29 20.07 [Windows98]
VisualWorks 5i.1
(Non-Commercial)		 12.30 15.52 13.91 [MacOS 8.5.1J]
VisualWorks 2.5.2 11.39 13.84 12.62 [MacOS 8.5.1J]
VisualWorks 2.5.1 11.19 13.17 12.18 [MacOS 8.5.1J]
VisualWorks 3.0a
(Non-Commercial)		 10.07 13.81 11.94 [MacOS 8.5.1J]
VisualWorks 3.0
(Non-Commercial)		 9.59 12.62 11.11 [Windows95]
Squeak 2.8 Jitter 3.1 8.23 9.03 8.63 [MacOS 9.0.4J]
Squeak VM 2.7 PPC 3.93 * 3.54 * 3.74 [MacOS 9.0.2J]
VisualWorks 2.5 2.64 4.70 3.67 [MacOS 8.5.1J]
Squeak 2.8.2 3.85 * 3.39 * 3.62 [MacOS 9.0.4J]
Squeak 2.8 3.25 * 3.30 * 3.28 [MacOS 9.0.4J]
Squeak VM 2.7 PPC 2.67 * 2.40 * 2.54 [MacOS 9.0J]
SmalltalkAgents 2.2b1 1.81 3.23 2.52 [MacOS 8J]
Squeak 2.5 * 2.77 * 2.24 * 2.51 [Windows98]
MPWsqueak * 1.94 * 1.67 * 1.81 [MacOS 8.5.1J], build with MPW 3.4.3, from VM 2.4b, 2.4c image
VisualWorks 3.0
(Non-Commercial)		 1.53 1.88 1.71 VirtualPC 1.0 (Windows95), [MacOS 8.1J]
Squeak VM 2.5 PPC * 1.84 * 1.56 * 1.70 [MacOS 8.5.1J]
Squeak VM 2.7 PPC * 1.81 * 1.57 * 1.69 [MacOS 8.5.1J]
Squeak VM 2.6 PPC * 1.80 * 1.53 * 1.67 [MacOS 8.5.1J]
Squeak VM 2.4 PPC (c) * 1.83 * 1.51 * 1.67 [MacOS 8.5.1J]
VisualWorks 3.0a
(Non-Commercial)		 1.59 1.73 1.66 VirtualPC 2.1.2 (Windows98), [MacOS 8.5.1J]
Squeak VM 2.4 PPC (b) * 1.79 * 1.51 * 1.65 [MacOS 8.5.1J]
Squeak 2.4 * 1.35 * 0.96 * 1.16 [Windows95]
Squeak 2.4b * 1.30 * 0.97 * 1.14 [Windows95]
Smalltalk/V Mac 1.1 1.00 0.68 0.84 [MacOS 8.1J]
Squeak 1.31 * 1.22 * 0.43 * 0.83 [Windows95]
Squeak 1.31 * 1.05 * 0.59 * 0.82 [MacOS 8J]
Squeak 1.31 (Jitter) 0.84 0.59 0.72 [MacOS 8J]
Squeak 1.31 (Jitter) 0.73 0.47 0.60 [Windows95]
Smalltalk/V 2.0.3d4 0.66 0.53 0.60 [MacOS 8J]
*
2 test of SmopstoneBenchmark benchmark is intended to test the efficiency of recursively calling a block, that it isn't supported by conventional VM. So the result would be fairly pointless.

VWNC3.0 performance comparison

see Smalltalk benchmark on Win95, WinNT, and Linux (in Japanese) by Mr. WATANABE.

  1. primitive
    Running all test of $VISUALWORKS/advanced/ATBenchmarks.pcl, (3 iterations) and gets harmonic mean. Here is Settings. ... What a ugly Dialog... X-< 
    [MacOS 8.5.1J] 3570.0 : details of [MacOS 8.5.1J]
[Windows95]    3510.0 : details of [Windows95]
  2. I/O
    filing-in source code of IPA016.tar.gz (4891KB), about 50 classes, 500KB size. According to the advice from Mr. WATANABE, I modify original source code that IpaSystem class>>install never be sent. 
    [MacOS 8.5.1J] 183800 msec
[Windows95]     58347 msec
Created: Feb 17, 1998
[Smalltalk home]