Describe a workload. The demonstrator characterises each stage as an orientation in Orientational Connective Logic, chooses its number format and representation, generates hardware organisations for it, rejects what cannot hold it, and runs it on the Quester GX-1 specification.
Start from a preset or edit the stages. Every result on this page updates as you type.
| Stage | Step | Format | Operations | GB touched | Regular | Forwarded | Feeds | Dense product |
|---|
The one free parameter of the design comparison. A fully specialised element is taken to be this many times better than the reference GPU. No measurement stands behind it. At 1.0× the uniform design cannot be beaten.
Four signs per stage: number precision, access pattern, what bounds it, and locality. Stages with the same signs are Parallel and form one class. Stages whose signs differ on three or four counts Resist each other.
| Stage | Format | Character | Precision | Access | Bound by | Locality | Class | Resists |
|---|
A format is allowed only if its worst-case rounding error stays within the stage’s tolerance. Tighten the tolerance and the format widens; ask for the impossible and the stage is rejected.
| Format | Bits | Worst-case error | Verdict |
|---|
Bound: γk·κ with γk = k·u/(1−k·u), u the unit roundoff, k the accumulation length (or the tree depth plus one). Worst case, so formats that work in practice for statistical reasons can fail it. An accumulation length of 1 means sums are held in a wider format.
A dense matrix product can be rewritten as a low-rank, sparse or banded one when the data has that structure. The change is accepted only if the stage, conversion included, gets faster. An accepted change is applied to the workload above and can alter the stage’s character.
| Representation | Operations | GB touched | Conversion share | Time on the reference GPU | Decision |
|---|
| Element | Serves | Free signs | Area |
|---|
Each stage of the fastest generated design carries one of TSAM’s five values at every moment. Set a deadline, or break a stage and watch the failure reach everything that depends on it. With recovery on, a broken stage is rolled back and run again, at the cost of its time.
| Stage | Value now | κ | Limit ρ | At the deadline | Why |
|---|
This panel executes a real computation in your browser: a 32 × 32 matrix product in double precision, checked against a checksum identity that must hold up to rounding. Inject an error and see whether the check catches it and the transaction recovers.
Invariant: for every column j, Σi Cij = Σk (Σi Aik)·Bkj. Tolerance: 5·N·u·Σ|A||B|. An error smaller than the rounding tolerance cannot be told from rounding, and the check says so.
Eight heterogeneous chiplets. Areas were sized by search over 150 random workloads and scored on 400 others. An equal split was tested and dropped: on the six reference workloads it left half the compute area idle.
| Chiplet | Takes | Free signs | Area | Stages routed here now |
|---|
| Stage | Chiplets able to take it | Chosen | Because |
|---|
A proposed architecture. The mapping from each role to the four signs, the routing rule and the area floor of 2% are modelling choices. Designs are compared at equal total area, so the model cannot value the main practical reason for chiplets: a package of several dies holds more silicon than one die can be made with.
Here the published specification is the device. The rates and memory figures below are design targets, entered as the model’s inputs. The table shows what a device with those figures would do with your workload, and where its peak rates would and would not be reached.
| Specification | Reference GPU | Quester GX-1 target | Ratio |
|---|
| Stage | Reference GPU | Quester target | Faster by | Bound by | Rate reached | Of its target | Data placed in | With cache |
|---|
Counting rules, to be confirmed: “120 PFLOPS sparse NVFP4” is read as NVIDIA reads its own “with sparsity” figures, the dense-equivalent rate at 2:4 structured sparsity, which is twice the operations performed. The other four targets are read as dense rates. A device without a format runs it at its next wider one. “Faster by” compares both devices without caches, because the reference GPU’s cache sizes are not public.
Where each line of the Quester GX-1 announcement appears on this page, and in what sense.
| Published line | On this page | Sense |
|---|
Each test had a failure condition fixed before it ran. T-2c and T-4 were pre-registered and run once on fresh instances.
| Test | Question | Outcome | Result |
|---|
The designs above assume that an element serving more kinds of work costs more per operation. On 15 November that assumption was tested against a component cost model built separately, with no geometric quantity in it. Its method and pass mark were fixed before the run, and the run was repeated independently with identical numbers.
pre-registered verdict Partial at 45 nm and not supported at 7 nm, against a rank-correlation bar of 0.6.
Cost never fell when a character was added to an element (25,440 checks). The count of signs on which characters disagree ranked designs better than precision count or pairwise distance, with a rank correlation of about 0.3 to 0.6 depending on set size. It falls short of the bar because the count stops distinguishing sets once they span all four signs.
| Finding in the independent model | Energy per operation | Area per unit rate |
|---|---|---|
| Mixing compute-bound and memory-bound work in one element | ×1.18 | ×1.87 |
| Mixing high and reduced precision | ×1.11 | ×1.37 |
| Mixing regular and irregular access | ×1.10 | ×1.39 |
| Mixing local and forwarded output | ×1.05 | ×1.16 |
| Largest gain from specialising (tensor role against a fully general element) | ×1.71 | ×2.86 |
A fully general element in that model costs ×1.64 in energy and ×3.26 in area against a specialised one. On this page’s gain slider that is a setting between 1.6× and 3.3×; the default is 2.0×. These gains are well below the 8× an equal split into eight chiplets would need. One value does not describe both energy and area, while this page uses a single value.
The cost model is analytical: about half of its 58 coefficients are estimates, three cited figures did not match their sources when checked, and no circuit was synthesised. An exploratory follow-up suggests the mean orientation of a set predicts this cost much better than the count does; that has not been tested on a separate model. Files and the verification record are in the package under records/external/argon_cost_test.
Arithmetic on public figures, not a result of this model. The last column follows the gain slider above.
| Published target | Times the reference | Power at reference efficiency | At the assumed gain |
|---|
Reference: NVIDIA H100 SXM, dense peak rates, 700 W (datasheet), a 2022 device, so these powers are upper estimates. Memory: JEDEC HBM4, 2 TB/s and 64 GB per stack (Semiconductor Engineering). For scale: NVIDIA’s Rubin GPU is announced at 50 PFLOPS NVFP4 inference with 288 GB and 22 TB/s of HBM4 (Tom’s Hardware); the Blackwell B200 at 9 PFLOPS dense FP4, 4.5 PFLOPS dense FP8, 40 TFLOPS FP64 and 1 kW (Tom’s Hardware).