Skip to main content

VSA Math Benchmark Suite — MATH-003

Branch: ralph/math-framework Tech Tree Node: MATH-003 Level: 11.39


Key Metrics​

MetricValueStatus
Operations benchmarked6 (bind, unbind, bundle2, bundleN, similarity, permute)Complete
Dimensions tested1024, 4096, 10000Complete
Memory compression vs float3219.5-20.0xVerified
Bundle-N recall curveN=3..500Complete
Convergence validation3 tests (bind recovery, bundle3, orthogonality)Complete
Proof verification12 proofs timedComplete
Comparison tableTernary vs Float32 vs Int8 vs BinaryComplete

What This Means​

For Users​

  • 20x memory savings over float32 representations, validated across all tested dimensions
  • Add-only compute for bind/unbind (no multiply), enabling efficient hardware implementations
  • Quantified recall curves showing bundle capacity limits at every scale from N=3 to N=500

For Operators​

  • Benchmark suite runs via zig build bench-math with ReleaseFast optimization
  • 7-section suite covers all critical VSA operations
  • Results are reproducible with deterministic seeded vectors

For Researchers​

  • Information density: 1.585 bits/trit (log2(3)), 58.5% more than binary
  • Convergence: Bind/unbind recovery > 0.60, bundle3 signal > 0.15, orthogonality < 0.10
  • Recall curve: Empirical vs theoretical 1/sqrt(N) model comparison

Technical Details​

Architecture​

The benchmark suite (benchmarks/bench_math.zig) imports the core VSA module and bundle optimizer:

  • vsa module: bind, unbind, bundle2, bundle3, cosineSimilarity, permute
  • bundle_opt module: BundleAccumulator, bundleN

Benchmark Sections​

  1. Operation Throughput: ops/sec and ns/op for each VSA primitive at 3 dimensions
  2. Bundle-N Throughput: Accumulator performance scaling from N=3 to N=500
  3. Memory Efficiency: Packed ternary (5 trits/byte) vs float32/binary/theoretical
  4. Recall Curve: Bundle capacity analysis with theory comparison
  5. Convergence Validation: Statistical validation over multiple trials
  6. Proof Verification Time: 12 algebraic proofs timed at 1000 iterations each
  7. Comparison Table: Multi-format information density comparison

Memory Comparison (dim=1024)​

FormatBytesBits/elementCompression
Ternary packed2051.601.0x (baseline)
Float32409632.0020.0x more
Int810248.005.0x more
Binary packed1281.000.6x less

Conclusion​

MATH-003 provides a comprehensive, reproducible benchmark suite that quantifies the ternary VSA advantage across all critical dimensions: throughput, memory, recall, and convergence. The 20x memory savings vs float32 and add-only compute model are validated with empirical data.

Next steps: Run benchmarks on target hardware platforms, compare with SIMD-optimized implementations (OPT-001).


phi^2 + 1/phi^2 = 3 = TRINITY