The documents of the bench
FoQLens is a language model whose weights are read at a precision set by the meaning of the query; its mechanism is FoQZones, focusable quantization zones. This is the documentation of the bench that tests it - the mechanism, the goals, the plan and every preregistration.
Every document below is a markdown file in the repository, and each link goes to its source.
The idea
- The precision regulator · docs/precision-regulator.md
- The glossary · docs/glossary.md
- The mathematics of the bench · docs/bench-math.md
- Zone strategies · docs/zone-strategies.md
- The .refocustensors model format · docs/refocustensors.md
- The kernel that reads the copy · docs/kernels.md
- Performance of the bench · docs/performance.md
- Problem statement · docs/problem-statement.md
- Goals · docs/goals.md
- Plan · docs/plan.md
- Hypotheses · docs/hypotheses.md
What the bench measures on
- The corpus · docs/corpus.md
- Invariants · docs/invariants.md
- Data sources · docs/data-sources.md
- The data of the runs · docs/data.md
Around it
- Visual metaphor · docs/visual-metaphor.md
- Prior art · docs/prior-art.md
- Reading notes · docs/reading-notes.md
- The station · docs/station.md
Preregistration
- Preregistration (English) · prereg/PREREGISTRATION.md
- Пререгистрация (original) · prereg/PREREGISTRATION.ru.md
Experiments
- E001 - uniform quantization on the corpus · experiments/E001-uniform-quantization/results.md
- E002 - uniform quantization with a working base precision D2 · experiments/E002-base-precision-d2/results.md
- E003 - the ladder over a calibrated base · experiments/E003-calibrated-base/results.md
- E004 - the address of a query · experiments/E004-question-address/results.md
- E005 - the precision map of a query · experiments/E005-precision-map/results.md
- E006 - retention of knowledge by the filter's map · experiments/E006-filter-map-retention/results.md