-
Notifications
You must be signed in to change notification settings - Fork 888
Add switch and metadata to separate algorithm approach types #615
Copy link
Copy link
Open
Description
Algorithms are currently not grouped by their underlying approach, which makes comparisons between fundamentally different methods unreliable. For example, comparing hnswlib with Glass is misleading since one is graph-based and the other combines graph and quantization.
Possible Solution:
- Require each author to specify the underlying algorithm type when submitting a method (e.g., graph-based, quantized, tree-based, hashing, neural, hybrid, etc.).
- Add this classification as metadata to the benchmark configuration.
- Extend the website visualization with a selector to filter and compare results by approach type.
This would support more transparent evaluations, fairer comparisons, and clearer research interpretation.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels