Search results

[BUG] [EVALS] SciFact tutorial: compute_ndcg_at_k uses mismatched gain scales for DCG (binary) vs IDCG (3) — depresses NDCG by ~3×

bugSomething isn't workingSomething isn't working

Status: Open.

#261 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 24, 2026

[BUG] [EVALS] SciFact tutorial notebook indexes queries.jsonl + test-queries.jsonl as corpus documents (glob="*.jsonl" overmatches)

bugSomething isn't workingSomething isn't working

Status: Open.

#260 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 24, 2026

[BUG] [EVALS] SciFact tutorial: NDCG@3 and MRR helpers iterate a set as if it has retrieval-rank order

bugSomething isn't workingSomething isn't working

Status: Open.

#259 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 24, 2026

[EVALS] gpt-5.4-nano reports ~3% accuracy in SciFact tutorial due to fragile prompt template + extract_solution regex

Status: Open.

#258 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 22, 2026

[DOCS] SciFact tutorial notebook claims "4 configurations" but RFGridSearch produces 8 runs

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#257 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 22, 2026

[BUG] [FIT] SFT-FSDP Lite Notebook - All runs Failed

bugSomething isn't workingSomething isn't working

P0Blocker Issues / Issues with most critical featuresBlocker Issues / Issues with most critical features

Status: Open.

Bug

#255 In RapidFireAI/rapidfireai;

· chethan-rfai opened on May 22, 2026

[BUG] [EVALS] NDCG metrics not displayed on ML-Flow UI charts

bugSomething isn't workingSomething isn't working

P1Issue with Non Critical FeaturesIssue with Non Critical Features

Status: Open.

Bug

#254 In RapidFireAI/rapidfireai;

· chethan-rfai opened on May 22, 2026

[BUG] [FIT] Cloned runs by default is set to run for 1 epoch while parent run is configured with max_steps

bugSomething isn't workingSomething isn't working

P1Issue with Non Critical FeaturesIssue with Non Critical Features

Status: Open.

Bug

#253 In RapidFireAI/rapidfireai;

· chethan-rfai opened on May 22, 2026

[BUG] MLflow only logs 3 pipeline params (model, rag_search_type, rag_k); chunk_size / embedder / reranker invisible in sweeps

Status: Open.

Bug

#246 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 14, 2026

[BUG] Evals config_set silently renames api_config to "pipeline" and accepts unknown keys that are never consumed

Status: Open.

Bug

#245 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 14, 2026

[BUG] normal_approximation crashes with math.sqrt domain error when estimate drifts past [0,1]

Status: Open.

Bug

#244 In RapidFireAI/rapidfireai;

· kamran-rapidfireAI opened on May 14, 2026

[BUG] evals controller hangs in busy-loop when actor leaks busy state

bugSomething isn't workingSomething isn't working

Status: Open.

#239 In RapidFireAI/rapidfireai;

· ekirimlioglu opened on May 4, 2026