Benchmark - DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Ward Ed

Nov 9

SWE-bench Multilingual on Hugging Face: 15 of 34 Scores Are Not a Count Out of 300 Tasks

#ai #machinelearning #benchmark #llm

15 min read

Nokka

Nov 9

โมเดลเดียวกัน แต่ผลต่างเกือบ 40 จุด: Harness Leaderboard บอกว่าควรเลือกตัวครอบ AI อย่างไร

#ai #benchmark #opensource

2 min read

jamilxt

Nov 8

A 6 GB GPU Runs a 26B LLM at 45 Tokens per Second. How to Test the Claim

#llm #machinelearning #opensource #benchmark

7 min read

Ward Ed

Nov 8

olmOCR-bench on Hugging Face: Three Rows Use a Different Average, and One Moves From 13th to 7th or 19th

#ai #machinelearning #ocr #benchmark

14 min read

QuantID

Nov 8

The Benchmark That Writes a New Exam Every Month: SuperCLUE's November 2026 Board, 19 Models, One Table

#ai #llm #benchmark #machinelearning

4 min read

김민식/학생

Nov 8

Оценка, которая каждый месяц пишет новый экзамен: ноябрьская таблица SuperCLUE 2026, 19 моделей в одной таблице

#ai #llm #benchmark #machinelearning

2 min read

김민식/학생

Nov 8

La evaluación que reescribe su examen cada mes: el tablero de SuperCLUE de noviembre de 2026, 19 modelos en una tabla

#ai #llm #benchmark #machinelearning

4 min read

GINIGEN AI

Nov 8

One Week, Three Public Numbers: 73.68 Open-Weight #1 in Math Reasoning, 290 of 290 Actions Denied, 3.15M On-Device Downloads

#ai #llm #benchmark #security

3 min read

Avery Wang

Nov 7

Write the Provenance Ledger Before the Benchmark Number

#ai #testing #python #benchmark

5 min read

QuantID

Nov 8

毎月、問題を作り直す評価機関: SuperCLUE 2026年11月ボード、世界最前線19モデルを一枚の表に

#ai #llm #benchmark #machinelearning

2 min read

Dakota Lin

Nov 7

Tokens per Accepted Patch: The Only AI Metric I Keep

#performance #ai #benchmark #opensource

5 min read

RESK

Nov 7

How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary

#llm #evaluation #benchmark #safety

4 min read

Ward Ed

Nov 7

Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM

#ai #machinelearning #speechrecognition #benchmark

16 min read

Avery Wang

Nov 6

Calibrate the Task Set Before You Scale the Run

#ai #testing #python #benchmark

6 min read

Matt

Nov 6

We beat Mem0 on their own benchmark, on their own terms. Now we can't submit it.

#ai #llm #agents #benchmark

14 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.