Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
benchmarking
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
My A/B rig had 95% confidence intervals and was wrong in both directions
realist
realist
realist
Follow
Nov 9
My A/B rig had 95% confidence intervals and was wrong in both directions
#
rust
#
performance
#
benchmarking
#
hackathon
Comments
Add Comment
9 min read
Moderation
LLM Evaluation, Explained: How a Benchmark Produces Comparable Numbers (TL;DR)
RESK
RESK
RESK
Follow
Nov 9
LLM Evaluation, Explained: How a Benchmark Produces Comparable Numbers (TL;DR)
#
llm
#
benchmarking
#
evaluation
#
ai
Comments
Add Comment
4 min read
Moderation
The agent called the framework's MCP server in 0 of 5 runs
Cole Halton
Cole Halton
Cole Halton
Follow
Nov 7
The agent called the framework's MCP server in 0 of 5 runs
#
ai
#
testing
#
mcp
#
benchmarking
Comments
Add Comment
6 min read
Moderation
How to install Siege on Ubuntu ( The Most Advanced Benchmarking Tool)
FlatlinerAtheist | CLI-NERDS
FlatlinerAtheist | CLI-NERDS
FlatlinerAtheist | CLI-NERDS
Follow
Nov 2
How to install Siege on Ubuntu ( The Most Advanced Benchmarking Tool)
#
devops
#
benchmarking
Comments
Add Comment
4 min read
Moderation
LLM Evaluation That Actually Compares: Inside the FreeCAD Fix Benchmark
RESK
RESK
RESK
Follow
Nov 1
LLM Evaluation That Actually Compares: Inside the FreeCAD Fix Benchmark
#
llm
#
benchmarking
#
evaluation
#
freecad
Comments
Add Comment
4 min read
Moderation
FP8 Cut Our TPOT by 25%. At High Concurrency, It Also Changed the Answers.
Huilin Ye
Huilin Ye
Huilin Ye
Follow
Oct 30
FP8 Cut Our TPOT by 25%. At High Concurrency, It Also Changed the Answers.
#
llm
#
vllm
#
quantization
#
benchmarking
Comments
Add Comment
3 min read
Moderation
AI Agent Evaluation, End to End: How LFORLA Scores a Drone Build
RESK
RESK
RESK
Follow
Oct 28
AI Agent Evaluation, End to End: How LFORLA Scores a Drone Build
#
ai
#
benchmarking
#
agents
#
evaluation
Comments
Add Comment
4 min read
Moderation
Go 1.28 HTTP/2 Parking: Measuring Memory Savings
Mohammad Abdolirad
Mohammad Abdolirad
Mohammad Abdolirad
Follow
Oct 26
Go 1.28 HTTP/2 Parking: Measuring Memory Savings
#
go
#
http2
#
performance
#
benchmarking
Comments
Add Comment
5 min read
Moderation
AI Agent Evaluation End to End: How LFORLA Scores a LEGO Build From Brief to Render
RESK
RESK
RESK
Follow
Oct 20
AI Agent Evaluation End to End: How LFORLA Scores a LEGO Build From Brief to Render
#
ai
#
benchmarking
#
agents
#
evaluation
Comments
Add Comment
5 min read
Moderation
Benchmarking an Agent Without Lying to Yourself
Harrison Guo
Harrison Guo
Harrison Guo
Follow
Oct 15
Benchmarking an Agent Without Lying to Yourself
#
ai
#
machinelearning
#
benchmarking
#
testing
Comments
Add Comment
5 min read
Moderation
Benchmarking S3 Throughput: How to Measure Without Lying
Ethan Carter
Ethan Carter
Ethan Carter
Follow
Oct 14
Benchmarking S3 Throughput: How to Measure Without Lying
#
s3
#
performance
#
benchmarking
#
storage
Comments
Add Comment
11 min read
Moderation
csperf Diff: Comparing Two Runs Without Spreadsheet Chaos
compilersutra
compilersutra
compilersutra
Follow
Oct 12
csperf Diff: Comparing Two Runs Without Spreadsheet Chaos
#
csperf
#
diff
#
benchmarking
#
performance
Comments
Add Comment
4 min read
Moderation
We Wanted a Fast Offline AI. First, We Had to Fix Our Benchmark.
LastBrowser
LastBrowser
LastBrowser
Follow
Oct 11
We Wanted a Fast Offline AI. First, We Had to Fix Our Benchmark.
#
webdev
#
ai
#
llm
#
benchmarking
Comments
Add Comment
22 min read
Moderation
I Built a Benchmark That Catches AI Models Cheating (And They All Failed)
Ratnesh Saxena
Ratnesh Saxena
Ratnesh Saxena
Follow
Oct 11
I Built a Benchmark That Catches AI Models Cheating (And They All Failed)
#
kagglechallenge
#
ai
#
llm
#
benchmarking
Comments
Add Comment
3 min read
Moderation
Noise Sources: Affinity, Frequency, and Background Load — How to isolate and quantify non‑compiler variance with csperf
compilersutra
compilersutra
compilersutra
Follow
Oct 10
Noise Sources: Affinity, Frequency, and Background Load — How to isolate and quantify non‑compiler variance with csperf
#
methodology
#
benchmarking
#
csperf
#
performance
Comments
Add Comment
3 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account