Noam Brown
Person on 3 sites
Research scientist at OpenAI, who built the poker AIs Libratus and Pluribus and helped pioneer test-time compute and reasoning in language models.
-
5 facts on wiqqi (opens wiqqi.app)
Who people, organisations and podcasts are, and how they connect, with sources.
Updated 2026-11-01 -
2 channels on ppll (opens ppll.app)
Where public figures publish, and what they are on record saying.
Updated 2026-10-27 -
18 beliefs on korrents (opens korrents.com)
-
Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used. (opens korrents.com)
“I think the reason why it doesn't show up as so much better on the benchmarks is because the benchmarks are being presented, the benchmark results are being presented in the wrong way. They're not controlling for the…”
-
Running a model until its performance plateaus is no longer a usable evaluation rule, because a well-scaffolded model keeps improving for weeks. (opens korrents.com)
“But what we're seeing today with the modern models is that 5.5 and other models can think for if you scaffold them reasonably well, can think for weeks even um before having performance plateau on some of these…”
-
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. (opens korrents.com)
“my claim is the proper way to evaluate the models now is you either have some kind of budget for the benchmark whether it's tokens or cost or time or whatever or you plot the performance as a function of the amount of…”
-
Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used. (opens korrents.com)