Chatbots Are Cheating on Their Benchmark Tests

Generative-AI companies have been selling a narrative of unprecedented, endless progress. Just last week, OpenAI introduced ...
AOL

New benchmark tests speed of running AI models

(Reuters) - An artificial intelligence benchmark group called MLCommons unveiled the results on Monday of new tests that determine how quickly top-of-the-line hardware can run AI models. A Nvidia Corp ...
Yahoo

New AI benchmark tests speed of responses to user queries

SAN FRANCISCO (Reuters) - Artificial intelligence benchmarking group MLCommons on Wednesday released a fresh set of tests and results that rate the speed at which top-of-the-line hardware can run AI ...
SiliconANGLE

AI startup Sierra’s new benchmark shows most LLMs fail at more complex tasks

Generative artificial intelligence startup Sierra Technologies Inc. is taking it upon itself to “advance the frontiers of conversational AI agents” with a new benchmark test that evaluates the ...

Artificial Analysis overhauls its AI Intelligence Index, replacing popular benchmarks with 'real-world' tests

Artificial Analysis overhauls its AI Intelligence Index, replacing saturated benchmarks with real-world tests measuring ...
Business Insider

VERSES Challenges AI Industry with Benchmark Tests

VANCOUVER, British Columbia, Feb. 22, 2024 (GLOBE NEWSWIRE) -- VERSES AI Inc. (CBOE:VERS) (OTCQB:VRSSF) (“VERSES” or the “Company”), a cognitive computing company developing next-generation ...