AI>In The News

Web Bench - A new way to compare AI Browser Agents

CommunityNews

CommunityNews

Web Bench - A new way to compare AI Browser Agents

TL;DR: Web Bench is a new dataset to evaluate web browsing agents that consists of 5,750 tasks on 452 different websites, with 2,454 tasks being open sourced. Anthropic Sonnet 3.7 CUA is the current SOTA, with the detailed results here.

Over the past few months, Web

Read in full here:

View thread on forum
#browser#web
0 321 0

Where Next?

View thread on forum
browser
web
Home AI>In The News
#browser#web
0 321 0
Last post

Popular Ai topics Top

First poster: bot
AI>In The News

Combating Anti-Blackness in the AI Community
In response to a national and international awakening on the issues of anti-Blackness and systemic discrimination, we have penned this pi...
devinguillory.com
#community/diversity
0 1266 1
New
First poster: CommunityNews
AI>In The News

Everyone wants to do the model work, not the data work: Data Cascades in High-Stakes AI (pdf)
AI models are increasingly applied in high-stakes domains like health and conservation. Data quality carries an elevated signifi- cance i...
storage.googleapis.com
#pdf
0 1440 0
New
First poster: CommunityNews
AI>In The News

What is artificial intelligence and why is it important?
Many recent big advances in tech have one key thing at the heart of then: artificial intelligence.
bbc.co.uk
#basics
0 1277 0
New
First poster: bot
AI>In The News

An ancient language has defied translation for 100 years. Can AI crack the code?
An ancient language has defied decryption for 100 years. Can AI crack the code?. Machine learning can translate between two known langua...
restofworld.org
#code
0 695 0
New
CommunityNews
AI>In The News

Imagen: An AI system that creates photorealistic images from input text
We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understandin...
imagen.research.google
3 1131 1
New
First poster: CommunityNews
AI>In The News

How to fix the eyes in AI-generated images
aidemos.info
0 3922 0
New
First poster: AstonJ
AI>In The News

Why AI is still dumb and not scary at all (pt.1)
How I Learned to Stop Worrying and Love the AI
tejo.substack.com
15 462 9
New
First poster: TimButterfield
AI>In The News

Introducing Kiro - a new agentic IDE
A new agentic IDE that works alongside you from prototype to production
kiro.dev
6 596 6
New
CommunityNews
AI>In The News

New AI model turns photos into explorable 3D worlds, with caveats
Openly available AI tool creates steerable 3D-like video, but requires serious GPU muscle.
arstechnica.com
0 523 0
New
First poster: jkdiaz
AI>In The News

Vibe coding has turned senior devs into ‘AI babysitters,’ but they say it’s worth it
TechCrunch spoke to experienced coders about their time using AI-generated code about what they see as the future of vibe coding.
techcrunch.com
#coding#techcrunch
0 538 2
New

Other popular topics Top

Devtalk
General Dev>Dev Chat

What dev-related stuff have you been up to?
Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...
#community
1042 20430 390
New
AstonJ
General Dev>Hardware

Which keyboard do you have?
If it’s a mechanical keyboard, which switches do you have? Would you recommend it? Why? What will your next keyboard be? Pics always w...
#hardware/keyboards#sticky#mechanical-keyboards
144 8820 50
New
AstonJ
General Dev>Hardware

Seen any cool new keyboards?
We have a thread about the keyboards we have, but what about nice keyboards we come across that we want? If you have seen any that look n...
/keyboards#mechanical-keyboards
49 5587 39
New
AstonJ
Backend>Chat

How to install Ruby 3 with ASDF
In case anyone else is wondering why Ruby 3 doesn’t show when you do asdf list-all ruby :man_facepalming: do this first: asdf plugin-upd...
/ruby#asdf
11 5679 4
New
Margaret
General Dev>Dev Chat

PragProg’s Medium Posts
Hello everyone! This thread is to tell you about what authors from The Pragmatic Bookshelf are writing on Medium.
#pragprog#blog-post
1147 28379 760
New
PragmaticBookshelf
Backend>Learning Resources

Programming WebRTC
Use WebRTC to build web applications that stream media and data in real time directly from one user to another, all in the browser. ...
pragprog.com
#pragprog#published-book/js#webrtc/book-programming-webrtc
27 4743 6
New
Maartz
General Dev>Dev Chat

Roc Language - a new purely functional programming language built for speed and ergonomics
Hi folks, I don’t know if I saw this here but, here’s a new programming language, called Roc Reminds me a bit of Elm and thus Haskell. ...
#programminguages#functional-programming
49 4745 14
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Peter Ullrich (Author) Interview and AMA!
Author Spotlight: Peter Ullrich @PJUllrich Data is at the core of every business, but it is useless if nobody can access and analyze ...
/elixir/phoenix/book-building-table-views-with-phoenix-liveview
72 4211 21
New
PragmaticBookshelf
General Dev>Learning Resources

A Common-Sense Guide to Data Structures and Algorithms in Python, Volume 1
Big O Notation can make your code faster by orders of magnitude. Get the hands-on info you need to master data structures and algorithms ...
pragprog.com
#pragprog/python#published-book/book-a-common-sense-guide-to-data-structures-and-algorithms-in-python-volume-1
24 3803 11
New
PragmaticBookshelf
Backend>Learning Resources

Agile Web Development with Rails 8
Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...
pragprog.com
#pragprog#web-development/ruby/rails#published-book/book-agile-web-development-with-rails-8
12 5049 7
New
Back to top

Sponsor Spotlight

EEF

Supporting innovation across the BEAM ecosystem.

AI>In The News

AI In The News ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap