counterweight/hojas
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

lots of stuff

Browse source
This commit is contained in:
counterweight 2026-07-23 12:16:52 +02:00
parent b8225c639e
commit b9ad9215cc
Signed by: counterweight
GPG key ID: 883EDBAA726BD96C
1393 changed files with 84963 additions and 5687 deletions
Download patch file Download diff file Expand all files Collapse all files

7
interesting/llms-are-bad-at-real-world-sql.md Normal file
View file

@ -0,0 +1,7 @@
# LLMs are bad at real world SQL
https://cacm.acm.org/blogcacm/if-you-think-you-can-do-real-world-text-to-sql/
An interesting article from an academic blog that explains something I had sensed for quite a long time: LLMs may seem to perform a decent job at translating natural language requests into SQL queries. But that only holds on pristine, lab-grade database schemas. The moment you jump into a messy, real database, it all breaks down.
This guys replicated some benchmarks on a nasty DWH database and suddenly, success rates went down from 80% of cases to an astounding... 0%. Way to go Claude.