Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
viraptor
on Sept 21, 2024
|
parent
|
context
|
favorite
| on:
Forget ChatGPT: why researchers now run small AIs ...
It's pretty much happening already. Apple devices have MPS. Both new Intels and Snapdragon X have some form of NPU.
moffkalast
on Sept 21, 2024
[–]
It would be great if any NPU that currently exists was any good at LLM acceleration, but they all have really bad memory bottlenecks.
Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact