vision-camera-realtime-object-detection VS coral-pi-rest-server

📦 VisionCamera Realtime Object Detection with TensorFlow Lite - demo

They were completely sold out for 2-3 years (2020 onwards), and Google wiped documentation (https://coral.ai/products/accelerator/ redirects to the main page, which has no reference to the original Coral). I can't tell where there's an official place to buy this. I see some on Amazon, but that might be resold.

OP is probably using an AI accelerator like this: https://coral.ai/products/accelerator which works great on a PI and uses very little power. It will do the Yolo part, but you can't really expect it to do the multimodal LLM part, although you could try to run Florence directly on the PI too.

That said, you can always look at something like https://coral.ai/products/accelerator/ to help with the performance you need.

Should only be ~$60 https://coral.ai/products/accelerator/

The Coral USB accelerator might be of interest if you want to do some light ML with a low power budget.

However, a pi doesn't have the strength to run something like Llama.cpp, of course, so I've been considering using something like the Coral USB Accelerator (https://coral.ai/products/accelerator). As I've been learning more about it, it seems to be very geared towards TensorFlow Lite models. But whisper.cpp and Llama.cpp use ggml models.