Problem

With the current design of the AI Bridge, all the AI traffic goes through coderd and the main PostgresDB, and when a deployment scales for 1000s of users, this could be problematic.

Let's run scale tests to gauge its impact and decide if we need a more modular architecture.

This may require designing a new load generator.