Compare in-memory vector storage with vector DB options to assess which one provides better performance for context retrieval during LLM interactions.

• Scope:

  • Set up in-memory vector storage and vector DB.
  • Test both methods for speed, scalability, and retrieval accuracy.
  • Provide a performance comparison with documented recommendations.

• Outcome:

  • Performance data comparing in-memory storage vs vector DB.
  • Clear recommendation for the vector storage approach.