Skip to content

devdo-eu/compact_llm_test

Repository files navigation

compact_llm_test

The repository contains the code (template) used for testing compact LLM models.

  • The QAData.json file contains all 570 questions used to test models from Polish history.
  • The judge_belik.ipynb file contains the code used to evaluate the responses of all tested models in “LLM as judge” mode.
  • The check_response_times.ipynb file contains the code used to determine the normalized response times of the models.
  • Files with the prefix 0experiment_ contain logs from the model tests.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •