Skip to content

Conversation

@CharlieFRuan
Copy link
Member

@CharlieFRuan CharlieFRuan commented May 4, 2025

We add the following models:

  • Qwen3-0.6B: q0f16, q0f32, q4f16_1, q4f32_1
  • Other Qwen3: {1.7B, 4B, 8B} x {q4f16_1, q4f32_1}

Compiled at:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant