Expressive Vector Engine – SIMD in C++

1. eve

   1 10 1,279 9.4 C++

   Expressive Vector Engine - SIMD in C++ Goes Brrrr (by jfalcou)

   

   Here is a bunch of simple examples: https://github.com/jfalcou/eve/blob/fb093a0553d25bb8114f1396...

   I personally think we have the following strenghs:

   * Algorithms. Writing SIMD loops is very hard. We give you a lot of ready to go loops. (find, search, remove, set_intersection to name a few).

2. Stream

   getstream.io featured

   Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

   

3. xsimd

   2 5 2,565 9.3 C++

   C++ wrappers for SIMD intrinsics and parallelized, optimized mathematical functions (SSE, AVX, AVX512, NEON, SVE, WebAssembly, VSX, RISC-V))

   

   Interesting library, but i see it falls back into what happens to almost all SIMD libraries, which is that they hardcode the vector target completely and you cant mix/match feature levels within a build. The documentation recommends writing your kernels into DLLs and dynamic-loading them which is a huge mess https://jfalcou.github.io/eve/multiarch.html

   Meanwhile xsimd (https://github.com/xtensor-stack/xsimd) has the feature level as a template parameter on its vector objects, which lets you branch at runtime between simd levels as you wish. I find its a far better way of doing things if you actually want to ship the simd code to users.

4. zimt

   3 1 49 5.6 C++

   header-only C++ template library to process n-dimensional arrays with multithreaded SIMD code

   

   +1, dynamic dispatch is important. Our Highway library has extensive support for this.

   Detailed intro by kfjahnke here: https://github.com/kfjahnke/zimt/blob/multi_isa/examples/mul...

5. gemma.cpp

   4 9 6,644 9.4 C++

   lightweight, standalone C++ inference engine for Google's Gemma models.

   

   As mentioned ("re-include our source file"), we are indeed able to put the SIMD code, as well as the self-#include of itself, in a load.cxx TU.

   Here is an example: https://github.com/google/gemma.cpp/blob/9dfe2a76be63bcfe679...

Suggest a related project