What Every Developer Should Know About GPU Computing

1. ADIOS2

   1 2 313 9.7 C++

   Next generation of ADIOS developed in the Exascale Computing Program

   

2. Stream

   getstream.io featured

   Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

   

3. llama.cpp

   2 949 91,658 10.0 C++

   LLM inference in C/C++

   

4. TinyLlama

   3 15 8,780 8.4 Python

   Discontinued The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

   

5. public

   4 1 16 10.0 C++

   A collection of my cources, lectures, articles and presentations (by alexander-titov)

   

   Also check out this talk and slides from few years ago about CPU and GPU nitpicks

   Alexander Titov — Know your hardware: CPU memory hierarchy https://youtu.be/QOJ2hsop6hM

   https://github.com/alexander-titov/public/blob/master/confer... Your Hardware - CPU Memory Hierarchy -- Alexander Titov -- C%2B%2B Moscow Meetup March 2019.pdf

   https://github.com/alexander-titov/public/blob/master/confer... - what it is and why you should care -- Alexander Titov -- CoreHard 2019.pdf

6. AdaptiveCpp

   5 23 1,759 9.3 C++

   Compiler for multiple programming models (SYCL, C++ standard parallelism, HIP/CUDA) for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!

   

   Sapphire Rapids is a CPU.

   AMD's primary focus for a GPU software ecosystem these days seems to be implementing CUDA with s/cuda/hip, so AMD directly supports and encourages running GPU software written in CUDA on AMD GPUs.

   The only implementation for sycl on AMD GPUs that I can find is a hobby project that apparently is not allowed to use either the 'hip' or 'sycl' names. https://github.com/AdaptiveCpp/AdaptiveCpp

7. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

Suggest a related project