3outeille (Ferdinand Mom) · GitHub

3outeille/README.md

Research engineer at HuggingFace, Large scale pretraining
Interested in Efficient Transformer, CPU & GPU black magic.
My resume.

Pinned Loading

huggingface/transformers huggingface/transformers Public

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python 154k 31.6k
huggingface/picotron huggingface/picotron Public

Minimalistic 4D-parallelism distributed training framework for education purpose

Python 1.9k 149
huggingface/nanotron huggingface/nanotron Public

Minimalistic large language model 3D-parallelism training

Python 2.4k 262
CNNumpy CNNumpy Public

A Numpy implementation of a Convolutional Neural Network: slow & fast (im2col/col2im).

Python 58 11
Yaae Yaae Public

Yaae: Yet another autodiff engine (written in Numpy).

Python 28
pathtracer-rust pathtracer-rust Public

A naive Monte Carlo Pathtracer written in Rust

Rust 7 1