GENet look promising in the paper. Better or similar results as EfficientNet/MobileNet with faster inference time.
Pytorch implementation: https://github.com/idstcv/GPU-Efficient-Networks
It composed of 3 networks:

• GENet_large (31M param)
• GENet_normal (21M param)
• GENet_small (8.17M)

Paper here: https://arxiv.org/abs/2006.14090

Sotabench: https://sotabench.com/user/EvgeniiZh/repos/Randl/GPU-Efficient-Networks
For example: GENet_large does similar result to EfficientNet B1 (NoisyStudent) but is 1.9x faster.

Is it in your plan to implement it?
I'm maybe thinking to give it a try if I got some time.

Tell me if I'm wrong but It could also be a good backbone for EfficientDet ?

Thanks again @rwightman for all the work you've done!