Repositories
Neural Network Intelligence (NNI)
Blog: https://nni.readthedocs.io/en/latest/CommunitySharings/NNI_AutoFeatureEng.html
Repository: https://github.com/microsoft/nni
Vision Transformer Implementation
Repository: https://github.com/lucidrains/vit-pytorch
Paper: https://openreview.net/pdf?id=YicbFdNTTy
Transformers: SOTA NLP for PyTorch and TensorFlow
Repository: https://github.com/huggingface/transformers
Jukebox: Music Generator
Blog: https://openai.com/blog/jukebox/
Repository: https://github.com/openai/jukebox
Papers
‘Less Than One’-shot learning
Blog: https://www.technologyreview.com/2020/10/16/1010566/ai-machine-learning-with-tiny-data/?itm_source=parsely-api
Actual paper: https://arxiv.org/pdf/2009.08449.pdf
Brain-inspired Replay for continual learning
Blog: https://singularityhub.com/2020/09/28/how-a-memory-quirk-of-the-human-brain-can-galvanize-ai/
Paper: https://www.nature.com/articles/s41467-020-17866-2
Training Generative Adversarial Networks with Limited Data
Blog: https://deepai.org/publication/training-generative-adversarial-networks-with-limited-data
Paper: https://arxiv.org/pdf/2006.06676.pdf
Tools
NVIDIA Maxine
Video conferencing applications based on Maxine can reduce video bandwidth usage down to one-tenth of H.264 using AI video compression, dramatically reducing costs.
https://developer.nvidia.com/maxine