This repository provides the latest deep learning example networks for training. These examples focus on achieving the best performance and convergence from NVIDIA Volta Tensor Cores.
These examples, along with our NVIDIA deep learning software stack, are provided in a monthly updated Docker container on the NGC container registry (https://ngc.nvidia.com). These containers include:
- The latest NVIDIA examples from this repository
- The latest NVIDIA contributions shared upstream to the respective framework
- The latest NVIDIA Deep Learning software libraries, such as cuDNN, NCCL, cuBLAS, etc. which have all been through a rigorous monthly quality assurance process to ensure that they provide the best possible performance
- Monthly release notes for each of the NVIDIA optimized containers
The examples are organized first by framework, such as TensorFlow, PyTorch, etc. and second by use case, such as computer vision, natural language processing, etc. We hope this structure enables you to quickly locate the example networks that best suit your needs. Here are the currently supported models:
- ResNet-50 [MXNet] [PyTorch] [TensorFlow]
- ResNext [PyTorch]
- SE-ResNext [PyTorch]
- SSD [PyTorch] [TensorFlow]
- Mask R-CNN [PyTorch]
- U-Net(industrial) [TensorFlow]
- U-Net(medical) [TensorFlow]
- VNet [TensorFlow]
- GNMT [PyTorch] [TensorFlow]
- Transformer [PyTorch]
- BERT [PyTorch][TensorFlow]
- Transformer-XL [PyTorch]
- NCF [PyTorch] [TensorFlow]
- VAE-CF [TensorFlow]
- Tacotron & WaveGlow [PyTorch]
- Jasper [PyTorch]
In each of the network READMEs, we indicate the level of support that will be provided. The range is from ongoing updates and improvements to a point-in-time release for thought leadership.
We're posting these examples on GitHub to better support the community, facilitate feedback, as well as collect and implement contributions using GitHub Issues and pull requests. We welcome all contributions!
In each of the network READMEs, we indicate any known issues and encourage the community to provide feedback.