This is a PyTorch implementation of InceptionNeXt proposed by our paper "InceptionNeXt: When Inception Meets ConvNeXt". Many thanks to Ross Wightman, InceptionNeXt is integrated into timm.
TLDR: To speed up ConvNeXt, we build InceptionNeXt by decomposing the large kernel dpethweise convolution with Inception style. Our InceptionNeXt-T enjoys both ResNet-50’s speed and ConvNeXt-T’s accuracy.
Our models are trained and tested in the environment of PyTorch 1.13, NVIDIA CUDA 11.7.1 and timm 0.6.11 (pip install timm==0.6.11). If you use docker, check Dockerfile that we used.
Data preparation: ImageNet with the following folder structure, you can extract ImageNet by this script.
│imagenet/
├──train/
│ ├── n01440764
│ │ ├── n01440764_10026.JPEG
│ │ ├── n01440764_10027.JPEG
│ │ ├── ......
│ ├── ......
├──val/
│ ├── n01440764
│ │ ├── ILSVRC2012_val_00000293.JPEG
│ │ ├── ILSVRC2012_val_00002138.JPEG
│ │ ├── ......
│ ├── ......
The throughputs are measured on an A100 with full precisioni and batch size of 128. See Benchmarking throughput.
We also provide a Colab notebook which run the steps to perform inference with InceptionNeXt:
To evaluate our CAFormer-S18 models, run:
MODEL=inceptionnext_tiny python3 validate.py /path/to/imagenet --model $MODEL -b 128 \ --pretrained
On the environment described above, we benchmark throughputs on an A100 with batch size of 128. The beter results of "Channel First" and "Channel Last" memory layouts are reported.
For Channel First:
MODEL=inceptionnext_tiny # convnext_tiny python3 benchmark.py /path/to/imagenet --model $MODEL
For Channel Last:
MODEL=inceptionnext_tiny # convnext_tiny python3 benchmark.py /path/to/imagenet --model $MODEL --channel-last
We use batch size of 4096 by default and we show how to train models with 8 GPUs. For multi-node training, adjust --grad-accum-steps according to your situations.
DATA_PATH=/path/to/imagenet CODE_PATH=/path/to/code/inceptionnext # modify code path here ALL_BATCH_SIZE=4096 NUM_GPU=8 GRAD_ACCUM_STEPS=4 # Adjust according to your GPU numbers and memory size. let BATCH_SIZE=ALL_BATCH_SIZE/NUM_GPU/GRAD_ACCUM_STEPS MODEL=inceptionnext_tiny # inceptionnext_small, inceptionnext_base DROP_PATH=0.1 # 0.3, 0.4 cd $CODE_PATH && sh distributed_train.sh $NUM_GPU $DATA_PATH \ --model $MODEL --opt adamw --lr 4e-3 --warmup-epochs 20 \ -b $BATCH_SIZE --grad-accum-steps $GRAD_ACCUM_STEPS \ --drop-path $DROP_PATH
Training (fine-tuning) scripts of other models are shown in scripts.
@inproceedings{yu2024inceptionnext,
title={Inceptionnext: When inception meets convnext},
author={Yu, Weihao and Zhou, Pan and Yan, Shuicheng and Wang, Xinchao},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={5672--5683},
year={2024}
}
Weihao Yu would like to thank TRC program and GCP research credits for the support of partial computational resources. Our implementation is based on pytorch-image-models, poolformer, ConvNeXt and metaformer.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4