Lang Nie¹, Chunyu Lin^{1 *}, Kang Liao¹, Shuaicheng Liu², Yao Zhao¹

¹Institute of Information Science, Beijing Jiaotong University

²School of Information and Communication Engineering, University of Electronic Science and Technology of China

^{{nielang, cylin, kang_liao, yzhao}@bjtu.edu.cn, [email protected]}

The details of the dataset can be found in our paper.

We release our testing results with the proposed dataset together. One can download it at Google Drive or Baidu Cloud(Extraction code: 1234).

• python 3.6
• numpy 1.18.1
• tensorflow 1.13.1

If you encounter some problems about the tensorflow environment, please refer to this issue.

For windows OS users, you have to change '/' to '\\' in 'line 52 of Codes/utils.py'.

Download VGG-19. Search imagenet-vgg-verydeep-19 in this page and download imagenet-vgg-verydeep-19.mat.

Modify the 'Codes/constant.py' to set the 'TRAIN_FOLDER'/'ITERATIONS'/'GPU'. In our experiment, we set 'ITERATIONS' to 100,000.

cd Codes/
python train.py

Our pretrained rectangling model can be available at Google Drive or Baidu Cloud(Extraction code: 1234). And place the four files to 'Codes/checkpoints/Ptrained_model/' folder.

Modidy the 'Codes/constant.py'to set the 'TEST_FOLDER'/'GPU'. The path for the checkpoint file can be modified in 'Codes/inference.py'.

cd Codes/
python inference.py

Modidy the 'Codes_for_Arbitrary_Resolution/constant.py'to set the 'TEST_FOLDER'/'GPU'. The path for the checkpoint file can be modified in 'Codes_for_Arbitrary_Resolution/inference.py'. Then, put the testing images into the folder 'Codes_for_Arbitrary_Resolution/other_dataset/' (including input and mask) and run:

cd Codes_for_Arbitrary_Resolution/
python inference.py

The rectangling results can be found in Codes_for_Arbitrary_Resolution/rectangling/.

This paper has been accepted by CVPR2022 as oral presentation. If you have any questions, please feel free to contact me.

NIE Lang -- [email protected]

@inproceedings{nie2022deep,
  title={Deep Rectangling for Image Stitching: A Learning Baseline},
  author={Nie, Lang and Lin, Chunyu and Liao, Kang and Liu, Shuaicheng and Zhao, Yao},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={5740--5748},
  year={2022}
}

1. Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, and Yao Zhao. Depth-aware multi-grid deep homography estimation with contextual correlation. IEEE Trans. on Circuits and Systems for Video Technology, 2021.

2. Kaiming He, Huiwen Chang, Jian Sun. Rectangling panoramic images via warping. SIGGRAPH, 2013.