Journal of Southern Medical University ›› 2023, Vol. 43 ›› Issue (9): 1636-1643.doi: 10.12122/j.issn.1673-4254.2023.09.23

Previous Articles     Next Articles

A 3D/2D registration method based on reconstruction of orthogonal-view Xray images

MI Jia, ZHOU Yujia, FENG Qianjin   

  1. School of Biomedical Engineering, Southern Medical University//Guangdong Provincial Key Laboratory of Medical Image Processing//Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510515, China
  • Online:2023-09-20 Published:2023-09-28

Abstract: Objective To establish a 3D/2D registration method for preoperative CT and intra-operative X-ray images in image-guided spine surgery. Methods We propose a 3D/2D registration algorithm based on 3D image reconstruction. The algorithm performs 3D image reconstruction of 2D orthogonal view X-ray images, thus converting the problem into 3D/3D registration. By constructing an end-to-end framework that combines the two tasks of reconstruction and registration, the geodesic distance is measured in the 3D manifold space to complete the registration. Results We conducted experiments on the public dataset CTSpine1k. The tests on two test sets with different initial registration errors showed that for data with small initial errors, the proposed algorithm achieved a rotation estimation error of 0.115±0.095° and a translation estimation error of 0.144±0.124 mm; for data with larger initial errors, a rotation estimation error of 0.792±0.659° and a translation estimation error of 0.867±0.701 mm were achieved. Conclusion The proposed method can achieve robust and accurate 3D/2D registration at a speed that meets real-time requirements to improve the performance of spine surgery navigation.

Key words: 3D/2D registration; surgery navigation; reconstruction; deep learning