基于光度立體法的中醫(yī)舌體三維表面重建
doi: 10.11999/JEIT150124 cstr: 32379.14.JEIT150124
基金項(xiàng)目:
國(guó)家自然科學(xué)基金(61201360)
3D Reconstruction of Tongue Surface Based on Photometric Stereo Method
Funds:
The National Natural Science Foundation of China(61201360)
-
摘要: 在中醫(yī)舌診客觀化研究進(jìn)程中,以2維舌圖像為基礎(chǔ)進(jìn)行分析所獲得的舌體特征信息有限,制約了舌診的客觀化發(fā)展。在將光度立體法用于靜態(tài)舌模型表面3維重建的可行性研究基礎(chǔ)之上,為了對(duì)真實(shí)舌體表面進(jìn)行3維重建,該文設(shè)計(jì)一種舌體3維動(dòng)態(tài)信息采集系統(tǒng),用于舌像采集;然后采用光度立體法依次求出舌體表面的法向量、紋理反射率和深度信息,并基于DirectX進(jìn)行3維顯示;最后針對(duì)舌體表面高光區(qū)域?qū)χ亟ńY(jié)果的影響,采用高光剔除算法剔除高光。經(jīng)高光剔除后的重建結(jié)果和原來(lái)相比,在重建精度和魯棒性等方面都有更好的表現(xiàn)。經(jīng)實(shí)驗(yàn)證實(shí),該重建方法的平均相對(duì)誤差約為7.24%,重建結(jié)果可形象地表達(dá)舌體的表面形態(tài)和齒痕等細(xì)節(jié)信息,可輔助中醫(yī)進(jìn)行診斷。Abstract: In the process of the objective research in traditional Chinese medicine tongue diagnosis, the tongue information obtained from the analysis of 2D tongue image is limited. It restricts the development of tongue diagnosis. Based on the feasibility of photometric stereo method to reconstruct the static tongue mode, for reconstructing the 3D surface of the real tongue, a dynamic information collection system is designed for image information acquisition. Then the normal vectors, texture reflectance and depth values are obtained with photometric stereo method, and the 3D surface of tongue is displayed based on DirectX. Finally, a highlight excluding algorithm is used to reduce the effects of the highlight areas on the reconstruction results. After the highlight excluding, it performs better in the reconstruction accuracy and robustness aspects. Experimental results indicate that the average relative error of this algorithm is of 7.24%. The results can express the tongue surface morphology and details such as tooth marks visually.
-
Key words:
- Image processing /
- Photometric stereo method /
- 3D reconstruction /
- Highlight /
- Surface normal /
- Tongue characterization
-
陳雪姣, 王玉臣, 王德才. 中醫(yī)舌診客觀化研究的發(fā)展概況[J]. 江西中醫(yī)藥, 2012, 43(1): 72-75. Chen Xue-jiao, Wang Yu-chen, and Wang De-cai. The overview of the development of traditional Chinese medicine tongue diagnosis[J]. Jiangxi Journal of Traditional and Chinese Medicine, 2012, 43(1): 72-75. 葉長(zhǎng)明, 蔣建國(guó), 詹曙. 基于三維人臉成像系統(tǒng)的復(fù)數(shù)域人臉識(shí)別方法[J]. 電子測(cè)量與儀器學(xué)報(bào), 2011, 25(5): 420-426. Ye Chang-ming, Jiang Jian-guo, and Zhan Shu. Face recognition in complex domain based on 3D facial imaging system[J]. Journal of Electronic Meeasurement and Instrument, 2011, 25(5): 420-426. 王昕, 郭寶鋒, 尚朝軒. 基于二維ISAR圖像序列的雷達(dá)目標(biāo)三維重建方法[J]. 電子與信息學(xué)報(bào), 2013, 35(10): 2475-2480. Wang Xin, Guo Bao-feng, and Shang Chao-xuan. 3D reconstruction of target geometry based on 2D data of inverse synthetic aperture radar images[J]. Journal of Electronics Information Technology, 2013, 35(10): 2475-2480. 李自力, 朱光喜, 朱耀庭. 一種基于會(huì)聚雙目立體視覺(jué)的用戶(hù)化身模型[J]. 電子與信息學(xué)報(bào),?2003, 25(6):?763-770. Li Zi-li, Zhu Guang-xi, and Zhu Yao-ting. A user avatar model based-on convergent binocular stereo vision[J]. Journal of Electronics Information Technology, 2003, 25(6): 763-770. 陳宇峰, 譚文靜, 王海濤. 光度立體三維重建算法[J]. 計(jì)算機(jī)輔助設(shè)計(jì)與圖形學(xué)學(xué)報(bào), 2005, 17(11): 2408-2414. Chen Yu-feng, Tan Wen-jing, and Wang Hai-tao. Photometric stereo 3D reconstruction and application[J]. Journal of Computer-Aided Design Computer Graphics, 2005, 17(11): 2408-2414. Woodham R J. Photometric method for determining surface orientation from multiple images[J]. Optical Engineering, 1980, 19(1): 191139. Coleman E Jr and Jain R. Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry [J]. Computer Graphics and?Image Processing, 1982, 18(4): 309-328. L H, Cai Y, and Guo S. 3D reconstruction of tongue surface based on photometric stereo[C]. 2007 IEEE 11th International Conference on Signal Processing (ICSP), Barcelona, Spain, 2012, 3: 1668-1671. 朱穆朗瑪, 燕海霞, 錢(qián)鵬. 基于圖像信息采集的中醫(yī)舌診儀器硬件設(shè)計(jì)研究進(jìn)展[J]. 世界科學(xué)技術(shù)中醫(yī)藥現(xiàn)代化, 2014, 16(2): 433-437. Zhu Mulangma, Yan Hai-xia, and Qian Peng. Study progress on designs of acquisition instrument with image capturing in tongue inspection[J]. Modernization of Traditional Chinese Medicine and Materia MedicaWorld Science and Technology, 2014, 16(2): 433-437. Park J I, Lee M H, Grossberg M D, et al.. Multispectral imaging using multiplexed illumination[C]. 2007 IEEE 11th International Conference on Computer Vision, Rio De Janeiro, Brazil, 2007: 1-8. 徐慶相. 基于光度立體視覺(jué)的表面精細(xì)特征三維重建技術(shù)研究[D]. [碩士論文], 華中科技大學(xué), 2011. Xu Qing-xiang. Research on 3D reconstruction of detailed features based on photometri stereo[D]. [Master dissertation], Huazhong University of Science Technology, 2011. 張彥. 基于光度立體視覺(jué)的三維重建的研究[D]. [碩士論文], 吉林大學(xué), 2013. Zhang Yan. The research of three-dimensional reconstruction based on photometric stereo[D]. [Master dissertation], Jilin University, 2013. Georghiades A S. Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo[C]. Ninth IEEE International Conference on Computer Vision (ICCV?2003), Nice, France, 2003: 816-823. Barsky S and Petrou M. The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(10): 1239-1252. 張珊珊, 呂東輝, 孫九愛(ài). 近光源光度立體三維重建誤差分析[J]. 計(jì)算機(jī)技術(shù)與發(fā)展, 2015(1): 168-172. Zhang Shan-shan, L Dong-hui, and Sun Jiu-ai. Reconstruction error analysis on photometric stereo with nearby light sources[J]. Computer Technology and Development, 2015(1): 168-172. 張屹凌. 基于光度立體算法的圖像建模系統(tǒng)的設(shè)計(jì)及實(shí)現(xiàn)[D]. [碩士論文], 浙江大學(xué), 2006. Zhang Yi-ling. Design and implementation of image-based modeling system based on photometric stereo[D]. [Master dissertation], Zhejiang University, 2006. 桂思怡, 林國(guó)順. 基于DirectX的立體裝箱三維可視化輔助模塊技術(shù)[J]. 計(jì)算機(jī)與現(xiàn)代化, 2014(2): 15-19. Gui Si-yi and Lin Guo-shun. DirectX-based techniques of stereo loading systems 3D visualized auxiliary module[J]. Computer and Modernization, 2014(2): 15-19. 許家佗, 張志楓, 任宏福, 等. 基于圖像處理的舌形胖瘦分析方法[C]. 第二次全國(guó)中西醫(yī)結(jié)合診斷學(xué)術(shù)研討會(huì)論文集. 2008: 43-47. Xu Jia-tuo, Zhang Zhi-feng, Ren Hong-fu, et al.. Analysis of fat/thin tongue based on image processing method[C]. The Second National Integrated Traditional Chinese and Western Medicine Diagnosis of Academic Symposium, Lijiang, 2008: 43-47. -
計(jì)量
- 文章訪問(wèn)數(shù): 1621
- HTML全文瀏覽量: 171
- PDF下載量: 674
- 被引次數(shù): 0