A Framework to Visualize 3D Breast Tumor Using X-Ray Vision Technique in Mobile Augmented Reality

Authors

  • Hameedur Rahman Centre for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia
  • Haslina Arshad Centre for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia
  • Rozi Mahmud Cancer Research and Education Centre (CaRE), Faculty of Medicine and Health Science, Universiti Putra Malaysia, 43400 Serdang, Selangor, Malaysia
  • Zainal Rasyid Mahayuddin Centre for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia
  • Waqas Khalid Obeidy Centre for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia

Keywords:

Augmented Reality, Biopsy, Breast Cancer, Visualization,

Abstract

Breast cancer patients who require breast biopsy have increased over the past years and Stereotactic Biopsy uses series of images to carefully position the imaging equipment and target the area of concern. However, it has the constraint of accurate 3D Tumor visualization. An Augmented Reality (AR) Guidance Biopsy system of breast has become the method of choice for researchers, yet this AR tumor visualization has limitation to the extent of superimposing the 3D Imaging Data only. In this paper, a framework to visualize 3D breast tumor technique is being introduced to accurately visualize 3D tumor to see through the skin of US-9 Opaque breast phantom on a mobile display. This mobile AR visualization technique consists of 4 phases where it initially acquires the image from Computed Tomography (CT) or Magnetic Resonance Images (MRI) and processes the medical images into 3D slices, secondly, it will purify these 3D grayscale slices into 3D breast tumor model using 3D modeling reconstruction technique. Furthermore, in visualization processing, this virtual 3D breast tumor model is enhanced using X-Ray Visualization technique to only see through the skin of the phantom for better visualization. Finally, the composition of it is displayed on a smartphone device with an optimized accuracy of the 3D tumor visualization in a six degree of freedom (6DOF). The experiment was made to test the visualization accuracy on US-9 breast phantom which has 12 tumors in different sizes and categorized in 3 levels. Our frame shows the 3D tumor visualization accuracy, however, the accuracy comparison is pending. The two radiologists from Hospital Serdang performed successful visualization of a 3D tumor in an X-ray vision. The framework is perceived as an improved visualization experience because the AR X-ray visualization allowed direct understanding of the breast tumor beyond the visible surface towards accurate biopsy targets.

References

of cancer for 25 sites in the adult population. International journal of cancer. 2002;97(1):72-81.

Stuckey A. Breast cancer: epidemiology and risk factors. Clinical obstetrics and gynecology. 2011;54(1):96-102.

Siegel R, Naishadham D, Jemal A. Cancer statistics, 2013. CA: a cancer journal for clinicians. 2013;63(1):11-30.

McPherson K, Steel C, Dixon J. ABC of breast diseases. Breast cancer--epidemiology, risk factors and genetics. BMJ: British Medical Journal. 1994;309(6960):1003.

Nelson HD, Tyne K, Naik A, Bougatsos C, Chan BK, Humphrey L. Screening for breast cancer: an update for the US Preventive Services Task Force. Annals of internal medicine. 2009;151(10):727-37.

Starner T. Project glass: An extension of the self. IEEE Pervasive Computing. 2013;12(2):14-6.

Nicolau S, Soler L, Mutter D, Marescaux J. Augmented reality in laparoscopic surgical oncology. Surgical oncology. 2011;20(3):189-201.

Heydarzadeh M, Nourani M, Park J, editors. An augmented reality platform for CABG surgery. Biomedical Circuits and Systems Conference (BioCAS), 2015 IEEE; 2015: IEEE.

Pisano ED, Fuchs H, State A, Livingston M, Hirota G, Garrett W, et al. Augmented reality applied to ultrasound-guided breast cyst aspiration. Breast disease. 1998;10:221-30.

Livingston MA, Dey A, Sandor C, Thomas BH. Pursuit of “X-ray vision” for augmented reality. Human Factors in Augmented Reality Environments: Springer; 2013. p. 67-107.

Kockro RA, Tsai YT, Ng I, Hwang P, Zhu C, Agusanto K, et al. DEX‐RAY: AUGMENTED REALITY NEUROSURGICAL NAVIGATION WITH A HANDHELD VIDEO PROBE. Neurosurgery. 2009;65(4):795-808.

Burdea Grigore C, Coiffet P. Virtual reality technology: London: Wiley-Interscience; 1994.

Azuma RT. A survey of augmented reality. Presence: Teleoperators and virtual environments. 1997;6(4):355-85.

Madhani AJ, Niemeyer G, Salisbury JK, editors. The black falcon: a teleoperated surgical instrument for minimally invasive surgery. Intelligent Robots and Systems, 1998 Proceedings, 1998 IEEE/RSJ International Conference on; 1998: IEEE.

Bajura M, Fuchs H, Ohbuchi R, editors. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. ACM SIGGRAPH Computer Graphics; 1992: ACM.

Sato Y, Nakamoto M, Tamaki Y, Sasama T, Sakita I, Nakajima Y, et al. Image guidance of breast cancer surgery using 3-D ultrasound images and augmented reality visualization. IEEE Transactions on Medical Imaging. 1998;17(5):681-93.

Lopez Hänninen E, Amthauer H, Hosten N, Ricke J, Böhmig M, Langrehr J, et al. Prospective Evaluation of Pancreatic Tumors: Accuracy of MR Imaging with MR Cholangiopancreatography and MR Angiography 1. Radiology. 2002;224(1):34-41.

Kalkofen D, Mendez E, Schmalstieg D, editors. Interactive focus and context visualization for augmented reality. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality; 2007: IEEE Computer Society.

Farrell MR, Sayed JA, Underwood AR, Wellman CL. Lesion of infralimbic cortex occludes stress effects on retrieval of extinction but not fear conditioning. Neurobiology of learning and memory. 2010;94(2):240-6.

Schlüter S, Sheppard A, Brown K, Wildenschild D. Image processing of multiphase images obtained via X‐ray microtomography: a review. Water Resources Research. 2014;50(4):3615-39.

Lorensen WE, Cline HE, editors. Marching cubes: A high resolution 3D surface construction algorithm. ACM siggraph computer graphics; 1987: ACM.

Fisher BD, Pylyshyn ZW, editors. The cognitive architecture of bimodal event perception: A commentary and addendum to Radeau. Current Psychology of Cognition; 1994: Citeseer.

Bajura M, Fuchs H, Ohbuchi R, editors. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. ACM SIGGRAPH Computer Graphics; 1992: ACM.

Mendez E, Schmalstieg D, editors. Importance masks for revealing occluded objects in augmented reality. Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology; 2009: ACM.

Feiner S, MacIntyre B, Hollerer T, Webster A, editors. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Wearable Computers, 1997 Digest of Papers, First International Symposium on; 1997: IEEE.

Mendez E, Schmalstieg D, editors. Importance masks for revealing occluded objects in augmented reality. Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology; 2009: ACM.

Downloads

Published

2017-09-15

How to Cite

Rahman, H., Arshad, H., Mahmud, R., Mahayuddin, Z. R., & Obeidy, W. K. (2017). A Framework to Visualize 3D Breast Tumor Using X-Ray Vision Technique in Mobile Augmented Reality. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(2-11), 145–149. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2753

Issue

Vol. 9 No. 2-11: The Challenge of Computer and Engineering in Building Sustainable Service Systems I

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.