Affiliations
AffiliationsItem in Clipboard
De-Identification of Facial Features in Magnetic Resonance Images: Software Development Using Deep Learning TechnologyYeon Uk Jeong et al. J Med Internet Res. 2020.
. 2020 Dec 10;22(12):e22739. doi: 10.2196/22739. AffiliationsItem in Clipboard
AbstractBackground: High-resolution medical images that include facial regions can be used to recognize the subject's face when reconstructing 3-dimensional (3D)-rendered images from 2-dimensional (2D) sequential images, which might constitute a risk of infringement of personal information when sharing data. According to the Health Insurance Portability and Accountability Act (HIPAA) privacy rules, full-face photographic images and any comparable image are direct identifiers and considered as protected health information. Moreover, the General Data Protection Regulation (GDPR) categorizes facial images as biometric data and stipulates that special restrictions should be placed on the processing of biometric data.
Objective: This study aimed to develop software that can remove the header information from Digital Imaging and Communications in Medicine (DICOM) format files and facial features (eyes, nose, and ears) at the 2D sliced-image level to anonymize personal information in medical images.
Methods: A total of 240 cranial magnetic resonance (MR) images were used to train the deep learning model (144, 48, and 48 for the training, validation, and test sets, respectively, from the Alzheimer's Disease Neuroimaging Initiative [ADNI] database). To overcome the small sample size problem, we used a data augmentation technique to create 576 images per epoch. We used attention-gated U-net for the basic structure of our deep learning model. To validate the performance of the software, we adapted an external test set comprising 100 cranial MR images from the Open Access Series of Imaging Studies (OASIS) database.
Results: The facial features (eyes, nose, and ears) were successfully detected and anonymized in both test sets (48 from ADNI and 100 from OASIS). Each result was manually validated in both the 2D image plane and the 3D-rendered images. Furthermore, the ADNI test set was verified using Microsoft Azure's face recognition artificial intelligence service. By adding a user interface, we developed and distributed (via GitHub) software named "Deface program" for medical images as an open-source project.
Conclusions: We developed deep learning-based software for the anonymization of MR images that distorts the eyes, nose, and ears to prevent facial identification of the subject in reconstructed 3D images. It could be used to share medical big data for secondary research while making both data providers and recipients compliant with the relevant privacy regulations.
Keywords: GDPR; HIPAA; de-identification; deep learning; facial feature detection; medical image; personal information protection; privacy protection.
©Yeon Uk Jeong, Soyoung Yoo, Young-Hak Kim, Woo Hyun Shim. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 10.12.2020.
Conflict of interest statementConflicts of Interest: None declared.
FiguresFigure 1
Process of (A) developing the…
Figure 1
Process of (A) developing the facial feature detector, which is a deep learning…
Figure 1Process of (A) developing the facial feature detector, which is a deep learning model that can detect the eyes, nose, and ears in 3-dimensional (3D) magnetic resonance (MR) images, and (B) distorting the facial features in nonanonymized cranial MR images.
Figure 2
3-dimensional (3D) volume rendering of…
Figure 2
3-dimensional (3D) volume rendering of magnetic resonance images (MRI), showing the raw and…
Figure 23-dimensional (3D) volume rendering of magnetic resonance images (MRI), showing the raw and distorted images from the Alzheimer's Disease Neuroimaging Initiative (ADNI) .
Similar articlesLien CY, Deng RJ, Fuh JL, Ting YN, Yang AC. Lien CY, et al. Prog Brain Res. 2024;290:141-156. doi: 10.1016/bs.pbr.2024.07.003. Epub 2024 Aug 31. Prog Brain Res. 2024. PMID: 39448110
Prior FW, Brunsden B, Hildebolt C, Nolan TS, Pringle M, Vaishnavi SN, Larson-Prior LJ. Prior FW, et al. IEEE Trans Inf Technol Biomed. 2009 Jan;13(1):5-9. doi: 10.1109/TITB.2008.2003335. IEEE Trans Inf Technol Biomed. 2009. PMID: 19129018
Familiar AM, Khalili N, Khalili N, Schuman C, Grove E, Viswanathan K, Seidlitz J, Alexander-Bloch A, Zapaishchykova A, Kann BH, Vossough A, Storm PB, Resnick AC, Kazerooni AF, Nabavizadeh A. Familiar AM, et al. AJNR Am J Neuroradiol. 2025 May 2;46(5):964-972. doi: 10.3174/ajnr.A8581. AJNR Am J Neuroradiol. 2025. PMID: 39532533
Galbusera F, Cina A. Galbusera F, et al. Eur Radiol Exp. 2024 Feb 6;8(1):11. doi: 10.1186/s41747-023-00408-y. Eur Radiol Exp. 2024. PMID: 38316659 Free PMC article. Review.
Kushida CA, Nichols DA, Jadrnicek R, Miller R, Walsh JK, Griffin K. Kushida CA, et al. Med Care. 2012 Jul;50 Suppl(Suppl):S82-101. doi: 10.1097/MLR.0b013e3182585355. Med Care. 2012. PMID: 22692265 Free PMC article. Review.
Wahid KA, Glerean E, Sahlsten J, Jaskari J, Kaski K, Naser MA, He R, Mohamed ASR, Fuller CD. Wahid KA, et al. Semin Radiat Oncol. 2022 Oct;32(4):400-414. doi: 10.1016/j.semradonc.2022.06.009. Semin Radiat Oncol. 2022. PMID: 36202442 Free PMC article. Review.
Neri E, Aghakhanyan G, Zerunian M, Gandolfo N, Grassi R, Miele V, Giovagnoni A, Laghi A; SIRM expert group on Artificial Intelligence. Neri E, et al. Radiol Med. 2023 Jun;128(6):755-764. doi: 10.1007/s11547-023-01634-5. Epub 2023 May 8. Radiol Med. 2023. PMID: 37155000 Free PMC article.
Yang HC, Rahmanti AR, Huang CW, Li YJ. Yang HC, et al. J Med Internet Res. 2022 Mar 4;24(3):e29506. doi: 10.2196/29506. J Med Internet Res. 2022. PMID: 35254278 Free PMC article.
Uchida T, Kin T, Sato K, Koike T, Kiyofuji S, Takeda Y, Niwa R, Saito T, Takashima I, Kawahara T, Miyawaki S, Oyama H, Saito N. Uchida T, et al. Curr Med Imaging. 2023;19(12):1387-1393. doi: 10.2174/1573405619666230123105057. Curr Med Imaging. 2023. PMID: 36694319 Free PMC article.
Patel R, Provenzano D, Loew M. Patel R, et al. J Med Imaging (Bellingham). 2023 Nov;10(6):066501. doi: 10.1117/1.JMI.10.6.066501. Epub 2023 Nov 22. J Med Imaging (Bellingham). 2023. PMID: 38074629 Free PMC article.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.3