Deep learning extended depth-of-field microscope for fast and slide-free histology.

Abstract

Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells-a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.

• Authors: Lingbo Jin, Yubo Tang, Yicheng Wu, Jackson B Coole, Melody T Tan, Xuan Zhao, Hawraa Badaoui, Jacob T Robinson, Michelle D Williams, Ann M Gillenwater, Rebecca R Richards-Kortum, Ashok Veeraraghavan
• Journal: Proceedings of the National Academy of Sciences of the United States of America (Proc Natl Acad Sci U S A) Vol. 117 Issue 52 Pg. 33051-33060 (12 29 2020) ISSN: 1091-6490 [Electronic] United States
• PMID: 33318169 (Publication Type: Journal Article, Research Support, N.I.H., Extramural, Research Support, U.S. Gov't, Non-P.H.S.)
• Copyright: Copyright © 2020 the Author(s). Published by PNAS.

Topics

• Algorithms
• Animals
• Biopsy (instrumentation, methods, standards)
• Calibration
• Carcinoma (pathology)
• Deep Learning
• Humans
• Image Processing, Computer-Assisted (instrumentation, methods, standards)
• Microscopy, Fluorescence (instrumentation, methods, standards)
• Mouth Neoplasms (pathology)
• Swine