Review of fluorescence guided surgery visualization and overlay techniques.

In fluorescence guided surgery, data visualization represents a critical step between signal capture and display needed for clinical decisions informed by that signal. The diversity of methods for displaying surgical images are reviewed, and a particular focus is placed on electronically detected and visualized signals, as required for near-infrared or low concentration tracers. Factors driving the choices such as human perception, the need for rapid decision making in a surgical environment, and biases induced by display choices are outlined. Five practical suggestions are outlined for optimal display orientation, color map, transparency/alpha function, dynamic range compression, and color perception check.

• Publication year

  2015

• Venue

  Biomedical Optics Express

• Publication date

  2015-10-01

• Fields of study

  Medicine, Computer Science, Engineering

• Identifiers
  DOI 10.1364/BOE.6.003765PMID 26504628PMCID PMC4605037
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• A Novel Approach for Sentinel Lymph Node Identification Using Fluorescence Imaging and Image Overlay Navigation Surgery in Patients with Breast Cancer

  2016cited by this paper
• Macroscopic-imaging technique for subsurface quantification of near-infrared markers during surgery

  2015cited by this paper
• Image overlay solution based on threshold detection for a compact near infrared fluorescence goggle system

  2015cited by this paper
• Integration of Indocyanine Green Videoangiography With Operative Microscope: Augmented Reality for Interactive Assessment of Vascular Structures and Blood Flow

  2015cited by this paper
• IND-Directed Safety and Biodistribution Study of Intravenously Injected Cetuximab-IRDye800 in Cynomolgus Macaques

  2015cited by this paper
• Tomography of epidermal growth factor receptor binding to fluorescent Affibody in vivo studied with magnetic resonance guided fluorescence recovery in varying orthotopic glioma sizes

  2015cited by this paper
• Efficacy of FLOW 800 with indocyanine green videoangiography for the quantitative assessment of flow dynamics in cerebral arteriovenous malformation surgery.

  2015cited by this paper
• Clinical applications of indocyanine green (ICG) enhanced fluorescence in laparoscopic surgery

  2014cited by this paper
• Microscopic lymph node tumor burden quantified by macroscopic dual-tracer molecular imaging

  2014cited by this paper
• Detection of sentinel lymph nodes in minimally invasive surgery using indocyanine green and near-infrared fluorescence imaging for uterine and cervical malignancies.

  2014cited by this paper
• Geophysical tutorial: How to evaluate and compare color maps

  2014cited by this paper
• Quantitative in vivo immunohistochemistry of epidermal growth factor receptor using a receptor concentration imaging approach.

  2014cited by this paper
• Robust overlay schemes for the fusion of fluorescence and color channels in biological imaging

  2014cited by this paper
• Image artifacts from MR-based attenuation correction in clinical, whole-body PET/MRI

  2013cited by this paper
• Fluorescent Affibody Peptide Penetration in Glioma Margin Is Superior to Full Antibody

  2013cited by this paper
• First in-human intraoperative imaging of HCC using the fluorescence goggle system and transarterial delivery of near-infrared fluorescent imaging agent: a pilot study.

  2013cited by this paper
• System and methods for wide-field quantitative fluorescence imaging during neurosurgery.

  2013cited by this paper
• Use of Indocyanine Green for Detecting the Sentinel Lymph Node in Breast Cancer Patients: From Preclinical Evaluation to Clinical Validation

  2013cited by this paper
• Rapid optical imaging of human breast tumour xenografts using anti-HER2 VHHs site-directly conjugated to IRDye 800CW for image-guided surgery

  2013cited by this paper
• Targeting tumors with nanobodies for cancer imaging and therapy.

  2013cited by this paper
• Value of fusion of PET and MRI in the detection of intra-pelvic recurrence of gynecological tumor: comparison with 18F-FDG contrast-enhanced PET/CT and pelvic MRI

  2013cited by this paper
• Whole Cell-SELEX Aptamers for Highly Specific Fluorescence Molecular Imaging of Carcinomas In Vivo

  2013cited by this paper
• Fluorescence-guided surgery with live molecular navigation — a new cutting edge

  2013cited by this paper
• Vital-dye enhanced fluorescence imaging of GI mucosa: metaplasia, neoplasia, inflammation.

  2012cited by this paper
• Optical molecular imaging of multiple biomarkers of epithelial neoplasia: epidermal growth factor receptor expression and metabolic activity in oral mucosa.

  2012cited by this paper
• Use of Panitumumab-IRDye800 to Image Microscopic Head and Neck Cancer in an Orthotopic Surgical Model

  2012cited by this paper
• Quantitative, spectrally-resolved intraoperative fluorescence imaging

  2012cited by this paper
• Nerve-Highlighting Fluorescent Contrast Agents for Image-Guided Surgery

  2011cited by this paper
• Coregistered fluorescence-enhanced tumor resection of malignant glioma: relationships between δ-aminolevulinic acid-induced protoporphyrin IX fluorescence, magnetic resonance imaging enhancement, and neuropathological parameters. Clinical article.

  2011cited by this paper
• Targeted, activatable, in vivo fluorescence imaging of prostate-specific membrane antigen (PSMA) positive tumors using the quenched humanized J591 antibody-indocyanine green (ICG) conjugate.

  2011cited by this paper
• Using statistical and machine learning to help institutions detect suspicious access to electronic health records

  2011cited by this paper
• Intraoperative tumor-specific fluorescence imaging in ovarian cancer by folate receptor-α targeting: first in-human results

  2011cited by this paper
• The clinical use of indocyanine green as a near‐infrared fluorescent contrast agent for image‐guided oncologic surgery

  2011cited by this paper
• High Vascular Delivery of EGF, but Low Receptor Binding Rate Is Observed in AsPC-1 Tumors as Compared to Normal Pancreas

  2011cited by this paper
• Combined fluorescence and reflectance spectroscopy for in vivo quantification of cancer biomarkers in low- and high-grade glioma surgery.

  2011cited by this paper
• Randomized, double-blind comparison of indocyanine green with or without albumin premixing for near-infrared fluorescence imaging of sentinel lymph nodes in breast cancer patients

  2011cited by this paper
• Review of Neurosurgical Fluorescence Imaging Methodologies

  2010cited by this paper
• Novel Intraoperative Near-Infrared Fluorescence Camera System for Optical Image-Guided Cancer Surgery

  2010cited by this paper
• Optical Image-guided Surgery—Where Do We Stand?

  2010cited by this paper
• Surgery with molecular fluorescence imaging using activatable cell-penetrating peptides decreases residual cancer and improves survival

  2010cited by this paper
• Activatable cell penetrating peptides linked to nanoparticles as dual probes for in vivo fluorescence and MR imaging of proteases

  2010cited by this paper
• Diverging Color Maps for Scientific Visualization

  2009cited by this paper
• The FLARE™ Intraoperative Near-Infrared Fluorescence Imaging System: A First-in-Human Clinical Trial in Breast Cancer Sentinel Lymph Node Mapping

  2009cited by this paper
• Imaging of lymph flow in breast cancer patients after microdose administration of a near-infrared fluorophore: feasibility study.

  2008cited by this paper
• Fluorescence-guided surgery with 5-aminolevulinic acid for resection of malignant glioma: a randomised controlled multicentre phase III trial.

  2006cited by this paper
• Intraoperative sentinel lymph node mapping of the lung using near-infrared fluorescent quantum dots.

  2005cited by this paper
• Virally directed fluorescent imaging improves diagnostic sensitivity in the detection of minimal residual disease after potentially curative cytoreductive surgery

  2005cited by this paper
• Applied Logistic Regression: Hosmer/Applied Logistic Regression

  2005cited by this paper
• Prospective evaluation of surgical microscope-integrated intraoperative near-infrared indocyanine green videoangiography during aneurysm surgery.

  2005cited by this paper
• Estimating the Probability of Cancer with Several Tumor Markers in Patients with Colorectal Disease

  2004cited by this paper
• Application of Haptic Feedback to Robotic Surgery

  2004cited by this paper
• Near-infrared fluorescent type II quantum dots for sentinel lymph node mapping

  2004cited by this paper
• High Dynamic Range Display Systems

  2004cited by this paper
• Adaptive Logarithmic Mapping For Displaying High Contrast Scenes

  2003cited by this paper
• In vivo near-infrared fluorescence imaging.

  2003cited by this paper
• Fluorescence-guided resections of malignant gliomas--an overview.

  2003cited by this paper
• Comparison of functional brain PET images and intraoperative brain-mapping data using image-guided surgery.

  2002cited by this paper
• Retinex in Matlab

  2000cited by this paper
• Prenatal Diagnosis of Placenta Previa Accreta by Transabdominal Color Doppler Ultrasound

  2000cited by this paper
• Intraoperative ultrasound for guidance and tissue shift correction in image-guided neurosurgery.

  2000cited by this paper
• Which Trajectories Through Which Perceptually Uniform Color Spaces Produce Appropriate Colors Scales for Interval Data? (Invited Paper)

  1999cited by this paper
• Model-updated image guidance: initial clinical experiences with gravity-induced brain deformation

  1999cited by this paper
• Task performance in endoscopic surgery is influenced by location of the image display.

  1998cited by this paper
• Randomised study of influence of two-dimensional versus three-dimensional imaging on performance of laparoscopic cholecystectomy.

  1998cited by this paper
• Visual attention: control, representation, and time course.

  1997cited by this paper
• Adaptive speckle reduction filter for log-compressed B-scan images

  1996cited by this paper
• Guided Search 2.0 A revised model of visual search

  1994cited by this paper
• A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope.

  1986cited by this paper
• The effect of inattention on form perception.

  1981cited by this paper
• Lightness and retinex theory.

  1971cited by this paper
• The Molecular Basis of Visual Excitation

  1968cited by this paper
• The molecular basis of visual excitation.

  1968cited by this paper

• Advancing Precision in Abdominal Oncologic Surgery: Real-Time Fluorescence Guidance and Emerging Assistive Exoskeleton Technologies

  2025influential citation
• Current and Emerging Fluorescence-Guided Techniques in Glioma to Enhance Resection

  2025cites this paper
• State of the art medical devices for fluorescence-guided surgery (FGS): technical review and future developments

  2024cites this paper
• A pan-cancer dye for solid-tumour screening, resection and wound monitoring via short-wave and near-infrared fluorescence imaging

  2024cites this paper
• First-in-man study of the PSMA Minibody IR800-IAB2M for molecularly targeted intraoperative fluorescence guidance during radical prostatectomy

  2024cites this paper
• A pan-cancer agent for screening, resection and wound monitoring via NIR and SWIR imaging

  2024cites this paper
• Targeting Human Pancreatic Cancer with a Fluorophore-Conjugated Mucin 4 (MUC4) Antibody: Initial Characterization in Orthotopic Cell Line Mouse Models

  2024cites this paper
• An ambient light-compatible, fluorescence-guided surgery imaging platform for real-time clinical assessment of vascular perfusion and flap viability in breast reconstruction

  2023cites this paper
• Fluorescence-guided resection of intradural spinal tumors: a systematic review and meta-analysis

  2023cites this paper
• Rational Design and Biological Application of Hybrid Fluorophores.

  2023cites this paper
• Fluorescence-guided surgical system using holographic display: from phantom studies to canine patients

  2023cites this paper
• Adaptive brightness fusion method for intraoperative near-infrared fluorescence and visible images.

  2022cites this paper
• Algorithms and instrumentation for rapid spatial frequency domain fluorescence diffuse optical imaging

  2022cites this paper
• Fluorescence molecular optomic signatures improve identification of tumors in head and neck specimens

  2022cites this paper
• Indocyanine green fluorescence image processing techniques for breast cancer macroscopic demarcation

  2022cites this paper
• Receptor-Targeted Fluorescence-Guided Surgery With Low Molecular Weight Agents

  2021cites this paper
• Pulsed-light illumination optical system integrated into surgical microscope for 5-ALA-induced tumor fluorescence detection without surgical process interruption

  2021cites this paper
• Comprehensive review of surgical microscopes: technology development and medical applications

  2021cites this paper
• The Impact of Temporal Variation in Indocyanine Green Administration on Tumor Identification During Fluorescence Guided Breast Surgery

  2021cites this paper
• Usefulness of PET-guided surgery with 64Cu-labeled cetuximab for resection of intrapancreatic residual tumors in a xenograft mouse model of resectable pancreatic cancer

  2021cites this paper
• Head‐Mounted Devices for Noninvasive Cancer Imaging and Intraoperative Image‐Guided Surgery

  2020cites this paper
• An aptamer-based, fluorescent and radionuclide dual-modality probe.

  2020cites this paper
• INTRAOPERATIVE PHOTODYNAMIC DIAGNOSIS AND NEW SIGHT ON RADICALISM OF SURGICAL INTERVENTION AT ESOPHAGEAL CANCER

  2020cites this paper
• Development of a drug–device combination for fluorescence-guided surgery in neuroendocrine tumors

  2020cites this paper
• Perspective on optical imaging for functional assessment in musculoskeletal extremity trauma surgery

  2020cites this paper
• Effect of Absorption and Scattering on Fluorescence of Buried Tumours

  2020cites this paper
• Enhancing Parathyroid Gland Visualization Using a Near Infrared Fluorescence-Based Overlay Imaging System.

  2019cites this paper
• Innovative surgical guidance for label‐free real‐time parathyroid identification

  2019cites this paper
• Fluorescence in Colorectal Surgery

  2019cites this paper
• Intraoperative biophotonic imaging systems for image-guided interventions

  2018cites this paper
• Fluorescence‐guided surgery and intervention — An AAPM emerging technology blue paper

  2018cites this paper
• Fluorescence-guided surgery and intervention — An AAPM emerging technology blue paper

  2018cites this paper
• Multimodal fluorescence imaging navigation for surgical guidance of malignant tumors in photosensitized tissues of neural system and other organs

  2018cites this paper
• In vivo fluorescence imaging of hepatocellular carcinoma using a novel GPC3-specific aptamer probe.

  2018cites this paper
• Radiotherapy-induced Cherenkov luminescence imaging in a human body phantom

  2018cites this paper
• Intraoperative brain tumor resection with indocyanine green using augmented microscopy.

  2018cites this paper
• Molecular endoscopic imaging in cancer

  2018cites this paper
• Cranial nerve contrast using nerve-specific fluorophores improved by paired-agent imaging with indocyanine green as a control agent

  2017cites this paper
• Award Number: W81XWH-16-1-0005 TITLE: Lymph Node Metastases Optical Molecular Diagnostic and Radiation Therapy

  2017cites this paper
• Combination of Fluorescence-Guided Surgery With Photodynamic Therapy for the Treatment of Cancer

  2017cites this paper
• Clinically compatible flexible wide-field multi-color fluorescence endoscopy with a porcine colon model.

  2017cites this paper
• Development of endoscopic system based on fluorescence imaging for detection of colon cancer

  2017cites this paper
• Intraoperative visualization of plasmon resonant liposomes using augmented microscopy

  2017cites this paper
• Feasibility of real‐time near‐infrared indocyanine green fluorescence endoscopy for the evaluation of mucosal head and neck lesions

  2016cites this paper
• Laser-advanced new methods for diagnostics and therapeutics

  2016cites this paper
• Intraoperative Fluorescence Imaging for Personalized Brain Tumor Resection: Current State and Future Directions

  2016cites this paper
• Microdose fluorescence imaging of ABY-029 on an operating microscope adapted by custom illumination and imaging modules.

  2016cites this paper
• Cutting Edge in Thyroid Surgery: Autofluorescence of Parathyroid Glands.

  2016cites this paper
• Review of fluorescence guided surgery systems: identification of key performance capabilities beyond indocyanine green imaging

  2016cites this paper
• Vision 20/20: Molecular-guided surgical oncology based upon tumor metabolism or immunologic phenotype: Technological pathways for point of care imaging and intervention.

  2016cites this paper
• Modulation of Neural Network Activity through Single Cell Ablation: An in Vitro Model of Minimally Invasive Neurosurgery

  2016cites this paper
• Photonanomedicine: a convergence of photodynamic therapy and nanotechnology.

  2016cites this paper
• Intraoperative imaging using intravascular contrast agent

  2016cites this paper
• Simultaneous In Vivo Fluorescent Markers for Perfusion, Protoporphyrin Metabolism, and EGFR Expression for Optically Guided Identification of Orthotopic Glioma

  2016cites this paper
• Introduction to the optics and the brain 2015 feature issue.

  2015cites this paper
• How to evaluate and compare color maps

  2014cites this paper