Close

FLIMJ: an open-source ImageJ toolkit for fluorescence lifetime image data analysis

Dasong Gao, Paul R Barber, Jenu V Chacko, Md Abdul Kader Sagar, Curtis T Rueden, Aivar R Grislis, Mark C Hiner, Kevin W Eliceiri

Posted on: 25 November 2020

Preprint posted on 18 August 2020

Article now published in PLOS ONE at http://dx.doi.org/10.1371/journal.pone.0238327

Extending the ImageJ toolkit: FLIMJ

Selected by Mariana De Niz

Background

Fluorescence lifetime imaging microscopy (FLIM) is one of various advanced fluorescence imaging techniques, which allows for the measurement of how long a fluorophore stays in an excited energy state. Changes in fluorescence lifetime can reveal important associations between the physical structure and the chemical microenvironment of a molecule. On this basis, FLIM allows investigating molecular level cellular behaviours, including, for instance, the metabolic state of differentiating cells, or FRET of signaling events during cell division. FLIM can be used in two modes of operation: time-domain and frequency domain, and is compatible with multiple microscopy modalities. Emerging applications of FLIM continuously push forward innovation of FLIM-related hardware. However, although quantitative FLIM has the need for powerful downstream image analysis software, the development of tools for FLIM image analysis has lagged behind due to various hurdles. Currently unmet needs in the scientific community include: a) an open and extensible FLIM algorithm library that supports most FLIM formats and which can be modified and used by developers; b) a FLIM analysis tool that can use the library, and can be easily used by bench biologists; c) the integration of FLIM analysis with versatile microscopy analysis. While various tools have been developed in this direction, FLIM workflows have been largely segregated from the open source tool ImageJ/Fiji, due to the lack of the necessary FLIM workflow functionality. However, the recent development of the ImageJ Ops framework has laid a solid foundation for such a FLIM analysis toolbox. The ImageJ Ops framework is a suitable environment for developing modular, extensible image processing workflow components.

In their work, Gao et al (1) have built on previous efforts by their group and others, to develop an ImageJ-centric toolkit, FLIMJ, that addressed the needs discussed above. FLIMJ offers FLIM fitting routines with seamless integration with other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Being built on ImageJ Ops, this also enables FLIMJ’s routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming. A number of other ImageJ features could be utilized with FLIM data including scripting, 3D visualization, and feature tracking. Moreover,  multipleimaging file formats can be supported through the use of the SCIFIO (http://scif.io/) infrastructures to support a range of open and proprietary FLIM file formats. The authors propose this as the first FLIM analysis system that offers this range of flexibility and functionality, and explore FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization.

Figure 1. Schematic showing general setup of FLIMJ.

 

Key findings and developments

Overall development: methods

FLIMJ provides access to a variety of FLIM analysis techniques including standard nonlinear least-squares fitting (in the form of the Levenberg-Marquardt (LM) algorithm); advanced algorithms such as maximum likelihood, global, and Bayesian analysis optimised for FLIM; and simpler methods such as the rapid lifetime determination (RLD) by integration and frequency domain analysis via the method of phasors. FLIMJ allows the ability to account for an instrument response function that distorts the pure exponential decay. Moreover, it allows the addition of new methods, and can inherit the standard library code interface, as well as ensuring maximal compatibility with other parts of ImageJ, which allows powerful preprocessing and post-anaylsis for the FLIM workflow. The toolkit presented by Gao et al  comprises 3 major components: FLIMLib, FLIMJ Ops, and FLIMJ-UI.

1.FLIMLib

FLIMLib (https://flimlib.github.io/) is a cross-platform compatible library with contains C implementation of the algorithms. The library can be compiled to run as a native executable on Linux, Windows, or macOS. FLIMLib is equipped with a Java Native Interface (JNI) wrapper created by the SWIG framework (http://swig.org/), which offers efficient type conversion and data transfer between C and Java applications. More connectors can be added to make the library accessible to many high-level programmers using Python, MATAB, C++ and C# among others. The interaction could be through a graphical user interface such as with TRI2 or ImageJ, through a command line in scriptable form, or via a third-party framework such as MATLAB or R. Data analysis methods currently present in the open-source library for lifetime data include: rapid lifetime determination, Levenberg-Marquardt (LM) non-linear least squares fitting, maximum likelihood estimation, global analysis, phasor, and Bayesian inference.

2.FLIMJ Ops

FLIMJ Ops is a plugin built upon the ImageJ Ops framework that connects FLIMLib and the ImageJ ecosystem. With help from the ImageJ Ops framework, FLIMJ Ops provides a concise yet flexible programmatic interface that can be easily included in a scripting workflow.

3.FLIMJ UI

FLIMJ-UI is an ImageJ plugin created to facilitate integrating tools for visualizing results and allow fine-tuning of configurations. It is based on the SciJava command framework, and invokes FLIMJ Ops to carry out the computation. The plugin can be started through scripting, or may be launched by the user from Fiji during an image analysis workflow.

 The authors further provide two example demo notebooks with the FLIMJ Ops repository: 1) a groovy notebook running on the BeakerX kernel that accesses ImageJ Ops directly, 2) a python Jupyter notebook that accesses ImageJ ops through the PyImageJ interface to invoke FLIMJ Ops.

 

Overall development: validation

The authors demonstrate the FLIMJ workflow and validate the results using separate software and simulated data for two different cases:

1.Segmentation

This case consisted on linking fluorescence lifetime processing to other advanced image processing plugins within ImageJ, to accurately measure protein dimer formation in cancer tissue. The authors aimed for FRET efficiency calculation of segmented tumorous tissue. A challenging aspect of these measurements in tissue is the need to segment the tumour tissue from surrounding stroma and other normal tissue components. The authors created a pipeline that uses trainable Weka segmentation on the intensity image in parallel to FLIMJ to provide tumour segmented lifetime statistics.

2.Co-localization

This case consisted on measuring co-localization of NAD(P)H, and antibody distribution for microglia. This use case is based on the Fiji ROI colocalization plugin and links to fluorescence lifetime processing of autofluorescence images of microglia. The authors have previously explored the potential applicability of NAD(P)H FLIM in differentiating microglia functional state. The expectation in this case was that the hybrid method allowing lifetime estimation from raw decay data, and colocalization analysis, can be helpful in determining the effectiveness of FLIM based approaches in the identification of microglia. To properly evaluate microglia identification with endogenous NADH signal, colocalization analysis can be of great benefit to quantitatively analyze overlap.

For both cases, FLIMJ was shown to perform optimally with the central components of each workflow, as well as to have the potential to be integrated with more complex ones. Moreover, the authors validated the routines by comparing FLIMJ against commercially available FLIM analysis standards.

What I like about this preprint

I like all developments that are consistent with open science, and the democratization of science – making tools available to everyone, both in terms of cost accessibility, and expertise (i.e., that the development is equally accessible to developers and to bench scientists). Equally, I think this development will be of great use to the scientific community as it closes important gaps between hardware novelties and software needs.

References

1.Gao D et al, FLIMJ: an open-source ImageJ toolkit for fluorescence lifetime image data analysis, bioRxiv, 2020.

 

doi: https://doi.org/10.1242/prelights.25896

Read preprint (1 votes)

Author's response

Jenu Chacko, Kevin W. Eliceiri shared

Open questions 

1.Can you expand further on other possible uses of FLIMJ beyond the cases you explored on co-localization and segmentation?

FLIM has been used with image processing tools like marker identification, time series analysis, and more straightforward tasks such as resampling, reshaping of data. However, these tasks were bound to tools commercial vendors provided. FLIMJ can employ these image processing tasks at any stage of the fitting. For example, if a median filter has to be applied before calculating a derived quantity like FRET efficiency, FLIMJ can do that with a single script line. FLIMJ can be used any with any of the image processing routines of ImageJ.

2. Can you expand further on potential limitations that users should be aware of in specific cases?

Specific use cases and constraints associated with FLIMJ are tied to the model-dependent behavior of FLIM as a technique. FLIM analysis does require the user to be familiar with different methods of extracting the feature of interest. For example, consider a low light scenario: if the user needs a fair reproduction of the lifetime curve, the user should use Bayes estimates; however, if the final goal is an estimate of a derived parameter instead of the decay curve itself, the user would benefit from phasor plots or other gated analysis.

3.You mention there is still room for development for FLIMJ. What are the next immediate steps to address?

The immediate steps are a) extend the library to Python for integration into more tools like deep learning and other research tools. b) Seek to expand the FLIM data format support. c)to accommodate more FLIM-based analysis tools for autofluorescence and metabolic imaging community, such as tools for Fluorescence Anisotropy analysis, etc.

4. As it is open access, and open to developers too, to add functions, how do you envisage to keep the tool accessible (in terms of expertise) to bench users? For instance, do you intend to provide tutorials online or such form of training as the tool develops further?

We are continuously adding more tutorials and guidelines for users to expand the methods through FLIMJ-OPS library methods. The FLIMJ library is a script-friendly tool that can be modeled to any bench user’s requirement. The FLIMJ-UI uses a simplistic design that can perform essential functions without extensive training and future-proofed for more community-engaged development. As we move forward, adding more extensions and functionalities, the developers must support their works with demos and guides. As part of the ImageJ ecosystem, there will be ongoing support to ensure this smooth integration into the user’s analysis, focusing on accessibility and customization.

Have your say

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Sign up to customise the site to your preferences and to receive alerts

Register here

Also in the bioinformatics category:

Functional Diversity of Memory CD8 T Cells is Spatiotemporally Imprinted

Miguel Reina-Campos, Alexander Monell, Amir Ferry, et al.

Selected by 22 August 2024

Marina Schernthanner

Bioinformatics

Enhancer-driven cell type comparison reveals similarities between the mammalian and bird pallium

Nikolai Hecker , Niklas Kempynck , David Mauduit, et al.

Selected by 02 July 2024

Rodrigo Senovilla-Ganzo

Bioinformatics

Expressive modeling and fast simulation for dynamic compartments

Till Köster, Philipp Henning, Tom Warnke, et al.

Selected by 18 April 2024

Benjamin Dominik Maier

Systems Biology

Also in the cell biology category:

The RNA binding protein HNRNPA2B1 regulates RNA abundance and motor protein activity in neurites

Joelle Lo, Katherine F. Vaeth, Gurprit Bhardwaj, et al.

Selected by 24 September 2024

Felipe Del Valle Batalla

Neuroscience

Pharyngeal neuronal mechanisms governing sour taste perception in Drosophila melanogaster

Bhanu Shrestha, Jiun Sang, Suman Rimal, et al.

Selected by 23 September 2024

Matthew Davies

Cell Biology

Feedback regulation by the RhoA-specific GEF ARHGEF17 regulates actomyosin network disassembly

Vasundhara Rao, Benjamin Grädel, Lucien Hinderling, et al.

Selected by 18 September 2024

Vibha SINGH

Cell Biology

preLists in the bioinformatics category:

‘In preprints’ from Development 2022-2023

A list of the preprints featured in Development's 'In preprints' articles between 2022-2023

 



List by Alex Eve, Katherine Brown

9th International Symposium on the Biology of Vertebrate Sex Determination

This preList contains preprints discussed during the 9th International Symposium on the Biology of Vertebrate Sex Determination. This conference was held in Kona, Hawaii from April 17th to 21st 2023.

 



List by Martin Estermann

Alumni picks – preLights 5th Birthday

This preList contains preprints that were picked and highlighted by preLights Alumni - an initiative that was set up to mark preLights 5th birthday. More entries will follow throughout February and March 2023.

 



List by Sergio Menchero et al.

Fibroblasts

The advances in fibroblast biology preList explores the recent discoveries and preprints of the fibroblast world. Get ready to immerse yourself with this list created for fibroblasts aficionados and lovers, and beyond. Here, my goal is to include preprints of fibroblast biology, heterogeneity, fate, extracellular matrix, behavior, topography, single-cell atlases, spatial transcriptomics, and their matrix!

 



List by Osvaldo Contreras

Single Cell Biology 2020

A list of preprints mentioned at the Wellcome Genome Campus Single Cell Biology 2020 meeting.

 



List by Alex Eve

Antimicrobials: Discovery, clinical use, and development of resistance

Preprints that describe the discovery of new antimicrobials and any improvements made regarding their clinical use. Includes preprints that detail the factors affecting antimicrobial selection and the development of antimicrobial resistance.

 



List by Zhang-He Goh

Also in the cell biology category:

BSCB-Biochemical Society 2024 Cell Migration meeting

This preList features preprints that were discussed and presented during the BSCB-Biochemical Society 2024 Cell Migration meeting in Birmingham, UK in April 2024. Kindly put together by Sara Morais da Silva, Reviews Editor at Journal of Cell Science.

 



List by Reinier Prosee

‘In preprints’ from Development 2022-2023

A list of the preprints featured in Development's 'In preprints' articles between 2022-2023

 



List by Alex Eve, Katherine Brown

preLights peer support – preprints of interest

This is a preprint repository to organise the preprints and preLights covered through the 'preLights peer support' initiative.

 



List by preLights peer support

The Society for Developmental Biology 82nd Annual Meeting

This preList is made up of the preprints discussed during the Society for Developmental Biology 82nd Annual Meeting that took place in Chicago in July 2023.

 



List by Joyce Yu, Katherine Brown

CSHL 87th Symposium: Stem Cells

Preprints mentioned by speakers at the #CSHLsymp23

 



List by Alex Eve

Journal of Cell Science meeting ‘Imaging Cell Dynamics’

This preList highlights the preprints discussed at the JCS meeting 'Imaging Cell Dynamics'. The meeting was held from 14 - 17 May 2023 in Lisbon, Portugal and was organised by Erika Holzbaur, Jennifer Lippincott-Schwartz, Rob Parton and Michael Way.

 



List by Helen Zenner

9th International Symposium on the Biology of Vertebrate Sex Determination

This preList contains preprints discussed during the 9th International Symposium on the Biology of Vertebrate Sex Determination. This conference was held in Kona, Hawaii from April 17th to 21st 2023.

 



List by Martin Estermann

Alumni picks – preLights 5th Birthday

This preList contains preprints that were picked and highlighted by preLights Alumni - an initiative that was set up to mark preLights 5th birthday. More entries will follow throughout February and March 2023.

 



List by Sergio Menchero et al.

CellBio 2022 – An ASCB/EMBO Meeting

This preLists features preprints that were discussed and presented during the CellBio 2022 meeting in Washington, DC in December 2022.

 



List by Nadja Hümpfer et al.

Fibroblasts

The advances in fibroblast biology preList explores the recent discoveries and preprints of the fibroblast world. Get ready to immerse yourself with this list created for fibroblasts aficionados and lovers, and beyond. Here, my goal is to include preprints of fibroblast biology, heterogeneity, fate, extracellular matrix, behavior, topography, single-cell atlases, spatial transcriptomics, and their matrix!

 



List by Osvaldo Contreras

EMBL Synthetic Morphogenesis: From Gene Circuits to Tissue Architecture (2021)

A list of preprints mentioned at the #EESmorphoG virtual meeting in 2021.

 



List by Alex Eve

FENS 2020

A collection of preprints presented during the virtual meeting of the Federation of European Neuroscience Societies (FENS) in 2020

 



List by Ana Dorrego-Rivas

Planar Cell Polarity – PCP

This preList contains preprints about the latest findings on Planar Cell Polarity (PCP) in various model organisms at the molecular, cellular and tissue levels.

 



List by Ana Dorrego-Rivas

BioMalPar XVI: Biology and Pathology of the Malaria Parasite

[under construction] Preprints presented at the (fully virtual) EMBL BioMalPar XVI, 17-18 May 2020 #emblmalaria

 



List by Dey Lab, Samantha Seah

1

Cell Polarity

Recent research from the field of cell polarity is summarized in this list of preprints. It comprises of studies focusing on various forms of cell polarity ranging from epithelial polarity, planar cell polarity to front-to-rear polarity.

 



List by Yamini Ravichandran

TAGC 2020

Preprints recently presented at the virtual Allied Genetics Conference, April 22-26, 2020. #TAGC20

 



List by Maiko Kitaoka et al.

3D Gastruloids

A curated list of preprints related to Gastruloids (in vitro models of early development obtained by 3D aggregation of embryonic cells). Updated until July 2021.

 



List by Paul Gerald L. Sanchez and Stefano Vianello

ECFG15 – Fungal biology

Preprints presented at 15th European Conference on Fungal Genetics 17-20 February 2020 Rome

 



List by Hiral Shah

ASCB EMBO Annual Meeting 2019

A collection of preprints presented at the 2019 ASCB EMBO Meeting in Washington, DC (December 7-11)

 



List by Madhuja Samaddar et al.

EMBL Seeing is Believing – Imaging the Molecular Processes of Life

Preprints discussed at the 2019 edition of Seeing is Believing, at EMBL Heidelberg from the 9th-12th October 2019

 



List by Dey Lab

Autophagy

Preprints on autophagy and lysosomal degradation and its role in neurodegeneration and disease. Includes molecular mechanisms, upstream signalling and regulation as well as studies on pharmaceutical interventions to upregulate the process.

 



List by Sandra Malmgren Hill

Lung Disease and Regeneration

This preprint list compiles highlights from the field of lung biology.

 



List by Rob Hynds

Cellular metabolism

A curated list of preprints related to cellular metabolism at Biorxiv by Pablo Ranea Robles from the Prelights community. Special interest on lipid metabolism, peroxisomes and mitochondria.

 



List by Pablo Ranea Robles

BSCB/BSDB Annual Meeting 2019

Preprints presented at the BSCB/BSDB Annual Meeting 2019

 



List by Dey Lab

MitoList

This list of preprints is focused on work expanding our knowledge on mitochondria in any organism, tissue or cell type, from the normal biology to the pathology.

 



List by Sandra Franco Iborra

Biophysical Society Annual Meeting 2019

Few of the preprints that were discussed in the recent BPS annual meeting at Baltimore, USA

 



List by Joseph Jose Thottacherry

ASCB/EMBO Annual Meeting 2018

This list relates to preprints that were discussed at the recent ASCB conference.

 



List by Dey Lab, Amanda Haage
Close