FAIR enough? A perspective on the status of nucleotide sequence data and metadata on public archives

Background

Nucleotide sequencing data are frequently used in all areas of life science, and due to technical progress, the amount of data is growing exponentially (1). Recently, we can observe an emerging trend of “recycling” and reanalyzing existing data archived in open access data stores. This “data mining” approach can help to answer scientific questions beyond the ones tackled in the study originally producing the data. However, to ensure proper reuse of existing data, it is not enough to provide the primary data, such as a nucleotide sequence; rather it is essential to specify the associated metadata – features which describe the primary data – such as experimental conditions and methods used to generate them. Therefore, the FAIR guidelines which offer directions to make data Findable, Accessible, Interoperable and Reusable were initiated (2).

To facilitate data standardization, the Genomic Standards Consortium (GCS) established the so called MIxS (Minimal Information about any (x) Sequence) checklists which determine mandatory parameters and suggest using a uniform vocabulary to describe the sampled environment and experimental settings, for example through “Environmental Ontology” (ENVO) (3). ENA (European Nucleotide Archive), one of the three main data archives, strongly encourages submitters to follow these MIxS guidelines. Additionally, professional support for simple and sustainable data deposition is offered by brokerage services such as the German Federation for Biological Data (GFBio) or the China Nucleotide Sequence Archive (CNSA). Despite all measures implemented to promote FAIRness and to further standardize data storage, interoperability and reusability are still hampered by incorrect and insufficient description of metadata (4).

Research question and approach

In their study, Hassenrück and colleagues examined the metadata status of raw read Illumina amplicon and whole genome shotgun sequencing data from ecological material. Specifically, they aimed to assess if the primary sequence data comply with data submission standards. Therefore, the authors searched for raw read data from ecological metagenomes (NCBI taxid 410657) available at ENA. Then they reviewed all “cases” for metadata information about i) geographic coordinates, ii) target gene, subfragment or primers, iii) length of the amplified fragment (nominal length) and iv) use of standard vocabulary to describe the sampled environment according to ENVO.

Furthermore, the format of the submitted raw data is of major importance for automated reusability of nucleotide sequencing data. Therefore, a data mining case study using amplicon studies of the V3-V4 hypervariable region of the bacterial 16S gene was performed to investigate among others correct filing according to ENA guidelines and proper declaration as environmental sample.

Main Findings

Collectively, the number of cases steadily increased in the last years and peaked in 2020 with more than 120 000 submitted sequences; but in total only 6.5% of the analyzed sequences showed compliance with the MIxS checklist, and since 2018 this proportion has clearly decreased.

General metadata, such as geographic coordinates, were provided in nearly all cases. In contrast, mandatory information about the targeted DNA region – critical for data interpretation and reuse – was inadequate in most cases. Only 7% of all examined cases contained correct target gene details, whereas about 1/3 of sequences submitted according to the MIxS checklist had this information readily available. Nominal length, another mandatory parameter, was only specified in 14% of all cases; notably, the use of a MIxS checklist ensured that almost all cases provided information about this value.

Evaluation of the description of environmental characteristics using ENVO revealed that around 70% of all cases did not include any information about these parameters. In contrast, although the use of ENVO terms was sometimes inconsistent, nearly all cases using the MIxS checklist provided those values. Of note, the use of a brokerage service substantially improved metadata quality, especially accessibility and interoperability. Compared to amplicon sequencing data, the quality of whole genome shotgun sequencing (WGS) data was slightly higher.

Lastly, in the scope of a data mining study, the authors analyzed raw reads from 39 studies stored on ENA regarding their compliance with ENA submission requirements. They report that only eight studies were submitted as required and thus pointed out that especially interoperability and reusability of nucleotide sequencing data is still limited.

Overall, these results reveal an alarming trend towards a decline of use of proper standards in data submission and storage which negatively impacts metadata quality. To overcome these problems, the authors give recommendations for the different parties involved, including researchers, research institutions and funding agencies.

Why I chose this preprint

In my opinion, data sharing and communication is the basis for successful, reliable and sustainable research. The recent technological advances allow us to generate an overwhelming amount of data, but in most cases only a small fraction is used in the original study. To fully exploit the potential of these buried “data corpses”, which could massively facilitate scientific progress without additional benchwork effort, FAIRness and proper data management are key. The present study by Dr. Hassenrück and colleagues calls attention to the existing deficits in nucleotide sequencing data storage and gives helpful and easy-to-implement suggestions for the different parties involved in the data sharing process. Moreover, it was very exciting for me to get deeper insights into the global data management processes, regulations, and institutions.

Questions to the authors

• Why do you think WGS data are more frequently submitted in compliance with MIxS?
• Which of your recommendations do you consider as the most important?
• Your study focused on data derived from ENA. Are the same problems present in other data archives?

References

1) Harrison, Peter W., et al. “The European Nucleotide Archive in 2020.” Nucleic acids research 49.D1 (2021): D82-D85.

2) Wilkinson, Mark D., et al. “The FAIR Guiding Principles for scientific data management and stewardship.” Scientific data 3.1 (2016): 1-9.

3)  Yilmaz, Pelin, et al. “Minimum information about a marker gene sequence (MIMARKS) and minimum information about any (x) sequence (MIxS) specifications.” Nature biotechnology 29.5 (2011): 415-420.

4) Eckert, Ester M., et al. “Every fifth published metagenome is not available to science.” PLoS biology 18.4 (2020): e3000698.

Tags: availability, data management, fairness, interoperability, nucleotide sequencing, reusability

doi: https://doi.org/10.1242/prelights.30958

Read preprint (No Ratings Yet)