DisTEMIST corpus: detection and normalization of disease mentions in spanish clinical cases

DisTEMIST corpus: training set + MULTILINGUAL RESOURCES + CROSSMAPPINGS

• DISTEMIST-entities: complete training set (750 clinical cases)
• DISTEMIST-linking: part 1 of the training set (209 clinical cases)
• DISTEMIST-linking: part 2 of the training set (375 clinical cases)

Introduction

The DisTEMIST corpus is a collection of 1000 clinical cases with disease annotations linked with Snomed-CT concepts. All documents are released in the context of the BioASQ DisTEMIST track for CLEF 2022. For more information about the track and its schedule, please visit the website.

File structure:

The DisTEMIST corpus has been randomly divided into a training set, containing 750 clinical cases, and a test set (584 in the case of subtrack2), consisting of 250 additional cases. Participants must train their systems using the train set and submit predictions for the test set, on which they will be evaluated.  The file structure of the corpus is as follows:

• train_set:
  • text_files: Folder with plain text files of the clinical cases  
  • subtrack1_entities: It contains annotations in a tab-separated file (TSV) with the following columns:
    • filename: document name
    • mark: identifier mention id
    • label: mentions type (ENFERMEDAD)
    • off0: starting position of the mention in the document
    • off1: ending position of the mention in the document
    • span:  text span
  • subtrack2_linking: It contains annotations in a tab-separated file (TSV) with the following columns:
    • filename: document name
    • mark: identifier mention id
    • label: mentions type (ENFERMEDAD)
    • off0: starting position of the mention in the document
    • off1: ending position of the mention in the document
    • span:  text span
    • codes: List of Snomed-CT concept codes linked to the mention. If there is more than one code associated with a mention, they will be concatenated by the symbol “+”.
    • semantic relation: the relationship between the assigned code and the mention. It can be EXACT, when the code corresponds exactly with the mention, or NARROW, when the mention corresponds to a narrower concept than the Snomed-CT code. For instance, the concept “Chorioretinal lacunae” does not exist in Snomed-CT. Then, it is normalized to the Snomed-CT ID 302893000 (“Chorioretinal disorder”).

• test_set: The 250 clinical cases that will be used to evaluate the systems will be published in accordance with the schedule of the task [CURRENTLY NOT INCLUDED IN THE FILE]

• multilingual-resources: we have generated the annotated training and validation sets in 6 languages: English, Portuguese, Catalan, Italian, French and Romanian. The process was:
  1. The text files were translated with a neural machine translation system.
  2. The annotations were translated with the same neural machine translation system.
  3. The translated annotations were transferred to the translated text files using an annotation transfer technology.
  • The text files are stored in the multilingual_resources/training-text-files subfolder.
  • The annotated TSV files are stored in the multilingual_resources/lang subfolders.
  • If you want to visualize the multilingual resources, check out this Brat server: https://temu.bsc.es/mDistemist/#/translations/
    For instance, you can see the parallel annotations in English vs in French, or in Spanish (the gold standard) vs in Catalan.

• cross-mappings. We include the same entities as in DISTEMIST-linking but mapped to Snomed-CT, MeSH, ICD-10, HPO, and OMIM. The original mappings are manual and to Snomed-CT. The mapping to the other terminologies was done through the UMLS Metathesaurus.

Resources 

• Web
• Evaluation Library
• DISTEMIST gazetteer
• DISTEMIST guidelines
• More resources soon