Nothing Special   »   [go: up one dir, main page]
Skip to main content
Download PDF
Download ePub

Biomedical data analyses facilitated by open cheminformatics workflows

Journal of Cheminformatics volume 15, Article number: 46 (2023) Cite this article

The Special Collection ”Biomedical Data Analyses Facilitated by Open Cheminformatics Workflows” (https://www.biomedcentral.com/collections/BDAOCW) aimed to collect and publish cheminformatics workflows for curation and analysis of diverse life science data sets. Especially at a time where in many areas of science reproducibility of results is significantly challenged [1, 2], it is important to encourage publication of workflows for data curation, including data extraction, integration, annotation, cleaning/filtering, standardization and analysis. However, this reproducibility ”crisis” is not only a challenge but can become an opportunity for change and better publication practise in the future [3].

For many scientific workflows, curation of data is essential and takes a significant amount of time. Many different scientific disciplines and data types depend on data standardization and preprocessing, which is nicely exemplified by the different areas covered in this special issue - from small molecules, to metabolomics, and drug-protein interactions. However, choices made during data curation can be quite subjective, i.e. containing user-defined cut-offs, and also depends on the problem at hand. Thus, published workflows shall enable comparability and reproducibility of results in line with FAIR (findable, accessible, interoperable, and reusable) principles both for data [4] as well as software [5]. Another advantage of using already existing workflows is avoiding mistakes and challenges others have already faced and overcome before.

Many scientific studies in the fields of cheminformatics and computational chemistry aim to extract and connect knowledge from (experimental) data. One fundamental assumption is the correctness of input data from experimental resources. However, systematic errors, i.e. translation between 1D, 2D, and 3D structure representations, as well as random errors, such as incorrect human input, occur ranging from on average two errors per (medicinal chemistry) publication to 0.1\(-\)3.4% for different databases [6,7,8]. In addition to errors in experimental resources, the correct representation and standardization of molecules, including their tautomers and protonation states, can be highly challenging and time-consuming. Molecules are often represented by the Simplified Molecular Input Line Entry System (SMILES) [9] or InChI [10, 11] representation. However, there is no universal standard for SMILES and using different programs will lead to different representations for the same molecule. The importance of (automated) chemical structure curation is demonstrated by the publication of structure standardization workflows by major bioactivity data resources like ChEMBL [12], PubChem [13], or canSAR [14].

In the field of machine learning (ML) and artificial intelligence (AI) publication of code is more commonly applied. Due to increasing amount of published methods in that area, more publications including guidelines on reproducibility but also on model comparison itself became available [15,16,17]. It could serve as an example for other areas of cheminformatics and computational chemistry for which open source publications and workflows are not yet commonly published with manuscripts.

Publication of data on the other hand is an even more challenging topic especially when considering proprietary data. Public bioacitivty data often have a lower number of negative or inactive data compared to proprietary data, thus displaying a higher ratio of actives to inactives than commonly seen in i.e. high-throughput screening (HTS) runs [18,19,20,21]. Thus, public and proprietary data sets complement each other in terms of chemical space coverage. Another advantage of proprietary data is the estimation of experimental uncertainty, since often a more homogeneous curation pipeline and assay setup is applied as well as multiple measurements for the same compounds are available. In order to satisfy the request for reproducibility and data sharing without violating intellectual property (IP) rights, the application of developed methods and workflows to public and private data in the same manner is a good solution. This process has been encouraged for research papers submitted to J. Cheminf. as demonstrated by these examples [22, 23].

The workflows submitted for this special issue include KNIME workflows [24], Galaxy [25] or Jupyter notebooks[26]. In addition to these workflow tools, platforms for publishing and sharing of code, such as GitHub [27] or GitLab are available and allow sharing with and enhancements by peers. Larger data that requires more storage space, such as model input data or machine learning models themselves, can be stored in open-repositories such as Zenodo [28]. Docker [29] became popular in order to avoid any issues with cross platform installation. With all these resources available, ideal conditions for improvements and requirements for reproducibility are at hand.

Ultimately, publication of workflows does not mean that these workflows cannot be changed anymore. These serve as a basis and starting point for further research and can also help during teaching, with already existing initiatives such as TeachOpenCADD [30, 31]. Thus, we strongly encourage open access publication of workflows in order to help driving research the best way possible.

In this special issue, diverse topics were covered from data analysis (nonadditivity analysis, thermal shift assay analysis, or MS/MS analysis for metabolomics), structural analysis (drug-protein interactions, fragment-based virtual screening) to machine learning (retraining of ML models, ML for off-target predictions, MMPA and QSAR). This nicely illustrates how important data workflows and analysis are across different scientfic fields.

As mentioned already, data availability is still a great challenge especially when it comes to high quality data. Many of todays’ influential researchers have grown up in a culture where data and knowledge sharing has not been appreciated yet, but was rather seen as potentially limiting their chances for securing one of the rare tenured academic positions. Herein, a reward system to encourage data sharing could be a first incentive. Additionally, data sharing initiatives, such as federated learning with the MELLODDY project [32], have been conducted to share proprietary data and enhance machine learning models across companies. In the future, it would be great to see more initiatives to share data cross company but also between academia and industry to advance method development.

Abbreviations

AI:

Artificial intelligence

CADD:

Computer-aided drug design

FAIR:

Findable, accessible, interoperable, and reusable

HTS:

High-throughput screening

InChI:

International chemical identifier

IP:

Intellectual property

ML:

Machine learning

MMPA:

Matched molecular pair analysis

SMILES:

Simplified molecular input line entry system

QSAR:

Quantitative structure activity relationship

References

  1. Yang Y, Youyou W, Uzzi B (2020) Estimating the deep replicability of scientific findings using human and artificial intelligence. Proc Natl Acad Sci 117(20):10762–10768. https://doi.org/10.1073/pnas.1909046117

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Errington TM, Denis A, Perfito N, Iorns E, Nosek BA (2021) Challenges for assessing replicability in preclinical cancer biology. eLife 10:e67995

    Article  PubMed  PubMed Central  Google Scholar 

  3. Munafò M, Chambers C, Collins A, Fortunato L, Macleod M (2022) The reproducibility debate is an opportunity, not a crisis. BMC Res Notes 15:43. https://doi.org/10.1186/s13104-022-05942-3

    Article  PubMed  PubMed Central  Google Scholar 

  4. Wilkinson MD, Dumontier M, Aalbersberg IJ, Appleton G, Axton M, Baak A, Blomberg N, Boiten J-W, da Silva Santos LB, Bourne PE, Bouwman J, Brookes AJ, Clark T, Crosas M, Dillo I, Dumon O, Edmunds S, Evelo CT, Finkers R, Gonzalez-Beltran A, Gray AJG, Groth P, Goble C, Grethe JS, Heringa J, ’t Hoen PAC, Hooft R, Kuhn T, Kok R, Kok J, Lusher SJ, Martone ME, Mons A, Packer AL, Persson B, Rocca-Serra P, Roos M, van Schaik R, Sansone S-A, Schultes E, Sengstag T, Slater T, Strawn G, Swertz MA, Thompson M, van der Lei J, van Mulligen E, Velterop J, Waagmeester A, Wittenburg P, Wolstencroft K, Zhao J, Mons B, (2016) The FAIR guiding principles for scientific data management and stewardship. Sci Data 3:160018

    Article  PubMed  PubMed Central  Google Scholar 

  5. Barker M, Chue Hong NP, Katz DS et al (2022) Introducing the FAIR principles for research software. Sci Data 9: 622. https://doi.org/10.1038/s41597-022-01710-x

  6. Olah M, Mracec M, Ostopovici L, Rad R, Bora A, Hadaruga N, Olah I, Banda M, Simon Z, Mracec M, Oprea TI (2005) Wombat: world of molecular bioactivity. Chemoinform Drug Discov 23:221–239. https://doi.org/10.1002/3527603743.CH9

    Article  Google Scholar 

  7. Young D, Martin T, Venkatapathy R, Harten P (2008) Are the chemical structures in your qsar correct? QSAR Comb Sci 27:1337–1345. https://doi.org/10.1002/QSAR.200810084

    Article  CAS  Google Scholar 

  8. Fourches D, Muratov E, Tropsha A (2010) Trust, but verify: on the importance of chemical structure curation in cheminformatics and qsar modeling research. J Chem Inform Model 50:1189–1204. https://doi.org/10.1021/ci100176x

    Article  CAS  Google Scholar 

  9. Weininger D (2002) Smiles, a chemical language and information system. 1. introduction to methodology and encoding rules. J Chem Inform Comput Sci 28:31–36. https://doi.org/10.1021/ci00057a005

    Article  Google Scholar 

  10. Heller S, McNaught A, Stein S, Tchekhovskoi D, Pletnev I (2013) Inchi - the worldwide chemical structure identifier standard. J Cheminform 5:1–9. https://doi.org/10.1186/1758-2946-5-7

    Article  CAS  Google Scholar 

  11. Heller SR, McNaught A, Pletnev I, Stein S, Tchekhovskoi D (2015) Inchi, the iupac international chemical identifier. J Cheminform 7:1–34. https://doi.org/10.1186/S13321-015-0068-4

    Article  CAS  Google Scholar 

  12. Bento AP, Hersey A, Félix E, Landrum G, Gaulton A, Atkinson F, Bellis LJ, Veij MD, Leach AR (2020) An open source chemical structure curation pipeline using rdkit. J Cheminform 12:1–16. https://doi.org/10.1186/S13321-020-00456-1

    Article  Google Scholar 

  13. Hähnke VD, Kim S, Bolton EE (2018) Pubchem chemical structure standardization. J Cheminform 10:1–40. https://doi.org/10.1186/S13321-018-0293-8

    Article  Google Scholar 

  14. Dolciami D, Villasclaras-Fernandez E, Kannas C, Meniconi M, Al-Lazikani B, Antolin AA (2022) Cansar chemistry registration and standardization pipeline. J Cheminform 14:1–20. https://doi.org/10.1186/S13321-022-00606-7

    Article  Google Scholar 

  15. Walters WP (2020) Code sharing in the open science era. J Chem Inf Model 60:4417–4420

    Article  CAS  PubMed  Google Scholar 

  16. Bajorath J, Coley CW, Landon MR, Walters WP, Zheng M (2021) Reproducibility, reusability, and community efforts in artificial intelligence research. Artif Intel Life Sci 1:100002

    CAS  Google Scholar 

  17. Walters WP (2022) Comparing classification models-a practical tutorial. J Comput Aided Mol Des 36:381–389

    Article  Google Scholar 

  18. Bradley D (2008) Dealing with a data dilemma. Nature Rev Drug Discov 7:632–633

    Article  Google Scholar 

  19. Rodríguez-Pérez R, Miyao T, Jasial S, Vogt M, Bajorath J (2018) Prediction of compound profiling matrices using machine learning. ACS Omega 3:4713–4723

    Article  PubMed  PubMed Central  Google Scholar 

  20. Cáceres EL, Mew NC, Keiser MJ (2020) Adding stochastic negative examples into machine learning improves molecular bioactivity prediction. J Chem Inf Model 60:5957–5970

    Article  PubMed  Google Scholar 

  21. Valsecchi C, Grisoni F, Motta S, Bonati L, Ballabio D (2020) NURA: a curated dataset of nuclear receptor modulators. Tox Appl Pharmaco 407:115244

    Article  CAS  Google Scholar 

  22. Morger A, Mathea M, Achenbach JH, Wolf A, Buesen R, Schleifer K-J, Landsiedel R, Volkamer A (2020) KnowTox: pipeline and case study for confident prediction of potential toxic effects of compounds in early phases of development. J Cheminf 12:24

    Article  CAS  Google Scholar 

  23. Boldini D, Friedrich L, Kuhn D, Sieber SA (2022) Tuning gradient boosting for imbalanced bioassay modelling with custom loss functions. J Cheminform 14:1–13. https://doi.org/10.1186/S13321-022-00657-W

    Article  Google Scholar 

  24. Berthold MR, Cebron N, Dill F, Gabriel TR, Kötter T, Meinl T, Ohl P, Thiel K, Wiswedel B (2009) Knime - the konstanz information miner: Version 20 and beyond. SIGKDD Explor Newsl 11(1):26–31. https://doi.org/10.1145/1656274.1656280

    Article  Google Scholar 

  25. Afgan E, Baker D, Batut B, van den Beek M, Bouvier D, Čech M, Chilton J, Clements D, Coraor N, Grüning BA, Guerler A, Hillman-Jackson J, Hiltemann S, Jalili V, Rasche H, Soranzo N, Goecks J, Taylor J, Nekrutenko A, Blankenberg D (2018) The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update. Nucleic Acids Res 46(W1):537–544. https://doi.org/10.1093/nar/gky379

    Article  CAS  Google Scholar 

  26. Kluyver T, Ragan-Kelley B, Pérez F, Granger BE, Bussonnier M, Frederic J, Kelley K, Hamrick JB, Grout J, Corlay S, Ivanov P, Avila D, Abdalla S, Willing C, Jupyter Development Team (2016) Jupyter Notebooks - a publishing format for reproducible computational workflows. In: Loizides F, Scmidt B (eds) International Conference on Electronic Publishing. IOS Press, Amsterdam, pp 87–90

    Google Scholar 

  27. github (2023). GitHub. Retrieved from https://github.com/

  28. European Organization For Nuclear Research, OpenAIRE (2013) Zenodo. CERN. https://doi.org/10.25495/7GXK-RD71

    Article  Google Scholar 

  29. Merkel D (2014) Docker: lightweight linux containers for consistent development and deployment. Linux J 2014(239):2

    Google Scholar 

  30. Sydow D, Rodríguez-Guerra J, Volkamer A (2021) Teaching computer-aided drug design using TeachOpenCADD. In: Teaching Programming across the Chemistry Curriculum, Washington, pp 135–158. https://pubs.acs.org/doi/abs/10.1021/bk-2021-1387.ch010

    Google Scholar 

  31. Sydow D, Rodríguez-Guerra J, Kimber TB, Schaller D, Taylor CJ, Chen Y, Leja M, Misra S, Wichmann M, Ariamajd A, Volkamer A (2022) TeachOpenCADD 2022: open source and FAIR Python pipelines to assist in structural bioinformatics and cheminformatics research. Nucleic Acids Res. https://doi.org/10.1093/nar/gkac267

    Article  PubMed  PubMed Central  Google Scholar 

  32. Oldenhof M, Ács G, Pejo B, Schuffenhauer A, Holway N, Sturm N, Dieckmann A, Fortmeier O, Boniface E, Mayer C, Gohier A, Schmidtke P, Niwayama R, Kopecky D, Mervin L, Rathi PC, Friedrich L, Formanek A, Antal P, Rahaman J, Zalewski A, Heyndrickx W, Oluoch E, Stössel M, Vanco M, Endico D, Gelus F, de Boisfossé T, Darbier A, Nicollet A, Blottière M, Telenczuk M, Nguyen VT, Martinez T, Boillet C, Moutet K, Picosson A, Gasser A, Djafar I, Simon A, Arany A, Simm J, Moreau Y, Engkvist O, Ceulemans H, Marini C, Galtier M (2022) Industry-scale orchestrated federated learning for drug discovery. arXiv. https://doi.org/10.48550/arXiv.2210.08871

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Medicinal Chemistry, Research and Early Development, Respiratory and Immunology (R&I), BioPharmaceuticals R&D, AstraZeneca, Gothenburg, Sweden

    Eva Nittinger

  2. Research Informatics, Collaborative Drug Discovery, Inc., Ottawa, Canada

    Alex Clark

  3. Data Operations, Exscientia, Oxford, UK

    Anna Gaulton

  4. European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Hinxton, UK

    Barbara Zdrazil

Authors
  1. Eva Nittinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alex Clark
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anna Gaulton
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Barbara Zdrazil
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

EN, AC, AG, and BZ contributed to the Special Collection. EN and BZ wrote the editorial. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Eva Nittinger or Barbara Zdrazil.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nittinger, E., Clark, A., Gaulton, A. et al. Biomedical data analyses facilitated by open cheminformatics workflows. J Cheminform 15, 46 (2023). https://doi.org/10.1186/s13321-023-00718-8

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/s13321-023-00718-8

Journal of Cheminformatics

ISSN: 1758-2946

Contact us