{"id":16311,"date":"2019-07-10T08:51:03","date_gmt":"2019-07-10T06:51:03","guid":{"rendered":"https:\/\/www.andrewalliance.com\/?p=16311"},"modified":"2023-07-26T16:21:03","modified_gmt":"2023-07-26T14:21:03","slug":"repeating-science-sharing-protocols-important","status":"publish","type":"post","link":"https:\/\/www.andrewalliance.com\/fr\/articles\/repeating-science-sharing-protocols-important\/","title":{"rendered":"Sharing &#038; repeating protocols \u2013 it&#8217;s not rocket science!"},"content":{"rendered":"<h3><strong>The reproducibility crisis<\/strong><\/h3>\n<blockquote><p><em>Question: what can be aggravating, sometimes unpleasant, often unrewarding, brings little prestige and can consume insane amounts of time, resources and effort.<\/em><\/p>\n<p><em>Answer: repeating a research study!<\/em><\/p><\/blockquote>\n<p>Leaders in fields ranging from biomedical research to social science have said it again and again: replication matters, and so does sharing protocols.\u00a0 The importance of repeating experiments is central to the career of the scientist.\u00a0 Indeed, it is absolutely crucial, be it for a research publication or for a patent application.\u00a0 In order for a finding to have any significance at all, it needs to be \u2018true\u2019 more than the one time that it was done by the original research group.\u00a0 If not, we have to attribute it to either serendipity, sloppy dissemination or, rarely, fraud.\u00a0 A major result may depend on a subtlety in how the experiment was conducted that was neither communicated via a research or indeed, conference paper.<\/p>\n<blockquote><p><em>Science is facing a &#8220;reproducibility crisis&#8221; where more than two-thirds of researchers have tried and failed to reproduce another scientist&#8217;s experiments, research suggests.<\/em><\/p><\/blockquote>\n<h3><strong>The challenge of\u00a0sharing protocols<\/strong><\/h3>\n<p>My first recollection of publishing research came while doing research at the National Research Council Labs in Ottawa, Canada.\u00a0It was a very exciting moment.\u00a0This was the reward for weeks of toil optimizing a process for the functionalization of polymeric surfaces using remote plasma chemical vapour deposition.\u00a0 It turned out that publishing a paper was actually an awful lot of work in itself.\u00a0 It involved a number of aspects.\u00a0 Thinking about which journal to submit it to meant appreciating the pecking order of journals as indicated by their \u2018Impact Factor\u2019.\u00a0 It also meant figuring out how to convert the laboratory notes into a well organised paper that would \u2019pass\u2019 peer review\u2019 and sharing protocols so that it would be easily repeatable by other researchers!<\/p>\n<h3><strong>Interpreting protocols<\/strong><\/h3>\n<p>The \u2018methods and materials\u2019 section of a research paper provides the \u2018recipe\u2019. \u00a0Rather like baking a cake, however, there is a question of human interpretation and skill inherent in being able to review another researcher\u2019s experimental protocol and repeat it step by step. \u00a0This is especially true in the life sciences where research invariably involves working with liquids.\u00a0 Let\u2019s assume that you manage to extract the correct step by step protocol from the research paper.\u00a0 You can list the labware used and, at least in theory, re-use the same brand and type of labware, though many do not do this.\u00a0 More problematic are the steps that involve human intervention such as, for example, the use of a manual pipette.\u00a0 Even if you use the same pipette, how can you tell whether it has been calibrated in the same way as the one used in the published work.\u00a0Moreover, different human operators use pipettes in different ways, not surprisingly yielding slightly different results.\u00a0 When you are mixing different samples and reagents, this\u00a0can become quite problematic.. indeed, kit often leads to frustrated clinicians and drug developers who want solid foundations of pre-clinical research to build upon!<\/p>\n<blockquote><p><em>Experimental protocols are key when planning, performing and publishing research in many disciplines, especially in relation to the reporting of materials and methods.<\/em><\/p><\/blockquote>\n<p>Sharing protocols more readily, ideally by some electronic means in our age of the Internet of Things, obviates many potential sources of error.<\/p>\n<h3><strong>Is repeatability really a problem?<\/strong><\/h3>\n<p>Over the last few years, the University of Virginia\u2019s Center for Open Science has run \u2018The Reproducibility Project\u2019, attempting to repeat the findings of five landmark cancer studies.\u00a0 You might believe this would be well established given that the whole integrity of the \u2018scientific method\u2019 is contingent upon repeatability of findings.\u00a0 Read the research paper, repeat the protocol that has been both peer reviewed and disseminated through top journals and \u2018voila\u2019!\u00a0 Except that is not what actually happened.<\/p>\n<p>Concern over the reliability of the results published in scientific literature has been growing for some time.\u00a0 According to a survey published in the journal Nature in 2017, more than 70% of researchers have tried and failed to reproduce another scientist&#8217;s experiments. \u00a0Marcus Munafo is one of them. Now, Professor of biological psychology at Bristol University, he almost gave up on a career in science when, as a PhD student, he failed to reproduce a textbook study on, of all things, &#8216;anxiety&#8217;.<\/p>\n<p>Opinion holds that much of this is due to a human tendency to focus on the \u2018exciting\u2019 vs the rather mundane reality of ensuring repeatable, valid science.\u00a0 Undoubtedly, much is due to the way that science is disseminated.. it is still a slow process, even when it comes down to reviewing research that has significant potential to save lives. \u00a0That sort of research has its highest impact as part of a collaboration, initially between academic institutions, then at some point between (the pharmaceutical) industry and academia. \u00a0Moreover, there can be understandable barriers to sharing protocols for commercial reasons, as well as that basic human concern for competition.<\/p>\n<h3><strong>Easier sharing of protocols accelerates innovation<\/strong><\/h3>\n<p>Collaborations require experiment protocols to be shared between research groups, and repeated, and you only have to spend the briefest amount of time on social media sites for researchers, such as ResearchGate, to realise that shared protocols, including those on https:\/\/www.nature.com\/nprotinvite raise as many questions as they solve when it comes to understanding how to \u2018bake the cake\u2019, though in this instance, \u2018mixing or indeed, shaking, the cocktail might be more apt\u2019.<\/p>\n<p>Providing a means by which researchers can easily construct, execute, capture, and disseminate their experiment protocols, which includes the semi- or fully-automated execution of each step eliminates all the variables and solves the need of those frustrated clinicians and drug developers who want solid foundations of pre-clinical research to build upon!<\/p>\n<p>Our challenge is not only to make it easier for scientists to repeat both their own and the science of other research groups but to speed up the process of bringing innovation to market.\u00a0 Major funders of research, both public and private sector, are trying to remove the barriers to this, be they the speed of peer review, the ease with which a protocol can be accurately and quickly shared, and the greater use of smart automation enabling scientists to focus on higher level activities.\u00a0 If you wonder what those higher level activities might be, take a look at the burgeoning databases of biological pathways and the effort and resources required to solve one of man\u2019s greatest challenges.. understanding what makes us tick.\u00a0 Put another way, addressing the repeatability problem isn\u2019t \u2019rocket science\u2019.. we have the tools available today.. let\u2019s use them!<\/p>\n<p>&nbsp;<\/p>\n<p><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone wp-image-20283 size-full\" src=\"https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/07\/OneLab-Demo.jpg\" alt=\"\" width=\"1948\" height=\"854\" srcset=\"https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/07\/OneLab-Demo.jpg 1948w, https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/07\/OneLab-Demo-300x132.jpg 300w, https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/07\/OneLab-Demo-1024x449.jpg 1024w, https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/07\/OneLab-Demo-768x337.jpg 768w, https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/07\/OneLab-Demo-1536x673.jpg 1536w\" sizes=\"(max-width: 1948px) 100vw, 1948px\" \/><\/p>\n<h3><strong>Enter <a href=\"https:\/\/www.andrewalliance.com\/fr\/laboratory-software\/\">OneLab<\/a><\/strong><\/h3>\n<p>Andrew Alliance has developed a solution to solve this particular problem and it is called <a href=\"https:\/\/www.andrewalliance.com\/fr\/laboratory-software\/\">OneLab<\/a>.\u00a0It is a unique browser-based software environment enabling researchers to design, execute, and share, their own protocols, through a highly intuitive graphical interface that can then be executed step-by-step, from any PC or tablet. <a href=\"https:\/\/onelab.andrewalliance.com\"><strong>Go to https:\/\/onelab.andrewalliance.com today and try out OneLab for free.<\/strong><\/a> It can be used with your current set-up and does not require any connected devices. \u00a0Sharing protocols could not be easier.<\/p>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_16259\" aria-describedby=\"caption-attachment-16259\" style=\"width: 1200px\" class=\"wp-caption alignnone\"><img decoding=\"async\" class=\"wp-image-16259 size-full\" src=\"https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/06\/Onelab-design-and-execute.jpg\" alt=\"Onelab-design-and-execute\" width=\"1200\" height=\"703\" \/><figcaption id=\"caption-attachment-16259\" class=\"wp-caption-text\">Experiments can be set-up and controlled with ease from a laptop or tablet.<\/figcaption><\/figure>\n<p><a href=\"https:\/\/www.andrewalliance.com\/fr\/laboratory-software\/\">OneLab<\/a> combines some powerful advantages:<\/p>\n<p><strong>Designing experiment protocols is easy:<\/strong><\/p>\n<p>&#8211; Intuitive graphical drag-and- drop design interface.<\/p>\n<p>&#8211; Eliminate error-prone calculations for serial dilutions and concentration normalizations.<\/p>\n<p>&#8211; Accelerate collaboration and training by easily sharing protocols with other researchers.<\/p>\n<p><strong>Executing them is even easier:<\/strong><\/p>\n<p>&#8211; Ensure correct manual execution of protocols, with your current set-up.<\/p>\n<p>&#8211; Guarantee reproducibility with secure communication of protocols to OneLab compatible device(s).<\/p>\n<p>&#8211; Connectivity with the award-winning <a href=\"https:\/\/www.andrewalliance.com\/fr\/andrew-plus\/?gclid=EAIaIQobChMI24nLo9up4wIVCrftCh3wTgyaEAAYASAAEgLRJfD_BwE\">Robot de pipetage Andrew+<\/a> and <a href=\"https:\/\/www.andrewalliance.com\/fr\/electronic-pipettes\/\">Pipette+ smart pipetting system<\/a>, or any other connected device, enables researchers to achieve the highest levels of repeatability and productivity, with the added advantage of full traceability.<\/p>\n<p><img decoding=\"async\" class=\"alignnone wp-image-16217 size-full\" src=\"https:\/\/www.andrewalliance.com\/wp-content\/uploads\/2019\/06\/Screenshot-2019-06-14-at-15.42.50.png\" alt=\"\" width=\"1048\" height=\"498\" \/><\/p>\n<p>Learn more at <strong>www.andrewalliance.com<\/strong><\/p>","protected":false},"excerpt":{"rendered":"<p>Leaders in fields ranging from biomedical research to social science have said it again and again: replication matters, and so does sharing protocols.\u00a0 The importance of repeating experiments is central to the career of the scientist.\u00a0 Indeed, it is absolutely crucial, be it for a research publication or for a patent application.\u00a0 In order for a finding to have any significance at all, it needs to be \u2018true\u2019 more than the one time that it was done by the original research group.\u00a0 If not, we have to attribute it to either serendipity, sloppy dissemination or, rarely, fraud.\u00a0 A major result may depend on a subtlety in how the experiment was conducted that was neither communicated via a research or indeed, conference paper.<\/p>","protected":false},"author":9,"featured_media":18798,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1335],"tags":[],"class_list":["post-16311","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-articles"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/posts\/16311","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/comments?post=16311"}],"version-history":[{"count":0,"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/posts\/16311\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/media\/18798"}],"wp:attachment":[{"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/media?parent=16311"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/categories?post=16311"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.andrewalliance.com\/fr\/wp-json\/wp\/v2\/tags?post=16311"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}