<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>NIF Blog &#187; Curation</title>
	<atom:link href="http://blog.neuinfo.org/index.php/category/essays/curation/feed" rel="self" type="application/rss+xml" />
	<link>http://blog.neuinfo.org</link>
	<description>Neuroscience Information Framework</description>
	<lastBuildDate>Sat, 27 Feb 2010 00:42:18 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Defining Adulthood</title>
		<link>http://blog.neuinfo.org/index.php/general-information/define-adult</link>
		<comments>http://blog.neuinfo.org/index.php/general-information/define-adult#comments</comments>
		<pubDate>Wed, 03 Feb 2010 16:00:12 +0000</pubDate>
		<dc:creator>Jade</dc:creator>
				<category><![CDATA[Curation]]></category>
		<category><![CDATA[General information]]></category>

		<guid isPermaLink="false">http://blog.neuinfo.org/?p=159</guid>
		<description><![CDATA[THE PROBLEM
Adulthood, like many terms we use for describing data, is a very poorly defined and a somewhat arbitrary concept. When does an organism become an adult? The answer in general would be “it depends on how you define adult.” In the highly charged world of scientific discourse, people may argue correctly that there is [...]]]></description>
			<content:encoded><![CDATA[<p><span style="text-decoration: underline;"><strong>THE PROBLEM</strong></span></p>
<p>Adulthood, like many terms we use for describing data, is a very poorly defined and a somewhat arbitrary concept. When does an organism become an adult? The answer in general would be “it depends on how you define adult.” In the highly charged world of scientific discourse, people may argue correctly that there is no single definition of adult that would satisfy everyone or that there is a magical time point at which it occurs. The question for the Neuroscience Information Framework or any other group attempting to integrate data from many sources is not whether one group of definitions is correct, but rather whether such a concept is useful for comparing and understanding data.</p>
<p>To illustrate this point, MGI or the mouse genome informatics project, which is <em>the</em> place to go for all things mouse (from mouse strains to ontologies and genes), does not define the term adult, because of the disagreement among scientists as to what constitutes the break between juvenile and adult mice (personal communication). Of course MGI does have the “adult brain ontology”, among other resources labeled with the term adult. So they use the term as it is useful and describes a set of organismal characteristics, but are unwilling to define the term due to the ambiguities in the definitions.</p>
<p>Other large datasets, such as the Allen Brain Atlas do not deal with these sorts of definitions; rather they take data only from postnatal day 55 animals, which they consider safely within the adult range.</p>
<p>In an ideal world, we would provide a standard set of organism attributes for every subject used that is provided in a computable form, e.g., age, weight, sexual maturity. Anyone would therefore request data only from those subsets of animals that were comparable, e.g., between ages 30 days and 90 days and between 100g – 200g. Within a given resource, e.g., database, one can easily set up such a system. However, for a system like NIF that searches across broad swaths of information contained in individual databases, XML files, HTML pages and text, it is currently impossible to provide such a universal computational service on the fly even for something that should be conceptually simple, e.g., representation of age (days, months, years, prenatal, embryonic etc). Nevermind the fact that such information is not consistently available for a source.</p>
<p>A consideration of the literature shows that many times the only label for age is “adult” with no specifics provided.</p>
<p>For databases that take and analyze data from published work, like neuromorpho.org, the word adult is the only age that accurately describes a particular data set. Automated systems recognize this term, but if the definition is not constant across sources, the “adult” is not a useful bucket for aggregating information. One source may have adult as starting at P21 while another at P30. Furthermore automated systems would not be able to translate “P55” as adult, or “week 5” into adulthood unless there was a definition that could be applied.</p>
<p><span style="text-decoration: underline;"><strong>DEFINITION OF ADULT</strong></span></p>
<p>The question is whether we can come up with a definition of adulthood that can be consistently applied. Most of the biological definitions of adulthood deal with the readiness of an organism to reproduce, sexual maturity, or the notion that an animal is full-grown. Both definitions have inherent problems. For example, many species including male rats do not stop growing until death, making “full-size” only applicable when animals have reached their death. Similarly, sexual maturity may be defined as the onset of estrus, but can also be defined as the termination of ‘pubescence’ a period of time that is difficult to access in a rat or mouse.</p>
<p>Adding a little complexity to the problem is the relatively simple question of what is the day of birth. Scientists from various entrenched camps define postnatal day zero as the day of birth and others define it as postnatal day one. Neither group is incorrect, but anyone attempting to bring together data from various datasets (or publications) is required to spend a large amount of time attempting to understand whether the particular piece of data comes from an animal that is P5 or P4.</p>
<p>Due to the inherent problems in defining such a thing, the ontology community (a community concerned with establishing standards in discourse in scientific communication) and many researchers that build databases meant to compare data from various sources treat adulthood with caution. Nonetheless, as evidenced by its wide use, the concept of “adult” is useful and often stands alone as an important characteristic for defining data even though it is not well defined for any species.</p>
<p><span style="text-decoration: underline;"><strong>THE ARBITRARY BUT DEFENSIBLE SOLUTION</strong></span></p>
<p>The above-mentioned problems with defining adulthood are echoed and magnified in humans, because of a need to access emotional maturity and readiness to take on the tasks of independent existence in a complex society.   The solution to determining what an adult human is has been strangely simple and boils down to a number.  Any parent of a teenager knows that there is no magical event that happens on the 18<sup>th</sup> birthday of a child, but for legal systems a hard cut-off is needed, so that treatment of criminal activities and rights bestowed on individuals are clearly defined.  Therefore in almost all advanced societies the legal adult is 18 years of age, whether or not they are emotionally ready to be one or whether or not the pubertal period has passed.</p>
<p>We suggest that a similar arbitrary but defensible cut-off date should be established and implemented for all research animals so that when age of animal is reported as “adult” we can, with some degree of certainty, compare data of one study to the thousands of other similar studies.</p>
<p>According to the work of Finlay and Darlington (Science, 268:1578-84)<strong> </strong>with the chronometry of species, the final important steps in brain development of mice occur 29.7 days after conception, or postnatal day 12 (birth is P0 in this case), menstruation typically begins between postnatal day 25 and 40 and body growth is completed at about age postnatal day 50.  So we can use the arbitrary date of postnatal day 50 as the definition of adult mouse, as this is a reasonable standard for an adult.  We will define the day of birth as postnatal day 0.  Mice between the age of P0 and P24 will be termed juvenile and mice between P25 and P49 should be termed early adult.</p>
<p><span style="text-decoration: underline;"><strong>IN CONCLUSION</strong></span></p>
<p>In the NIFSTD (Neuroscience Information Framework standard ontology) we will define arbitrary but defensible standards for mice and other common research species as this sort of standard is an important part of establishing a common framework in discussion, and not necessarily dealing with the absolute scientific truth.</p>
<p>The reason that we need a standard for age and many other such common terms is that we need to establish a point of reference, which will allow for accurate communication about results.  This is presumably the reason that the standard international system of units (SI) was put in place and we believe in the standardization of certain common variables in experiments for the sake of effective data analysis.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.neuinfo.org/index.php/general-information/define-adult/feed</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Professional vs. self-curation</title>
		<link>http://blog.neuinfo.org/index.php/essays/professional-vs-self-curation</link>
		<comments>http://blog.neuinfo.org/index.php/essays/professional-vs-self-curation#comments</comments>
		<pubDate>Mon, 12 Oct 2009 16:53:22 +0000</pubDate>
		<dc:creator>lee</dc:creator>
				<category><![CDATA[Curation]]></category>
		<category><![CDATA[Essays]]></category>

		<guid isPermaLink="false">http://blog.neuinfo.org/?p=68</guid>
		<description><![CDATA[NIF's tireless curators continue to add valuable resources to NIF's registry and data federation.  New tools, however, allow "self registration" so that resource providers can work with NIF curators in presenting accurate and up-to-date content.  Find out about Biositemaps and learn how to do the DISCO at NIF! ]]></description>
			<content:encoded><![CDATA[<h3><em><strong>Benefits and pitfalls of integration of two very different data types</strong></em><em><strong>, by Dr. Anita Bandrowski, NIF Curator<br />
</strong></em></h3>
<p><em><strong>Overview of NIF registration processes and the role of DISCO:</strong></em><br />
The Neuroscience Information Framework (NIF) project has a dynamic inventory of more than 2300 neuroscience-relevant resources. What makes that inventory dynamic is that NIF encourages resource providers to register their resource to our catalog of &#8220;all things neuroscience.&#8221;  This process is not terribly involved for resource providers as they need to fill out basic information about their resource such as the URL, name, description and keywords.  In the near future, resource providers will also be able to take away a &#8220;DISCO&#8221; file, short for resource discovery.  This file is maintained on the resource providers&#8217; Web site.  Resource providers maintain the currency of information within this file at the source.  When a change is made, NIF is alerted to the change through an automated agent that crawls the site periodically.  In this way, resource providers do not need to provide updated information to NIF or any other system that indexes it.  The updates are performed by the system. In this way, the NIF catalog is kept up-to-date without having to visit each of the 2000+ sites currently listed.</p>
<p>The process of provider registration is a good idea, and we are not the only ones to think of it.  Other projects in biomedical science essentially seek to accomplish the same goal.   Of these, the Biositemaps project, supported by the National Centers for Biomedical Computation, has advanced considerably towards implementing a similar technology.   NIF believes that if providers register their resources using one of these tools, then they should not have to do it again using a slightly different tool. Rather, the data generated by all tools should be accessible to all systems.  We have just completed an exercise in harvesting Biositemaps files into NIF and provide here our experience with and perspectives on the exercise.<br />
<em><br />
<strong>Rationale for integration:</strong></em><br />
Tools such as Biositemaps and DISCO allow the people who know the most about their resources, i.e., those who created them, to describe those resources so that search engines can easily find them.  This &#8220;self description&#8221; is a great idea in theory, but in practice it may not work as intended.  The NIF project, a framework for resource description and discovery, has recently developed tools to harvest the descriptions from Biositemaps.  We believe that biomedical resources should be described in a consistent manner and made discoverable so that projects similar to NIF can present them to our user community.  During this exercise, we have come across several problems that were echoed by other projects attempting to do similar things.</p>
<p>At the outset, the Biositemaps initiative was created as a Google sitemaps-like database that was intended to point search engines to appropriate information about biological software and data sets.  Biositemaps has a great deal of appropriate data about biologically relevant software tools. Because of this, NIF was highly interested in importing this data, which was especially enticing because the data was able to be dynamically updated by the resource providers, meaning that if the particular software tool has a new version, the search systems would be notified automatically of any update.</p>
<p><strong><em>Metadata structure compatibility and vocabularies:</em></strong><br />
NIF has made a conscious decision to have a very simple metadata structure to alleviate problems, including the inappropriate use of metadata fields and the time intensiveness of both the curation effort and the training of curators.  The original NIF developed a fairly comprehensive structure (still available at  <a href="http://neurogateway.org">http://neurogateway.org</a>; see also Gardner et al., 2008) that was populated by the resource providers themselves.  These resource providers were mostly scientists who were building tools or databases.  Many scientists are not metadata experts, and this led to a very inconsistent labeling of resources at the outset of the NIF project.  The inconsistencies in annotation made searching for resources a very difficult task; furthermore, the complicated structure was not intuitive to the end user.  The simple structure adopted by NIF [MM1]alleviated the curation and search problems and also turned out to be quite useful for integrating lots of different metadata structures, including Biositemaps.  The mapping of fields from Biositemaps to the NIF was very simple, taking only a few days to reconcile.</p>
<p>The most significant effort for achieving integration was the mapping the resource types, e.g., database, software tools.  Biositemaps populates the resource type from the Biomedical Resource Ontology (BRO: <a href="http://bioportal.bioontology.org/ontologies/39002">http://bioportal.bioontology.org/ontologies/39002</a>), while NIF uses the NIFSTD  resource ontology.  These two efforts were developed independently but are now  converging by concerted effort of both groups.  However, during this process, they continue to have some differences.  For example, some classes exist in one ontology and not the other, e.g., core facility that is explicitly labeled in the BRO and not labeled in the NIF.  Thus, if resource providers mark their resources as a core facility, the NIF can’t automatically ingest this information, requiring intervention by a human curator.  Therefore, we have continued to align the BRO and NIFSTD as much as is humanly possible to alleviate the need for human intervention.<br />
<em><strong><br />
Data structure compatibility and scope:</strong></em><br />
While the metadata structure harmonization has taken some effort, it is a tamable exercise, but we have noticed that the data within Biositemaps supplied by resource providers is extraordinarily heterogeneous in quality.  In about 200 out of 400 Biositemaps, the data are well formed, but for the remaining records, there is partial information including missing resource names or URLs, making it difficult to take all of the data in Biositemaps and import it into NIF in an automated fashion.  The NIF registry database (as all databases) expects to see certain minimal data including a name and a URL. When these items are not present, the database does not accept the record.  Additionally, heterogeneity comes from the amount of descriptive text. NIF registry records prepared by curators have text of 3-6 paragraphs in most cases, but most Biositemaps resources describe themselves in a single sentence.  NIF uses longer descriptions because we found out early in the project that longer descriptive text includes many keywords NIF users would use for search that may not be included as keywords, making search through the NIF registry more effective.  With minimal descriptions, it is unlikely that the NIF search interface would retrieve Biositemaps resources in a sea of NIF curated resources.  Finally, the issue of combining records that are already present in NIF with Biositemaps data presented some challenges to our system.  Because we don’t yet have a universal way of assigning URI’s to resources, resources tend to be cross-listed in many catalogs.  For this reason, NIF is supporting the Common Naming Project (<a href="http://neurocommons.org/page/Common_Naming_Project">http://neurocommons.org/page/Common_Naming_Project</a>).  As NIF had already provided additional curation to the resources listed that was in many cases more thorough than that supplied by the resource providers, the process of reconciling and merging of information was not straightforward. To address the problems noted above, NIF has updated the registry data structure to accommodate two versions of each record that coexist, one is a storage bin for automated data and the other the human curated version.  Any record that is publicly available in the NIF will be curated by a human, yet with automatic registration, the human curator will be prompted to review the site whenever an update occurs.</p>
<p>Resource characterization is a tricky problem, and it is difficult to know for a particular audience the correct way to represent a resource. For example, the Biositemaps entry for the I2B2 project (<a href="https://www.i2b2.org/">https://www.i2b2.org/</a>; an NIH-funded National Center for Biomedical Computing containing a large amount of software resources) created individual Biositemaps for each plug-in to their software tools.  This is an issue of scope. Because NIF’s curators as a policy do not divide resources to this extent, we consider most plug-ins to be a part of the software resource, not an individual resource (there are some exceptions ,such as MATLAB libraries).  For a project such as NIF, resources need to be well defined because trying to catalog every resource useful to neuroscientists can be a daunting task if a resource is too narrow, such as a plug-in.  If we consider a resource to be appropriate for NITRC, a software library with hundreds of software applications, then it will take a curator some time to annotate this.  However if we consider each plug-in to each program a resource, the task becomes too large and is not likely to help users.  On the other hand, if a user is looking for a very specific plug-in, then having access to each individually is likely to be useful.</p>
<p>To solve this scope problem, we have created a uniqueness criterion for the URL, meaning that if the URL is not unique among several Biositemaps &#8220;resources,&#8221; then the resource descriptions will be folded into one.  The solution is not perfect because unrelated resources could potentially have the same URL, but this strategy solved more problems than it created.</p>
<p><em><strong>Summary:</strong></em><br />
&#8220;Self registration&#8221; tools such as Biositemaps can be used to help human curators annotate a resource, including alerting curators that a resource has been created. However, while these tools can certainly help, we believe that these self-reporting tools do not replace trained human curators.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.neuinfo.org/index.php/essays/professional-vs-self-curation/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
