{"id":43,"date":"2012-06-26T15:31:40","date_gmt":"2012-06-26T15:31:40","guid":{"rendered":"http:\/\/notebooks.dataone.org\/dmptool\/?p=43"},"modified":"2013-05-15T16:07:08","modified_gmt":"2013-05-15T16:07:08","slug":"evaluating-the-dmptool-user-tests-dmptool-kit-prototype","status":"publish","type":"post","link":"https:\/\/notebooks.dataone.org\/dmptool-content\/evaluating-the-dmptool-user-tests-dmptool-kit-prototype\/","title":{"rendered":"Evaluating the DMPtool, User Tests, DMPtool ‘Kit’ Prototype"},"content":{"rendered":"

Week 2<\/strong><\/p>\n

June 26, 2012: Closely evaluating the content of the tool, drafting the the user test tool,\u00a0 developing a prototype for the kit<\/strong><\/strong><\/p>\n

Summary of Today’s Post:<\/strong>
\n – Evaluated NOAA template\/guide content<\/strong>
\n – Brainstorm user testing tool<\/strong>
\n – Prototype of ‘kit’<\/strong><\/p>\n

In order to be systematic about trying to improve the content of the DMPtool, I decided to go through each of the templates\/guides for the funding groups that pertain to the Earth Sciences community.\u00a0 The following 5 relate to this community:<\/p>\n

– NOAA
\n– NSF- AGS
\n– NSF-AST
\n– NSF-BIO
\n– NSF-EAR<\/p>\n

Am I missing others?\u00a0 I didn’t know if chemistry would count?<\/p>\n

Evaluating NOAA:<\/strong>
\nSo far I have gone through the NOAA template and noted down areas that I think could be improved, made more clear, where additional resources and links could be added, etc.<\/p>\n

Resources (to the right of the template):
\n– This is a quick fix, yet it should definitely be addressed–the links to the resources are all broken.<\/p>\n

1. General Description of data to be managed
\n– Good<\/p>\n

2. Points of contact
\n– Good<\/p>\n

3. Data Stewardship
\n– I think some explanation about what stewardship is, might be helpful.\u00a0 This thought lead me to my next, which was, I think something to be tested during the user testing could be how much of the explanations and descriptions used in this tool are particularly jargon-y or only understandable to a library community.\u00a0 Do researchers use terms and phrases like stewardship?\u00a0 I am not sure.
\n– Perhaps a link to a resource that describes what the data lifecycle is, though it may be self-explanatory in one sense, I think when we talk about the lifecycle we mean something very specific and imagine that oft referred to DCC data lifecycle image.
\n-the language used here “available to the customer”…. is customer the right word?\u00a0 I’m not sure people are selling and buying data, but rather making it available to future researchers, students, ect.<\/p>\n

4. Data Documentation
\n– “which metadata repository will be used to document this data collection?”\u00a0 Is this referring to the metadata standard?\u00a0 This seems like it may be confusing, because when I think of a metadata repository I think of a data registry or something, but not a standard used to document data.<\/p>\n

5. Data Sharing
\n– I think a link\/resource to information about OPeNDAP or OGC might be helpful, once again, I wonder if researchers are familiar with data access protocols?\u00a0 Which is why I think a linked resource might be beneficial here.
\n– “In what catalogs will these services or data be made registered to enable discovery by users and other catalogs.”\u00a0 Strange wording that might confuse the user.<\/p>\n

6. Initial Data Storage and Protection
\n– Good<\/p>\n

7. Long-term archiving and preservation
\n– Good<\/p>\n

Was this exercise helpful?\u00a0 It definitely helped me to think about the types of questions I would want to ask users.\u00a0 Unless anyone has any objections, I will continue doing this for all 5 of the templates I’ve identified as being part of the DataONE community.<\/p>\n

Brainstorming ideas for the User Testing Tool:<\/strong>
\nAs I am waiting to hear back from Laura Miller at UVa, I began thinking about the types of questions\/areas to concentrate on.\u00a0 So far I think I want to focus on 4 main sections of the user test: background information, contents of the tool, the resources provided, and the design.\u00a0 In the parentheses following each section below, I explain exactly why I am concerned with this main section as it relates to the earth sciences community.\u00a0 Then are some ideas for the kinds of questions I can ask researchers.\u00a0 (I have never conducted user testing, so I am not entirely sure what it should entail.\u00a0 Feedback\/resources\/suggestions requested!)<\/p>\n

A) Background information from each of the users (have researchers needed to construct DMPs before? Where have they received help?\u00a0 Was creating a DMP difficult?) :
\n1. Have you created a data management plan before?
\n2.What were the most difficult aspects?
\n3. Have you ever sought help from the library at your university when considering data management or questions about data management, metadata, data storage, etc.?<\/p>\n

B.) Contents of the DMPtool: the language used (does the tool use too much library jargon? Does the obscure language deter users? Though earth scientists have jargon of their own, a lot of the language in this tool seems to be library-related jargon and may be confusing to researchers)
\n1. Are there any particular words used that seem to be particularly confusing or obscure?
\n2. Are you familiar with the data lifecycle?
\n3.\u00a0 Are you familiar with data access protocols?<\/p>\n

C.) Resources provided by the DMPtool (do extra resources need to be provided to assist researchers in creating their DMPs? Specifically, is metadata the most difficult aspect? Based on my research of the prominent organizations in the earlth sciences community, very little attention is paid to metadata and data management, with exception of some, and so this may be a problem area.\u00a0 Will a tool kit about the most widely used metadata standards encourage more researchers to use the DMPtool?)
\n1. Are you comfortable with the term metadata?
\n2.\u00a0 Do you know which metadata standards are most typically used by your community?
\n3. Does this ‘kit’ help you understand the standards better?<\/p>\n

D.) Design of the tool (is the layout and design of the tool user friendly? Not quite sure the impetus for this section specifically as it relates to earth scientists, but this is still an important section to consider improvements to, agreed?)
\n1.??<\/p>\n

Prototype for the DMPtool Kit:<\/strong>
\nI have also created a snap-shot of the prototype of the ‘kit’. The snapshot is the page about metadata standards.\u00a0 Let me know if the link doesn’t work.<\/p>\n

DMPKitPrototype_metadata<\/a><\/p>\n

Thanks!<\/p>\n

-r<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

Week 2 June 26, 2012: Closely evaluating the content of the tool, drafting the the user test tool,\u00a0 developing a prototype for the kit Summary of Today’s Post: – Evaluated NOAA template\/guide content – Brainstorm user testing tool – Prototype of ‘kit’ In order to be systematic about trying to Continue reading Evaluating the DMPtool, User Tests, DMPtool ‘Kit’ Prototype<\/span>→<\/span><\/a><\/p>\n","protected":false},"author":29,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[47],"tags":[],"_links":{"self":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts\/43"}],"collection":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/comments?post=43"}],"version-history":[{"count":1,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts\/43\/revisions"}],"predecessor-version":[{"id":958,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/posts\/43\/revisions\/958"}],"wp:attachment":[{"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/media?parent=43"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/categories?post=43"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/notebooks.dataone.org\/wp-json\/wp\/v2\/tags?post=43"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}