The HathiTrust April 2013 Update is now available.   Several important new developments are announced in the newsletter:

• Service to support access for users with print disabilities at partner institutions
• Updated, enhanced HathiTrust web presence and user interface

The newsletter also reports on a Board of Governors in-person meeting, activities related to ingest of locally-digitized materials from partner institutions, and next steps and plans for the HathiTrust Research Center.

In an important new development, HathiTrust now provides a way for the UC campuses to offer full view of some of the in-copyright books in HathiTrust to our print disabled patrons.   A designated representative on campus (typically someone from an office devoted to services for persons with disabilities) will be able to access works in HathiTrust that are owned by that campus, on behalf of users at the campus who have print disabilities, and can distribute full PDFs of the works to those users.   

Campuses must take action to implement this service.  

Details, including terms of use and a form to begin registration, are available at http://bit.ly/14keW0C. To register, please complete the form with appropriate signatures and send to feedback@issues.hathitrust.org. For campuses who intend to set up this service, more information about the service can be found on the HathiTrust site: http://www.hathitrust.org/accessibility.

HathiTrust expects to make improvements to the process as time goes on.  

Last month Springer topped our list for most titles distributed, 2731, which included the first titles sent, 41, for the newest Springer subject collection, Energy monographs. These include all the recently licensed 2013 titles published to date. Following it, our other significant distributions were for Wiley (309 titles), IEEE (87 titles), and SuperStar (85 titles). For journals, EBSCO (161 titles), Open Access (126 titles), Wiley (62 titles), and Cambridge (31 titles) represented our highest distributions.

On Tuesday, May 14th, SCP posted a file of records for the Dacheng journals, 6,971 titles. These are brief records that SCP created from available vendor data. Over time, the campuses will receive full-level OCLC records to replace these brief records. The replacement of records will be done per the standard SCP process for the replacement of records: the replaced record will be redistributed as a delete and the new record sent coded as new.

Until next month …

Ahmed Alsum from the Web Science and Digital Libraries Research Group at Old Dominion University posted a comprehensive summary of the GA. As you can see from his summary, there were many great presentations and discussions. It was very hard to choose just five things to share, but here they are:

1. Dark(ish) Archives

Because of copyright and privacy issues, many of the national libraries in Europe cannot provide online, public access to their web archives. They can only allow access in the library and many do not even allow printing in the library. So, how do you raise the awareness of web archiving when no one can see the archives?! There was much discussion about creating site lists/registries for the sites in these archives – some felt this would only lead to disappointment when the user finds out that they have to travel to the archive to see the materials. Sound familiar? Yes, finding aids. And YES, they are extremely useful!

Harvesting tools.
Source: WikiMedia Commons

2. Common tools support is critical

Most IIPC members are using the same suite of OS tools –Heritrix and Open Source Wayback. There was a lot of concern about the development path for these tools. At member breakout sessions where future paths were discussed and prioritized, there was a clear message that tools are important. The IIPC steering committee quickly responded by supporting tool management as a top priority for the organization. Be on the lookout for updates and concrete plans shortly.

3. National and University Library of Slovenia is innovative

Besides being wonderful conference hosts, the National and University Library of Slovenia is doing some innovative work when it comes to web archiving. They demo’d a prototype (see screenshots) of a tool for end users to engage and interact with web archives. It includes features such as: gather and save sites; annotate sites; tag sites; and crowd sourcing of metadata. The next generation of web archives is here!

4. Researchers use of web archives

There were several informative presentations by researchers about how they are using web archives. Sophie Geibeil, an historian from Aix-Marseille-Université, uses the archives to study the untold story of North African immigration. Megan Dougherty, a social scientist from Loyola University, was not as interested in site content as much as she was in taking an anthropological point of view of the sites; that is, studying the social aspects of sites – how people share sites, interact with sites, etc. Niels Brügger, from Netlab at Aarhus University, discussed their various research projects in the areas of digital humanities and internet studies, including RESAW and FUTARC. Helen Hockx-Yu, UK Web Archive at the British Library, presented UK Web Archives in the eyes of scholars.  She made the case for thinking of the archives not as documents but rather as large datasets for data mining and analysis.

5. Dancing into the future?

David Rosenthal provided historical context for the early days of web crawling and also provided some future challenges. Not surprising, the web as mainly HTML links is rapidly becoming a thing of the past. Turns out all the current, problematic areas (including rich media, database driven features, dynamically generated URIs, etc.) remain challenging, and now add to that the fact that the new web is more and more JavaScript. Is there no rest for the weary? David did leave us with a light at the end of tunnel. He talked about recent work by the Institute National de L’Audiovisuel (INA) in Paris. The team there created a live archive proxy that shows great promise to enable the capture of some of the more problematic content. Also, there is Memento, which provides an aggregation of web archives each collected in slightly different ways by institutions so moving toward covering all the bases.

Fred Astaire.
Source: WikiMedia Commons

David also had a great analogy for one of the challenges of preserving the web today; he says it is like “preserving theatre or dance” because as we view the web it changes to become an individual experience based on who we are, displaying customized ads and other personalized content.   As he put it: “Every performance is a unique and unrepeatable interaction between the performers, in this case a vast collection of dynamically changing databases, and the audience. Actually, it is even worse. Preserving the Web is like preserving a dance performed billions of times, each time for an audience of one, who is also the director of their individual performance.” (Source: http://blog.dshr.org/2013/04/talk-on-harvesting-future-web-at.html)

Overall, it was an excellent, thought-provoking conference. Clearly there are lots of challenges ahead for web archiving, but so many more opportunities.

Limited View

Those books not in the public domain, around 7,000,000, are now labeled HathiTrust Digital Library Limited view (search only). See the following example:

With this message, users know that the full text is not accessible, but that the text is available for searching for words or phrases.

Finding full text materials

Users determine if any of the 3,000,000 HathiTrust books in the public domain are available in full text by the presence of the “View Now” link on the results screen.

Clicking the “View Now” link displays the link to the full text of the item. For public domain works in HathiTrust, a new label displays on the results and item level screens: HathiTrust Digital Library Full View.

From the results screen

From the item record screen

Another easy way to find public domain works is by conducting a keyword search such as “cookery” and using the facets to limit to ebooks, and the year 1902 (or a year prior to 1923).

OCLC is now working on a process to find and relabel the records that are added each month.

Thanks for your persistence

Thanks to the pressure and persistence of many UC public services staff, faculty and students, the UC University Librarians, and in particular, Kathryn Stine, Alison Ray, Lynne Cameron, Lena Zentall and Patti Martin at CDL and Jeff Penka and Bill Carney at OCLC.

CDL’s UC3 program has just completed a flurry of hiring to fill four positions, two funded by the Alfred P. Sloan Foundation.

Joshua Hubbard and Bhavitavya (Bhavi) Vedula were hired to work on the DMPTool2 project, funded by the Alfred P. Sloan Foundation.  Josh has jumped in head first, helping with requirements for the project.    We’re looking forward to his Rails expertise going forward.   Bhavi has more than five years of development experience, much of it with Ruby/Rails and JQuery-based user interfaces.  Most recently she was part of a bioinformatics research group at Northwestern University tracking childhood developmental health. 

Shirin Faenza has joined UC3 as developer on a one-year contract, initially working on Merritt user interface improvements.  She has more than three years of web application development experience, most recently with Seedchange, a platform for crowd sourcing technology startup venture capital investing.  She has also worked as a technical translator, converting the Linux Journal into her native Italian. 

Ken Weiss is a production systems administrator, coordinating operational policies and procedures for UC3 services.  He replaces Margaret Low, who retired in 2012.  Most recently Ken worked as a technical analyst and architect as a contractor.  Before that he was technical director for enterprise architecture at Charles Schwab.   Long term UC staff may recall Ken’s earlier stint at the CDL in 1999-2000 when he redeployed OAC, then a research project at UCB, as a CDL production service. 

Please welcome Josh, Bhavi, Shirin, and Ken!

Recent Enhancements, News, and Activities

• WAS at Society of California Archivists (SCA), Berkeley, CA. April 11 – 13. The WAS team attended and staffed a booth. Rosalie Lack also gave a short presentation to the Online Archive of California (OAC)’s Users Group meeting. http://www.slideshare.net/rosalielack/society-of-california-archivists-sca
• International Internet Preservation Consortium General Assembly (IIPC), Ljubljana, Slovenia. April 22‐ 26. The IIPC is a consortium of libraries, academic institutions and other organization engaged in web archiving. IIPC actively promotes the development of open source tools, standards and best practices in web archiving. Rosalie Lack participated as an IIPC member as well as a member of the IIPC’s Access Working Group member. The IIPC’s General Assembly includes 3 days of member meetings and 2 days open to the public. The theme of the public conference day was: Scholarly Access to Web Archives: Progress, Requirements, and Challenges.
• Bug fixes. The WAS technical team (Erik Hetzner and Scott Fisher) fixed several ongoing, but intermittent bugs that were causing display issues in both the public and curator interfaces. You should see a marked improvement in display. A reminder to please report any problems that you encounter by sending an email to: washelp@ucop.edu.

WAS Activity, April 2013

• 113 archives actively collected
• 1340 sites collected
• 1.5 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/p/curators.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

]]> http://www.cdlib.org/cdlinfo/2013/05/10/was-service-update-april-2013/feed/ 0 http://www.cdlib.org/cdlinfo/2013/05/10/dataup-service-update-april-2013/ http://www.cdlib.org/cdlinfo/2013/05/10/dataup-service-update-april-2013/#comments Fri, 10 May 2013 19:17:45 +0000 cstrasser http://www.cdlib.org/cdlinfo/?p=13559 More...]]>

Recent Enhancements, News, and Activities

• We gathered potential stakeholders of DataUp in Santa Barbara, CA for a meeting to discuss the tool’s future directions. The meeting took place April 2‐3 at the National Center for Ecological Analysis and Synthesis (NCEAS). The meeting report is available at
  https://bitbucket.org/dataup/main/downloads/DataUpReport.pdf.
• Strasser held a DataUp workshop at the UC Berkeley Library on April 11.
• Strasser virtually presented on DataUp at the Association of College and Research Libraries (ACRL) 2013 Meeting in Indianapolis, IN. The video is available at http://vimeo.com/63614563.
• Strasser presented on DataUp at a workshop for graduate students during the International Association of Landscape Ecologists 2013 Meeting in Austin, TX on April 16. Slides available at http://www.slideshare.net/carlystrasser/dataup-for-the-iale-2013-meeting.
• Strasser visited the California Polytechnic State University on April 18 and presented on DataUp to the librarians and researchers. Slides available at http://www.slideshare.net/carlystrasser/dataup-presentation-at-cal-poly.

DataUp Service Description
The DataUp add-in and web application help researchers organize, manage, archive, and share their tabular data. The major functionality of both tools is to guide researchers through the following:

• Carry out a best practices check to determine if there are issues present that might make use or interpretation of the data difficult
• Create metadata in standardized EML (Ecological Metadata Language) format
• Describe the attributes (i.e. columns) of the dataset in standard EML format
• Obtain a unique identifier for the dataset
• Generate a data citation
• Post the data and associated metadata to a data repository

DataUp Service Manager
Carly Strasser carly.strasser@ucop.edu or uc3@ucop.edu.

DataUp Training Materials, Guides, FAQs and Webinars
The most current DataUp information is on the website (http://dataup.cdlib.org). This includes frequently asked questions and instructions on accessing and using DataUp. Other relevant sites include the code site (https://bitbucket.org/dataup/main) and the web application site (http://dataup.org).

Recent Enhancements, News, and Activities

• DMPTool webinar series: The first webinar, an introduction to the DMPTool, will be May 28.
• Register for the webinar: http://bit.ly/Z4g43Z
• Read more about the webinar series: http://blogs.library.ucla.edu/dmptool/webinar-series/
• We’ve created two advisory boards for the DMPTool, a Researcher Advisory Board and an Administrative Advisory Board. More about the advisory boards, with membership, here:
  http://blogs.library.ucla.edu/dmptool/2013/04/11/advisory-boards-established/.
• We’ve updated the data management requirements for the NSF Biological Sciences directorate. We contacted everyone who had customized this template for their institution. You will find more information about the changes here:
  http://blogs.library.ucla.edu/dmptool/2013/05/02/nsf-bio-dmp-updated.
• New team members:
• We hired a software developer, Bhavi Vedula, who will work on the changes to the
  DMPTool. She will be based in Oakland at CDL, and will begin May 1. She and our other
  new developer Josh Hubbard will begin to implement the requirements developed by
  the project team.
• There were 241 data management plans created in April 2013, and 287 new users. There are a total of over 5,200 registered users from over 700 institutions, who have created over 4,500 data management plans.

Contributing Organizations
There are now 83 partner institutions that have either configured their campus single‐signon or customized the DMPTool for their users. There are participating organizations in 34 states and the District of Columbia; California leads all states with 18 participating organizations. A map of all participating organizations is available here: http://bit.ly/L85sKj.

DMPTool Service Description
The Data Management Plan Tool (DMPTool) provides an easy to use interface that:

• Helps users create ready-to-use data management plans for specific funding agencies
• Meets funder requirements for data management plans
• Provides step-by-step instructions and guidance for how to manage data
• Provides information about resources and services available at your institution to help fulfill the data management requirements of your grant

DMPTool Service Managers

• Perry Willett perry.willett@ucop.edu
• Carly Strasser carly.strasser@ucop.edu
• Trisha Cruse patricia.cruse@ucop.edu

Please send any questions or general correspondence to uc3@ucop.edu. Note that campus library contacts have been embedded in the DMPTool and campus users will be directed to a local library contact.

DMPTool Training Materials, Guides, FAQs and Webinars
Help Guide: https://dmp.cdlib.org/help/guide.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

Recent Enhancements, News, and Activities

• Work is in‐progress and on track to migrate Merritt’s underlying technical infrastructure from physical servers to Virtual Machines (VM). (All UCOP services are moving to VMs.) We expect this work to be completed in June 2013.
• The following related activities are also in‐progress and on track:
  • migrating collections from the legacy Digital Preservation Repository (DPR) to Merritt
  • transitioning storage from UCOP Data Center to San Diego Supercomputer Center’s Cloud Storage Service
• For a current summary of 2013 development priorities for 2013, see the UC3 Curation Wiki: http://bit.ly/16O0hGK.

Merritt Service Description
Merritt is a production level service that provides the UC community with an easy to use tool to manage, archive, and share their content. Content can be deposited and managed via a user-interface or an API.

Merritt Service Managers

• Perry Willett perry.willett@ucop.edu
• Adrian Turner adrian.turner@ucop.edu

Please send any questions or general correspondence to uc3@ucop.edu.

Merritt Training Materials, Guides, FAQs and Webinars
More information about Merritt is available at http://www.cdlib.org/services/uc3/merritt or by sending an inquiry to uc3@ucop.edu.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.