- Email: [email protected]
Building the S&T Digital Library at the Naval Research Laboratory
Building the S&T Digital Library at the Naval Research Laboratory: A Report R. James King The Ruth H. Hooker Research Library has been delivering digital information to researchers’ desktops at Naval Research Laboratory (NRL) sites across the country for over ten years. This article describes the current and planned efforts at unifying the various journals, databases, reference tools, and linking schemes into a comprehensive and integrated Web-based scientific and technical digital library for the benefit of the NRL and the broader naval research community. Serials Review 2003; 29:76–82. © 2003 Elsevier Inc. All Rights Reserved.
Introduction
Overview of the Digital Library at the Naval Research Library, 1989–1997
The Naval Research Laboratory (NRL) was founded in 1923 to create a corporate laboratory (partially at Thomas Edison’s insistence) that would enable the U.S. Navy to keep pace with foreign powers. The NRL’s areas of study cover basic research in the navy’s working environment of oceans, land, skies, and space, but work extends to the more traditional “applied sciences,” as demonstrated by the NRL’s creation of the “Clementine” satellite and shipboard fire suppression techniques.1 For over ten years, the Ruth H. Hooker Research Library has been delivering information to researchers’ desktops at the NRL, including the main campus in Washington, DC; detachments in Mississippi and California; and its parent organization, the Office of Naval Research in Virginia. Researchers, administrators, and program managers at the U.S. Navy and Marine Corp’s primary corporate research facility currently enjoy continuous access to databases, reference tools, technical reports, and journals via the Web, whether in the office, at home, or on travel. Several of these services are now being offered under the umbrella of the Naval Scientific & Technical (S&T) Digital Library, which is beginning to serve the naval research community across the United States, including the naval warfare centers, several naval medical facilities, and key naval educational facilities.
The NRL Library is a pioneer in the library field through its work with digital resources since the late 1980s. In 1989, the NRL Library initiated a large project to digitize over 180,000 technical reports representing over ten million pages. This digitization project made the NRL Library the first and largest digital library in the federal arena at that time.2 In the early 1990s, the NRL Library pioneered a telnet-based, menu-driven, campuswide information system that allowed end users to access networked CD-ROMs, Internet sites, and locally stored databases and formed the foundation for future desktop information efforts.3 Finally, the NRL Library’s first Website (InfoWeb) came online in 1994, followed in 1995 by the release of TORPEDO (The Optical Retrieval Project: Electronic Documents Online). In addition to scanned technical reports, TORPEDO provided journal content through a cooperative project involving the NRL, the American Physical Society, and Los Alamos National Laboratory. This project enabled NRL researchers to be the first in the world to access Physical Review E and Physical Review Letters from their desktops, clearly demonstrating the viability of electronic journals. This project also set the stage for the development of the commercial product of APS, Physical Review On-Line Archive (PROLA).4 Following these early accomplishments, in the mid1990s the NRL Library commenced InfoVision/2000, a broad-based evaluation of the NRL Library to determine the library of the future. With the InfoVision/2000 study, the NRL Library received clear direction and support from Laboratory management to shift to an environment offering Web-based and digital journals whenever
King is Chief Librarian (Acting), U.S. Naval Research Laboratory, Ruth H. Hooker Research Library, 4555 Overlook Avenue, Code 5220, Washington, DC 20375; e-mail: james.king@ nrl.navy.mil. 0098-7913/03$–see front matter © 2003 Elsevier Inc. All rights reserved. PII: S0098-7913(03)00022-4
76
Volume 29, Number 2, 2003
Building the S&T Digital Library at the Naval Research Laboratory
and reference tools and to thousands of journals. In 2001, the NRL Library introduced a complete redesign of its InfoWeb homepage (see Figure 1). The homepage uses Macromedia’s ColdFusion, a tag-based scripting environment, to generate dynamic Web pages from records in a Sybase SQL (structured query language) database. This new Website relies on established Website design and interface principles and provides a foundation for new features, such as a user-customized homepage, a “my favorite journals” feature, saved searches, and quick access to journal articles. In its role as the container, InfoWeb assists staff with maintenance and support issues related to these free and licensed information resources, such as link verification, link maintenance, and support of multiple discovery paths through link duplication. The NRL Library currently provides over one hundred scientific databases and over 2,500 scholarly journals to researchers at any of its locations across the country. Each of these entities (i.e., journal, database, Website, reference tool) has its own record in the database along with which pages it should appear on, so that maintenance is eased by providing a single place to modify or delete a record. Having this databasedriven design also makes it possible to have an item appear in dozens of places rather than limiting users to specific paths of information tool discovery.
possible. As a 1996 response to this directive, the Library introduced a Web-based, e-mail table of contents alerting service called “Contents-to-Go”5 and became the first Sirsi Library Catalog site to deploy WebCat (the Web interface to the Sirsi Library Catalog). One year later, the NRL Library released a local installation of the Institute for Scientific Information’s (ISI) Web of Science and completed its migration to a Web-based service model. Finally, in 2001, the NRL Library released TORPEDO Ultra, moving the digital content repository from TIFF (tagged image file format) to PDF (portable document format) and from Excalibur EFS (encrypting file system) to Excalibur’s new concept search engine called RetrievalWare.
Current Integration Efforts In 2002, the NRL Digital Library became a reality and now provides end-user access to hundreds of databases and thousands of online journals. Although this pales in comparison to the thousands of print-based reference sources, the overwhelming number of journal issues extending back to the early nineteenth century and over 50,000 books that are available only within the Library signals tremendous progress for the NRL Digital library. NRL user surveys continue to reinforce support for, and appreciation of, desktop access to as much information as possible. Users indicate an average of two hours per week saved with online access to resources and the ability to conduct their own searches. The NRL has a library staff of thirty-five, including five on-site information technology (IT) contractors and five federal employees (a mix of IT staff and librarians). These ten employees develop and maintain the NRL Digital Library, and the rest of the staff spend at least a portion of their time directly or indirectly supporting the digital services. Most libraries that are moving into the “hybrid library era”6—well past the truly print-based journal collection, but not yet a truly digital library—must cope with the unfortunate side effect of multiplicity of user interfaces. Print-based resources retain predictable forms of layout and access, but digital resources allow the publisher/creator to create a variety of interfaces and access points, even within the same product! As a result, library focus must shift from building collections of digital content to integrating such diverse information systems. Current integration efforts revolve around our Web interface (InfoWeb), our digital content repository (TORPEDO Ultra), and the content-linking mechanism that will tie the various resources of the NRL Digital Library together. The following sections describe how the NRL is using these three components to reach the goal of a completely Web-based service.
TORPEDO Ultra: A Digital Repository If InfoWeb is the front door to the digital library, then TORPEDO Ultra is, in some respects, the digital equivalent of the library’s physical stacks. TORPEDO Ultra stores digital copies of journals, reports, eBooks, standards, press releases, and conference proceedings. TORPEDO Ultra blends Convera RetrievalWare—a commercial offthe-shelf search engine offering a semantic term expansion and relevancy ranking—with an internally developed Web interface to provide users with a more intuitive and convenient way to search and browse journal and technical report content. TORPEDO Ultra currently contains over 6,000 technical reports, 2,000 NRL press releases, 10,000 NRL-authored articles and conference papers, and more than 1.5 million articles from over 1,300 journals, altogether totaling over 11 million pages.7 The TORPEDO Ultra v.2 interface (see Figure 2) also enables cross-linking between TORPEDO Ultra and the ISI Web of Science (Science Citation Index) database, which allows users to retrieve cited and citing articles from within the search/browse results of TORPEDO Ultra. This capability is similar to the linked references found on many publisher Websites, except that TORPEDO Ultra links to references of any of the 5,000 journals indexed with Web of Science rather than limiting linkages to those articles produced by that publisher (or those the publisher has agreements with). Finally, TORPEDO Ultra is a full-text search system that allows for intuitive exploration through three search modes: a) Boolean; b) pattern, which finds near matches and compensates for OCR (optical character recognition) errors and/or misspellings; and c) concept. Concept
InfoWeb InfoWeb (http://infoweb2.nrl.navy.mil) acts as the front door (portal, gateway, etc.) and as the container for the NRL Digital Library. As the doorway, InfoWeb facilitates desktop access to hundreds of databases, Websites,
77
R. James King
Serials Review
Figure 1. InfoWeb screen shot.
Figure 2. TORPEDO Ultra screen shot.
78
Volume 29, Number 2, 2003
Building the S&T Digital Library at the Naval Research Laboratory
type, volume, issue, page, author list, and abstract. To prepare for the future, support for UNICODE (universal language character set) and MathML (XML support for coding and displaying mathematics on the Web) was included in this XML file. At present, this information is downgraded for display in the browser while we wait for these standards to be supported more fully. The final method of obtaining content for TORPEDO was the hardest: digitizing publisher content. In 1995, the NRL Library negotiated a cooperative research project with the American Physical Society to digitize two of their journals—Physical Review E (PRE) and Physical Review Letters (PRL)—to test researcher’s acceptance of Webbased access to journal literature.10 NRL researchers were the first in the world to access PRE and PRL articles from the World Wide Web and wholeheartedly accepted desktop access to scholarly literature, now the preferred access method. Since then, the NRL Library has digitized over 200,000 pages of journal issues for the American Institute of Physics and is concluding a similar-sized project with the Optical Society of America. Storing digital content locally has several advantages over simply pointing users to a remote Website. First, it allows the NRL and consortial users to take advantage of dedicated network connections between many Department of Defense networks, resulting in faster response times. Next, it provides a single interface to all content, facilitating information retrieval by replacing the widely varying interfaces found on publisher and vendor sites. For example, we have found that, on average, researchers regularly consult journals from seven different publishers, which means seven sites to search, seven different interfaces, seven search protocols to master, and possibly multiple formats and usage rights for each site. Hosting journals locally lets users search the publications of multiple publishers without the need to learn the search protocol for each site. Third, locally hosting content offers some unique opportunities for helping users get to full content, no matter where they begin. For example, the NRL Library Catalog can link directly to PDF versions of NRL technical reports, and locally mounted ISI Web of Science databases can link to journal articles in TORPEDO Ultra and at remote publishers’ Websites. One of the most important motivations for hosting locally, however, is to create a permanent library archive for the NRL and other licensed users throughout the federal government. When an organization subscribes to an electronic journal, it is often paying for access over a period of many years, at a price of thousands of dollars annually. If that subscription is cancelled for any reason, such as financial considerations, a shift in research interests, or a change in journal focus, the organization usually loses access not only to the current year but also to all prior years. From a librarian’s perspective, this loss amounts to a publisher entering the library and removing all the bound volumes from the shelf every time the library cancels a print subscription. The archival component is particularly critical and addresses a major concern expressed by nearly all librarians. The NRL Library and Convera Corporation jointly won two major awards in 2002 for the development and
searches are the real strength of the TORPEDO Ultra system, expanding the search terms entered by users to also search for equivalent and related terms (e.g., lawyer, attorney, and ambulance chaser), and ranking the resultant “hit list” to bring the most precise results to the first pages of search results. This sophisticated searching parallels the skills of a trained reference librarian who performs a complex search by drawing all of the relevant lexical relationships (synonym, homonym, plurals, etc.) into the search. NRL staff will continue to improve term expansion through the addition of discipline-specific semantic word cartridges (Convera-produced products that merge semantic word nets with a structured thesaurus) converted from established thesauri from the Institution of Electrical Engineers Inspec (an established index for engineering), the National Library of Medicine’s Medical Subject Headings (MeSH), and the Defense Technical Information Center.
Building TORPEDO Ultra The NRL Library obtains content for TORPEDO in three ways: digitizing agency content, licensing publisher content, and digitizing publisher content. Digitizing agency content is the easiest to start with because unclassified, unlimited content created by government agencies is in the public domain and eliminates copyright concerns. In the early years of the digital library, NRL staff digitized technical reports as a space-saving measure8 and cooperated with the NRL publishing group to provide a native PDF file of each technical report at the time of publication. The next step was licensing publisher content. Elsevier Science was the first publisher to provide a digital distribution model for their entire run of journals, meaning that an organization could subscribe to the digital version of any Elsevier journal and have it delivered for local loading. The NRL joined this effort shortly after the completion of the TULIP project (Elsevier’s experimental digital distribution model that was tested in several universities9) and has been loading Elsevier content ever since. Since the mid-1990s, many other publishers have developed commercial models for digital content loading or have established special relationships with select organizations to load content. The NRL Library currently has local loading agreements, representing over 2,000 journals, with Academic Press, the American Physical Society, the American Institute of Physics, Institute of Physics, Institution of Electrical and Electronics Engineers, Institution of Electrical Engineers, Elsevier Science, Optical Society of America, and Kluwer Academic. Of these 2,000 titles, TORPEDO Ultra has loaded 1,300. NRL staff quickly realized the need to convert the various metadata formats (primarily SGML [Standard Generalized Markup Language] along with other structured data formats) from many different publishers into a consistent structure. To this end, the NRL Library converted all publisher-received bibliographic data into an internally developed XML (extensible markup language)/ DTD (document type definition) structure that is an aggregation of all the information provided by publishers, including the journal name, ISSN, article title, article
79
R. James King
Serials Review
an information provider such as a journal publisher, database, or library catalog and sends it to the user’s linkresolving system as defined by the user’s profile. That link-resolving system reads the bibliographic data and determines what services this particular user can use, such as a link to the full text of the article, a link to biographies of the authors, or a link to a list of citations in Science Citation Index.
deployment of TORPEDO Ultra: the Digital Consulting Institute (a technology consulting organization focused on bringing together IT professionals and technology providers) Portal Excellence Award11 and the first-ever Best Practices Award from the Delphi Group (a market research firm focused on best digital business practices).12 These awards recognize the development of an innovative information resource as well as the successes realized by extending this system to the larger navy audience, currently thirteen naval facilities across the country with a potential user base of 60,000 personnel.
NRL’s Master Journal Database: Design and Expansion
Robust Linking Services
A key component of linking services is a back-end database of what resources are available to which users. To support linking services, the NRL Library developed the Master Journal Database (MJDB) as a repository for all journal-related information available to the NRL. Because most library catalog systems are simply a digital equivalent of the printed card catalog and not a digital asset management system, the NRL Library developed the MJDB outside of the catalog with the hopes of some day integrating the two systems. The MJDB holds all basic information about a journal, including the official title, the short title, the shelving title, and links to the record containing the former and new title of the journal (roughly keyed to the ISSN). This system lists the journal publisher, holdings statements for each format, subjects covered by the title, links to full content where available, and a listing of which reference sources the journal is indexed in with a link to online availability if applicable. The MJDB has become the engine behind our dynamic e-journal listing that not only shows all of the 2,500 journals available online, but also shows all of the title holdings that are available only in print or microform. Although originally designed to ease the management of Web-based journal lists, the MJDB is now becoming the foundation for linking services based on the OpenURL framework. It also is being expanded to support the entire navy, resulting in a new, much larger product: the Navy Journal Information Management System (N-JIMS). N-JIMS is being designed to manage all journal information for any of the naval libraries across the country. A database-driven solution, N-JIMS quickly will become a “union catalog” of all journal holdings and the engine behind a navywide journal access Website. In addition to the core information contained in the MJDB, N-JIMS will provide a navigable structure showing the journal changes (title and ISSN) over time, collection development history for each title at each site, license terms/ restrictions, a copy of the signed license, purchasing information, and authentication information. N-JIMS also will be the foundation of a navywide linking service based on the OpenURL framework. Because most journal subscriptions are moving to consortial procurements, a centralized database of each site’s journal subscriptions will greatly simplify negotiations. In addition, N-JIMS will be able to interact with other journal information repositories, such as library catalogs, to reduce duplicate keying.
A Web interface that provides access to digital content is especially powerful when all of its resources are connected by a reference-linking structure. NRL staff acknowledge that libraries have always used tools to link their users to the information they need through available technologies. Card catalogs and article indexes reorganize the available information in new ways so that researchers can find information by author, subject, or title rather than just by journal, volume, issue, or call number. The World Wide Web forces libraries to explore new ways to link users to all of the information available to them, whether print, digital, or a combination of these resources. The first phase in linking, which the NRL and most libraries have undertaken, focuses on “content enabling” services, or adding hyperlinks to full content where possible through the inclusion of URLs in the 856 field of library bibliographic records for online catalogs. In addition, many of the bibliographic database providers, such as ISI and SilverPlatter, have provided mechanisms for linking from individual bibliographic records to the full-text PDF on a publisher Website. Unfortunately, if an organization such as the NRL loads the journal content locally, it often cannot take advantage of these linking options (referred to as the “appropriate copy problem,” or situations in which a full-text link on a commercial Website points to the primary source of the content), even though the organization has access to the content through another location.13 In addition, library staff face nightmares when dealing with hundreds of information providers, many of whom have their own linking and authentication systems. In response to the appropriate copy problem and the management headaches, many organizations are introducing interlinking services, typified by the OpenURL framework and Ex Libris’ SFX (short for Special Effects, the first commercial product based on the OpenURL framework).14 The OpenURL framework attempts to centralize all of the various linking schemes that currently are embedded in the various publisher Websites and database provider systems into one locally controlled product. An organization with a product such as SFX can provide a customized list of appropriate and available services to each user of the system, no matter where users currently reside. Basically, the OpenURL link syntax pushes bibliographic data (ISSN, author, volume, issue, page, etc.) from either a “hit list” or full record view of
80
Volume 29, Number 2, 2003
Building the S&T Digital Library at the Naval Research Laboratory
Web of Science and the National Research Library Alliance
Locally mounted and remote databases and publications are available to researchers through a Web-based portal known as InfoWeb. A key InfoWeb component is the TORPEDO Ultra digital repository, which consists of thousands of agency publications and over 1,000 licensed journals, offering intelligent yet intuitive searching across a wide range of information. Through various linking services, many of these digital services have been “content enabled,” including the NRL Library’s catalog and locally hosted bibliographic databases (such as Web of Science and Inspec). Linking services are also being expanded to support new standards, such as the OpenURL framework and the Open Archives Initiative, to ultimately allow for interlinking of all of the digital services available to researchers. The NRL Library is now expanding these award-winning services to other U.S. Navy facilities across the country representing over 60,000 potential users.
OpenURL-compliant services such as SFX require a database of local journal holdings before they can provide dynamic and customized linking services. Rather than building a separate database for this type of service, the NRL decided to create a core journal database to be shared by the Web-based journal list, the library catalog, and the linking service, to improve accuracy and reduce duplication of effort. One of the databases at the center of our integration efforts is the ISI’s Web of Science, which provides access to Science Citation Index Expanded, Social Sciences Citation Index, and ISI Proceedings. The NRL mounted the first copy of Web of Science outside of ISI. This copy contains the full run of data back to 1945 for use by all employees served by a consortium of federal science libraries known as the National Research Library Alliance (NRLA).15 The NRLA (currently composed of the NRL, NASA Goddard Space Flight Center, NASA Glenn Research Center, NASA Langley Research Center, the National Institute of Standards and Technology, the National Science Foundation, and the Naval Postgraduate School) was formed to obtain preferred pricing on products and to develop jointly the next-generation digital library. Web of Science allows users to easily create bibliographies on a subject, find articles written by a particular author, discover who has cited a certain article, and even navigate through the entire evolution of a research topic contained within 5,000 journals.16 ISI Links greatly enhances the use of this product and enables intra- and intercontent linking, publisher full-text links, OPAC links, and context-sensitive linking solutions such as OpenURL and SFX.17 Linking within Web of Science allows users to make the transition from tracking a call number in a library’s stacks to viewing the full content at the desktop. The ISI is releasing a new software suite called Web of Knowledge 5.0 that offers single-search capabilities across a mix of databases, including Science Citation Index, Social Sciences Citation Index, ISI Proceedings, Inspec, Derwent Patent Database, and BIOSIS Previews, as well as set searching, de-duplication of “hit lists,” and concept searching.
Notes 1. Naval Research Laboratory, The Little Book of Big Achievements, 2001, http://tid.nrl.navy.mil/pubs%20pdfs/Little_Book.pdf (27 January 2003). 2. Doris R. Folen and Laurie E. Stackpole, “Optical Storage and Retrieval of Library Material,” Information Technology and Libraries 12, no. 2 (June 1993): 181–91, also available at http://infoweb2. nrl.navy.mil/archive/NRL_publications/optical_material.html (27 January 2003). 3. Roderick D. Atkinson, Laurie E. Stackpole, and John Yokley, “Developing the Scientific-Technical Digital Library at a National Laboratory,” in Digital Libraries: Current Issues, Digital Libraries Workshop DL ’94, Newark, NJ, USA, May 1994, Selected Papers, ed. Nabil R. Adam, Bharat K. Bhargava, and Yelena Yesha (Berlin Heidelberg: Springer-Verlag, 1995), 265–79, also available at http://infoweb2.nrl. navy.mil/archive/NRL_publications/digital_library_94.html (27 January 2003). 4. American Physical Society, “History of PROLA,” http://prola. aps.org/info/about.html (27 January 2003); Roderick D. Atkinson and Laurie E. Stackpole, “TORPEDO: Networked Access to Full-Text and Page-Image Representations of Physics Journals and Technical Reports,” The Public-Access Computer Systems Review 6, no. 3 (1995): 3–5, also available at http://info.lib.uh. edu/pr/v6/n3/atki6n3.html (27 January 2003). 5. R. James King, “Hybrid Methods of Desktop Journal Article Delivery,” in Proceedings of the NASIG 14th Annual Conference—From Carnegie to Internet2: Forging the Serials Future, ed. P. Michelle Fiander, Joseph C. Harmon, and Jonathan David Makepeace (New York: Haworth, 2000), 263–67, also available at http://infoweb2.nrl.navy. mil/archive/NRL_publications/James_Nasig99_HybridDelivery.pdf (27 January 2003).
Conclusion
6. Chris Rusbridge, “Towards the Hybrid Library,” D-Lib Magazine 4 (July/August 1998): 17–18, http://www.dlib.org/dlib/july98/ rusbridge/07rusbridge.html (27 January 2003).
The NRL Library continues to be an innovator in providing its distributed user community with a single point of access to information needed to support scientific research. In the early 1990s, Tom Davenport and Larry Prusak wrote a thought-provoking article about the library as a virtual, multinodal information network with expertise centers. They assured readers that the human “information assistant” would always have a role in information services. Taking the concepts introduced by Davenport and Prusak and molding them into the Web environment, the NRL Library is attempting to “blow up the corporate library” by pushing as much information to the desktop as possible.18
7. Laurie E. Stackpole and R. James King, “Electronic Journals as a Component of the Digital Library,” Issues in Science & Technology Librarianship 22 (Spring 1999), http://www.istl.org/99-spring/ article1.html (27 January 2003). 8. Folen and Stackpole, “Optical Storage.” 9. Karen Hunter, “E-Journals at Elsevier Science: Over Two Decades of Experimentation and Development,” Elsevier News Release, August 2002, http://www.kb.nl/kb/ict/dea/download/eskb_e-journalsates4_ 20aug02.pdf (27 January 2003). 10. Atkinson, Stackpole, and Yokley, “Developing the Scientific-Technical Digital Library”; American Physical Society, “History of PROLA.”
81
R. James King
Serials Review
11. DCI, “2002 DCI Portal Excellence Award: Content Management Award Announcement,” DCI’s Corporate and E-Business Portals Conference, 2002, http://exhibit.dci.com/porweb/awards.asp#winners (27 January 2003).
no. 4 (April 1999), http://www.dlib.org/dlib/april99/van_de_sompel/ 04van_de_sompel-pt1.html (27 January 2003). 15. Laurie E. Stackpole and Roderick D. Atkinson, “The National Research Library Alliance: A Federal Consortium Formed to Provide Inter-Agency Access to Scientific Information,” Issues in Science & Technology Librarianship 18 (Spring 1998), http://www.istl.org/98spring/article6.html (27 January 2003).
12. Delphi Group, “Delphi Group Salutes Best Practice Organizations during 2002 Integrated Enterprise Summit, October 28, 2002,” Press Release, 15 October 2002, http://www.delphigroup.com/about/ pressreleases/2002-PR/20021015-ie-best-practices.htm (27 January 2003).
16. Harriet Oxley, “ISI Spins a Web of Science,” Database 21, no. 2 (April/May 1998): 37–40.
13. Oren Beit-Arie, Miriam Blake, Priscilla Caplan, Dale Flecker, Tim Ingoldsby, Laurence W. Lannom, William H. Mischo, Edward Pentz, Sally Rogers, and Herbert Van de Sompel, “Linking to the Appropriate Copy: Report of a DOI-Based Prototype,” D-Lib Magazine 7, no. 9 (September 2001), http://www.dlib.org/dlib/september01/caplan/09caplan. html (27 January 2003).
17. Helen Szigeti, “The ISI Web of Knowledge Platform: Current and Future Directions,” 2001, http://www.isinet.com/isi/hot/essays/isiplatform/ 8105138/index.html (27 January 2003). 18. Tom H. Davenport and Larry Prusak, “Blow up the Corporate Library,” International Journal of Information Management 13, no. 6 (1994): 409–11.
14. Herbert Van de Sompel, “Reference Linking in a Hybrid Library Environment, Part 1: Framework for Linking,” D-Lib Magazine 5,
82
Introduction
Overview of the Digital Library at the Naval Research Library, 1989–1997
The Naval Research Laboratory (NRL) was founded in 1923 to create a corporate laboratory (partially at Thomas Edison’s insistence) that would enable the U.S. Navy to keep pace with foreign powers. The NRL’s areas of study cover basic research in the navy’s working environment of oceans, land, skies, and space, but work extends to the more traditional “applied sciences,” as demonstrated by the NRL’s creation of the “Clementine” satellite and shipboard fire suppression techniques.1 For over ten years, the Ruth H. Hooker Research Library has been delivering information to researchers’ desktops at the NRL, including the main campus in Washington, DC; detachments in Mississippi and California; and its parent organization, the Office of Naval Research in Virginia. Researchers, administrators, and program managers at the U.S. Navy and Marine Corp’s primary corporate research facility currently enjoy continuous access to databases, reference tools, technical reports, and journals via the Web, whether in the office, at home, or on travel. Several of these services are now being offered under the umbrella of the Naval Scientific & Technical (S&T) Digital Library, which is beginning to serve the naval research community across the United States, including the naval warfare centers, several naval medical facilities, and key naval educational facilities.
The NRL Library is a pioneer in the library field through its work with digital resources since the late 1980s. In 1989, the NRL Library initiated a large project to digitize over 180,000 technical reports representing over ten million pages. This digitization project made the NRL Library the first and largest digital library in the federal arena at that time.2 In the early 1990s, the NRL Library pioneered a telnet-based, menu-driven, campuswide information system that allowed end users to access networked CD-ROMs, Internet sites, and locally stored databases and formed the foundation for future desktop information efforts.3 Finally, the NRL Library’s first Website (InfoWeb) came online in 1994, followed in 1995 by the release of TORPEDO (The Optical Retrieval Project: Electronic Documents Online). In addition to scanned technical reports, TORPEDO provided journal content through a cooperative project involving the NRL, the American Physical Society, and Los Alamos National Laboratory. This project enabled NRL researchers to be the first in the world to access Physical Review E and Physical Review Letters from their desktops, clearly demonstrating the viability of electronic journals. This project also set the stage for the development of the commercial product of APS, Physical Review On-Line Archive (PROLA).4 Following these early accomplishments, in the mid1990s the NRL Library commenced InfoVision/2000, a broad-based evaluation of the NRL Library to determine the library of the future. With the InfoVision/2000 study, the NRL Library received clear direction and support from Laboratory management to shift to an environment offering Web-based and digital journals whenever
King is Chief Librarian (Acting), U.S. Naval Research Laboratory, Ruth H. Hooker Research Library, 4555 Overlook Avenue, Code 5220, Washington, DC 20375; e-mail: james.king@ nrl.navy.mil. 0098-7913/03$–see front matter © 2003 Elsevier Inc. All rights reserved. PII: S0098-7913(03)00022-4
76
Volume 29, Number 2, 2003
Building the S&T Digital Library at the Naval Research Laboratory
and reference tools and to thousands of journals. In 2001, the NRL Library introduced a complete redesign of its InfoWeb homepage (see Figure 1). The homepage uses Macromedia’s ColdFusion, a tag-based scripting environment, to generate dynamic Web pages from records in a Sybase SQL (structured query language) database. This new Website relies on established Website design and interface principles and provides a foundation for new features, such as a user-customized homepage, a “my favorite journals” feature, saved searches, and quick access to journal articles. In its role as the container, InfoWeb assists staff with maintenance and support issues related to these free and licensed information resources, such as link verification, link maintenance, and support of multiple discovery paths through link duplication. The NRL Library currently provides over one hundred scientific databases and over 2,500 scholarly journals to researchers at any of its locations across the country. Each of these entities (i.e., journal, database, Website, reference tool) has its own record in the database along with which pages it should appear on, so that maintenance is eased by providing a single place to modify or delete a record. Having this databasedriven design also makes it possible to have an item appear in dozens of places rather than limiting users to specific paths of information tool discovery.
possible. As a 1996 response to this directive, the Library introduced a Web-based, e-mail table of contents alerting service called “Contents-to-Go”5 and became the first Sirsi Library Catalog site to deploy WebCat (the Web interface to the Sirsi Library Catalog). One year later, the NRL Library released a local installation of the Institute for Scientific Information’s (ISI) Web of Science and completed its migration to a Web-based service model. Finally, in 2001, the NRL Library released TORPEDO Ultra, moving the digital content repository from TIFF (tagged image file format) to PDF (portable document format) and from Excalibur EFS (encrypting file system) to Excalibur’s new concept search engine called RetrievalWare.
Current Integration Efforts In 2002, the NRL Digital Library became a reality and now provides end-user access to hundreds of databases and thousands of online journals. Although this pales in comparison to the thousands of print-based reference sources, the overwhelming number of journal issues extending back to the early nineteenth century and over 50,000 books that are available only within the Library signals tremendous progress for the NRL Digital library. NRL user surveys continue to reinforce support for, and appreciation of, desktop access to as much information as possible. Users indicate an average of two hours per week saved with online access to resources and the ability to conduct their own searches. The NRL has a library staff of thirty-five, including five on-site information technology (IT) contractors and five federal employees (a mix of IT staff and librarians). These ten employees develop and maintain the NRL Digital Library, and the rest of the staff spend at least a portion of their time directly or indirectly supporting the digital services. Most libraries that are moving into the “hybrid library era”6—well past the truly print-based journal collection, but not yet a truly digital library—must cope with the unfortunate side effect of multiplicity of user interfaces. Print-based resources retain predictable forms of layout and access, but digital resources allow the publisher/creator to create a variety of interfaces and access points, even within the same product! As a result, library focus must shift from building collections of digital content to integrating such diverse information systems. Current integration efforts revolve around our Web interface (InfoWeb), our digital content repository (TORPEDO Ultra), and the content-linking mechanism that will tie the various resources of the NRL Digital Library together. The following sections describe how the NRL is using these three components to reach the goal of a completely Web-based service.
TORPEDO Ultra: A Digital Repository If InfoWeb is the front door to the digital library, then TORPEDO Ultra is, in some respects, the digital equivalent of the library’s physical stacks. TORPEDO Ultra stores digital copies of journals, reports, eBooks, standards, press releases, and conference proceedings. TORPEDO Ultra blends Convera RetrievalWare—a commercial offthe-shelf search engine offering a semantic term expansion and relevancy ranking—with an internally developed Web interface to provide users with a more intuitive and convenient way to search and browse journal and technical report content. TORPEDO Ultra currently contains over 6,000 technical reports, 2,000 NRL press releases, 10,000 NRL-authored articles and conference papers, and more than 1.5 million articles from over 1,300 journals, altogether totaling over 11 million pages.7 The TORPEDO Ultra v.2 interface (see Figure 2) also enables cross-linking between TORPEDO Ultra and the ISI Web of Science (Science Citation Index) database, which allows users to retrieve cited and citing articles from within the search/browse results of TORPEDO Ultra. This capability is similar to the linked references found on many publisher Websites, except that TORPEDO Ultra links to references of any of the 5,000 journals indexed with Web of Science rather than limiting linkages to those articles produced by that publisher (or those the publisher has agreements with). Finally, TORPEDO Ultra is a full-text search system that allows for intuitive exploration through three search modes: a) Boolean; b) pattern, which finds near matches and compensates for OCR (optical character recognition) errors and/or misspellings; and c) concept. Concept
InfoWeb InfoWeb (http://infoweb2.nrl.navy.mil) acts as the front door (portal, gateway, etc.) and as the container for the NRL Digital Library. As the doorway, InfoWeb facilitates desktop access to hundreds of databases, Websites,
77
R. James King
Serials Review
Figure 1. InfoWeb screen shot.
Figure 2. TORPEDO Ultra screen shot.
78
Volume 29, Number 2, 2003
Building the S&T Digital Library at the Naval Research Laboratory
type, volume, issue, page, author list, and abstract. To prepare for the future, support for UNICODE (universal language character set) and MathML (XML support for coding and displaying mathematics on the Web) was included in this XML file. At present, this information is downgraded for display in the browser while we wait for these standards to be supported more fully. The final method of obtaining content for TORPEDO was the hardest: digitizing publisher content. In 1995, the NRL Library negotiated a cooperative research project with the American Physical Society to digitize two of their journals—Physical Review E (PRE) and Physical Review Letters (PRL)—to test researcher’s acceptance of Webbased access to journal literature.10 NRL researchers were the first in the world to access PRE and PRL articles from the World Wide Web and wholeheartedly accepted desktop access to scholarly literature, now the preferred access method. Since then, the NRL Library has digitized over 200,000 pages of journal issues for the American Institute of Physics and is concluding a similar-sized project with the Optical Society of America. Storing digital content locally has several advantages over simply pointing users to a remote Website. First, it allows the NRL and consortial users to take advantage of dedicated network connections between many Department of Defense networks, resulting in faster response times. Next, it provides a single interface to all content, facilitating information retrieval by replacing the widely varying interfaces found on publisher and vendor sites. For example, we have found that, on average, researchers regularly consult journals from seven different publishers, which means seven sites to search, seven different interfaces, seven search protocols to master, and possibly multiple formats and usage rights for each site. Hosting journals locally lets users search the publications of multiple publishers without the need to learn the search protocol for each site. Third, locally hosting content offers some unique opportunities for helping users get to full content, no matter where they begin. For example, the NRL Library Catalog can link directly to PDF versions of NRL technical reports, and locally mounted ISI Web of Science databases can link to journal articles in TORPEDO Ultra and at remote publishers’ Websites. One of the most important motivations for hosting locally, however, is to create a permanent library archive for the NRL and other licensed users throughout the federal government. When an organization subscribes to an electronic journal, it is often paying for access over a period of many years, at a price of thousands of dollars annually. If that subscription is cancelled for any reason, such as financial considerations, a shift in research interests, or a change in journal focus, the organization usually loses access not only to the current year but also to all prior years. From a librarian’s perspective, this loss amounts to a publisher entering the library and removing all the bound volumes from the shelf every time the library cancels a print subscription. The archival component is particularly critical and addresses a major concern expressed by nearly all librarians. The NRL Library and Convera Corporation jointly won two major awards in 2002 for the development and
searches are the real strength of the TORPEDO Ultra system, expanding the search terms entered by users to also search for equivalent and related terms (e.g., lawyer, attorney, and ambulance chaser), and ranking the resultant “hit list” to bring the most precise results to the first pages of search results. This sophisticated searching parallels the skills of a trained reference librarian who performs a complex search by drawing all of the relevant lexical relationships (synonym, homonym, plurals, etc.) into the search. NRL staff will continue to improve term expansion through the addition of discipline-specific semantic word cartridges (Convera-produced products that merge semantic word nets with a structured thesaurus) converted from established thesauri from the Institution of Electrical Engineers Inspec (an established index for engineering), the National Library of Medicine’s Medical Subject Headings (MeSH), and the Defense Technical Information Center.
Building TORPEDO Ultra The NRL Library obtains content for TORPEDO in three ways: digitizing agency content, licensing publisher content, and digitizing publisher content. Digitizing agency content is the easiest to start with because unclassified, unlimited content created by government agencies is in the public domain and eliminates copyright concerns. In the early years of the digital library, NRL staff digitized technical reports as a space-saving measure8 and cooperated with the NRL publishing group to provide a native PDF file of each technical report at the time of publication. The next step was licensing publisher content. Elsevier Science was the first publisher to provide a digital distribution model for their entire run of journals, meaning that an organization could subscribe to the digital version of any Elsevier journal and have it delivered for local loading. The NRL joined this effort shortly after the completion of the TULIP project (Elsevier’s experimental digital distribution model that was tested in several universities9) and has been loading Elsevier content ever since. Since the mid-1990s, many other publishers have developed commercial models for digital content loading or have established special relationships with select organizations to load content. The NRL Library currently has local loading agreements, representing over 2,000 journals, with Academic Press, the American Physical Society, the American Institute of Physics, Institute of Physics, Institution of Electrical and Electronics Engineers, Institution of Electrical Engineers, Elsevier Science, Optical Society of America, and Kluwer Academic. Of these 2,000 titles, TORPEDO Ultra has loaded 1,300. NRL staff quickly realized the need to convert the various metadata formats (primarily SGML [Standard Generalized Markup Language] along with other structured data formats) from many different publishers into a consistent structure. To this end, the NRL Library converted all publisher-received bibliographic data into an internally developed XML (extensible markup language)/ DTD (document type definition) structure that is an aggregation of all the information provided by publishers, including the journal name, ISSN, article title, article
79
R. James King
Serials Review
an information provider such as a journal publisher, database, or library catalog and sends it to the user’s linkresolving system as defined by the user’s profile. That link-resolving system reads the bibliographic data and determines what services this particular user can use, such as a link to the full text of the article, a link to biographies of the authors, or a link to a list of citations in Science Citation Index.
deployment of TORPEDO Ultra: the Digital Consulting Institute (a technology consulting organization focused on bringing together IT professionals and technology providers) Portal Excellence Award11 and the first-ever Best Practices Award from the Delphi Group (a market research firm focused on best digital business practices).12 These awards recognize the development of an innovative information resource as well as the successes realized by extending this system to the larger navy audience, currently thirteen naval facilities across the country with a potential user base of 60,000 personnel.
NRL’s Master Journal Database: Design and Expansion
Robust Linking Services
A key component of linking services is a back-end database of what resources are available to which users. To support linking services, the NRL Library developed the Master Journal Database (MJDB) as a repository for all journal-related information available to the NRL. Because most library catalog systems are simply a digital equivalent of the printed card catalog and not a digital asset management system, the NRL Library developed the MJDB outside of the catalog with the hopes of some day integrating the two systems. The MJDB holds all basic information about a journal, including the official title, the short title, the shelving title, and links to the record containing the former and new title of the journal (roughly keyed to the ISSN). This system lists the journal publisher, holdings statements for each format, subjects covered by the title, links to full content where available, and a listing of which reference sources the journal is indexed in with a link to online availability if applicable. The MJDB has become the engine behind our dynamic e-journal listing that not only shows all of the 2,500 journals available online, but also shows all of the title holdings that are available only in print or microform. Although originally designed to ease the management of Web-based journal lists, the MJDB is now becoming the foundation for linking services based on the OpenURL framework. It also is being expanded to support the entire navy, resulting in a new, much larger product: the Navy Journal Information Management System (N-JIMS). N-JIMS is being designed to manage all journal information for any of the naval libraries across the country. A database-driven solution, N-JIMS quickly will become a “union catalog” of all journal holdings and the engine behind a navywide journal access Website. In addition to the core information contained in the MJDB, N-JIMS will provide a navigable structure showing the journal changes (title and ISSN) over time, collection development history for each title at each site, license terms/ restrictions, a copy of the signed license, purchasing information, and authentication information. N-JIMS also will be the foundation of a navywide linking service based on the OpenURL framework. Because most journal subscriptions are moving to consortial procurements, a centralized database of each site’s journal subscriptions will greatly simplify negotiations. In addition, N-JIMS will be able to interact with other journal information repositories, such as library catalogs, to reduce duplicate keying.
A Web interface that provides access to digital content is especially powerful when all of its resources are connected by a reference-linking structure. NRL staff acknowledge that libraries have always used tools to link their users to the information they need through available technologies. Card catalogs and article indexes reorganize the available information in new ways so that researchers can find information by author, subject, or title rather than just by journal, volume, issue, or call number. The World Wide Web forces libraries to explore new ways to link users to all of the information available to them, whether print, digital, or a combination of these resources. The first phase in linking, which the NRL and most libraries have undertaken, focuses on “content enabling” services, or adding hyperlinks to full content where possible through the inclusion of URLs in the 856 field of library bibliographic records for online catalogs. In addition, many of the bibliographic database providers, such as ISI and SilverPlatter, have provided mechanisms for linking from individual bibliographic records to the full-text PDF on a publisher Website. Unfortunately, if an organization such as the NRL loads the journal content locally, it often cannot take advantage of these linking options (referred to as the “appropriate copy problem,” or situations in which a full-text link on a commercial Website points to the primary source of the content), even though the organization has access to the content through another location.13 In addition, library staff face nightmares when dealing with hundreds of information providers, many of whom have their own linking and authentication systems. In response to the appropriate copy problem and the management headaches, many organizations are introducing interlinking services, typified by the OpenURL framework and Ex Libris’ SFX (short for Special Effects, the first commercial product based on the OpenURL framework).14 The OpenURL framework attempts to centralize all of the various linking schemes that currently are embedded in the various publisher Websites and database provider systems into one locally controlled product. An organization with a product such as SFX can provide a customized list of appropriate and available services to each user of the system, no matter where users currently reside. Basically, the OpenURL link syntax pushes bibliographic data (ISSN, author, volume, issue, page, etc.) from either a “hit list” or full record view of
80
Volume 29, Number 2, 2003
Building the S&T Digital Library at the Naval Research Laboratory
Web of Science and the National Research Library Alliance
Locally mounted and remote databases and publications are available to researchers through a Web-based portal known as InfoWeb. A key InfoWeb component is the TORPEDO Ultra digital repository, which consists of thousands of agency publications and over 1,000 licensed journals, offering intelligent yet intuitive searching across a wide range of information. Through various linking services, many of these digital services have been “content enabled,” including the NRL Library’s catalog and locally hosted bibliographic databases (such as Web of Science and Inspec). Linking services are also being expanded to support new standards, such as the OpenURL framework and the Open Archives Initiative, to ultimately allow for interlinking of all of the digital services available to researchers. The NRL Library is now expanding these award-winning services to other U.S. Navy facilities across the country representing over 60,000 potential users.
OpenURL-compliant services such as SFX require a database of local journal holdings before they can provide dynamic and customized linking services. Rather than building a separate database for this type of service, the NRL decided to create a core journal database to be shared by the Web-based journal list, the library catalog, and the linking service, to improve accuracy and reduce duplication of effort. One of the databases at the center of our integration efforts is the ISI’s Web of Science, which provides access to Science Citation Index Expanded, Social Sciences Citation Index, and ISI Proceedings. The NRL mounted the first copy of Web of Science outside of ISI. This copy contains the full run of data back to 1945 for use by all employees served by a consortium of federal science libraries known as the National Research Library Alliance (NRLA).15 The NRLA (currently composed of the NRL, NASA Goddard Space Flight Center, NASA Glenn Research Center, NASA Langley Research Center, the National Institute of Standards and Technology, the National Science Foundation, and the Naval Postgraduate School) was formed to obtain preferred pricing on products and to develop jointly the next-generation digital library. Web of Science allows users to easily create bibliographies on a subject, find articles written by a particular author, discover who has cited a certain article, and even navigate through the entire evolution of a research topic contained within 5,000 journals.16 ISI Links greatly enhances the use of this product and enables intra- and intercontent linking, publisher full-text links, OPAC links, and context-sensitive linking solutions such as OpenURL and SFX.17 Linking within Web of Science allows users to make the transition from tracking a call number in a library’s stacks to viewing the full content at the desktop. The ISI is releasing a new software suite called Web of Knowledge 5.0 that offers single-search capabilities across a mix of databases, including Science Citation Index, Social Sciences Citation Index, ISI Proceedings, Inspec, Derwent Patent Database, and BIOSIS Previews, as well as set searching, de-duplication of “hit lists,” and concept searching.
Notes 1. Naval Research Laboratory, The Little Book of Big Achievements, 2001, http://tid.nrl.navy.mil/pubs%20pdfs/Little_Book.pdf (27 January 2003). 2. Doris R. Folen and Laurie E. Stackpole, “Optical Storage and Retrieval of Library Material,” Information Technology and Libraries 12, no. 2 (June 1993): 181–91, also available at http://infoweb2. nrl.navy.mil/archive/NRL_publications/optical_material.html (27 January 2003). 3. Roderick D. Atkinson, Laurie E. Stackpole, and John Yokley, “Developing the Scientific-Technical Digital Library at a National Laboratory,” in Digital Libraries: Current Issues, Digital Libraries Workshop DL ’94, Newark, NJ, USA, May 1994, Selected Papers, ed. Nabil R. Adam, Bharat K. Bhargava, and Yelena Yesha (Berlin Heidelberg: Springer-Verlag, 1995), 265–79, also available at http://infoweb2.nrl. navy.mil/archive/NRL_publications/digital_library_94.html (27 January 2003). 4. American Physical Society, “History of PROLA,” http://prola. aps.org/info/about.html (27 January 2003); Roderick D. Atkinson and Laurie E. Stackpole, “TORPEDO: Networked Access to Full-Text and Page-Image Representations of Physics Journals and Technical Reports,” The Public-Access Computer Systems Review 6, no. 3 (1995): 3–5, also available at http://info.lib.uh. edu/pr/v6/n3/atki6n3.html (27 January 2003). 5. R. James King, “Hybrid Methods of Desktop Journal Article Delivery,” in Proceedings of the NASIG 14th Annual Conference—From Carnegie to Internet2: Forging the Serials Future, ed. P. Michelle Fiander, Joseph C. Harmon, and Jonathan David Makepeace (New York: Haworth, 2000), 263–67, also available at http://infoweb2.nrl.navy. mil/archive/NRL_publications/James_Nasig99_HybridDelivery.pdf (27 January 2003).
Conclusion
6. Chris Rusbridge, “Towards the Hybrid Library,” D-Lib Magazine 4 (July/August 1998): 17–18, http://www.dlib.org/dlib/july98/ rusbridge/07rusbridge.html (27 January 2003).
The NRL Library continues to be an innovator in providing its distributed user community with a single point of access to information needed to support scientific research. In the early 1990s, Tom Davenport and Larry Prusak wrote a thought-provoking article about the library as a virtual, multinodal information network with expertise centers. They assured readers that the human “information assistant” would always have a role in information services. Taking the concepts introduced by Davenport and Prusak and molding them into the Web environment, the NRL Library is attempting to “blow up the corporate library” by pushing as much information to the desktop as possible.18
7. Laurie E. Stackpole and R. James King, “Electronic Journals as a Component of the Digital Library,” Issues in Science & Technology Librarianship 22 (Spring 1999), http://www.istl.org/99-spring/ article1.html (27 January 2003). 8. Folen and Stackpole, “Optical Storage.” 9. Karen Hunter, “E-Journals at Elsevier Science: Over Two Decades of Experimentation and Development,” Elsevier News Release, August 2002, http://www.kb.nl/kb/ict/dea/download/eskb_e-journalsates4_ 20aug02.pdf (27 January 2003). 10. Atkinson, Stackpole, and Yokley, “Developing the Scientific-Technical Digital Library”; American Physical Society, “History of PROLA.”
81
R. James King
Serials Review
11. DCI, “2002 DCI Portal Excellence Award: Content Management Award Announcement,” DCI’s Corporate and E-Business Portals Conference, 2002, http://exhibit.dci.com/porweb/awards.asp#winners (27 January 2003).
no. 4 (April 1999), http://www.dlib.org/dlib/april99/van_de_sompel/ 04van_de_sompel-pt1.html (27 January 2003). 15. Laurie E. Stackpole and Roderick D. Atkinson, “The National Research Library Alliance: A Federal Consortium Formed to Provide Inter-Agency Access to Scientific Information,” Issues in Science & Technology Librarianship 18 (Spring 1998), http://www.istl.org/98spring/article6.html (27 January 2003).
12. Delphi Group, “Delphi Group Salutes Best Practice Organizations during 2002 Integrated Enterprise Summit, October 28, 2002,” Press Release, 15 October 2002, http://www.delphigroup.com/about/ pressreleases/2002-PR/20021015-ie-best-practices.htm (27 January 2003).
16. Harriet Oxley, “ISI Spins a Web of Science,” Database 21, no. 2 (April/May 1998): 37–40.
13. Oren Beit-Arie, Miriam Blake, Priscilla Caplan, Dale Flecker, Tim Ingoldsby, Laurence W. Lannom, William H. Mischo, Edward Pentz, Sally Rogers, and Herbert Van de Sompel, “Linking to the Appropriate Copy: Report of a DOI-Based Prototype,” D-Lib Magazine 7, no. 9 (September 2001), http://www.dlib.org/dlib/september01/caplan/09caplan. html (27 January 2003).
17. Helen Szigeti, “The ISI Web of Knowledge Platform: Current and Future Directions,” 2001, http://www.isinet.com/isi/hot/essays/isiplatform/ 8105138/index.html (27 January 2003). 18. Tom H. Davenport and Larry Prusak, “Blow up the Corporate Library,” International Journal of Information Management 13, no. 6 (1994): 409–11.
14. Herbert Van de Sompel, “Reference Linking in a Hybrid Library Environment, Part 1: Framework for Linking,” D-Lib Magazine 5,
82