An Early Look at the BitCurator Environment

The following blogpost was written by Porter Olsen, BitCurator’s Research Assistant at the Maryland Institute for Technology in the Humanities (MITH)

Roughly one year ago members of the BitCurator Professional Experts Panel (PEP) met at MITH to help further refine the scope and priorities of the BitCurator project, and ensure that our efforts would have “real world” usefulness for archivists and librarians who are responsible for born-digital materials. The PEP meeting, along with a similar meeting in January of the Development Advisory Group, produced two significant results: first, revisions to a product requirements document that outlined the work to be done on the BitCurator project, including an architecture overview and feature descriptions; and second, a collection of detailed workflows that have helped us to identify where BitCurator can best fit into and enhance curatorial practices. The upcoming one-year anniversary of these initial meetings makes this a good time to take a look at how the BitCurator project has progressed and where we’re headed in the near future.

The BitCurator development team is making available at test release of the BitCurator Environment, which can now be downloaded from the Releases page. The BitCurator Environment is a fully functioning Linux system built on Ubuntu 12.04 that has been customized to meet the needs of archivists and librarians, and it can be run either as a stand-alone operating system or as a virtual machine. Once installed, the BitCurator Environment includes a number of digital forensics tools that can be integrated into digital curation workflows. A sampling of those tools includes:

  • Guymager: a tool for creating disk images in one of three commonly used disk image formats (dd, E01, and AFF).
  • custom Nautilus scripts: A collection of enhancements to Ubuntu’s default file browser that allow users to quickly generate checksums, identify file types, safely mount drives, and more.
  • bulk_extractor: a tool that locates personal identifiable information (PII) and then generates reports on that information in both human and machine readable formats.
  • Ghex: an open source hex editor that allows users to view a file in hexadecimal format.

The BitCurator environment will make additional available tools available in later releases.

The BitCurator team has also been developing various forms of documentation to complement the product development. On the BitCurator wiki you can find documentation that introduces virtual machines, instructs users on how to install the BitCurator environment, and gives detailed configuration instructions on sharing devices and files between host and virtual machines. We are also currently working on developing documentation that outlines use-case scenarios for digital archivists using the tools mentioned above.

It is not enough, of course, to simply build tools and a wiki page and hope users will come find our software. The BitCurator team has also been actively promoting the BitCurator Environment through lectures, panel discussions, conference talks, posters, and publications. Recent examples include presentations from Kam Woods (BitCurator technical lead), Cal Lee and Matthew Kirschenbaum (BitCurator Co-PIs) on BitCurator and digital forensics at this year’s Society of American Archivists conference in San Diego; and presentations by Cal at Archiving 2012 in Copenhagen, Denmark, Memory of the World in the Digital Age in Vancouver, Canada, the International Congress on Archives in Brisbane, Australia, and to the staff of the National Library of Australia in Canberra. In addition, team members Alex Chassanoff and Porter Olsen will present a poster on integrating digital forensics into born-digital workflows at the upcoming ASIS&T conference. We have also recently published an article in D-Lib Magazine titled “BitCurator: Tools and Techniques for Digital Forensics in Collecting Institutions.”

We have also been incorporating BitCurator elements into professional education offerings.  Cal has developed a one-day continuing education course called “Digital Forensics for Archivists” as part of the Digital Archives Specialist (DAS) curriculum of the Society of American Archivists (SAA).  Matt Kirschenbaum and Naomi Nelson (BitCurator PEP member) have been offering a course called “Born-Digital Materials: Theory & Practice” as part of the Rare Book School (RBS) at the University of Virginia.  Both the SAA and RBS courses serve as excellent mechanisms for raising awareness about BitCurator’s offerings and eliciting needs and perceptions from working professionals.

These are just a few examples of the work done by the BitCurator team to get the word out about BitCurator and our work on bringing digital forensics tools and techniques the digital curation community. For a full list of BitCurator related publications and presentations, please visit our project website at www.bitcurator.net.

As we look forward into the next few months, the BitCurator team has a number of goals and benchmarks that we will be working towards, chief among them being the release of the BitCurator beta later this fall. We are also organizing the second annual meeting of our Development Advisory Group for January 2013, where we will elicit feedback from DAG members on our releases to date. The day before the DAG meeting will be CurateGear 2013 on January 9 in Chapel Hill, where members of the DAG and many other experts will give presentations and run demos of software to support digital curation  And finally, we are currently in the process of applying for funding for phase two of the BitCurator project to support additional product development and further efforts to engage with working professionals who could benefit from implementation of the BitCurator tools. We invite those who are interested, especially those in collecting institutions working with born-digital materials, to follow our progress at www.bitcurator.net, or follow us on Twitter.  For those who would like to jump right in and start working with the BitCurator Environment, you can do so at the Release page and join theBitCurator Users List.

If you have questions about the BitCurator project or the role of digital forensics methods in born-digital curation, please feel free to ask them in the comments section below.

ASIST 2012 Poster

Here’s a sneak preview of the BitCurator poster we’ll be presenting at ASIST 2012 in Baltimore this coming weekend/next week.   The poster reports on results obtained in the first year of the project which include: (1) detailed workflows documenting the handling of born-digital content in several collecting institutions; (2) specifications on how BitCurator can support the implementation of digital forensics tools and methods in curatorial workflow.

Poster: Integrating Digital Forensics into Born-Digital Workflows: The BitCurator Project

CurateGear 2013: Enabling the Curation of Digital Collections

http://ils.unc.edu/digccurr/curategear2013.html

CurateGear 2013: Enabling the Curation of Digital Collections

January 9, 2013, 8:00AM-5:00PM
University of North Carolina at Chapel Hill
William and Ida Friday Center for Continuing Education

CurateGear 2013 is an interactive day-long event focused on digital curation tools and methods. See demonstrations, hear about the latest developments, and discuss application in professional contexts. This event is sponsored by Institute of Museum and Library Services, University of North Carolina School of Information and Library Science and The Andrew W. Mellon Foundation.

Register for CurateGear 2013

CurateGear 2013 Agenda

Symposium Speakers

Jonathan Crabtree, Odum Institute for Research in Social Science
Mark Evans, Tessella
Lisa Gregory, State Library of North Carolina
Barbara Guttman, National Institute of Standards and Technology
Carolyn Hank, McGill University
Chien-Yi Hou, University of North Carolina
Greg Jansen, UNC Libraries
Leslie Johnston, Library of Congress
Cal Lee, University of North Carolina
Jerry McDonough, University of Illinois
Nancy McGovern, MIT Libraries
Richard Marciano, University of North Carolina
Mark Matienzo, Yale University
Courtney Mumma, Artefactual Systems
Trevor Owens, Library of Congress
David Pearson, National Library of Australia
Doug Reside, New York Public Library
Ryan Scherle, Duke University
Seth Shaw, University Archives, Duke University
Katherine Skinner, Educopia Institute
Mike Thuman, Tessella
Helen Tibbo, University of North Carolina
William Underwood, Georgia Tech
Bram van der Werf, Executive Director, Open Planets Foundation
Doug White, National Institute of Standards and Technology
Kam Woods, University of North Carolina

BitCurator 0.1.5 released

We’ve released BitCurator 0.1.5, which you can find on the Release page.

BitCurator 0.1.5 is an upgrade/maintenance release as we prepare to add reporting functionality in the next few weeks. Early reporting functionality will appear in 0.2, currently scheduled for mid-October. The current maintenance release includes updates to bulk extractor, scripting fixes for live data triage in Nautilus, and security patches.

Note that the virtual machine is now packaged as a .tar.gz file. Windows users will need a 3rd party file archiving utility such as 7zip to extract the VM.