After Chris gives a lay of the land of the challenges involved in conceptualizing and preserving these hybrid formats within the the context of audiovisual archiving, David and Richard will present real life case studies where innovative approaches and solutions were developed to manage migration schemes. David’s presentation will include the initial findings from some controlled experiments he has been performing on the capture of miniDV tape using variable hardware and software configurations. Enabled by DVAnalyzer, David has been able to run comparative analytics on the error rates and bit structures in the data streams of multiple captures of the same tape. The early results are fascinating and the planned further testing looks to be equally revelatory and instructive. Keep an eye on avpreserve.com for further details on David’s testing and for future updates to the DVAnalyzer tool.

Richard’s presentation promises to be highly instructive as well, as he discusses three separate tape-to-file migration decisions and outcomes implemented at the BBC. The migration of media-based born-digital content presents a number of scenarios that are dependent on parameters of the source original and of the ultimate goals for the use of the resulting file, and Richard gives an excellent outline for the decision making process. Follow the developments at PrestoPRIME (http://www.prestoprime.org/) for future release of Richard’s report and for essential guidance on audiovisual preservation.

He even says “videos” instead of “movies”! [swoon]

A follow up column on the experience of migrating his MiniDV content (“Moving Taped Past to Hard-Drive Future”) takes a more technical than emotional bent on the process (though it does end with a stirring call-to-arms for everyone to start similar projects). I hope you read the article, but, in short, Pogue ran into some roadblocks with his first plan and had to go back and revise his strategy. I think it’s telling about the challenges involved in audiovisual preservation, especially as we move more into the digital realm, that what seems like a simple process (stick the tape in and let the machines do their work) brought some consternation to a tech expert (and one who gets personal emails from Steve Jobs, none the less). Yes, people should start working on reformatting their personal media collections, but there are a number of avenues, and branches of options off of those avenues, in deciding how to best do it, and not everyone has the resources at hand to help in those decisions.

I guess this is the point, then, where I should bring up some resources for people to consult about the reformatting of DVCam and MiniDV tape. They are touchy formats due to their small size and the makeup of the tape and binder, and it’s true that the formats are trending towards obsolescence, but there’s a lot of unique content out there shot on DV that’s going to need taking care of. David Rice has written a great piece about the ins and outs of migrating DV tapes, expressing the importance of capturing it as a data stream rather than as a video signal (“Digital Tape Preservation Strategy: Preserving Data or Video?”). Additionally, our free and open source DV Analyzer application is a simple tool that anyone can use to review the metadata in the DV data stream that’s carried over during a Firewire migration of DVCam or MiniDV.

(Allow me one geek moment here in response to Pogue’s article: Final Cut Pro can carry over the date and time metadata, but only if the captured stream is not re-transcoded during within the process. This may be accomplished by selecting File>Export or pulling the file from the Capture Scratch directory instead of using the Export>Using Quicktime Conversion option.)

The DV Analyzer tool also identifies and lists error codes in the DV stream that occur during playback. The garbbled video that Pogue mentions is likely a result of error concealment performed by the playback device — most typically misread data in frame being patched up with data from the previous frame — and DV Analyzer would provide the error detection code for those sections that could then be analyzed to see if it can be determined what the cause of the error was. Sometimes this is due to degradation, but often enough these errors are caused by the touchy nature of DV tapes. Many times the same errors will not appear if played through the deck again or run through another deck. Further information can be found at http://www.avpreserve.com/dvanalyzer/what-does-it-analyze/ or under the Case Studies section on the DV Analyzer main page http://www.avpreserve.com/dvanalyzer/.

A final important point from the article is how Pogue’s experience underscores how much we have to monitor and advocate for the tech companies to better understand and maintain the capabilities that enable preservation and access. The idea that professional film and television editors don’t need to know the date of when something was shot is fairly ludicrous. I doubt a news program would feel all right using footage for a story they can’t properly identify, or that film editors wouldn’t want to be able to find content from a certain date of shooting. Outside of this, the date stamp, timecode, and other metadata are absolutely necessary for the authenticity of archival materials, especially in matters of research or, increasingly, in legal matters (see this Times article about metadata as evidence). It’s maybe a tad idealistic to think we can always have an effect on corporate decisions, but a positive point is that a little vocal activity did do some good in getting Firewire ports back after Apple decided to remove them. Sure Firewire dependent devices were severely decreasing in manufacture, but there is so much out there that has been produced on those devices, and the future ability to access or capture that content for preservation extends well beyond the end of manufacturing.

— Joshua Ranger

DV tapes are not a preservation medium. As the support for DV tape technology gradually declines, it is imperative to begin migrating DV content from tapes to files for storage and ongoing preservation of the content. In the migration process, the technical nature of DV tapes frequently causes issues generally described as “glitchy” or “finicky”. DV tapes often perform differently from one play to the next and across playback devices. DV Analyzer provides an automated way to monitor and report on the accuracy of the migration process.

DV Analyzer is a technical quality control and reporting tool that examines DV streams in order to report errors in the tape-to-file transfer process. DV Analyzer also reports on technical metadata and patterns within DV streams such as changes in DV time code, changes in recording date and time markers, first and last frame markers within individual recordings, and more. To those concerned with preservation and archiving, this means that you now have the ability to automatically monitor integrity during reformatting of DV tapes and extract meaningful metadata from DV files.

AVPS is pleased to offer DV Analyzer free of charge to the AV preservation community which we serve. DV Analyzer is licensed by AudioVisual Preservation Solutions under the open source GNU General Public License.

For more information on DV Analyzer, or to download it go to: http://www.avpreserve.com/avpsresources/tools

To request specific information about the product go to: http://www.avpreserve.com/you/

Or e-mail us at info@avpreserve.com

We look forward to hearing your comments and suggestions about DVAnalyzer.

Be sure to catch up with David Rice, Chris Lacinak, or Joshua Ranger of AVPS at the AMIA conference this week. They can also answer your questions about DVAnalyzer.

The three sessions that we will be chairing and presenting at are as follows:

• Harnessing Collective Knowledge: Three Case Studies of New Collaborative Tools

Chris Lacinak (AVPS), Richard Wright (PrestoSpace), Mick Newnham (National Library of Australia)

A discussion and viewing of three new exciting projects – PrestoSpace’s wiki, National Library of Australia’s Mediapedia, and AudioVisual Preservation Solutions’ CEDAR – each of which provides open, collaborative, online resources that harness the expertise within the community through the use of centralized sites.

• Accessioning and Managing File-Based Born Digital Content

Chris Lacinak (AVPS), Grace Lile (WITNESS), Brian Hoffman (NYU), Dirk Van Dall (Broadway Video)

This session brings four experts and two case studies to the table to offer insights into the challenges that born digital file based video brings to your archive and offers strategies for managing it.

• Digitizing 102: Video Digitization Workflows and Challenges

David Rice (AVPS), Angelo Sacerdote (Bay Area Video Coalition), Skip Elsheimer (A/V Geeks LLC)

This session is a primer on the planning process for video digitization projects. It will examine case studies for working with damaged or ‘not-to-spec’ materials, address documentation practices for preservation workflow, and stress how to perform quality control on the process and the results.

Please join us!  We hope to see you there.
For more information about the Annual AMIA Conference:
www.amiaconference.com