Report reveals major gaps in preservation of valuable digital assets

With the release of the report, Mind the gap: assessing digital preservation needs in the UK, the Digital Preservation Coalition (DPC), of which Jisc is a founder member, aims to help government, public institutions and private companies turn high awareness into concerted action.

The survey reveals that the loss of digital data is commonplace - it is seen as an inevitable hazard by some - with more than 70% of respondents saying data had been lost in their organisation. Awareness of the potential economic and cultural risks is high, with 87% recognising that corporate memory or key cultural material could be lost and some 60% saying that their organisation could lose out financially. In 52% of the organisations surveyed there was management commitment to digital preservation - but only 18% had a strategy in place.

Prior to the survey, a number of high profile cases had helped raise awareness of the risks of digital data loss. In a recent judgement in the US, Morgan Stanley had more than $1 billion awarded against them as a result of their failure to preserve and hand over some documents required by the courts. The Securities and Exchange Commission in the US are also looking at fining the same bank over $10 million - specifically for failing to preserve email documents.

The data tapes from the 1975 Viking Lander mission to Mars were recently discovered to have deteriorated despite careful storage, and scientists also found that they could not decode the formats used and had to rely on the original paper printouts.

The BBC's 1986 Domesday project is another example of the unique fragility of digital material. Designed to capture a picture of Britain in 1986, the collection of photographs, maps and statistical information was recorded onto 30cm laserdiscs. But less than 20 years on, the laserdiscs and player are obsolete. The date was only rescued thanks to a surviving laserdisc player and more than a year's effort by specialist teams.

According to the DPC-commissioned report, the principal risks to digital material are: the deterioration of the storage medium; obsolescence of hardware, software or storage format; and failure to save crucial document format information (a common example is preserving tables of numbers without preserving an explanation of their meaning).

The report identifies 18 core needs, each of which has recommendations which will address them. Recommendations are addressed to organisations, government, and funding bodies. Among the key needs: awareness of digital preservation issues needs to be more commonplace - particularly amongst data creators; organisations need to take stock of their digital materials (55% of the respondents to the survey do not know what digital material they hold); and projects need to be funded from the outset with the long-term value of the information produced and the cost of retention taken into account. There needs to be funding for more digital archives.

This UK Digital Preservation Needs Assessment study, carried out by the software services company Tessella, looked at digital preservation practice in government bodies, archives, museums, libraries, education, scientific research organisations, pharmaceutical, environmental, nuclear, engineering, publishing and financial institutions.

"Gone are the days when archives were dusty places that could be forgotten until they were needed" said Lynne Brindley, Chair of the Digital Preservation Coalition. "The digital revolution means all of us - organisations and individuals - must regularly review and update resources to ensure they remain accessible. Updating need not be expensive, but the report is a wake-up call to each one of us to ensure proper and continuing attention to our digital records."

For further information on the Digital Preservation Coalition, please go to: DPC

Notes

The DPC is a cross-sectoral membership organisation dedicated to securing the preservation of digital resources in the UK. It currently has 28 members and associate members: The British Library, the Council for Museums, Archives and Libraries (MLA), the Consortium of University Research Libraries (CURL), the Digital Curation Centre (DCC), Joint Information Systems Committee (Jisc), the National Archives, the National Archives of Scotland; the National Library of Scotland, Public Record Office of Northern Ireland (PRONI); the University of Oxford, University of London Computer Centre (ULCC), Arts and Humanities Data Service (AHDS), the BBC Information & Archives, the Centre for Digital Library Research at Strathclyde (CDLR); the Corporation of London, Council for the Central Laboratory of the Research Councils (CCLRC) , the Ministry of Defence, National Electronic Library for Health, National Library of Wales, Natural History Museum, Online Computer and Library Center (OCLC), Open University, Publishers' Association, Research Libraries Group (RLG), Trinity College Library Dublin, the University of Southampton, UK Data Archive, and the Wellcome Library.