British Library begins web harvest
The British Library has begun to preserve the digital age for future generations.
It aims to “harvest” the entire UK web domain to document current events and record the country’s burgeoning collection of online cultural and intellectual works.
Billions of web pages, blogs and e-books will now be amassed along with the books, magazines and newspapers which have been stored for several centuries. The library could eventually collect copies of every public tweet or Facebook page in the British web domain.
Lucie Burgess, leading the project at the British Library, said the unprecedented operation would provide a complete snapshot of life in the 21st century which increasingly plays out online.
She said: “If you want a picture of what life is like today in the UK you have to look at the web. We have already lost a lot of material, particularly around events such as the 7/7 London bombings or the 2008 financial crisis. That material has fallen into the digital black hole of the 21st century because we haven’t been able to capture it. Most of that material has already been lost or taken down. The social media reaction has gone.”
The operation to “capture the digital universe” will begin with an automatic “web harvest” of an initial 4.8 million websites – or one billion web pages – from the UK domain, she said. This will start on Saturday and is expected to take three months. It will then take another two months to process the data.
Until now the British Library could only preserve a relatively small number of websites. The 2003 Legal Deposit Library Act paved the way for the information to be stored but copyright laws forced the library to seek permission each time it wanted to collect web content.
Under the new regulations – which extend to the Bodleian Library in Oxford, Cambridge University Library, the National Library of Scotland, the National Library of Wales and Trinity College Library in Dublin – it has the right to receive a copy of every UK electronic publication.
Roly Keating, chief executive of the British Library, said: “The regulations now coming into force make digital legal deposit a reality, and ensure that the Legal Deposit Libraries themselves are able to evolve – collecting, preserving and providing long-term access to the profusion of cultural and intellectual content appearing online or in other digital formats.”
Culture minister Ed Vaizey said: “Legal deposit arrangements remain vitally important. Preserving and maintaining a record of everything that has been published provides a priceless resource for the researchers of today and the future. So it’s right that these long-standing arrangements have now been brought up to date for the 21st century, covering the UK’s digital publications for the first time.”
Latest posts by Silversurfer's Editor (see all)
Leave a Comment!
Community Terms & Conditions
These content standards apply to any and all material which you contribute to our site (contributions), and to any interactive services associated with it.
You must comply with the spirit of the following standards as well as the letter. The standards apply to each part of any contribution as well as to its whole.
be accurate (where they state facts); be genuinely held (where they state opinions); and comply with applicable law in the UK and in any country from which they are posted.
Contributions must not:
contain any material which is defamatory of any person; or contain any material which is obscene, offensive, hateful or inflammatory; or promote sexually explicit material; or promote violence; promote discrimination based on race, sex, religion, nationality, disability, sexual orientation or age; or infringe any copyright, database right or trade mark of any other person; or be likely to deceive any person; or be made in breach of any legal duty owed to a third party, such as a contractual duty or a duty of confidence; or promote any illegal activity; or be threatening, abuse or invade another’s privacy, or cause annoyance, inconvenience or needless anxiety; or be likely to harass, upset, embarrass, alarm or annoy any other person; or be used to impersonate any person, or to misrepresent your identity or affiliation with any person; or give the impression that they emanate from us, if this is not the case; or advocate, promote or assist any unlawful act such as (by way of example only) copyright infringement or computer misuse.
Nurturing a safe environment
Our Silversurfers community is designed to foster friendships, based on trust, honesty, integrity and loyalty and is underpinned by these values.
We don't tolerate swearing, and reserve the right to remove any posts which we feel may offend others... let's keep it friendly!