Blog
Moving 4.3 million digital newspapers
#Checksums#data migration#SAM-FS#newspapers
The National Library of Norway has undertaken a massive re-archiving project to migrate 4.3 million digital newspapers (2.5 petabytes) from their 2007 bit-repository to our new Digital Preservation Services system. The project involved extensive data cleanup, checksum generation, and quality improvements, achieving migration speeds of up to 42TB per day.
Better Late Than Never: Adding Checksums to 16 Million Legacy Files
#Checksums#data migration#SAM-FS
Case study on verifying 2.5 Petabytes of legacy data during migration at the National Library of Norway. Details how checksums validated 16 million files across multiple storage copies, finding zero corruptions after 20 years.
Digital preservation poster
#Digital preservation#Poster#iPRES
As part of our internal outreach mission, the digital preservation had a poster made illustrating the whys and hows of digital preservation.
Rearchiving 2 million hours of digital radio, a comprehensive process
#Broadcasting#Rearchiving#HPSS#SAM-FS
The National Library is in the process of a major overhaul of its 2007 bit-repository, replacing it with a contemporary digital preservation system. This new solution is based on an in-house developed system called DPS (Digital Preservation Services), which uses IBM-HPSS as the underlying bit repository for data storage. This transition, which is expected to span over a couple of years, is necessary to ensure the long-term preservation and accessibility of the National Library’s digital collection.
Preferred Digital Formats at the National Library
#Digital Preservation#file formats
This is an overview of the digital formats preferred for digital preservation at the National Library. The Digital Preservation Team has compiled a list of file formats which is preferred by the National Library for digital preservation. The format list is based on recommendations from the respective media departments within the National Library. The list includes both formats produced by the National Library itself and formats received from others. The preferred formats is a list of formats we ideally want and are striving for.
Presentation from the Digital libraries: storage for now and forever conference
#Digital Preservation#IFLA#presentation
We were invited to talk at the Digital libraries: storage for now and forever conference hosted by the IFLA Preservation and Conservation Center at the National Library of Poland. The presentation is a crash course through digital storage and digital preservation practices at the National Library of Norway over the past 20 years. It concludes with our current status and our future plans. The recording of the event can be found below.
Ambitions, Goals, and Strategy for Digital Preservation at the National Library
The Digital Preservation Team at the National Library (NLN) has developed its first strategy for digital preservation. This strategy aims to steer, structure, and sharpen the focus of our digital preservation efforts over the coming two years. Strategy Design In developing the strategy, we aimed for writing a short and precise document. We wanted to avoid overwhelming the reader with a wall of text, or producing a verbose document that would be of little practical use.
NiFi S2S on Secured Instances
#NiFi#Site-to-Site#S2S#Security#Certificate#Reporting task
Guide to setting up a Site-to-Site (S2S) communication between two secured NiFi instances with user and policy management. This guide is based on experiences from National Library of Norway. Where NiFi is used to process large number of files and data, and it’s important to have proper security in place. This guide aims to help others who might struggle with S2S on secured NiFi instances, and make it easier to set up a SiteToSiteProvenanceReportingTask or similar. Since we couldn’t find a guide that would help us with this task we decided to write one ourselves.
Team Digital Preservation
#Team presentation#team organization#product teams
In June 2022 the IT Department established a team dedicated to preserving the National Library’s digital collection. This team handles all kinds of digital content, whether it’s digitized from physical sources or born digital. This includes media types like web pages, text documents, images, audio, and moving images. The team’s responsibilities involve ingesting, checking, storing, preserving, and providing access to high-quality digital files. We work closely with several other specialized media teams in the library.