This article contains a list of web archiving initiatives worldwide. For easier reading, the information is divided in three tables: web archiving initiatives, archived data, and access methods.
Some of these initiatives may or may not make use of several web archiving file formats and/or their own proprietary file formats.
This Wikipedia page was originally generated from the results obtained for the research paper A survey on web archiving initiatives, published by the Arquivo.pt (the Portuguese web-archive) team at the time.
Web archiving initiatives
Name Country Creation year Technologies Number of employees Comments Full-time Part-time End of Term Web Archive United States 2008 Heritrix, Wayback 6–10The End of Term Web Archive captures and saves U.S. Government federal government websites (.gov, .mil, etc.) in the Legislative, Executive, or Judicial branches of the government at the end of presidential administrations. Beginning in 2008, the EOT has thus far preserved websites from administration changes in 2008, 2012, 2016, 2020, and 2024. Project partners include CA Digital Library, Internet Archive, Webrecorder, Library of Congress, George Washington University, Stanford University, University of North Texas, the United States Government Publishing Office, and Common Crawl. Arkiwera Worldwide (but based in Sweden) 2020 Open source solutions and custom programming and scripts 3 4 Arkiwera is a Swedish company that maintains digital archives of websites and social media accounts for an annual fee. It supports automatic collection, replay, full-text search and data exports. EU Web Archive European Union 2013 Archive-It services 1 The EU Web Archive compiles the captures of the websites of the European Union institutions, which are hosted on the europa.eu domain and subdomains. Its aim is to preserve EU web content in the long term and to keep it accessible for the public. The archive was created in 2013 by the Historical Archives of the European Union and in 2018, the Publications Office of the EU took over this task and created the EU Web Archive service. The collection of archived websites is covered by the EU Legal Deposit scheme, which collects all the material produced by EU entities in a comprehensive bibliography. Alabama State Government and Politics Web Site and Social Media Archives United States 2005 Archive-It services Australia's Web Archive Australia 1996 PANDORA Digital Archiving System (PANDAS), Heritrix, Bamboo, NLA Trove, HTTrack, Webrecorder, outbackCDX. 4 >10 The National Library of Australia leads the 'PANDORA' component of the Australian Web Archive which takes a selective approach and is a collaborative program of 10 agencies providing curatorial input. PANDORA uses the PANDAS workflow system (developed by the NLA in the late 1990s) with HTTrack as the default harvester. The National Library of Australia also conducts bulk harvesting of Australian government (the Australian Government Web Archive) websites using the Heritrix harvester and Webrecorder with a backend infrastructure (referred to as 'Bamboo') to organise content and the NLA developed outbackCDX tool to manage indexing access restrictions for content. In addition to these approaches the National Library also conducts annual harvests of the whole .au domain which is done in collaboration with the Internet Archive using Heritrix and Wayback. In 2019, PANDORA, the Australian Government Web Archive and the whole domain harvests were integrated into a new single discovery and delivery portal through the NLA's Trove discovery service. PROMISE project Belgium 2017 Heritrix, PyWB 7 The PROMISE project was a two-year project (2017–2019) that explored the policy-related, legal, technical and scientific issues related to archiving the Belgian web. The aim of the project was to a) identify best practices in the field of web-archiving b) develop a strategy for preserving the Belgian web c) set up a pilot for preserving and providing access to the archived Belgian web and d) make recommendations for the implementation of a sustainable web-archiving service. The project was launched by the Royal Library of Belgium and the State Archives of Belgium in collaboration with Ghent University (Research Group for Media, Innovation and Communication and Ghent Centre for Digital Humanities), Université de Namur (Research Centre in Information, Law and Society) and Haute-École Bruxelles-Brabant (Unité de Recherche et de Formation en Sciences de l'Information et de la Documentation). In October 2019 the concluding colloquium 'Saving the web: the promise of a Belgian web archive') took place at KBR. The main research findings were presented during this colloquium. KBR web archive Belgium 2020 1 KBR or the Belgian Royal Library is developing an operational web archive based on the findings of the PROMISE research project (2017–2019). Operational policies and technical infrastructure will be developed based on the strategy outlined in the PROMISE project. KADOC-KU Leuven Belgium 2022 HTTrack, Heritrix, Archiveweb.page, Replayweb.page 0 1 Thematic archive with a collection concentrated around the interaction between religion, culture and society in Belgium. In 2023 a research project Best practices for social media archiving in Flanders and Brussels ended. MT.GOV Connect United States 2007 Archive-It services 1 Montana State Library collection of state agency websites dating from 1996 in partial fulfillment of statutory mandate to identify, acquire, describe, and provide permanent public access to state publications. Digitized historic state publications available at https://archive.org/details/MontanaStateLibrary Stillio Worldwide 2011 Puppeteer, V8 engine, Gecko, WebKit, Amazon Web Services 3 4 SaaS solution for periodical website & social media archiving. Provides screenshot archiving of both static and dynamic web pages in a fixed duration which can be customized as per requirements. Helps in regulatory compliances, trend tracking, ad banner verification, version changes. Pagefreezer Worldwide 2009 Pagefreezer's Deep Web Crawler, Hadoop, Cassandra, Elastic Search 100 SaaS solution for website & social media archiving. Provides automatic collection, replay, full-text search and data export of websites, blogs, social media and internal communication platforms for eDiscovery and regulatory compliance with FDA, FINRA, FSA, SEC, Federal Rules of Evidence, FOIA and records management laws.Page VaultUnited States2013 OoCities — GeoCities Archive / GeoCities Mirror Germany 2009 Wikiwix Archive — Linterweb France 2008 Selenium + MongoDB In production on French-speaking Wikipedia since 2008, open-source project which optimizes the consumption of inodes and thus fills hard drives. Contains an annotation space for archived documents. Main developer Fabien Coulon doctor du Litis on behalf of Linterweb, hosted by Renater. Webarchive Austria Austria 2008 NetarchiveSuite, Heritrix, OpenWayback 1 1 Deutsche Nationalbibliothek Germany 2012 Tools of oia GmbH 6 The crawling for the selective web archive is done by the German company oia GmbH. The access is restricted to the reading rooms of the German National Library. DILIMAG (Digital Literature Magazines) Austria 2007 WebCurator 2 One technician, one for collecting and metadata. Bibliothèque et Archives nationales du Québec (BAnQ) Canada 2012 Heritrix, Wayback, Browsertrix 2 Web Archiving Program at Library and Archives Canada Canada 2005 Archive-It services 4 3 Web archiving in Canada is a legislated activity that is conducted for digital preservation purposes under section 8 (2) of the Library and Archives of Canada Act. Four FTEs and three part-time staff work on the program. Web archiving at Library and Archives Canada is also utilized to effect Legal Deposit. Web Information Collection and Preservation - WICP (Chinese Web Archive)"Web Information Collection and Preservation - WICP (Chinese Web Archive)" China 2003 Heritrix, Wayback and NutchWAX . Croatian Web Archive (Hrvatski arhiv weba - HAW) Croatia 2004 Crawl: DAMP software, Heritrix Access: Wayback, Lucene 2 2 The Croatian Web Archive (HAW) is a collection of content harvested from the Internet. In 2004 the Archive started as a concept of selective capturing of web resources. Whole .hr domain harvests have been conducted annually since 2011. as well as thematic/event harvesting for events of national interest. The content of the Archive is publicly available via HAW website. (2 librarians full time, 1 librarian part time, NUL), 2 IT professionals part time (SRCE - University of Zagreb, University Computing Centre) Webarchiv (National Library of the Czech Republic) Czech Republic 2000 Heritrix, Wayback and Seeder. 5 2 Czech web archive (Webarchiv) maintained by National Library of the Czech Republic focuses on archiving the Czech national web. Acquisition policy consists of three lines: selective harvests (collection of resources based on selection criteria), topic collections (focused on significant topics in the area of the Czech web) and comprehensive harvests (automatic harvests of content on the national domain). Staff contains 1 manager, 3.5 curators + 1.5 technical staff. Netarkivet/ The Danish web archive (Royal Danish Library)Denmark 2005 Schedule/crawling: NetarchiveSuite, Heritrix, Browsertrix, Archiveweb.page Access/search/discovery frontend and playback: SolrWayback. Still installed Wayback for alternative playback, but planning to migrate to PyWb. 1 5.5 FTE Since 2005 the collection and preservation of the Danish part of the internet is included in the Danish Legal Deposit Law. The task is undertaken by the Royal Danish Library.
There is no public access to the Danish web archive .The archive is only accessible to researchers affiliated with a Danish research institution who have requested and been granted special permission to use the collection for specific research purposes.
This website https://www.kb.dk/en/find-materials/collections/netarkivet is designed to inform researchers, website owners, and other interested parties about the Danish web archive. Estonian Web Archive Estonia 2010 Heritrix, Squidwarc, PhantomJS and Puppeteer for screenshots of websites frontpages, Pywb, Custom Curator Tool. 3 1 Since 2006 the Legal Deposit Law allows the National Library of Estonia to collect Estonian websites as legal deposit copies. Web harvesting is done and archive is maintained by the National Library of Estonia. Finnish Web Archive Finland 2006 Heritrix, Solr, Pywb, Browsertrix Crawler, ArchiveWeb.page, OutbackCDX, Twarc2, YT-DLP. 3 >3 Maintained by the National Library of Finland. Annually, all *.fi domains are harvested, as well as web servers located in Finland. Outside these harvests, the library manually selects relevant websites. BnF - Web Legal Deposit France 2006 Heritrix, NetarchiveSuite, BCWeb, OpenWayback, SolrWayback, WARC Indexer/Solr 11As of 2026, the BnF states that "in accordance with intellectual property law, the collections are not accessible online" and the archives can be consulted by visiting a library in France.