Web archiving is the process of creating reliable copies of web-based content for long term preservation. This page provides information on what content the University preserves, how it preserves it, and how it can be accessed. When we talk about archiving web content, our aim is to reproduce websites as closely as possible to the way they functioned on the live web, and to ensure these reproductions (‘captures’) remain accessible and useable in the long-term. How does web archiving work?A web crawler navigates through a site and makes copies of all the files that comprise it. Copied files are collated into a standardised file format (a WARC file) for long-term preservation, along with metadata about when the capture was made and what technologies were used. The archived file package (‘capture’) can then be loaded into a playback tool, enabling a version of the website to be reconstructed. Web content changes rapidly, so we make regular captures over time to allow us to reflect and record those changes. What web content does the University archive?Our web archiving activity focuses on University content that has been made publicly available using the web, and is guided by the University Archives Collections Development Policy (Appendix G of the Collections Management Policy 2020-2030). Any content that is on the main ed.ac.uk domain is considered in scope for collection, and we make an effort to identify and capture any sites that are owned, managed, or hosted by the University on other domains. Where appropriate, we also use web archiving to preserve non-University web content that is acquired by Heritage Collections through donations, purchases, or commissions.How is University web content archived?University web content is predominantly archived through the UK Web Archive (UKWA) systems. The UKWA collects under legislation which entitles the British Library and other legal deposit libraries to make a copy of all UK print and digital publications, and University websites form part of this collecting activity. There are occasions where, due to technical or legal restrictions, University web content cannot be captured by the UKWA. In some of these cases, we create local captures using open-source tools like the WebRecorder tool suite. How can archived University sites be accessed?Most of the University’s archived web content can be accessed through the UKWA’s public interface. By default, access to content captured by the UKWA is restricted to computer terminals onsite in Legal Deposit Libraries, but the University has granted a license which enables access to captures from any computer terminal. This license automatically applies to all content on the main web domain (https://www.ed.ac.uk) and associated subdomains (with the exception of content on the blogs.ed.ac.uk domain), and is manually applied to other University-managed sites. Requests to access locally-held captures can be made through Heritage Collections Research Services.How complete is an archived website?An archived website is a static snapshot of a site captured at a specific moment in time. Archived pages can lack functionality for interactive elements such as search bars, contact forms, or dynamic feeds, and you should view an archived site as a historical record for reference rather than a fully navigable, operational website. Web Archiving Strategy Find out more about our approach to web archiving. Making archive-friendly websites There are a few simple steps that you can follow during the design process that can make your website more crawler-friendly and improve any copy that is made for preservation. This article was published on Wednesday 21 August 2024