Skip to content

webrecorder/archiveweb.page

Repository files navigation

ArchiveWebpage

ArchiveWeb.page is a JavaScript based application for interactive, high-fidelity web archiving that runs directly in the browser. The system can be used as a Chrome/Chromium based browser extension and also as a standalone Electron app.

The system creates, stores, and replays high-fidelity web archives stored directly in the browser's storage (via IndexedDB).

For more detailed info on how to use the extension and standalone app, see theArchiveWeb.page User Guide.

The browser extension is available on theChrome Web Store.

Downloads for the desktop are are available on theGitHub Releases page.

Architecture

The extension makes use of the Chrome debugging protocol to capture and save network traffic, and extends theReplayWeb.pageUI and thewabac.jsservice worker system for replay and storage.

The codebase for the extension and Electron app is shared, but they can both be deployed in different ways.

Building for Development

To develop ArchiveWeb.page, install Node 12+ and Yarn.

Install the Development Extension

For development, the extension can be built locally and loaded as an unpacked extension. If you want to make changes to the extension, do the following:

  1. Clone this repo. Runyarn install; yarn build-dev.(You can also runyarn buildto build the production version but it may be harder to debug).

  2. Open the Chrome Extensions page (chrome://extensions).

  3. Choose 'Load Unpacked Extension' and point to the./dist/extdirectory in your local copy of this repo.

  4. Click the extension icon to show the extension popup, start archiving, etc...

Development Workflow (Extension)

For development, it is recommended to use the dev build of the extension:

  1. Runyarn installand thenyarn run build-dev

  2. Runyarn run start-ext-- this will ensure thedist/extdirectory is rebuilt after any changes to the source.

  3. After making changes, the extension still needs to be reloaded in the browser. From the Chrome extensions page, click the reload button to load the latest version.

  4. Click the extension icon to show the extension popup, start recording, etc... The dev build of the extension will be grey to differntiate from the production version.

Using the Electron App

To run the Electron app development build:

  1. Clone this repo.

  2. Runyarn installand thenyarn run build-dev

  3. Runyarn run start-electronto start the app.

The Electron App version will open recording in a new window. It is is designed to support Flash, better support for IPFS sharing.

Development workflow (Electron App)

After making changes, rerunyarn run build-devandyarn run start-electronto load the app.

Standalone Build

To create a platform-specific binary, run:

yarn run pack

The standalone app will then be available in the./dist/directory.