Releases: N0taN3rd/wail
Bug fixes
Notable
- fixed issue with WAIL hanging on start
WAIL 1.2.0-beta3
Updated Electron to 1.8.1
Updated application dependencies to ensure stability
Improved Page Only
, Page + Same Domain Links
and Page + All Links
crawl stability.
WAIL 1.2.0-Beta2
Heritrix No Longer The Primary Crawler
WAIL has transitioned away from using Heritrix as the primary preservation method.
The Page Only
, Page + Same Domain Links
and Page + All Links
crawls now use a full Chrome browser.
You can monitor the progress of these crawls by going to the WAIL Crawls
section of the application.
For those wondering WAIL does not use WARCreate, Browsertrix, brozzler or Webrecorder or a derivation of one of these tools.
The special sauce powering these crawls has been open sourced and made available through node-warc
WAILs browser crawls pass Mat Kellys The Archival Acid Test
See #85
Heritrix based crawls are still available tho!!
WAIL provides auto configured Heritrix crawls via Heritrix Depth 1
, Heritrix Depth 2
and Heritrix Depth 3
crawl options.
These will launch Heritrix crawls at the respective depth.
beta2 change
- WAIL runs flash now. The flash plugin used by Google Chrome is packaged for each supported OS 😍
- Upped after page load wait and scroll time (yes WAIL interacts with the page)
in order to get more of that juicy only JavaScript content
WAIL 1.2.0-Beta
Heritrix No Longer The Primary Crawler
WAIL has transitioned away from using Heritrix as the primary preservation method.
The Page Only
, Page + Same Domain Links
and Page + All Links
crawls now use a full Chrome browser.
You can monitor the progress of these crawls by going to the WAIL Crawls
section of the application.
For those wondering WAIL does not use WARCreate, Browsertrix or Webrecorder or a derivation of one of these tools.
The special sauce powering these crawls has been open sourced and made available through node-warc
WAILs browser crawls pass Mat Kellys The Archival Acid Test
See #85
Heritrix based crawls are still available tho!!
WAIL provides auto configured Heritrix crawls via Heritrix Depth 1
, Heritrix Depth 2
and Heritrix Depth 3
crawl options.
These will launch Heritrix crawls at the respective depth.
WAIL 1.1.0
Updates
-
Electron has been updated to 1.7.3:
Chrome used by Electron is now 58.0.3029.11, Node and V8 also updated.
Userland should notice an increase in the smoothness and performance of WAIL when working with large (size and number of) collections -
WAIL's
Page Only Crawl
updated
Thanks to the Chrome version bump in Electron 1.7.3 thePage Only Crawl
has been transitioned away from the modified WARCreate style preservation to a full browser based crawl implementation.
Look for more update as WAIL transitions away from relying on Heritrix to provide itsPage + Same Domain
andPage + All Links
crawls.
Heritix based crawls will still be available in all future releases of WAIL -
Twitter login through WAIL improved
Previous releases of WAIL relied on electron-oauth-twitter.
But userland found that it was not alway reliable so this functionality has been overhauled completely to ensure reliability. -
UX improvements
Twitter Monitoring and Archiving Configuration
UI has been redesigned and condensed making it easier to use this feature
Collections Interface
has been reworked making it easier to manage your collections -
Pywb updated
Updated to 0.33.1 improving replay for all supported operating systems.
Replay on Windows is now just as smooth as Linux and OSX ❤️
1.1.0beta2.5
Addresses the issue of no collections available when WAIL is first used
Addresses WAIL-WARCreate error when user wanted to archive a schemeless URI
Performance of WAIL has been touched up
1.1.0beta
WAIL-Electron 1.0.3
Wail idling bug fix #70
WAIL-Electron next
Bleeding edge @1.0.3-next
builds of current dev WAIL will be placed here
WAIL-Electron 1.0.2
General stability updates (per Electron version update, Windows screen size style updates)
Long twitter monitoring stability fix
Twitter Sign-in internal workings updated
Removed relics to OpenWayback, WAIL-Electron uses pywb