How to create a local backup of a website

Atari talk, or the life and the universe and things. Just keep it clean!
Post Reply
User avatar
IngoQ
Site Admin
Site Admin
Posts: 690
Joined: Tue Aug 22, 2017 8:38 am
Location: Germany

How to create a local backup of a website

Post by IngoQ » Mon Jan 22, 2018 1:39 pm

Let's say, there is this website with a lot of files on it, and you would like a local copy of it, in case the site goes offline, how would you do that?

The probably easiest method is using wget, which is available for Linux (should already be included in most distributions) and Windows as well.

Windows Download: http://gnuwin32.sourceforge.net/packages/wget.htm (use the Installer)

The following command line will create a full backup of the site, including all (linked) downloads, and will do it's best to replace scripts with their respective static results. In addition all links to files will be replaced by local links, so that the result should be a completely offline browseable copy of the site.

Code: Select all

wget --no-clobber --convert-links --random-wait -r -p -E -e robots=off -U mozilla http://your.url
Just replace your.url with the real URL, and make sure you have sufficient drive space and bandwidth.
Ingo :geek:

“Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.” - Antoine de Saint-Exupéry

User avatar
DrF
Moderator
Moderator
Posts: 303
Joined: Thu Aug 17, 2017 1:18 pm

Re: How to create a local backup of a website

Post by DrF » Mon Jan 22, 2018 8:46 pm

I had trouble with Wget before im also very lazy.

I was using HTTrack Website Copier for Windows :

https://www.httrack.com/
It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. HTTrack is fully configurable, and has an integrated help system.

User avatar
exxos
Site Admin
Site Admin
Posts: 4673
Joined: Wed Aug 16, 2017 11:19 pm
Location: UK
Contact:

Re: How to create a local backup of a website

Post by exxos » Mon Jan 22, 2018 8:57 pm

I've had troubles with that program.. and many others :roll: .. they always seem to "die" for no reason at all for me :roll:

The only one which ever worked was Teleport pro 1.29.. but thats like a million years old now.. but still find it useful.

http://www.tenmax.com/teleport/pro/home.htm

No idea if later versions any good or not..
4MB STFM 1.44 FD- VELOCE+ 020 STE - 4MB STE 32MHz - STFM 16MHz - STM - MEGA ST - Falcon 030 CT60 - Atari 2600 - Atari 7800 - Gigafile - SD Floppy Emulator - PeST - HxC - CosmosEx - Ultrasatan - various clutter

https://www.exxoshost.co.uk/atari/ All my hardware guides - mods - games - STOS
https://www.exxoshost.co.uk/atari/last/storenew/ - All my hardware mods for sale - Please help support by making a purchase.

Post Reply