Showing posts with label Backups. Show all posts
Showing posts with label Backups. Show all posts

10 November 2010

Surviving the death of your Hard Drive

Surviving the death of your Hard Drive


Backup is a nice idea which people usually try to implement in retrospect.

(In recognition of this, one very good backup software is called Retrospect)
Your hard drive will certainly die before you do, and probably before your present project
* after 2 years or so, modern harddrives work on luck and prayer.

Free Backup Programs

SyncBack on PC

ChronoSync on Mac

Time machine

Making a clone - on a Mac

Making a clone - on a PC

Backup the Geeky way

Backup in the Clouds

Cloud Backup with Sync

25G free from Microsoft


.
Free Backup Programs


At Download.com you'll find 600 free backup programs.
(BTW: get used to using Download.com - you can find almost all commercial and free software there,
carefully organised, searchable, with reviews, and best of all, tested for viruses.
This is especially important for Mac users, most of whom don't have anti-virus protection.
Sometimes a popular PC program like Foxit is published for the Mac as a virus.)

.
My favourite on PC is SyncBack


SyncBack has an Easy mode which is ... easy.
* setting a schedule can be tricky, and this applies to many Windows programs
because Windows insists on using a login Password when setting a schedule
(you can override this, and SyncBack offers to do this. But if you don't, you must remember to click on the "Password" button when setting a schedule)
SyncBack also has an Expert mode which lacks almost nothing, though some things can be difficult to find
* you can backup to FTP sites, have multiple backup profiles running simultaneously, use complex filters
* if you are using it to back up your whole drive (not just your documents etc) it is worth a few dollars to upgrade and use the "Fast Backup" feature.
* but for most things the free program works better than many commercial ones.

.
On a Mac, the equivalent program is ChronoSync


ChronoSync has slightly fewer features than the PC SyncBack, but it is still very powerful, and it is prettier, and easy to use

.
Time machine


The Mac Time Machine is great - almost as good as the name suggests
* it copies the whole drive, and can restore back to a previous hour, or day, or week or month (depending how far back the date is)
* it works best with an external drive.
* I don't think it does anything you can't do on a PC, but it is easy, it looks good, and it has a great name.
For PC there are now similar programs (eg Genie Timeline, free or $40 to include system files)
* they do little more than Windows 7 already does for free, but they are easier to use, with a cool name.
(the built-in Windows features have mostly been around for years, but they are hidden deep in the machine,
and they have boring names like Restore Points and System Image, Shadow copies, so no-one looks for them.)
I've read that Seagate Replica works just like Time Machine, but I haven't tried it

.
Clone your hard drive - on a Mac


For real peace of mind, you may want to back up your whole drive, and not just your own files
* ie make a Clone not a backup but an exact copy of your whole harddrive as it is
* one great thing about this is that when you drive dies, you simply swap with the clone
* your computer is up and running again in 10 minutes, all set up as if nothing happened
* you need an external drive with the same physical size drive as your computer, though bigger capacity can be useful
* on a Mac, run Carbon Copy Cloner or SuperDuper. These Mac programs are wonderful

.
Clone your hard drive - on a PC


* on a PC there are lots of clone programs but look for one which allows incremental changes
* this means you won't be making a complete copy every time, which saves work for your drive
* the best for XP is XXClone: free or $40 for incremental backups.
* it isn't completely straightforward to use - see the tips here
* for post-XP use Paragon Drive Copy

.
Backup the Geeky way


(Non-geeks can miss the next bit: )
The best backup is still often a scripted program:
* on a Mac use AppleScript (much more powerful than the PC version and largely neglected)
* on a PC use the good old DOS commands in a Command Prompt (in Programs: Accessories) and feel nostalgic
* XCOPY is a wonderful command with lots of features. Type "XCOPY /?" for a list
* to write a program, you simply type the commands and save them as plain text, with the ending ".bat"
* eg, save the following line as a file called "Backup.bat" and put it in your Documents folder

XCOPY "*.*" "E:/Backup/" /M /C /Y /S /H /R /EXCLUDE:"~*.*"


The tags used here:
/M makes it copy only new or changed files, and marks them as copied
/C makes it carry on even when an error occurs (eg a file can't be copied)
/Y answers "Yes" to all those dumb "Are you sure?" questions
/S makes it include subdirectories
/H makes it include hidden and system files
/R overwrites Read-Only files if there is a new copy
/EXCLUDE:"~*.*" makes it ignore all the temporary files created by Word etc.
There are lots of other useful tags

You need to set up a schedule manually for this
* in Windows you find the Scheduler in Programs > Accessories > System tools
* for Macs I use the free Cron program, though there are other ways.

.
Backup in the Clouds


Data today lives in the "clouds" or on "server farms" - both picturesque ways of referring to data warehouses
* they have wonderful security, backups, hardware redundancy, and some are bomb-proof.
* employees are xrayed, iris scanned and weighed before entering and leaving (a friend works in one)
though like all new businesses there are cowboys and lots of Indians.

Carbonite.com - is probably the best deal 
* it excludes external drives (except temporarily) - though a workaround here may work for you
CrashPlan - a bit more but includes external drives and all deleted files
BackBlase.com - includes external drives, and costs less. Haven't tried it, but they are a good firm and this looks good.


One problem: Backing up your whole drive is likely to take a several weeks
* restoring is quicker if you have an ADSL line (download is faster than upload)

.
Cloud Backup & Sync all in one


Dropbox.com - free for 2G, about
* it is esp good for keeping the same files on more than one computer
* add PackRat for
* the free 2G account is perhaps all you need for your research, but photos very quickly fill it

.
25G free online from Microsoft


Microsoft Live SkyDrive has offered us all free 25G storage space
* it is a little cumbersome to use, so download SkyDrive Explorer which make work like a folder in Windows
* you can then use normal backup software to copy files into you free online space.

One day we will all have solid-state drives and we won't need to backup
* don't believe it. They still crash and die, and it looks like it happens quicker than people had thought
* the comforting thing is that solid state drives tend to freeze with their contents intact
* that is, you can't write to them, but you can still read them. Usually.
* so I think Paul's saying will still hold true: Backup, Backup, and again I say: Backup.
 

1 July 2009

Forget nothing and work anywhere



Imagine a world where everything you read is searchable so you can re-view any page containing a word or reference; where your computer is accessible from any other computer; and where you can instantly find any file you want. You can do all this now, with your present computer, for free.

Picture from Tyndale House
This posting will show you how, at zero cost, you can:
  • have an electronic photographic memory which is searchable
  • have automatic backups, ready for the day your computer dies
  • access your work and software from any web-connected computer
  • and you do NOT have to be continuously online.

1) Dropbox: Access your files on any computer - even with a poor connection

2) DjVu: Search everything you've read - with intact Greek & Hebrew

3) Zotero 2: Your automated librarian and bibliography/footnote creator

4) LogMeIn: View and control your computer from any other computer

5) GoogleDesktop: Index your whole life and find it again on any computer

1) Dropbox: Access your files on any computer - even with a poor connection:


Where should you keep shared files? - on your computer or online?
  • Files on your computer are fast and available even when the internet fails,
  • Files online are backed up and can be accessed on any computer
Now you can have BOTH, automatically updated, by using Dropbox.
  • files in your Dropbox folder live on your computer, and online
  • they are automatically kept in sync with identical folders on your other computers
  • or, on a public computer, you can go online and load the file from your storage
  • and if you accidentally delete it, the last three revisions are safely online
Get a free 2.25 Gb Dropbox here (enough space for about 2000 PhD theses!) Nearest rivala: SugarSync - 2 Gb free, on only one extra computer or PDA and LiveMesh - 5Gb online free, and syncs more. In Beta, but looks good.

2) DjVu: Searchable text which is an exact image, with intact Greek & Hebrew:


How should you store things you've read? - as scanned images or typed text?
  • Scans show the exact page, including page numbers, Greek & Hebrew
  • Text is searchable, but typing is tedious and automatic OCR is often garbled
Now you can have BOTH without correcting any text, by using DjVu
  • scan what you read even at only 200dpi, eg on your office photocopier
  • upload it to a free DjVu converter then save the file on your computer (the conversion site automatically deletes them after 6 days)
  • install the DjVu plugin which is much faster than viewing PDFs
  • they look just like a scan or photocopy, but they contain the typed text (like all OCR, it is not perfect, but this is OK because you see the original)
  • Hebrew & Greek remains legible, because you can see the original image
  • you can search and find a word, or copy and paste text into a summary
  • DjVu files are only about 1/6 the size of PDF files, so they're easy to store.
Does scanning take you too long? Flatbed scanners are cheap but scans take 20-30 secs. Look at your office photocopier - it may have a scanning function as fast as copying. At Tyndale House the photcopier scans to a public server accessible on all computers. Its quick!

3) Zotero: Your automated librarian and bibliography/footnote creator


How should you record your bibliography? - as a strict database or free-form records?
  • Databases like Endnote create searchable records automatically from some catalogues and create references in different styles in your documents, but data of ten need tidying
  • Free-form records can be written quickly, but the format needs retyping for publication
Now you can have BOTH created automatically from most sources, by using Zotero
  • collects bibliographic fields automatically from web catalogues (including Tyncat)
  • can be organised by both tags and folders, and the content searched by words
  • can attach whole documents to the records, including articles from JSTOR etc
  • can store whole web pages or highlighted clippings and redisplay them
  • can index and search PDFs and web pages (but not DOC or DjVu files)
  • can create bibliography records and footnotes in hundreds of standard styles
Zotero 2 can now share collections on different computers. To do this:
  • if you already have a Zotero folder, make a backup. (To find it, click on the cog symbol, then 'Preferences' then 'Advanced' then 'Storage Location' then 'Show Data Directory')
  • install Firefox 3 from here and Zotero 2 from here then create a Zotero ID here
  • in Firefox, click on Zotero (bottom right), then on Actions (the 'cog' icon) then 'Preferences'
  • to add SBL style etc for formatting citations, click on 'Styles' then 'Additional Styles'
You can access your Zotero files on two or more computers and update them all automatically:
  • in 'Preferences', click on 'Sync', enter your Zotero ID for the Sync Server and tick Sync automatically
  • the 'Storage Server' needs WebDAV but no free online storage service provides this, so instead:
  • use 1) Dropbox (see above): create a folder 'Zotero' in your Dropbox folder, then click on 'Preferences' 'Advanced' and 'Choose'
  • or 2) Live Sync duplicates folders on two computers without keeping an online copy: download, find and run it on both computers and tell it to sync the Zotero folder

4) LogMeIn: View and control your computer from any other computer :


How do you work at the office and at home? Carry a laptop or data stick with you, or work online?
  • Carrying hardware around feels safe, though editing copied files can lead to several versions.
  • Zoho's online office suite is powerful and fast, but you need dependable internet access.
Now you can have BOTH by controlling your office computer from home using LogMeIn
  • you can use your office computer from any other computer, which 'becomes' that computer
  • in 'full screen' mode, it is easy to forget that you are actually controlling another computer
  • you can switch between computers and copy and paste from one computer to the other
  • create a free account at LogMeIn and install the software on your computers
  • you can then access them even on public computers (without installing) by web browsing
Zoho is worth considering for true 'cloud computing' - ie doing all your work online. Their Notebook is almost as good as Google's notebook (sadly discontinued), and their word processor is better than Google Docs. They also have spreadsheet, database etc. But until we have reliable internet access everywhere, true cloud computing will have to wait.

5) GoogleDesktop: Index your whole life and find it again on any computer:


How do you search for your files? Keep them strictly organised or index them? Do BOTH of course, but now you can index your whole life with GoogleDesktop
Google Desktop indexes and searches documents, emails, calendar, viewed webpages etc
  • you can choose to include external drives or restrict the indexing categories
  • results are ordered in an intelligent way, like Google web searches
  • you can share indexes to be visible on any other computer you log into
  • it share files between computers, but not reliably. Use DropBox instead (see above)
  • it stores deleted files and previous versions, ready to be resurrected
  • there are lots of other gadgets to watch email, calendar, news stations etc
  • it even indexes words inside scans, if they are in DjVu format (see above)
  • to turn DjVu on: click on the down arrow, 'Options', 'Desktop Search', then at 'Indexing plugins' click on 'Download Page' and search for 'DjVu Plug-in'. Download and Run.

1 June 2007

Backup, backup and again I say backup

The little known saying of Paul, "Backup, backup and again I say backup"
is something which every Biblical Scholar (and everyone else) should heed.
A book will survive 1000 years or more with benign neglect in a dry place,
but a hard drive will function inside a computer for only 3 - 10 years.
A floppy disc will fade, a CD will scratch, and even flash memory will die.
So whatever we want to keep, we have to keep on backing up.

1) Backup onto what?
2) Backup software (free or cheap)
3) How to make your work last forever.


1) Backup onto what?
Backup onto something which is normally separate from your computer.
A Tyndale scholar had his laptop and backups stolen from his car 3 months before
submission. His only other backup was 5 months old. Could this happen to you?

Good choices:
DVDs, Flash memory, portable drives, internet spaces

DVDs are already old technology but they will last some time yet, mainly because of movies.
Like paper, they survive well with benign neglect. They don't fade or crack (though early ones did)
Unlike other media, they should survive the electromagnetic pulse of a nuclear bomb.
Warnings: Don't leave recordable CDs in the sun, and don't buy non-branded DVDs or CDs

Flash memory (aka USB stick, SD card etc) lasts a long time.
No one knows how long in practice (yet) but some come with a 10-year guarantee.
This is the memory of the future. Mini computers are being built with flash memory
instead of a hard drive - they are smaller, with longer battery life and more reliable.
My prediction: SD cards (or Mini SDs) will be the next 'floppy' to replace CDs.
My tip: Buy " Ultra II SD Plus" cards - an SD card which has a click-out for USB slots.
You can use it as a tiny USB memory stick, and also put it in your SD camera, PDA
or MP3 player, so it is easy to swap files without any leads.

Portable drives can hold much more than flash memory (at present).
So if your data includes lots of pictures or music, or you want to copy your whole drive,
you need a portable drive. If you have a desktop computer, you can add a permanent
drive inside, but remember it will be stolen or burned along with the original,
so make a separate backup of your data.
My tip: Buy a drive which is powered through the USB slot,
so you don't have another cumbersome power supply.

Internet space means that you don't have to worry about re-copying your backups.
Someone else will do it. Several firms will sell you space with easy backup software
Carbonite is cheap and forget-about-it automatic. MediaMax gives 25G backup free.
You can also email files to yourself - Google provides 2G space and others are following this lead.
Or you can use a GMail account as backup space using software like GSpace
My tip: You can own more than one GMail account, so register another just for backup.

2) Backup software (free or cheap)

Backing up can be done in two main ways: Copy the data, or Clone the drive.
If you have spent ages setting up your computer exactly as you want it, clone it.
If the data is more important (ie the documents, photos etc), just copy the data.
If you want to preserve older copies of documents, use incremental backup.
If you work on more than one computer, you need to backup with synchronisation to
make sure that both computers keep in step and that you always work on the latest version.

Copy the data:
Copy everything in My Documents (plus the Desktop if you are untidy like me and often leave
things there). You should check that all your programs are leaving documents there - email is
often a culprit, so you may need to find your email folder.
If you have limited room (on a small memory stick) you can buy a bigger stick or copy less.
The common culprits for full memory sticks are photos, music, and email spam attachments.
You can just copy your email texts and leave the attachments in Eudora (though not in Outlook).
Or, you could get a portable drive.

Clone the drive:
A "clone" is an exact copy of the drive. This is harder to make than in the old days
when you just copied the files. Now software is moulded to the machine when it is installed,
and many files can't be copied while the operating system is running. Nevertheless, some
programs have found ways round this (see below).
Macs can be booted from an external clone, but Windows will not allow this (supposedly for security
reasons), so you have to either install your clone in the machine, or clone it again to your new computer.

If you are really clever you will make a RAID mirror, which makes a constant fail-safe clone,
by writing the data onto two identical hard drives. Follow the instructions here.
I used to use command-line batch files instead of backup programs, but life is too short.
OS X and Windows have free backup software which is good, but there is room for improvement.

Here are the programs I recommend as being easy, powerful and mostly cheap or free.
Mac:
Retrospect is perhaps the best - it copies and makes increments, but it is expensive
and can be confusing, and there is now a cheap and easy-to-use alternative:
SuperDuper, despite its cutesie name, is a very powerful tool.
Even the free version can make a complete bootable clone of a drive, as well as normal backups.
The $28 version can incrementally add to a clone, so you always have an exact copy.
PC:
There are many backup programs for the PC - here is a good partial list. These are my favourites:
BackPack Professional copies, compresses, writes to DVD etc, with schedule - FREE (for personal use)
SyncBack synchronises so you can carry backups between two computers, eg at home and at work.
This remarkable software synchronises by data or content, over networks and FTP, and all for FREE!
Either synchronise over the internet by FTP or synchronise via a memory stick.
It can also backup automatically in the background on a schedule, copying only the files you have changed.
The $30 version copies files even when open, and keeps previous copies (up to a limit you set) and works faster.
Katchall Archive keeps a copy every time you save a file. At any time you can right-click on a
file and ask for an earlier copy. You can set a limit to the number of copies, though texts take
up very little room because only the changes are saved, and they are highly compressed.
Ever discovered you accidentally deleted a footnote a month ago? This would have saved it.
No longer free, but your documents are worth $30.
XXClone makes a bootable clone. FREE for personal use - for $40 it updates incrementally.
Tip: To make sure your emails are safe, create another email account and use a filter to copy every email to it.


3) How to make your work last forever.
Floppy disks and hard drives are magnetic, so they gradually leak their data. Long before
this happens, the mechanism goes out of fashion. I remember Don Carson writing the first
Gramcord morphological NT and saving it on a state-of-the art double-8" floppy drives.
I showed my daughters one of those floppies and they laughed at me derisively,
as if I was claiming that we all used to wear meter-long clown's shoes.

All present-day media formats will pass away, but your documents need to remain forever.
The secret to eternal life for documents is the internet. Make several copies in various sites,
and let other people help themselves to copies so your work is preserved also by others.
If you really think you can make money out of it, publish it as a book at www.LuLu.com
(it can be sold as an eBook, or as a paper book - you fix the price and keep the profit).
Virtually the whole internet is being archived at present (see www.Archive.org) so even if your site
disappears, your document will survive. One day an internet archaeologist will find your work.

If you follow all the above advice, you will feel paranoid and safe both at the same time.
And one day your work may make you famous - probably after you are dead, because you are so ahead of your time.