9
Feb

As soon as your business grows, so does the need of backing up everything. You can’t be serious about your business if you don’t backup and save important stuff just in case something goes wrong. As soon as MacStories started growing some months ago, I began to look out for good solutions to daily back up my files and various databases, and I was looking for a cloud solution. Sure, there’s Dropbox for that. Really guys? Would you suggest Dropbox for people who need to save files with incremental backups everyday? You know that it costs a lot and that, in the best case, you have to manually drag & drop every folder inside it? (unless you create your folders in /Dropbox from the start). No, that doesn’t work for me. I need something cheap, that runs in the background as soon as I make some changes, it has to be reliable, fast and secure. The unicorn of backups, basically.

Most like every new app I’ve recently discovered, everything happened on Twitter: I don’t remember quite well, but it was some night ago when someone tweeted “this new beta of Arq rocks!”

Today I’m going to talk about Arq from Haystack Software, an application that has already become a fundamental part of my workflow.

Arq Icon

In the quest for finding the perfect online backup service, the answer was pretty obvious: Amazon S3. The “Simple storage service” that Amazon provides starting from $0.15 per GB is indeed very famous among bloggers who daily upload their posts’ pictures to S3 in order to achieve faster delivery times to their audience. When combined to CloudFront, S3 is a damn good CDN, with a damn good price. But we ain’t talking about CDN and delivery times here, I want to focus on backing up stuff. As I mentioned above, I was looking for this backup service then I discovered this new application: Arq uses Amazon S3 to contionuously backup the files / folders on your Mac. Everything goes straight into S3’s bucket, on your account, safe and encrypted. Let’s see how it works, anyway.

First, you need to create an AWS (Amazon Web Service) account and sign up to S3. You can review the prices here, but they’re really good overall. Once you’ve signed up to S3, go download Arq here. Fire it up and enter your S3’s access ID and secret access key, which your can retrieve in the Security tab of your AWS account. Here comes one of the coolest things about Arq: you can manually set up how much money you’d like to spend every month on Amazon by either editing the $ field or choosing a different amount of GBs. By default, Arq tells you that you’ll pay $4.95 per month every 33GBs. Sounds great, huh?

Arq Mac

If you already use S3 or you’ve used it before, you probably know that it works with “buckets” or – put simply – “folders” that contain files. Well, Arq is based on this same assumption, but with some technical differences. On the surface, you just have to choose which folders to backup (even your entire home folder if you want) and they go listed in the sidebar, backed up at regular intervals. On the technical side things are a little bit more complex, but you should know them anyway – it’s your stuff after all.

From the documentation: (full page here)

“Arq stores backup data in S3 in a format similar to that of the open-source version control system ‘git’.

When you first run Arq and give it your public and private S3 keys, it create an S3 “bucket” with the name “<yourpublickey>.com.haystacksoftware.arq”. It also creates a “universally unique identifier” (UUID) for your computer.”


Put (again) simply, if you add – say – 5 folders in Arq and you try to browse your S3 account with another app like S3 Hub, you’ll only see one folder. But don’t worry: everything is inside it, in an encrypted format that only Arq recognizes.

So, Arq can perform incremental backups of everything on your Mac and even restore it. Don’t worry for the technical aspects, unless you really want to know the details of what’s going on behind the curtains.

Using Arq is really simple: you can choose folders to backup from the + button in the sidebar. Once you’ve selected a folder Arq will start encrypting and uploading it to Amazon. Arq encrypts files before they leave the computer, it uses a password that you only know and provides security through AES-256 encryption. The password is never sent to Amazon or whatever,so don’t fear anything. The best feature of Arq’s backups is that the application uses a technology similar to Apple’s Time Machine: backups are de-duplicated, thinned and checked at a regular schedule. Basically, it weeds out older backups, keeps hourly backups for the past 24 hours, daily backups for the past month and keeps weekly backups until your SE storage “budget” is reached.

Arq Mac

What about the restore system? Simple as this: drag & drop, or hit a button. Just enter a folder (like the Candybar library, for example) select the files you want to restore (the icons database) and either drag them in the Finder or press Restore. Mac-specific metadata will be correctly restored and you’ll be happy as it’s Christmas morning.

Last, Arq performs everything in the background. You can quit the app from the dock, but an “agent” will keep running in the menubar, constantly monitoring for changes with very small memory footprint.

There’s no doubt Arq has changed my workflow. I don’t need to care about losing my data anymore, as everything just happens in the background without getting in my way and $4.95 every 33GB per month sounds like a totally reasonable price to me.

If you’re serious about backups and like the idea (I do) of having your stuff on Amazon S3, go download Arq. It’s just great.

Giveaway

The Haystack guys gave us 10 Arq licenses to give away to MacStories readers.

Entering the contest is simple. All you have to do is:

- Follow me and Arq on Twitter (@storiesofmac & @arqbackup) and tweet this message: “Win a Copy of Arq for Mac on MacStories http://mcstr.net/9sjGiy @storiesofmac”

and

- Leave a comment telling me why you’d like to win the app. Be sure to include a link to your tweet.

I’ll pick up the winners on Friday, February 12th.

Good luck!



Subscribe to our RSS feeds. You can also follow our official Twitter account @macstoriesnet.



  1. #1

    That's what Justin said 6 months ago:

    I love S3 — and combine this app with the<a href="http://developer.amazonwebservices.com/connect/entry.jspa?externalID=3512&categoryID=49">recent announcement about Amazon supporting versioning</a> …and it’s "Time Machine in the Cloud" time, people!:


  2. #2

    That's what toby said 6 months ago:

    I want to win Arq, because I’m looking for an online backup system since weeks and didn’t find any good.

    http://twitter.com/tobyo/status/8868626724


  3. #3

    That's what Bruna said 6 months ago:

    http://twitter.com/brasmussen/status/8868515506

    The one who know the value of a backup is the one who has already lost some important data.


  4. #4

    That's what Mark Hewitt said 6 months ago:

    http://twitter.com/bmistudioa/statuses/8868673152

    Just signed up for a S3 account and would love to give this software a try. Backup is key when a HD crash can happen anytime.

    Regards,
    Mark


  5. #5

    That's what Ned said 6 months ago:

    I want to be able to back up my music online :)

    http://twitter.com/ordnance_elf/status/8868881890

    Ned.


  6. #6

    That's what Suhail Patel said 6 months ago:

    I want to win the Contest because then I could backup all my schoolwork and know that even if my house caught fire my Coursework (which would be the least of my worries) would still exist :P

    Tweet: http://twitter.com/suhailpatel/status/8868969219


  7. #7

    That's what Fabio said 6 months ago:

    As always great rewies. I often thought to Amazon S3 but worried about the configuration. This sw seems great. Only one doubt: it has a "proprietary" way to encrypt: it they discontinue to update the sw what about the backup? Anyway here my tweet: http://twitter.com/fabiomacori/status/8869096992

    Stefan Reitshamer Reply:

    Hi @Fabio, I’m the developer of Arq. The data formats aren’t secret (it’s your data after all). I wrote them up, I just haven’t put a link to the doc anywhere yet:

    http://www.haystacksoftware.com/arq/s3_data_format.txt

    The format is a little more complicated than just dumping files into S3 for 2 reasons: de-duplication, and "packing" small files for efficiency (less transaction overhead).


  8. #8

    That's what Keir said 6 months ago:

    I could really use this for backing up my Photo’s.

    Currently I’m using Dropbox but my photo’s are eating up quite a large amount of my space so could definitely use with backing them up elsewhere :)

    Thanks!

    Tweet:
    http://twitter.com/Keir/status/8869226860


  9. #9

    That's what Arthur B said 6 months ago:

    I would love this. I save backups to a external hard drive but I’m always horrified that if something happens to my home, such as a fire, I would lose all data and have no backup to go back to. I need a remote/online backup solution and this fits the bill perfectly. Please pick me!!!!

    Thanks.

    http://twitter.com/ArthurBekaryan/status/8869429306


  10. #10

    That's what Fabrizio Lodi said 6 months ago:

    Two reasons: I don’t like Mozy and I’d like to try S3 from Italy (here a lot of people is not convinced about S3).

    http://twitter.com/xool/statuses/8869537927


  11. #11

    That's what zeebe said 6 months ago:

    Here is mine:
    http://twitter.com/zeebe/status/8870732790


  12. #12

    That's what Maija said 6 months ago:

    Here is the link for my entry:
    http://twitter.com/maijabear/status/8870735311


  13. #13

    That's what JazBoy said 6 months ago:

    The link for me!
    http://twitter.com/jazboy2005/status/8870738166


  14. #14

    That's what CazGirl said 6 months ago:

    Here is my link:
    http://twitter.com/cazgirl2000/status/8870740556


  15. #15

    That's what Daniel said 6 months ago:

    As a student in medical school, I get 20+ large powerpoint files a week, plus a few more documents and pdf’s. I’d love to be able to access all of those files online :)

    Daniel Reply:

    Oops, forgot the link:

    http://twitter.com/OrangeGuutan/status/8872871234


  16. #16

    That's what SuperGlide said 6 months ago:

    My HD crashed 2 weeks ago and it’s been agony recreating my files and applications. If I had been using online storage I could’ve avoided this time consuming resurrection. Next time I want to be prepared…
    http://twitter.com/ripvw/status/8872841233


  17. #17

    That's what fellowweb said 6 months ago:

    Federico,

    Awesome program. Thank you very much for sharing! It reminds me a bit of what JungleDisk has been before it was bought by Rackspace.

    It seems to perfectly fill the gap JungleDisk left. It sounds like the perfect tool for online backup.

    I’d love to win but I can’t wait and I’ll directly look for a trial version on the developer’s homepage. ;)

    http://twitter.com/fellowweb/status/8873670811


  18. #18

    That's what Brad said 6 months ago:

    The problem that I’ve found is that most of these inexpensive backup solutions like Carbonite do not work on PowerPC machines. I don’t see a requirement of Intel processor for Arq. If this is the case then this may be the solution that I’m looking for.

    Stefan Reitshamer Reply:

    @Brad, it’s a universal binary so it should work on PowerPC, but I don’t have one to test it. It requires at least 10.5 though.

    Please tweet me at @arqbackup if you run into any issues on your PowerPC machine and I’ll address them ASAP.


  19. #19

    That's what CannonGod said 6 months ago:

    I’m set private so I probably can’t enter the competition. Never mind! ^_^

    Going to finish my MobileMe trial, then go for the ARQ 30-day trial. Want to explore the alternatives to Dropbox.

    Personally I think you are paying the same rates as Dropbox for S3 access, but ARQ allows custom limits, not 50GB or 100GB packages. Also you can run a fully fledged website out of ARQ, rather than psuedo-code with Dropbox or MobileMe, letting ARQ be the auto FTP client :)

    CannonGod Reply:

    The biggest feature I’m waiting for is to have all my cloud-stored files viewable on the computer, but I choose which files I store locally.


  20. #20

    That's what Pattulus said 6 months ago:

    https://twitter.com/pattulus/status/8875098592

    You already made a point there: Dropbox is wonderful, but it’s too expensive to use the syncing lion to backup data.

    I always avoided Amazon S3, but reading your lines I thought again and again about joining the club… And well, now I did. Thanks.

    Pattulus Reply:

    @Pattulus, Wow… I just started the Arq Trial and it’s really, really stunning. And since the $29 would shrink my student budget, I’ll sit and wait (*80’s melody in my head*) and hoping for the best.


  21. #21

    That's what Davide85 said 6 months ago:

    I have to start considering Amazon S3 too ;-)
    here’s my tweet
    http://twitter.com/eikichiDanma/status/8875443228
    Hope to find place on the Arq ;-P


  22. #22

    That's what Justin Green said 6 months ago:

    Tweet: http://twitter.com/jutgreen/status/8887824088

    I’d like to win simple because I need an offsite backup solution, and Amazon S3 is about a reliable as it gets!


  23. #23

    That's what Dave said 6 months ago:

    @Stefan (developer)-I’d find this useful particularly if Arq can do incremental backups of iPhoto without re-uploading 20+GB each time I do a backup. I get the impression that Arq doesn’t dig into packages like this, but I wanted to be sure. Thanks!

    Stefan Reitshamer Reply:

    @Dave, after the initial upload, Arq will only upload files that have changed. Give it a try (it has a free 30-day trial and takes a few seconds to set up) and see if you’re happy with it.

    Stefan Reitshamer Reply:

    I should have also mentioned: Arq "de-duplicates" your files, so the same file contents are never stored more than once in your S3 account.


  24. #24

    That's what Henry Yue said 6 months ago:

    My tweet: http://twitter.com/AppleTribe/status/8891910197

    I love Dropbox for synchronizing files across my macs but to backup my media using Dropbox can be quite expensive. I am very interested to explore Arq as it uses Amazon S3 as their storage solution which has the lowest cost per GB for online backup.


  25. #25

    That's what Shadowchaser said 6 months ago:

    Tweet: http://twitter.com/pczajkowski/status/8893853114

    Wow! I was waiting for something like it. I’m a long time user of Amazon S3 and missed a solution which would allow me to easily backup my files there. Seems very user friendly so far. I love this spending limit functionality. Want it! Want it bad:)


  26. #26

    That's what SebaSonido said 6 months ago:

    https://twitter.com/SebaSonido/status/8896389775

    I have a lot of important files and have to backup them somewhere and Arq could be an app that I need.


  27. #27

    That's what jaryre said 6 months ago:

    http://twitter.com/jaryre/status/8897768369

    Really hope I can win this
    Have looked for a backup service for so long because I don’t want to loss my precious data in my mac
    I don’t have any backup service yet :(

    Thanks!


  28. #28

    That's what Dave said 6 months ago:

    Thanks for the reply, Stefan! I’d like to put in my giveaway entry, too. The initial upload for my iPhoto file will be a doozy, but I’d be loving Arq’s ability to upload only the changed parts from that point forward while keeping a backup of my precious photos on Amazon.

    http://twitter.com/QUIETFIRE2009/statuses/8902996068


  29. #29

    That's what Hector Lee said 6 months ago:

    http://twitter.com/hecty_/status/8903235175

    It might a solution to two things I haven’t tried. Subversion and Online Backup.


  30. #30

    That's what Frank Bianchetti said 6 months ago:

    https://twitter.com/bianchef/status/8906748075

    Low cost backup anywhere on AWS? Yeah, I want it.


  31. #31

    That's what Lesley said 6 months ago:

    I’d love to win as I’m in dire need of a good backup system – although my MacBook Pro is backed up my hundreds of RAW photos are not… Arq & Amazon S3 sound like a solution.

    http://twitter.com/LunaTicket/status/8925366128


  32. #32

    That's what Teryn said 6 months ago:

    https://twitter.com/wxee/status/8960116356

    I’d love to win because I need a good online backup system as well, and I’ve always found Amazon S3 to be very reliable for storage.


  33. #33

    That's what Randy said 6 months ago:

    http://twitter.com/6T9/status/8988291629

    I have had my share of HDD failures and while Time Machine is great, it isn’t bullet-proof and I would hate to have to learn that again the hard way :(

    Hook a brother up! Thanx :)


  34. #34

    That's what Joel Limberg said 6 months ago:

    http://twitter.com/joellimberg/status/9002475407

    My backup disks sit next to my computer, waiting for something to go really really wrong…


  1. Trackbacks:

    Justin toby Bruna Mark Hewitt Ned Suhail Patel Fabio Keir Arthur B Fabrizio Lodi zeebe Maija JazBoy CazGirl Daniel SuperGlide fellowweb Brad CannonGod Pattulus Davide85 Justin Green Dave Henry Yue Shadowchaser SebaSonido jaryre Dave Hector Lee Frank Bianchetti Lesley Teryn Randy Joel Limberg Protect Your Mac Files, Folders and Apps with Espionage. Review and Giveaway. Arq Amazon S3 Back Up Solution | ETHER CREATIVE Is it smart to use DropBox for backups? | Be Redundant! CrashPlan restore analysis « Haystack Software Blog Arq: Back Up Your Mac to Amazon S3