Brian.Carnell.Com > Home

Brian.Carnell.Com

Fair and Balanced

 

Guests

Logon
Account Signup

Favorite Sites

Anomalist
ArsTechnica
BBC
Becoming Conversant
BlogRoots
BoingBoing
Cam World
Catallaxy Files
COINT. TOOL
Comic Book Resources
Command Post
Crow Blog
Daily Grail
David Gurteen
Elisabeth Carnell
Enter Stage Right
Erin O'Connor
Extropy Inst.
Fredrik K.R. Norman
Free Conversant
FM.Net
Greg Pierce
Have Browser, Will Travel
InstaPundit
Just One Thing
Matt Welch
Meryl Yourish
Neuroprothesis News
Prodos
RPG News
Skeptic News
Smart Mobs
SJ Games
Tech Extreme
Think Geek
Tom's Hardware
Truer Words
Uncle Bear
USS Clueless
Voices of Unreason

Wednesday, August 25, 2004

Storing Everything -- Will 1 Terabyte Do for Power Users?

One of the reasons I am so obssessed with increasing hard drive storage is that I am constantly running out of it. As I mentioned before for the past week or so I've been using a FireFox extension to automatically save every web page that I visit. Doing a bit of surfing about similar applications led me to this short essay by Microsoft researchers Gordon Bell and Jim Gemmell about LifeBits. LifeBits is a program/concept whereby pretty much every document, photograph, video, audio, etc. that you create or receive would be stored. The trick is creating an interface to actually find things later when the data you've stored approaches the terrabyte levels and beyond.

Anyway, what strikes me about Bell and Gemmell's essay is that they have what I think are unrealistically low estimates for total storage requirements for a hypothetical 40 year professional life of storing everything. They seem to think it could be done in under at terabyte. So just for fun I looked at what I've been accumulating on an annual basis and projected that out over how much storage I'm going to need 40 years from now if I keep acquiring/generating data at the same rate I have over the last 10 years. And it breaks down something like this:

E-Mail - 16gb
Web pages/books/other text - 772gb
Pictures - 400gb
Music (MP3) - 234gb
Video (MPEG4)- 750gb
Misc - 200gb

That yields a grand total of 2.372 terabytes if I just continue at the same rate for the next 30 years. And given the way data generation/acquistion has accelerated I suspect the reality is that 30 years from now I'm going to want closer to 10-20 terabytes. Why?

Well, I'm likely to start taking pictures with a 6 or 7 megapixel camera rather than a 3 megapixel one. Rather than MP3, I'm likely to be using FLAC or some other lossless compression scheme for music (why not if storage gets cheap enough). As video becomes cheaper to record, manipulate and store, I find my usage of it accelerating as well.

As far as finding data I need, frankly I think the tools already exist for that provided they will scale to 100,000 photographs or almost a terabyte of text. The main problem is that these tools currently aren't integrated and are relatively difficult to use for non-geeks.

Discuss (0 Replies) | Printer Friendly | Permanent Link

Related Topics:




Tuesday, August 24, 2004

NewzCrawler 1.7

For the past few months, I've been using Bloglines as an RSS reader, but it just didn't scale very well with the huge number of feeds and news entries I was accumulating. So I decided to switch back to a Windows-based RSS reader. I had two requirements, however, which (oddly) turned out to be pretty difficult to meet:

1. It had to be able to let me subdivide the RSS feeds into multiple groupings and then automatically update those groupings (some RSS readers for Windows will only update the group you are currently viewing, which makes absolutely no sense).

2. It had to be able to store all data on an external hard drive so I could go back and forth from work without having to run some silly synchronization program.

As far as I can tell, the only decent RSS client that will do this in Windows is NewzCrawler.

Discuss (0 Replies) | Printer Friendly | Permanent Link

Related Topics:




Monday, August 23, 2004

Give Me Liberty or Give Me the FEC

There's a famous quote -- misattributed to Voltaire -- that goes, "I disapprove of what you say, but I will defend to the death your right to say it." John Kerry and George Bush seem to want to replace that maxim with, "If I don't like your ad, I'll whine to the Federal Elections Commission."

Kerry went from saying "bring it on" in response to questions about his war record to a "please make it stop" complaint with the FEC. Bush isn't much better, trumpeting his signing of the campaign finance reform law and demanding an end to ads that are outside of that framework.

It's amusing to see the two men vying for the most powerful elected office in the world running scared from the likes of MoveOn.Org or Swift Boat Veterans for Truth.

This is the best we have to choose from?

Discuss (1 Replies) | Printer Friendly | Permanent Link

Related Topics:


Bob Dole On Kerry's Vietnam Problem

The New York Times has finally noticed the controversy about John Kerry's Vietnam service. A lot of the initial controversy was about Kerry's medals and, frankly, it's one of those things like Bush's National Guard Service that is based largely on the personal memory of events 30+ years ago. Like the Bush National Guard issue, it also features people changing their minds and saying different things over time.

At worst, the military was a bit too quick to give Kerry medals, but the military has a history of dumbing down requirements for medals (especially, as one commentator on Fox noted, for officers).

The bigger issue, as far as I'm concerned, is Kerry's constant zig-zags about the morality of the war. Bob Dole nails this in the New York Times story, saying,

I mean, one day he's saying that we were shooting civilians, cutting off their ears, cutting off their heads, throwing away his medals or his ribbons. The next day he's standing there, 'I want to be president because I'm a Vietnam veteran.'

Exactly. Kerry has went from the 1970s admitting that he took part in activities which he considered war crimes -- including participating in free fire zones -- to the position that he was a war hero and anyone who dares question that is shameless.

Kerry and his advisers seem to have in their minds some mythical run for presidency where being a war hero was all it took to win the election. But rather than run that campaign, they appear to be intent on running a parody of a war hero campaign instead. It's been amusing to watch Bush run ads attacking, say, Kerry's attendance at Senate Intelligence Committee public hearings and see Kerry surrogates immediately act outraged that Bush would question the competency of someone who spent 4 months on a Swift Boat in Vietnam.

Personally, I'd prefer to hear more details about Kerry's secret plan to end the war in Iraq, but Kerry seems content to run out the clock to November with few details, hoping large helpings of "I was a war hero" and "Anybody but Bush" will be enough to put him over the top.

Source:

Kerry TV Ad Pins Veterans' Attack Firmly on Bush. Adam Nagourney and Jim Rutenberg, New York Times, August 23, 2004.

Discuss (2 Replies) | Printer Friendly | Permanent Link

Related Topics:


If I Were the Pope, I Wouldn't Go There

The Pope on Sunday condemned human cloning and made the odd argument that cloning and other efforts to improve human physiology represent human arrogance. According to Reuters,

The pope said medical research should not try to "manipulate" human beings "according to a project considered with arrogance better than that of the Creator himself."

What a strange claim. It reminds me of a commonly proferred claim by creationists that evolution must be wrong because no mere blind, unguided process could lead to something as magnificent as the eye. The other side, of course, is that the eye -- especially the human eye -- is a pretty lousy piece of engineering if it is the direct result of divine design. It is, however, an interesting compromise between competing needs if considered as the result of natural selection.

So it's a bit surprising to see the Pope invoking efforts to improve humans through cloning or genetic research as "a project considered with arrogance better than that of the Creator himself." Well, maybe if He'd taken his time and done things right the first time, His creation would haven't to spend so much time trying to produce better revisions.

Source:

Pope Condemns Human Cloning and Arrogance of Man. Reuters, August 22, 2004.

Discuss (0 Replies) | Printer Friendly | Permanent Link

Related Topics:


Hell Freezes Over

Politics certainly make strange bedfellows. Who would have thought that in 2004 we'd see The Nation defending the combat record of a Vietnam vet?

Discuss (0 Replies) | Printer Friendly | Permanent Link

Related Topics:


Slogger -- Your Own Personal Internet Archive

I am more than a bit jealous of Brester Kahle's Archive.Org and for a long time have wanted a tool that would let me create something along the lines of a personal Internet archive. Since storage is dirt cheap, as I've ranted and raved about, why not just automatically save ever web page I ever visit?

There are some commercial programs that come close, but not close enough and besides they all tend to be IE only.

Last night, however, I decided to see if there might be any extensions for Mozilla Firefox that allow something like this, and lo and behold I ran across Ken Schutte's excellent Slogger extension.

This is exactly what I wanted. I have configured Slogger so that every time I visit a page, it automatically saves that entire page. It also appends the page to a log list that shows the page name, the time I visited it, the original URL, and a link to a local copy. It uses a naming convention that uses the date down to the milliseconds for file names to avoid duplicate file name problems, etc.

You don't have to configure it this way. Slogger can be set up just to keep a detailed history, or it could be configured to save pages at the press of a button rather than automatically.

There are only a couple drawbacks that I noticed in the current version of the software.

First, if you are using tabbed browsing (and if you're using Firefox you'd be crazy not to), Slogger can only save the page in the active tab. So if you have Firefox set up to load new tabs in the background, Slogger can't automatically capture those background tabs (in fact, when you load a new background tab it will simply make another copy of the page in the active tab). I just configured Firefox to load new tabs in the foreground -- a bit of a change, but nothing I can't adapt to.

Second, although storage is certainly cheap, making copies of every single web page visited can still chew through hard drive space very quickly. Today has been a very light web surfing day for me, but Slogger has added about 105mb worth of files. I'd imagine on a typical day I'd be looking at 300-400mb of files. That ends up at about about 146 gigabytes/year. Since I only buy external drives these days, that's an annual storage cost of about $154 at today's hard drive prices. That's still less than $.50/day, as far as I'm concerned it's still incredibly cheap, but, as always, your milage may vary.

Discuss (3 Replies) | Printer Friendly | Permanent Link

Related Topics:




Saturday, August 21, 2004

Same Old Dave on Google

If Dave Winer didn't exist, someone would have to invent him. Dave's company, Userland, makes products so good at doing search that Winer uses Google for searching his own blog. Nonetheless, that doesn't stop Winer from not only criticizing Google for failing to implement non-trivial features, but goes on to suggest that Google is intentionally trying to destroy blogs (emphasis added),

It's very true that Google has failed to keep up with the "search engine optimization" tricks that cause links to porn sites to show up on our Referers pages and blog post comments. As we've said here several times, and thought many more, Google is the place where this practice should be stopped. It's because of Google that our sites are littered with links to these offensive sites that have nothing to do with ours. If they're smart enough to come up with tricks like Google News and Local Google, why can't their search engine recognize comment and referer spam and not use it in determining page rank? Of course they can. Why don't they? I'd love to hear an explanation. Better yet, I'd love to see them fix it. It's a bug in Google's software.

Maybe secretly Google really doesn't like blogs. Maybe it's not so secret. They still haven't deigned to support the standard format for syndication, as every other tech company and major publisher has. Why Google has a stake in breaking the standard is another puzzle. How does this relate to Don't Be Evil. We've asked this question a few times, only to be met with the usual Google stone wall.

When Google News first came out, Dave derided it as defective. Now it's so good, its evidence that Google really doesn't want to stop search engine optimization tactics.

I could go on about how Google usually get slammed by people, including Winer, when it tweaks its algorithms to try to deal with those trying to game the system, but the site of Dave complaining about a vendor being slow to fix a bug is simply too much to get past.

Discuss (9 Replies) | Printer Friendly | Permanent Link

Related Topics: Google, Dave Winer,




Thursday, August 19, 2004

DVD/DivX Player With USB Interface

I'm really surprised that IO DATA is the first company to come out with an obvious feature in a DVD player that also plays Windows Media, DiVX, etc. It has a USB 2.0 interface so you could load an external hard drive full of media, and then just plug-n-play. No worrying about configuring networks, installing special software on the machine that is going to serve the files, etc.

Unfortunately, this is a Japan-only release for now. Why doesn't somebody come out with a player like this for those of us in the U.S. I'd buy a couple.

Discuss (0 Replies) | Printer Friendly | Permanent Link

Related Topics:


Ted Kennedy Accidentally Placed on Wrong List

Apparently a clerical error led to Ted Kennedy being placed on the "No Fly" list. Sources report that he was supposed to be placed on the "No Drive" list.

Discuss ( Replies) | Printer Friendly | Permanent Link

Related Topics:


8/29/2004


My Other Weblogs

Other Recent Articles

PETA to Send Dog Excrement to Iams (AnimalRights.Net)

Great Britain Bans Vlasak (AnimalRights.Net)

Assistant Principal Charged with Sending Herself Threatening Letters (EquityFeminism.Com)

Portugal Tries Two Women and Their Midwife for Participating in Illegal Abortion (EquityFeminism.Com)

Cynthia McKinney Returns (LeftWatch.Com)

Gore Would Have Won and Moore Has Proof -- Someone Wrote a Letter-to-the-Editor Saying So! (LeftWatch.Com)

Journalists in Senegal Protest with Media Blackout (Overpopulation.Com)

Nigeria to Resume Polio Vaccination (Overpopulation.Com)

Ross Gelbspan's Pulitzer Prize (Skepticism.Net)

Anti-Vaccine Hysteria Grips Nigeria (Skepticism.Net)

Search


Site Managed with Conversant

 
Home Almanac Search Discussion Store About

© Copyright 1994-2003 by Brian Carnell. All rights reserved.