Showing posts with label Dropbox. Show all posts
Showing posts with label Dropbox. Show all posts

Friday, February 8, 2013

Bitcasa: Unlimited storage, version history & sync

bitcasa-sBitcasa has just emerged from “skunkworks” mode. The cloud storage startup made waves in 2011 as finalist at TechCrunch Disrupt and runner up at Startup Battlefield. They were Kickstarter financed and then went silent. Throughout 2012, there were no public bulletins, but some analysts noted that they filed for 20 patents--a few are really slick! Now, during Feb 2013, they have unveiled a cloud service with an edge over all others (SkyDrive, iDrive, Dropbox, Sugarsync, etc). In my opinion, only Symform and SpaceMonkey come close to the model that I described 3 years ago (search for ‘Ellery’ and ‘RDDC’).

Bitcasa gives every user folder sync, a timeline for version recovery, and cloud storage without limits. And, I really mean limitless! By the end of next month, I may be using petabytes, as in millions of gigabytes! The space available to me shows exabytes are still available.  That’s more than all the grains of sand on the world’s beaches and all the stars in the heavens. How much does this cost? Just $99 a year, or $49 if you sign up early this month. (Promo Code: BETATHANKS). WildDucks can help this Blog by using our referral link. It tacks a free month onto your editor’s subscription.

I can’t guarantee that Bitcasa will be around next year. After all, most startups fail. But in this case, I crafted a substantially identical network architecture years ago. I understand the business model. Even with a high fraction of data hogs, the venture can profitably service users for the long haul. If an understanding of the secret sauce isn’t sufficient to assuage hesitation, this interview with CEO Tony Gauda will floor you. He combines the technical and marketing genius of Steve Jobs with the showmanship of Siegfried and Roy, and the smile of Barak Obama

http://www.youtube.com/watch?v=3ImZWVxAQ_Q

Damon Michaels, a WildDuck contributor wrote:
Seems like a virtual drive. I need automatic backup of
my important data. I use Carbonite for this right now.

The folder-sync defaults to all drives in their entirety—even external drives and network attached storage! If you accept the default, it always backs up everything. But more importantly, Bitcasa reverses the model. As connectivity becomes more ubiquitous and speedy, they want you to use the cloud as your primary active storage. Eventually, it will even host your live EXE files (your apps) and your “bootable” OS. The synchronized copy on your PC will be the backup – as well as the one that is used when you cannot connect.

I proposed the fundamental principles used in Bitcasa architecture in this Blog, and 3 years ago in other articles. I called it a “Reverse Distributed Data Cloud” (RDDC). My spec adds distributed, P2P storage to the model. This reduces cost, creates redundancy, and makes a far more robust system. Not only does it get rid of the data center completely. With my model, it is unnecessary for the service provider to perform any backups. In effect, the live cloud is a RAID 10,000 constellation.

One architectural trade-off is the desire for massive de-duplication –vs– the compelling need for end-to-end encryption, in which only the individual users have the keys. These two features are incompatible. DropBox and Bitcasa claim that files are encrypted at the sender and that private keys are never given to the service. While technically true, that claim covers up a nasty little detail. They use a method called Convergent Encryption in which encryption keys are derived from a character string within the encrypted file. Although the service cannot decrypt a unique file (for example, your income taxes), they could compare a hash of your file to one provided by a government or alleged rights owner, thus proving that you have stored a copy of contested media. They could block access to movies and music that you have stored or even block your original upload. The good news is that with a full RDDC implementation, the need for de-duplication is greatly reduced or even eliminated. Therefore, a properly implemented RDDC can truly empower its uses with strong, end-to-end encryption.

I'll report more about Bitcasa after a few months of use. For now, I feel ratified to see my dream taking shape at several American ventures. If you find this field as fascinating as me, check out Symform, SpaceMonkey and Digital Lifeboat. That last venture is floundering, and may be bankrupt by the time you read this. But they have some very compelling technology for p2p, distributed storage.

Wednesday, November 16, 2011

Awash in cash, does Dropbox sense the undertow?

Dropbox CEO, Drew Houston, is about to facilitate a meaningful donation to his favorite cause, but he doesn’t know it yet. More about this in the last paragraph...

Dropbox is in an enviable position. The company is smokin! It’s so hot, that Forbes magazine calls it Tech’s Hottest Startup. So hot, that Steve Jobs tried to acquire it. So hot, that when anointed by the MacMeister with a personal audience, 28-year-old founder Drew Houston snubbed his proverbial nose at the offer. *

Dropbox: Atop it’s game...  But what about Future Shock?
What does Dropbox sell?
Dropbox sells cloud storage services, including backup, synchronization and file distribution. They are arguably king the market leader, but they have plenty of competition: Apple’s new iCloud, SugarSync, SkyDrive (Microsoft), LiveDrive, Google Docs, Box.net, FolderShare and a growing list of wannabees. Without getting into the nitty-gritty, let’s just say that if you’re not using Dropbox or a similar service now, you will do so soon.

What can cloud storage do for me?
You are probably familiar with Carbonite and Mozy. These vendors market clouds as safety nets, constantly backing up your PC over the internet, as you work. On the other hand, Google Docs makes collaboration easier and more efficient because users spread far apart can work on the same document at the same time – and without worrying about who has the latest version. These are all ancillary benefits of cloud computing at best. Since the concept is still in its infancy, they focus on a simple and easily digestible pitch.

But clouds offer much more! With data in the cloud, documents, photos and music are always available, backed up, in sync and safe – no matter where you travel or what gadget is handy. Files don’t depend on equipment that you own or carry, so you can travel light and with constant access to your business, media and memories. Much as predicted by Asimov in The Last Question, using a personal data cloud is like having your brain in ever-present hyperspace.

Dropbox is the convergence leader. What’s wrong with that?
When startups reach a phase that I call investor frenzy, founders and early investors inevitably get the “not invented here” bug, or the “we are obviously doing it right” bug. But smart directors swat away cocky bugs of success until the company reaches the profit phase and, of course, the ROI phase. They also keep a keen eye on competitors and even tiny startups to see if someone has come up with a startling new way to improve service, boost revenue or reduce expenses.

What’s new in cloud technology?
“What’s New” is a tectonic shift in technology from centralized, data center storage to distributed peer storage. It’s a dramatic architectural enhancement that I call Ellery’s Reverse Distributed Data cloud [RDDC]. While I can’t take the credit for all that is about to unfold, I was first to propose it three years ago. This past August, I blogged about the concept at AWildDuck.

RDDC changes dynamics of everything that matters in storage: cost, security and speed and even environmental impact – all in the right direction. As each user adds inexpensive storage to their own home or business network (the same drives that they previously used to store their working data or backups), a central “traffic cop” uses this worldwide, massively redundant, distributed storage network as if it were a “RAID-10,000” drive array. The Result: As long as 33% of users don’t turn off their storage devices at the same time, everyone’s data is available instantly, securely and without risk of errors or hacks.

Incredible? You Bet! Want more? Of course!
Consider the return data throughput. That’s the rate at which downloads from these many different storage drives arrive into your PC when restoring a backup or even when using a global cloud array as your main drive. You might think that spreading your data, bytewise across lots of slow uplinks would result in data recovery at a snail’s pace. You would be wrong. Even the programmers who understand the math are astounded at the RDT. Even if many drives in your personal cloud are heavily fragmented or poke along at the 3rd tier connection speed of a rural carrier, incoming throughput sizzles at blistering, heart-pounding speed. Why? Because inbound data is staged in the cloud as a torrent from a massively parallel cluster – and not as a serial stream from one peer.

There’s more. While all of this is happening the uplink channel is not idle. Your global cloud array dispatches data around the world with predictive caching, based on new research into the distribution of media across disparate platforms.

Should I Care?
While the architecture of remote storage may seem a geeky detail, the fallout is a litany of benefits to users and a massive windfall for the first provider’s to get with the program. They will enjoy a 90% reduction in operational expenses, while customers experience a blistering bump in speed and meaningful intangibles like fault tolerance associated with massive redundancy.

What vendors are rolling out this new technology?
Symform is already offering RDDC. SpaceMonkey has not yet announced, but it’s two founders in Salt Lake City (both from EMC) have an even more compelling model. They’re lining up investors now. They get it and the angels are starting to take notice!

These tiny startups and a few others have a big edge on their well-funded brethren, because they are already on top of RDDC. If the challenge is not rapidly met by Dropbox and SugarSync, the new kids will sweep the market.

What’s the risk to the established players? Will they catch up?
Cloud computing for the masses is rapidly becoming a crowded market. Massive consolidation will come in a year. Only a few companies will be left standing. Most of the names entering the market today, and even some established brands won’t survive nor even be acquired. They’ll just die. A few fortunate startups will cash out, because of their early implementation of RDDC. My bet is with cloud providers that move quickly into massively distributed data clouds. They will be healthy and profitable. If Dropbox gets it and moves quickly to seize the day, they will very likely come out on top.


[caption id="attachment_493" align="alignleft" width="236"] Drew Houston: In the catbird seat, but for how long?[/caption]

Does Drew know about RDDC?
He might. More likely, he considered it briefly and then dismissed it. Even a bright individual can overlook an elegant solution to an unrecognized problem. (i.e. reducing expenses dramatically while boosting data security).




It’s a safe bet that Carbonite and Mozy can’t implement RDDC in time to save their hides. One is too narrowly focused on marketing themselves as a backup service and the other is married to data centers that they own.





Perhaps Dropbox “gets it” and needs no input from their biggest fan. But perhaps – just perhaps mind you – they have yet to design a fully holographic RAID-10K algorithm. Perhaps they have not yet optimized predictive caching for peer distributed networks. Perhaps they are not equipped to quickly build a torrent reacquisition mechanism on the fly and activate it safely across thousands of peers with disparate upload and download speeds, while each user powers down storage media every day without notice.

What’s the ‘R’ stand for in “RDDC”?
It stands for “Reverse”. This teaser lacks an explanation by design. If Drew or his deputies at Dropbox contact me, I wish to give them an edge. It’s one of the few aspects of an ideal architecture model that has not yet been exploited by any startup.

If Dropbox knows about RDDC, what is the purpose of this blog?
Finally an easy question! Drew Houston may or may not be contemplating a Dropbox implementation of RDDC. But even if he is shoe-horning it into his ops plan right now, the purpose of this Blog is to get his attention. Dropbox understands the business of cloud computing. Yours truly understands the seismic benefits of Reverse Distributed Data Clouds and has the business and engineering experience to jump start a rapidly growing market leader. Your humble editor is itching to help a cloud sync startup beat Apple, Google, EMC and Amazon and dominate the market before the average Joe adopts RDDC from your daddy’s generation.





Tech & investment communities know Ellery by another name
I have never kept it a secret that Ellery is a pen name. I use it here at AWildDuck and for articles that I freelance to Google, c|net, Engadget, Yahoo & Amazon. My general vitae is posted to this blog and of course, Drew Houston will get all of my contact info.




Got your ears on, Drew? I get it. Years ago, I created the blueprint. I tested architectural dynamics before your competitors got off the ground. Together, we can dramatically reduce costs while creating the most robust swarm on earth. Together, we can sew up a new paradigm before others learn to tie their shoes. Reach to me, Drew. I’ll give 5 hours to your favorite cause for 5 minutes of your time. Nothing to lose and either way, you gain! Your move.




* To be fair, Drew admits that Jobs is his idol and a scion of high tech entrepreneurship!