Content feed Comments Feed

Online Storage Optimization

Exploring Next Generation Storage Solutions

Archive for November, 2009

Dedupe Deep Dive - Video

Posted by Sunshine On November - 25 - 2009

Lots of special treats awaited the participants of Gestalt IT Tech Field Day. While visiting the offices on November 13 Goutham Rao, CTO of Ocarina Networks stood at the whiteboard and offered a deep dive into the technology behind the company. It was a big hit with the participants. For those who would like a peek under the covers to discover what content-aware dedupe and compression entail, this video is quite a find. Thanks to Simon Seagrave at TechHead for allowing us to repost this video, which he took during the event. We hope you enjoy it.

Ocarina Networks - De-duplication & Compression Deep Dive from Simon Seagrave on Vimeo.

For the entire library of Tech Field Day videos, go to this Vimeo page.

Drobo Mania

Posted by Sunshine On November - 23 - 2009

Drobo maker Data Robotics has a major announcement out today that has the storage blog-o-tweet-osphere all atwitter. It has introed two new products, Drobo S and DroboElite. These new models add new functionality to the popular desktop, SOHO and single server SMB storage, making them faster, easier and more failproof. With the new Elite, they’re extending into the hot SMB storage market. We at Tech Field Day got a sneak peek on November 13. The new Drobos were literally unveiled–a black cloth pulled off to reveal the sleek black boxes beneath. To all of the attendees’ credit, no one broke the embargo. (This bodes well for future Tech Field Days–and I’m told a new one is already in the works.)

Today, the pressure was released and everyone has a chance to talk about the announcement. First out of the gate of the Gestalt IT/Tech Field Day crew, Devang Panchigar on his StorageNerve blog with a post that offers a comprehensive summary of the tech, plus a great video with a killer soundtrack. Next up was Stephen Foskett with a Willie Wonka comparison t0 make. He points out that one of the best new features of the Drobo S is its dual-drive protection. As we discovered at Drobo’s offices, both the Drobo S and DroboElite have built-in “self-healing” functionality. In fact, we were encouraged to fail a drive so that we could see it in action. That was fun!

Data Robotics’ BeyondRAID has birthed a new era. At a time when everyone–even personal home users–are facing an onslaught of rich media  such as video and photos, more and more people are seeking a simple, yet reliable way to safely store their data. Prosumers such as professional photographers are already fans of the Drobo–I have no doubt they’ll be interested in the Drobo S with its eSATA connectivity and better performance. The DroboElite is an SMB level offering, with iSCSI SAN support and the potential to expand into virtualized architectures. This is a major departure for the more prosumer-focused company.

I see the Elite catapulting Data Robotics to a new category–something its shareholders should be applauding. It is reaching well beyond the corner it seemed painted into in the past. scooterAnd Data Robotics should also be congratulated for coming up with such a memorable product name. I don’t know about you, but when I hear “Drobo” I keep thinking it must be some less-famous member of the Muppets. Scooter the assistant’s assistant, perhaps? (And you know he’d need someone to store all the great jokes and songs.)

Here are some other recommended pieces of reading about the new Drobos:

Louis Gray - By Thinking Small, Data Robotics’ Success Looking Big

The Register - Chris Mellor: Drobo restrings boxes to double-up product range
ZDNet - Andrew Nusca: Data Robotics debuts enterprise-ready DroboElite, five-bay Drobo S

Slashgear - Data Robotics unveil new Drobo S and DroboElite backup systems

Network Computing - Howard Marks Drobo Elite - Ready for the Server Room if not for the Data Center

We’ll be watching this company and space!

Pop a Dedupe Cork

Posted by Sunshine On November - 18 - 2009

champagne-flowers

Seems New Year’s is coming early this year. Across the pond in the UK, Ocarina and our partner BlueArc have decided to hand out bottles of bubbly to all and sundry. In short, anyone suffering from a storage hangover–that is, any company that is saddled with more than 20 TB of unstructured data–is eligible for a free bottle of champagne. Talk about the hair of the dog.

The bottle giveaway started last week, and runs through the end of November. It’s open to any companies across EMEA. Here are the basics: send us a sample data set, and we’ll dedupe and compress it by 30-80%, losslessly of course. If we fail, we’ll give you the bottle anyway. (The one thing we don’t accept are cryptologists trying to game the system. This should be a sample data set representative of your company’s main storage repository.) So it’s kind of a no lose situation, unless of course you don’t like champers. If that’s the case, just send the bottle on to this blogger, and she’ll be sure to give it to the needy. (That is, her friends and a few others she’s inviting over for brunch.)

We’re not talking about the cheap stuff here, either. I checked with the team in London, and have been told that it will be Taittinger or better quality.

So, why the sparkly stuff and not, say, a Starbucks gift certificate or some silly piece of shwagola? Because, say our UK marketing team, too much data shouldn’t be a source of misery. It can even (gasp!) be something to celebrate, if you’re equipped with the right tools. In this case, this is a combo of the BlueArc Mercury or Titan and the Ocarina ECOsystem for advanced dedupe and compression. Roll these two together, and you’ve got a delicious mimosa of a storage drink. Slainte!

Here’s how to win: Send an email with “FestiveGiveAway” in the reference line to: ukinfo (AT) ocarinanetworks.com or ukinfo (AT) bluearc.com. EMEA-based companies only, please.

Tech Field Day - Video

Posted by Sunshine On November - 16 - 2009

Tech Field Day may be over, but it lives on in digital form–scattered like so many tiny shreds of confetti across the interwebs. One of the delegates at the event, Rod Haywood, put together this video on his Musings of Rodos blog about Day 2 of the event, featuring interviews with Ocarina’s own Goutham Rao, plus Peter Pistek of Nirvanix, W. Curtis Preston of Truth in IT, and Jim Sherhart of Data Robotics.  Rod was kind enough to allow me to repost it, and so here it is for your viewing pleasure:

Gestalt IT Field Day 2 from Rodney Haywood on Vimeo.

Tech Field Day - The Home Stretch

Posted by Sunshine On November - 13 - 2009

It really has been a field day the last day and a half here in Silicon Valley. We’re in the final stretch of the Gestalt IT sponsored Tech Field Day, which brings together independent bloggers from around the globe for hands-on demos at Silicon Valley storage and virtualization companies.

The participants are some of the smartest and most influential in their fields (see the full list here). They haven’t spared the presenting companies–lobbing difficult questions and putting their opinions out on Twitter. For those who survived the drubbing, it’s been celebratory. We’ve all been following the conversation on the #TechFieldDay hashtag.

The morning here at Ocarina was a blast. Co-presenter and partner Nirvanix announced its upcoming CloudNAS 2.0–due out November 20. And our “bring out your data” challenge yielded two winners, and our average compression rates with these tougher than tough data sets was impressive. (A whole new post on this to come soon.) On Twitter, folks were raving about the whiteboard session on compression and dedupe by our CTO, Goutham Rao. As Devang Panchigar, known to many of us as @Storagenerve summed it up: “Rest of the presenters at #techfieldday, please be ready for deepdive sessions, ppl are loving it need tech not marketing.”

And we must apologize for the arctic conditions at the front of the room nearest the servers. Lots of tweets about using laptops as heaters and renting jackets. Guess that air conditioning works just a little too well!

Here are the posts I’ve seen so far on the event–no doubt there will be more.

First of all, Rick Vanover has been busy!

**Update** One more post from Rick: Day 2 recap of Tech Field Day

Within minutes of leaving Ocarina (or perhaps while still there) he posted this on Tech Republic: Storage-based compression and deduplication overview. Plus all these are also up:

TechRepublic - Storage in the cloud: Availability and SLAs

Rick Vanover’s Blog - Field Day Recap of Activities

Virtualization Review - Every Day Virtualization: Quick Thoughts on Virtualized I/O

Rick Vanover’s Blog - Gestalt IT Tech Field Day: Here we go!

Others:

Live blogging has been going on nonstop on John Obeto’s Absolutely Windows blog.

Musings of Rodos - Three days of posts:

Gestalt IT Field Days 2009 Day 1

And … Day 2
Featuring a video interview with Goutham Rao, CTO of Ocarina Networks, whose whiteboard presentation was a deep dive into the technology behind our compression and dedupe solution.

And now … Summary post: Gestalt IT Field Days 2009

Carlo Costanz0 - VMWare Info Tech Field Day

Rich Brambley - Gestalt IT Tech Field Day: Day 2 With a lovely picture of Mike Wilson, test architect at Ocarina running the compression of the participants’ data sets.

Marc Farley - StorageRap - Boy, the Gestalt IT Tech Field Day yesterday sure was fun This post includes a video featuring this blogger and Mr. Farley going on a mission for organizer Stephen Foskett.

Looking forward to seeing what else comes out. What a truly joyous and interesting event!

Tech Field Day Cometh

Posted by Sunshine On November - 11 - 2009

gestalt-it-field-day-logoExcitement is building here at Ocarina as tomorrow is the big kickoff for Tech Field Day, and we’re a presenting sponsor of the event. As we speak, cables are being laid, demos are being run through, and a certain amount of nervous excitement is in the air.

In just two short days, a horde of smart, savvy bloggers will descend on the Ocarina offices on Airport Parkway in San Jose, bearing thumb drives packed with their toughest data sets–part of a challenge we laid down in order to show them how well we can compress and dedupe that data.

visigoths_and_ostrogoths1

Sponsored by online IT pub Gestalt IT, the next two days are sure to be worth watching even if you’re not directly involved. Tech Field Day seems to me to represent a new kind of experimentation with social media in both its on- and offline form. The event brings together influential bloggers and others from around the world for two days of hands-on demos at storage and virtualization companies around Silicon Valley. As I mentioned on the VMWare Communities Roundtable today, this group of presenting sponsors represent Silicon Valley at its innovative best. And the fact that they were quickly able to recognize the value of such an event is a further testament to their forward thinking.

The chatter on blogs and Twitter in the weeks leading up to this event has been intense, which makes it even more exciting to be a part of. So, what the heck is this Tech Field Day that everyone’s talking about? It’s a fairly simple concept. Gather a group of the leading independent bloggers in IT, storage, virtualization and related fields and take them to companies around Silicon Valley for a deep dive on some cutting edge technology they may not yet know a whole lot about. No slick marketing presentations, no PR. Just plain, straightforward geeking out. Gestalt IT’s founder/publisher Stephen Foskett has said he plans future events as well, and they will encompass other areas of high tech.

Social media made this thing possible, and it’s making it easy to follow as well. Here are some of the ways to get in on the fun:

Twitter: Hashtag #TechFieldDay

FriendFeed

Or, The Official Tech Field Day Scoreboard, which aggregates all of the posts *and* tweets about the event in real time.

See you there!

Ocarina Named one of Top 10 Networking Companies

Posted by Murli Thirumale On November - 10 - 2009

We were pleased to receive word this week that SiliconIndia Magazine named Ocarina Networks one of its Top 10 Networking Companies, and one of its Top 100 Companies for 2009. The publication’s annual  “si100″ is a listing of the top 100 technology companies founded and managed by Indians in the U.S. According to the magazine, the winners were chosen by a panel of leading Indian CEO’s & CIO’s of public companies, VC’s, analysts, founders of other VC funded companies, along with the SiliconIndia editorial board.

What is particularly gratifying about this is that we didn’t know it was coming. We have no particular connection to or involvement with this publication–which to me means we were chosen on our own merit. A look at the other winners shows that we’re among some very innovative Valley companies, such as FatPipe Networks, which uses router clustering to enable faster Internet/WAN connections, and photonics device maker Alphion, among with many others. As someone who arrived in the U.S. seeking to contribute something of worth, I feel I’m in very good company with these fellow Indian entrepreneurs who have also made their homes here.

The timing could not be better. This Friday, we’ll be hosting a group of influential bloggers for Tech Field Day, an event sponsored by an online publication, Gestalt IT. This is an opportunity for us to provide hands-on demonstrations to a group of in-the-know technologists. We’re looking forward to giving them a chance to witness, in real time, our compression and deduplication solution, the Ocarina ECOsystem. We’ve challenged them to bring us their toughest data set to see how well we do. They’ll also get a chance to see how it integrates with an number of vendors’ storage, and will be testing it out themselves in demonstrations. In all, we expect a lively and thought-provoking discussion.

Going Up - Way, Way Up

Posted by Sunshine On November - 5 - 2009

glass-elevator

The space elevator dreamt of by Arthur C. Clarke (not to mention Roald Dahl) is becoming a reality. Well, sort of. NASA has announced the first successful climb by a laser-powered robot–one step closer to the dream of being able to lift objects directly into space.

As Tech Generation Daily reports, a winner was announced today–some very hard-core geeks at a place called LaserMotive have beaten all previous records by using a high powed laser array. Even more cool, they are using solar cells to power the motor.

As one commenter pointed out, Clarke popularized the idea of a space elevator, but in fact the idea was first proposed by one Konstantin Tsiolkovsky, a Russian rocket scientist, in — get this! –1895. One question: will there be a ladies apparel department on Mars when we arrive there? And if so, will we need special lead Manolo Blahniks?

Bring Out Your Data - The Deets

Posted by Sunshine On November - 4 - 2009

Lots of speculation this past week in the storage tweet-o-blog-0sphere around our “Bring Out Your Data” Challenge for Tech Field Day. We can’t wait to see what these smart and savvy participants bring us, and we’re confident about the results. There will be prizes awarded for those who stymie us and those who get the greatest reduction. This morning, we sent out a brief email giving a few more details about it. In the spirit of transparency, here is what we sent to the attendees:

Dear Tech Field Day attendee,

Ocarina Networks has issued a challenge to you for Tech Field Day: bring out your data. In brief, we’re asking you to arrive on November 13 at our offices with a thumb drive containing your toughest data set. We will compress and dedupe that data for you right in front of your eyes. This will be a chance for you to see the Ocarina ECOsystem in action so that you can assess data reduction and performance for yourself in real time.

Here are a few guidelines.

1. Try to keep it under 2 GB. This is to ensure that as many participants as possible have an opportunity to shrink their data during the four-hour time period you will be at the Ocarina offices.

2. If you would like to see both deduplication and compression, we recommend that you bring data that includes duplicates. In other words, one 2GB file is not going to be deduplicatable, but several different files that have shared objects will show much more interesting results. If you’re only interested in seeing our compression capabilities, then this isn’t necessary, but please keep in mind that the results you get in that case won’t reflect the deduplication feature.

3. Give us a mix of files from your local hard drive.

4. Label your stick. Put your name somewhere on the physical thumb drive. Also, give the directory your own first and last name.

A final note: we will return your flash drive to you at the end of the day, but please don’t bring us a sole copy of an important piece of data, as we may return it to you with the data in a compressed format.

Thanks for you participation in Tech Field Day, and we look forward to meeting you next week!

Best wishes,

The Ocarina Social Media Team

Carter George, Mike Davis, Sunshine Mugrabi, and Helen Miller-Montana

Going Native CIFS

Posted by Ocarina On November - 2 - 2009

A recent comment on this blog got me thinking, and this post is the result. The commenter, who identified him or herself only as “Sto Rage” asked: “When can we expect native CIFS support on the Ocarina platforms? The current implementation is outright clunky. So until you have a working CIFS implementation, I don’t think you can compete with NetApp. You may get better compression results, but it works only for NFS data.”

It’s a good point to raise–although I disagree with the “clunky” characterization. But as to the CIFS issue, I wish the answer was as simple as “it’s in the next release,” but this is actually one of the more complex and interesting topics in storage. So hold on to your hats, I’m going to go through Ocarina and CIFS in some detail.

Here’s the short answer: We give you native CIFS support on EMC, BlueArc, HDS, and HP.
Several more NAS vendors will be putting “Ocarina Inside” soon. We give you native CIFS support if you can use our Native Format Optimization. For those customers who use our appliance as a CIFS proxy, we provide good but not perfect CIFS support today, with a roadmap of continual improvement, including the possibility of a native CIFS stack inside the appliance in the first half of next year.

Here’s the longer and more detailed answer.

Ocarina can be deployed in one of three ways:

“Ocarina Inside”: Ocarina is embedded inside or alongside a NAS vendor’s solution.
Ocarina Appliance: A split-band appliance
Ocarina Native Format Optimization (NFO): files are optimized in their native format

Each one of these deployment options has different implications for the CIFS client.

In the “Ocarina Inside” case, the NAS vendor handles all the protocol stacks, and the client gets the full, rich native CIFS implementation of each vendor. Ocarina only uses dedupe or compress for the data stream.  We are not involved in the protocol traffic at all.  Examples of “Ocarina Inside” are EMC Celerra, HP Enterprise NAS, BlueArc, and HDS HNAS.  Additional “Ocarina Inside” partners will be announced soon. This is the best form of integration, because it makes deduplication and compression completely transparent to users and applications, and lets each storage vendor deliver all their full value-add, including in the CIFS protocol stack.

In the Ocarina Appliance case, Ocarina’s optimization happens out of the customer data path, but in order to expand files to their original state upon user access, the Ocarina intercepts read requests in-band. If an I/O (over CIFS or NFS) is to an Ocarina-optimized file, we step in, rehydrate the file, and pass it on to the user. This involves being a proxy for NFS and CIFS (and other protocols including WebDAV and http).   It’s fairly easy to be a proxy for NFS and http, but CIFS is more challenging. Ocarina has done a lot of infrastructure work to ensure that we preserve all of the Windows file attributes necessary for good CIFS integration – ACL’s, Extended Attributes, Alternate Data Streams, Windows share modes and oplocks, etc.

However, we have not written our own CIFS protocol, so our Windows semantic completeness is only as good as the protocol implementation that we sit on. On the appliance, today, that is Samba. Samba has improved a great deal over the last few years, but it is still not a “native” implementation of CIFS. While many storage vendors use variants of Samba for their CIFS stack, it is admittedly not as rich as, say, CIFS on Windows (the only true native CIFS) or CIFS on NetApp.

Ocarina has multiple customers who have implemented Ocarina using both NFS and CIFS on our appliance, and while there may be corner cases where it’s just not as good as the richest CIFS implementations, it’s not “outright clunky” either. There is room for improvement, though, and this is an area of primary focus for our next set of releases. It’s probably a topic for an entirely separate post, but there is a lot going on in the CIFS world these days, and we see some pretty exciting opportunities emerging in this space.

The third case is “Native Format Optimization.” This is a special use of Ocarina where we take certain rich media file types – photos, images and video – and compress them in a special way. What we do is compress them, but have the output be a new, smaller file but in the same native format it started out in. We’ll take a JPEG photo, compress it, and produce as output another perfectly formed JPEG photo….just smaller. The same is true for example for Flash videos. Now in this case, there is no need for a decompressor or for Ocarina to be in the read path or on the protocol at all. We can read files from your NetApp, shrink them, write them back on to your NetApp and Ocarina need not be involved at all when users or applications go to access those files.

In fact, we have a major Fortune 100 company who uses our technology on a large farm of NetApp filers in just this way. In this case, users access the files over all the native protocols that the NetApp supports, including NFS, “native” CIFS, and dual protocol support (NFS and CIFS at the same time). NFO only applies to certain file types, and so it is not the right fit for every data set. However, it is worth pointing out that one of the complaints you see about other deduplication and compression solutions for primary storage is that you save space at the cost of slowing performance down. With NFO, since there is NO decompression, just a smaller file in its original native format, performance is actually and always better.  There are simply fewer bytes to read off disk, fewer bytes to move over a network and no extra hop or decompression step to go through.  It’s a fantastic solution for customers with lots of image, photo, or video data, and it works with all native CIFS implementations.

So there you have it. CIFS support in more detail than you probably ever dreamed or imagined. We look forward to your further comments.