I recently had a chance to talk to Chris Marino, CEO and co-founder, of SnapLogic about his company's approach to Internet-scale, data integration. The SnapLogic team as a whole has significant experience and credentials within the two areas they aim to bring together, namely Internet-infrastructure and data integration. This is important, as throwing open source at a problem is different from coupling the benefits of an open source model with practical industry experience. Accordingly, during the talk and presentation they were able to portray a good understanding of the dynamics [shortcomings, opportunities for innovation/disruption] of the integration space.
Data integration + open source
A background for SnapLogic includes an overview of the current state of integration. Presently, commercial integration solutions are primarily designed for client-server applications while minimally addressing the bulk of problems which don't warrant a $10,000+ price tag (more on that later). As a result, there has been a preponderance of hand coded solutions put into place to close this gap. However, neither are well suited to scale in meeting what has been an explosion in data, service endpoints and the like, outside the firewall.
Since Matt Asay already posted a good synopsis of how SnapLogic is positioned to meet this demand using open source, I'll shy away from re-wording the information provided there. Nevertheless, it suffices to say that SnapLogic intends to offer a solution which reduces the inherent complexity of integration efforts by introducing standards-based consistency, using the concept of a data integration network. As illustrated below:
The SnapLogic bubble, portrayed in diagram's center, is the aforementioned integration network. It replaces the tangled [and expensive] mass that connector-based offerings from vendors like Tibco, Informatica, WebMethods, and IBM create when they are stretched beyond the limits of client-server architectures. SnapLogic offers an open source, full-featured option that outflanks the labors of hand coding and out-scales inflexible, costly commercial solutions. Simply put, bigger vendors just aren't positioned to meet this part of the demand curve when their entire business models and product suites have molded themselves almost exclusively to its higher end.
This has effectively created a vacuum with substantial room for SnapLogic to step into what could be close to a $19 billion data integration space by 2008 (according to IDC estimates), and deliver some well-heeled, innovation-driven disruption. As time passes, a squeeze on proprietary incumbents will most likely occur at the hands of a gathering momentum along a "long-tail." Thereby, resulting in an increasingly tighter segment in which the aforementioned market leaders will have to compete with each other...as room for growth and expansion down the tail will be progressively non-existent.
A new wave of open source innovation
From a larger, long-term perspective SnapLogic represents the next step in the evolution of the open source. In its earliest stages and up until today, open source has been pigeonholed solely as a source of less-expensive alternatives. Even today, there is a tendency to view it as more of a reactionary response to proprietary price and inflexibility pressures within a given market [see early stage Linux, MySQL]. Yet, as is evident with SnapLogic, open source is also a burgeoning source of and context for innovation.
During my talk with SnapLogic it became clear that it could have just as easily taken the proprietary road seeing how they:
- Are introducing an entirely new approach.
- Compete in an established market with ongoing growth potential.
- Are targeting an underserved market segment with a standards based approach.
- Have a working product with an experienced team behind it.
Consequently, it's nowhere near a stretch to visualize them as a closed source start-up capable of drumming up interest in a potential series A round of investment from the VC community. In more ways than one, an open source model is SnapLogic's by the choosing as opposed to out of raw necessity. The company can exist/compete without it, but has realized that the proprietary model is fundamentally broken and has adjusted accordingly. Even more telling is the SnapLogic team's focus on establishing community infrastructure around the project from the jump, an indication of a comprehension of the concept that community drives dollars.
Additionally, a fully open source development model co-joined with a commitment to open processes encourages the community to create, share and modify adapters. The net effective of which, will end up benefiting SnapLogic as a platform for innovation, as much as any core product feature set. Fellow open source operation, Jitterbit has experienced continuous success by encouraging a similar process of give-back/sharing of not just source code but also domain-specific components. So the model definitely has its merits as a productive fuel for the growth of an open source community.
Where things stand
It will be interesting to observe how similarly positioned open source products from the likes of Jitterbit, MuleSource and Talend are going to respond to SnapLogic's entrance, especially considering the company's potential for strong product differentiation (Internet-scale, data integration networks) and structurally sound approach to growth (community-centric approach). Either way, open source is well equipped to begin a collective push across the data integration landscape with solutions for EAI, ETL and more. If nothing else, it is an area definitely worth keeping an eye on.
Thanks for the kind words. There seems to be ample room in this space for different approaches because the problem is so large. Messaging routing, data services, SOA all will benefit from open source.
Posted by: Chris Marino | April 19, 2007 at 04:14 PM
you might want to go back and compare with Grand Central- which had similar ambitions and goals but didn't pull it off.
Posted by: James Governor | April 20, 2007 at 04:06 AM
James, you're not the first person to make this comparison. Grand Central tried to do way too much, way too early. Their vision of a Web Services Network sounds similar to a Data Integration Network, but they are actually quite different. A Data Integration Network provides data services not transaction services. Grand Central's vision was to become a central hub for Web Services with complexity of SOAP/WSDL/etc. They even had their own UDDI registry. That's not even close to what we are suggesting with SnapLogic.
Posted by: Chris Marino | April 20, 2007 at 01:13 PM
One more thing. It's not 100% clear from Alex's post here, so I'll say it explicitly. SnapLogic is not a hosted service. It's software that you download and run on your own premises and configure anyway you like. The diagram might indicate a shared infrastructure (like Grand Central's), but that is not the case at all. With SnapLogic, the software can run anywhere. On a dedicated servers or on the endpoints, or any combination of the two. The transformation logic can be partitioned across any of the instances. Collectively they become a Data Integration Network.
Posted by: Chris Marino | April 20, 2007 at 01:51 PM
As SOA moves from the domain of the early adopter/industry leaders into the mainstream, open source is going to increasingly be employed therein as both a cost effective replacement for proprietary products as well as a driver of flexible, open, standards-based components which aid security from an SOA perspective.
Jeans Clothing Store Online
Posted by: buy jeans | October 17, 2010 at 04:58 PM
i am just a little surprising for your mind.
Posted by: workout dvd | December 27, 2010 at 10:07 PM
It sounds well for this paper.
Posted by: ugg adirondack boot | December 27, 2010 at 10:09 PM
Thanks for your insight for the great written piece. I am glad I have taken the time to read this.
Posted by: Where to spend time | January 15, 2011 at 10:25 AM
we are just confused with the idea.
Posted by: true religion jeans | March 22, 2011 at 06:50 PM
he let someone bit on that.
Posted by: oakley sunglasses | March 22, 2011 at 06:52 PM
In case you have dreams of a single day operating your individual kitchen, a job as a kitchen helper may well be a splendid stepping stone.
Posted by: Buy Ysl Tribute Shoes | March 29, 2011 at 07:32 PM
Hello, i would like to read more information about this topic because i think that is very interesting
Posted by: Inversiones en oro | May 13, 2011 at 09:07 AM
Our company supply all kind of fake oakley sunglasses, Oakley sunglasses now has been recognized as one of the most coveted. They are famous for exceptional top quality technologies and a innovative range of sunglasses. But referring to the original one, the price is very high, some of us can not afford it, so cheap oakleys are you the best choice. We have been in knock off oakley sunglasses wholesale for 6 years, we always offer excellent quality and cheapest oakley sunglasses. Compare to original one, all the cheap oakley sunglasses have the same amazing style and quality as original, so there is a big market for our cheap oakley sunglasses. fake Oakleys are the best seller in our factory. If u want to make your life more colorful, cheap replica oakley sunglasses are your best choice. in our company, sale all kind of brand sunglasses, the (brand) sunglasses AAA is the best sunglasses. Basically with quality goods almost, and you can get them in discounted, all cheap oakleys, oakley replica, discount oakleys, fake oakleys sale are hight quality, free shipping if you order over $100. Please enjoy our fake oakleys site.
Posted by: cheap oakleys | May 28, 2011 at 01:20 AM
These information helps me consider some useful things, keep up the good work.
Posted by: jordan 11 | June 09, 2011 at 07:31 PM
advertising affordable auto insurance low cost auto insurance
Posted by: affordable car insurance | July 07, 2011 at 01:03 AM
It seems that you've put a good amount of effort into your article and I want a lot more of these on the World Wide Web these days. I truly got a kick out of your post. I do not have a bunch to to say in reply, I only wanted to register to say fantastic work.
Posted by: P90x Workout | July 22, 2011 at 12:21 AM
I am very thank you to share this article with me.it’s very good,I hope you can share more.Thanks!
Posted by: nike air max tn | August 04, 2011 at 12:12 AM
It is very interestin and important article.It is very helpful for me.I think more people will agree with your idea.
Posted by: timberland chukka | August 05, 2011 at 01:12 PM
Liked you on Facebook, too. =)
Posted by: supra vaider shoes | September 28, 2011 at 08:05 AM
About half the states regulate local, or intrastate movers.
Posted by: Long Distance Movers | October 26, 2011 at 10:31 AM
I recently came across your blog and have been reading along. I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often.
Posted by: moncler shop | November 20, 2011 at 12:04 AM