Welcome!

Cloud Event Processing - Analyze, Sense, Respond

Colin Clark

Subscribe to Colin Clark: eMailAlertsEmail Alerts
Get Colin Clark via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Top Stories by Colin Clark

Every year, I like to decompress a bit and take a break. Usually, I like to go scuba diving – the dive sites I like are usually far removed from email, Twitter, Facebook, etc. and it gives me a chance to actually unplug, defrag, and think a bit. This year, the family went to Grand Cayman to experience some of the world’s best diving. Within Grand Cayman is Hell, a small township dedicated to tourism and aptly named given the attached photo. We visited Hell in between dives, and rather than make my ex-wife room reservations or send out postcards, I thought I’d amplify a few predictions I’d made earlier after the benefit of some quality thinking time. So here they are: Cloud based services will finally hit Wall Street in 2011. It makes a lot of sense for firms to offer shared access to things like market data and to provide elastic resource for its manipulation. It d... (more)

Will The Real Marketing Department Please Stand Up?

Well, it would appear that Michael Stonebraker may have hung up his research hat and joined the marketing team. First, read this, “Will the Real Column Stores Please Stand Up?” And now read my reply, which Vertica has yet to approve on their blog. Mike, You’re describing an implementation, not an algorithm.  An analogy would be saying that anything that didn’t look like Hadoop wasn’t map/reduce. Column stores exist because disk is slow – not because they’re some new and magical way to store data.  As a researcher, you’re well aware of the fact that it is impossible to prove that a... (more)

Cloud Event Processing – Where For Art Thou oh CEP?

In a recent post, Louis Lovas of Progress Apama explains why the first generation CEP vendors don’t have many, if any, cloud deployments.  Here’s a quote from his post: Typical of event processing applications that do things are those in Capital Markets like algorthmic trading, pricing and market making. These applications perform some business function, often critcal in nature in their own right. Save connectivity to data sources and destinations, they are the key ingredient or the only ingredient to a business process.  In the algo world CEP systems tap into the firehose of da... (more)

Erlang, RabbitMQ, & Redis

VMWare has been on a buying spree lately. In the last month, they’ve announced both Redis and RabbitMQ. Here’s VMware’s take on Redis, and spring source’s on RabbitMQ.  RabbitMQ is built with Erlang. Much Rejoicing in the Village We use both of these technologies at Cloud Event Processing.  And we love Erlang too.  VMware’s acquisition of these technologies not only validates our decisions, which we are very selfishly pleased about, but also sends an interesting message. The Message Please Everyone’s busy abstracting resources in the cloud – making resources like compute, stora... (more)

Just When I Thought I Was Done… Bring on the Visualization!

“They pulled me back in.” – The God Father. I’ve received some interest/emails about TwitURL – our Map/Reduce as it applies to CEP (cloud event processing) project.  Seems that people would like to see the results of these processes visually.  Who can blame them, right?  So, I was thinking, how can I add a little sizzle to TwitURL? Panopticon Panopticon offers some pretty slick visualization capabilities – you can check them out here.  And based upon some feedback/requests, I’m going to hook up a heat map to the output of TwitURL.  The heat map will show which URL’s are the hott... (more)