Welcome!

Cloud Event Processing - Analyze, Sense, Respond

Colin Clark

Subscribe to Colin Clark: eMailAlertsEmail Alerts
Get Colin Clark via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Top Stories by Colin Clark

“They pulled me back in.” – The God Father. I’ve received some interest/emails about TwitURL – our Map/Reduce as it applies to CEP (cloud event processing) project.  Seems that people would like to see the results of these processes visually.  Who can blame them, right?  So, I was thinking, how can I add a little sizzle to TwitURL? Panopticon Panopticon offers some pretty slick visualization capabilities – you can check them out here.  And based upon some feedback/requests, I’m going to hook up a heat map to the output of TwitURL.  The heat map will show which URL’s are the hottest-the most tweeted URL over a given time frame.  Once we deploy TwitURL in the cloud, we’ll use this app to see what’s going on in there.  Here’s a picture of the heat map: ... (more)

CEP & RuleBots & OnRamps – Oh My!

I like Streambase’s announcement regarding their open source repository for CEP related stuff. And imitation is the sincerest form of flattery, so I thought I’d follow suit. In my glossary of terms, I deal with RuleBots and OnRamps. RuleBots RuleBots are pieces of code that subscribe to streams, do something of interest, and then put a result back on a stream. We’re releasing RuleBots with logic pertaining to Regulation NMS surveillance rules in the areas of: Trade Through, Unusual Activity, NBBO Calculator, Late Trading, Front Running, Wash Sales, Short Sales, Locked/Crossed, a... (more)

Why CEP in the Cloud Makes Sense

CEP isn’t really about low latency.  The ability to do things quickly is important, just as in any system – especially those systems that grow and need to handle a lot of information.  Doing things quickly means doing things efficiently.  And doing things efficiently means less money spent on hardware.  Theoretically anyway. SO WHAT IS REALLY COOL ABOUT CEP? CEP gives one the to submit queries like “select symbol, avg(shares) from trade_stream group by symbol over 5 minutes emit every 1 minute.”  The CEP engine would consume this query, and then start returning an average of sh... (more)

My Top Five Cloud Predictions for 2011: Colin Clark

Every year, I like to decompress a bit and take a break. Usually, I like to go scuba diving – the dive sites I like are usually far removed from email, Twitter, Facebook, etc. and it gives me a chance to actually unplug, defrag, and think a bit. This year, the family went to Grand Cayman to experience some of the world’s best diving. Within Grand Cayman is Hell, a small township dedicated to tourism and aptly named given the attached photo. We visited Hell in between dives, and rather than make my ex-wife room reservations or send out postcards, I thought I’d amplify a few predic... (more)

Erlang, RabbitMQ, & Redis

VMWare has been on a buying spree lately. In the last month, they’ve announced both Redis and RabbitMQ. Here’s VMware’s take on Redis, and spring source’s on RabbitMQ.  RabbitMQ is built with Erlang. Much Rejoicing in the Village We use both of these technologies at Cloud Event Processing.  And we love Erlang too.  VMware’s acquisition of these technologies not only validates our decisions, which we are very selfishly pleased about, but also sends an interesting message. The Message Please Everyone’s busy abstracting resources in the cloud – making resources like compute, stora... (more)