Welcome!

Cloud Event Processing - Analyze, Sense, Respond

Colin Clark

Subscribe to Colin Clark: eMailAlertsEmail Alerts
Get Colin Clark via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Top Stories by Colin Clark

I like Streambase’s announcement regarding their open source repository for CEP related stuff. And imitation is the sincerest form of flattery, so I thought I’d follow suit. In my glossary of terms, I deal with RuleBots and OnRamps. RuleBots RuleBots are pieces of code that subscribe to streams, do something of interest, and then put a result back on a stream. We’re releasing RuleBots with logic pertaining to Regulation NMS surveillance rules in the areas of: Trade Through, Unusual Activity, NBBO Calculator, Late Trading, Front Running, Wash Sales, Short Sales, Locked/Crossed, and Marking the Close. OnRamps Like the Twitter OnRamp we’ve been using in our Twityourl project, OnRamps take data from various sources and inject that data into the stream processing system. We’re releasing OnRamps for both listed and otc quotes and trades. Where? We’ll be publishing the d... (more)

Why CEP in the Cloud Makes Sense

CEP isn’t really about low latency.  The ability to do things quickly is important, just as in any system – especially those systems that grow and need to handle a lot of information.  Doing things quickly means doing things efficiently.  And doing things efficiently means less money spent on hardware.  Theoretically anyway. SO WHAT IS REALLY COOL ABOUT CEP? CEP gives one the to submit queries like “select symbol, avg(shares) from trade_stream group by symbol over 5 minutes emit every 1 minute.”  The CEP engine would consume this query, and then start returning an average of sh... (more)

Event Processing in the Cloud – DataSift is a Big Proof Point

In the past year or so, I’ve heard from many skeptics – people who didn’t believe that Event Processing could be successfully deployed in the cloud.  Granted, most of these folks represented firms actively engaged in providing the High Frequency Trading (Algo Trading) industry with tools.  And in that arena, cloud deployment probably doesn’t make sense.  Yet. Close to Home Though Ask people in Capital Markets about Twitter and the most common response you’ll get is, “What do people use it for?”  This is because most of the people in Capital Markets can’t use things like Twitter, i... (more)

Will The Real Marketing Department Please Stand Up?

Well, it would appear that Michael Stonebraker may have hung up his research hat and joined the marketing team. First, read this, “Will the Real Column Stores Please Stand Up?” And now read my reply, which Vertica has yet to approve on their blog. Mike, You’re describing an implementation, not an algorithm.  An analogy would be saying that anything that didn’t look like Hadoop wasn’t map/reduce. Column stores exist because disk is slow – not because they’re some new and magical way to store data.  As a researcher, you’re well aware of the fact that it is impossible to prove that a... (more)

My Top Five Cloud Predictions for 2011: Colin Clark

Every year, I like to decompress a bit and take a break. Usually, I like to go scuba diving – the dive sites I like are usually far removed from email, Twitter, Facebook, etc. and it gives me a chance to actually unplug, defrag, and think a bit. This year, the family went to Grand Cayman to experience some of the world’s best diving. Within Grand Cayman is Hell, a small township dedicated to tourism and aptly named given the attached photo. We visited Hell in between dives, and rather than make my ex-wife room reservations or send out postcards, I thought I’d amplify a few predic... (more)