Welcome!

Cloud Event Processing - Analyze, Sense, Respond

Colin Clark

Subscribe to Colin Clark: eMailAlertsEmail Alerts
Get Colin Clark via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Top Stories by Colin Clark

Cloud Expo on Ulitzer I was speaking with a company last week that would like to get into cloud event processing.  For the sake of discussion, I’m going to define ‘cloud’ as the ability to dynamically, and upon demand, use more or less compute, storage, or network capacity. This is often referred to as ‘elasticity.’  I’m also going to add a few other requirements; this cloud must be able to: Host operations for a number of customers, all accessing the same data, but in different ways, Provide access to a lot of big data (see #3 – it’s all stored too), Able to handle messages rates approach 1MM per second (yes, that’s a million messages per second), Do something with those messages before storing them (in fact, we’re not even worried about storing them), And while we’re doing something with those messages, relate them to previously stored messages. Cloud Event Proc... (more)

Twitter, DarkStar & Telescope – Delivering Sentiment to an Equities Broker

Cloud Event Processing has moved off the white board and into the real world of, ‘hey, we’ve got customers!’ Twitter When building a system like DarkStar, one can always run into difficulties – how does one demo a cloud based, distributed event processing system incorporating streaming map/reduce, complex event processing, and event driven pattern matching agents to prospective customers?  Our background includes very high velocity feeds, like equities and option market data feeds, but using those for demo purposes can be difficult.  So we decided on using Twitter.  We decided ... (more)

Why CEP in the Cloud Makes Sense

CEP isn’t really about low latency.  The ability to do things quickly is important, just as in any system – especially those systems that grow and need to handle a lot of information.  Doing things quickly means doing things efficiently.  And doing things efficiently means less money spent on hardware.  Theoretically anyway. SO WHAT IS REALLY COOL ABOUT CEP? CEP gives one the to submit queries like “select symbol, avg(shares) from trade_stream group by symbol over 5 minutes emit every 1 minute.”  The CEP engine would consume this query, and then start returning an average of sh... (more)

My Top Five Cloud Predictions for 2011: Colin Clark

Every year, I like to decompress a bit and take a break. Usually, I like to go scuba diving – the dive sites I like are usually far removed from email, Twitter, Facebook, etc. and it gives me a chance to actually unplug, defrag, and think a bit. This year, the family went to Grand Cayman to experience some of the world’s best diving. Within Grand Cayman is Hell, a small township dedicated to tourism and aptly named given the attached photo. We visited Hell in between dives, and rather than make my ex-wife room reservations or send out postcards, I thought I’d amplify a few predic... (more)

An Unabashed Plug for Ulitzer

New Media on Ulitzer I was recently introduced to this site. And I like it a lot. You can check out my contributions there by clicking on this link. Also please see CEP on Ulitzer. ... (more)