Cloud Event Processing - Analyze, Sense, Respond

Colin Clark

Subscribe to Colin Clark: eMailAlertsEmail Alerts
Get Colin Clark via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn

Top Stories by Colin Clark

VMWare has been on a buying spree lately. In the last month, they’ve announced both Redis and RabbitMQ. Here’s VMware’s take on Redis, and spring source’s on RabbitMQ.  RabbitMQ is built with Erlang. Much Rejoicing in the Village We use both of these technologies at Cloud Event Processing.  And we love Erlang too.  VMware’s acquisition of these technologies not only validates our decisions, which we are very selfishly pleased about, but also sends an interesting message. The Message Please Everyone’s busy abstracting resources in the cloud – making resources like compute, storage and network available dynamically, based upon demand. But we need more services on top of that.  When an application is deployed, wouldn’t it be neat if things like messaging, protocol handling, persistence, queuing, etc. were readily available and abstracted for use?  We think so; that’s ... (more)

Cloud vs Grid

IBM Session at Cloud Expo I’ve been getting a lot of email, and there have been some posts on this blog, regarding CEP based services in the cloud. So as we go down this road, I thought it would behoove us to examine what a cloud is and isn’t and what a grid is and isn’t. I found this introductory article from IBM.  It’s a good start.  I’ll be looking for some more articles – if you’ve got anything you’d like to add to this conversation, please feel free to contact me or add your comments below. Personally, my experience with grid comes from Capital Markets and calculating pric... (more)

Cloud Event Processing: CEP in the Cloud

Over the past few weeks, I’ve implemented map/reduce using techniques commonly found in Complex Event Processing.  Here’s a summary of what was involved, and what tools would make such a deployment easier. Getting the Data One of the first tasks accomplished was the creation of an OnRamp – we use OnRamps to get data into our cloud for processing.  The specific OnRamp used in this learning exercise subscribed to Twitter and fed the resulting JSON objects onto the service bus, RabbitMQ in this case.  We had to correctly configure RabbitMQ for this, and the OnRamp needed to be specif... (more)

Cloud Event Processing – Where For Art Thou oh CEP?

In a recent post, Louis Lovas of Progress Apama explains why the first generation CEP vendors don’t have many, if any, cloud deployments.  Here’s a quote from his post: Typical of event processing applications that do things are those in Capital Markets like algorthmic trading, pricing and market making. These applications perform some business function, often critcal in nature in their own right. Save connectivity to data sources and destinations, they are the key ingredient or the only ingredient to a business process.  In the algo world CEP systems tap into the firehose of da... (more)

IaaS and Building a Private Cloud

Cloud Expo on Ulitzer I was speaking with a company last week that would like to get into cloud event processing.  For the sake of discussion, I’m going to define ‘cloud’ as the ability to dynamically, and upon demand, use more or less compute, storage, or network capacity. This is often referred to as ‘elasticity.’  I’m also going to add a few other requirements; this cloud must be able to: Host operations for a number of customers, all accessing the same data, but in different ways, Provide access to a lot of big data (see #3 – it’s all stored too), Able to handle messages ra... (more)