“They pulled me back in.” – The God Father.
I’ve received some interest/emails about TwitURL – our Map/Reduce as it
applies to CEP (cloud event processing) project. Seems that people would
like to see the results of these processes visually. Who can blame them,
right? So, I was thinking, how can I add a little sizzle to TwitURL?
Panopticon offers some pretty slick visualization capabilities – you can
check them out here. And based upon some feedback/requests, I’m going to
hook up a heat map to the output of TwitURL. The heat map will show which
URL’s are the hottest-the most tweeted URL over a given time frame. Once
we deploy TwitURL in the cloud, we’ll use this app to see what’s going on
in there. Here’s a picture of the heat map:
Over the past few weeks, I’ve implemented map/reduce using techniques
commonly found in Complex Event Processing. Here’s a summary of what was
involved, and what tools would make such a deployment easier.
Getting the Data
One of the first tasks accomplished was the creation of an OnRamp – we use
OnRamps to get data into our cloud for processing. The specific OnRamp used
in this learning exercise subscribed to Twitter and fed the resulting JSON
objects onto the service bus, RabbitMQ in this case. We had to correctly
configure RabbitMQ for this, and the OnRamp needed to be specif... (more)
In the past year or so, I’ve heard from many skeptics – people who
didn’t believe that Event Processing could be successfully deployed in the
cloud. Granted, most of these folks represented firms actively engaged in
providing the High Frequency Trading (Algo Trading) industry with tools.
And in that arena, cloud deployment probably doesn’t make sense. Yet.
Close to Home Though
Ask people in Capital Markets about Twitter and the most common response
you’ll get is, “What do people use it for?” This is because most of
the people in Capital Markets can’t use things like Twitter, i... (more)
Every year, I like to decompress a bit and take a break. Usually, I like to
go scuba diving – the dive sites I like are usually far removed from email,
Twitter, Facebook, etc. and it gives me a chance to actually unplug, defrag,
and think a bit.
This year, the family went to Grand Cayman to experience some of the
world’s best diving. Within Grand Cayman is Hell, a small township
dedicated to tourism and aptly named given the attached photo.
We visited Hell in between dives, and rather than make my ex-wife room
reservations or send out postcards, I thought I’d amplify a few predic... (more)