In the past year or so, I’ve heard from many skeptics – people who
didn’t believe that Event Processing could be successfully deployed in the
cloud. Granted, most of these folks represented firms actively engaged in
providing the High Frequency Trading (Algo Trading) industry with tools.
And in that arena, cloud deployment probably doesn’t make sense. Yet.
Close to Home Though
Ask people in Capital Markets about Twitter and the most common response
you’ll get is, “What do people use it for?” This is because most of
the people in Capital Markets can’t use things like Twitter, instant
messaging, or Facebook at work and if they can, it’s heavily regulated.
But the point is, that they mostly don’t get it – I myself was included
in this camp until a friend of mine explained it to me. Since thing, I’ve
taken to Twitter like a fish to water. My point here is that the... (more)
I’ve spent the last couple of days, after absorbing the Sybase acquisition
of Aleri’s assets, looking at the various CEP players websites for evidence
of cloud (grid name du jour) deployment.
I haven’t found anything worth mentioning. That’s not to say that I
might have missed something. But my guess is that with all the economic
woes lately, that the CEP vendors have either chosen to ignore or just simply
aren’t aware that the rest of the world is actually solving real problems
with cloud deployments.
Which is interesting.
It’s interesting because one of the pioneers in CEP &... (more)
CEP isn’t really about low latency. The ability to do things quickly is
important, just as in any system – especially those systems that grow and
need to handle a lot of information. Doing things quickly means doing
things efficiently. And doing things efficiently means less money spent on
hardware. Theoretically anyway.
SO WHAT IS REALLY COOL ABOUT CEP?
CEP gives one the to submit queries like “select symbol, avg(shares) from
trade_stream group by symbol over 5 minutes emit every 1 minute.” The CEP
engine would consume this query, and then start returning an average of
Lately, I’ve been working on some interesting projects involving not just
the usual suspects of stream processing, but data mining within high velocity
time series. In conjunction with that effort, I’ve been doing a lot of
research in the areas of symbolic representation, dimension reduction,
clustering, indexing, classification, and anomaly detection. A prolific
researcher in this area is Dr. Eamonn Keogh – I’ll be applying some of
his team’s ideas so some interesting customer problems and telling you all
about it here. Let’s get started!
TOO MUCH DATA
In dealing with real... (more)
Every year, I like to decompress a bit and take a break. Usually, I like to
go scuba diving – the dive sites I like are usually far removed from email,
Twitter, Facebook, etc. and it gives me a chance to actually unplug, defrag,
and think a bit.
This year, the family went to Grand Cayman to experience some of the
world’s best diving. Within Grand Cayman is Hell, a small township
dedicated to tourism and aptly named given the attached photo.
We visited Hell in between dives, and rather than make my ex-wife room
reservations or send out postcards, I thought I’d amplify a few predic... (more)