I’m very pleased to welcome Rocana into the Cloudera Connect program, and to unveil the integration between Rocana Ops, the Rocana IT operations application, and Cloudera’s Enterprise Data Hub. This is precisely the kind of solution we see driving value for customers and accelerating the growth of the big data market.
The premise behind is simple: Modern IT teams capture huge amounts of diverse data from IT infrastructure – data like network activity, system metrics, user behavior and other telemetry. By storing that data in the Cloudera Enterprise Data Hub, and by using advanced analytics and powerful visualization techniques on it, teams can augment their IT operations to get a much more detailed, real-time view of activity in the data center. That, in turn, allows better planning, better diagnosis and troubleshooting when problems arise, and better use of business-critical IT infrastructure.
Of course, tools for monitoring data center infrastructure are nothing new. Older systems, though, were generally custom-built for the purpose, supporting a fixed collection of systems and services, locked to only a few data sources and limited to just a few ways to analyze and visualize them.
Rocana Ops, by contrast, is built to take advantage of the rich collection of data processing and analysis available on the Cloudera platform. The Apache Hadoop ecosystem offers a rich menu of data services. Rocana Ops uses Apache Kafka to ingest and transform data from IT systems. Kafka delivers the data to HDFS, Hadoop’s storage layer. There, it’s available for a wide range of analyses: Rocana Ops uses Cloudera Impala for high-performance SQL analysis, the fully-integrated Cloudera Search support by way of the Apache Solr project, and critical security, multi-tenancy and other platform services.
Because the Cloudera platform scales to petabytes, Rocana Ops can handle huge amounts of real-time and historical data, providing customers a better, more cost effective option.
Together, we’ve seen some great success already. Modern data centers are diverse and complex, and getting more so every day. Collecting service telemetry from all the systems supporting the business is hard; analyzing and presenting it comprehensively, so that IT staff can tell whether they’re hitting service levels across the board, can be overwhelming. Rocana meets these challenges because it scales both ingest and analysis, natively, on Cloudera.
Systems data is tricky to integrate and analyze, but application behavior is even harder. Applications and usage patterns change over time, and recognizing meaningful business events (“a visitor gave up on upgrading mobile phone service”) from a series of application events (web server delivered a page, pricing system produced three comparison offers, provisioning system started, web session timed out) requires a powerful and flexible system. Rocana allows business analysts to explore application data in just this way, and to discover important business insight in IT operations logs.
Securing IT infrastructure is absolutely critical. Because attackers are innovative, security systems must scale and evolve with threats. Rocana’s use of Cloudera for data capture, and real-time ingest of blacklist and other external data sources, means that operators can detect and respond to attacks quickly. Just as importantly, network activity can be saved for as long as necessary, giving forensic analysts a powerful tool for examining system behavior over long periods of time.
I’m really pleased to see Rocana delivering powerful, business-focused applications on top of the Cloudera Enterprise Data Hub. Applications like Rocana make it simple for traditional enterprise customers to realize the promise of big data: Better insight into the business, driven by a new class of advanced analytics.
Mike (@mikeolson) co-founded Cloudera in 2008 and served as its CEO until 2013 when he took on his current role of chief strategy officer (CSO.) As CSO, Mike is responsible for Cloudera’s product strategy, open source leadership, engineering alignment and direct engagement with customers.