OpenStack Summit May 2014 Atlanta

Even the smallest cloud has the potential to generate huge amounts of log information. Much of it is redundant, awkwardly formatted, and generally of little value, but hidden in there are clues that can help you understand that you are having, or more importantly, about to have a problem. Logs are an important triage tool to help you get out of the woods.

This presentation discusses some of the experiences, challenges, and revelations had while deploying a log management infrastructure for Openstack. It will cover topics such as handling large volumes of logs, filtering and parsing of different types of events, and some interesting queries that can help. Finally, it will cover some suggested improvements that the Openstack community might consider to make the process of log ingestion easier and log mining more fruitful.