Please note: This schedule is for OpenStack Active Technical Contributors participating in the Icehouse Design Summit sessions in Hong Kong. These are working sessions to determine the roadmap of the Icehouse release and make decisions across the project. To see the full OpenStack Summit schedule, including presentations, panels and workshops, go to http://openstacksummitnovember2013.sched.org.
Currently ceilometer supports only the two extremes of data retention:
* keep everything for always (the default behavior) * discard data older than a configured age (via the database.time_to_live option)
However there are many usecases where while fine-grained data doesn't need to persist forever, we also don't want older data to suddenly fall off a cliff when it gets to a certain age.
In these cases, a roll-up scheme would be more convenient, such these data as they age are distilled into progressively coarser grained aggregates before being eventually completely expired. As such these data would become gradually more condensed without losing all of their value for trend analysis, before finally being aged out altogether.
This feature would be driven by configured policies, so that for example certain meters are retained forever, whereas others are aggressively rolled up with data older than say one week being aggregated hourly, data older than month being aggregated daily, and so on.
This session will explore the feasibility of implementing such a scheme across the various storage drivers.
