Loading…
Please note: This schedule is for OpenStack Active Technical Contributors participating in the Icehouse Design Summit sessions in Hong Kong. These are working sessions to determine the roadmap of the Icehouse release and make decisions across the project. To see the full OpenStack Summit schedule, including presentations, panels and workshops, go to http://openstacksummitnovember2013.sched.org.

Sign up or log in to bookmark your favorites and sync them to your phone or calendar.

Savanna [clear filter]
Friday, November 8
 

1:30pm

Networking and installation topologies
Etherpad: https://etherpad.openstack.org/p/savanna-icehouse-networking

This session will include the following subject(s):

Handling the one-public-ip-per-cluster use case:

As the Hadoop clusters that Savanna manages grow having a floating/routable IP for each instance is not only wasteful but often unnecessary.

In a typical deployment the head node(s) (JobTracker&NameNode) need to be accessible to the user, but the individual workers within the cluster must only be accessible from the head node.

There is an architecture discussion to have about how to support this use case.

(Session proposed by Matthew Farrellee)

Flexible networking support:

Discuss the mechanisms required to support both nova-network and Neutron including features that could be required in area of networking for Savanna.

Subtopics:

* networking in different OpenStack topologies (problem of accessing VMs from Savanna controller and etc.);
* provisioning of a cluster over a private network/namespace using Neutron.

(Session proposed by Jonathan Maron)


Friday November 8, 2013 1:30pm - 2:10pm
AWE Level 2, Room 201A

2:20pm

Heat integration and scalability
Etherpad: https://etherpad.openstack.org/p/savanna-icehouse-architecture

This session will include the following subject(s):

Resources orchestration using Heat:

Savanna should use Heat for resources orchestration. There are number of loosely-researched problems in Heat that should be transformed to bug reports / blueprints in both Heat and Savanna projects to track this change.

The overall goal is to replace one-off orchestration with Heat-based one wherever makes sense.

(Session proposed by Clint Byrum)

New architecture and scalability:

Savanna should be horizontally scalable to support a lot of clusters provisioning at the time. On the other side we should solve the problem with provisioning large clusters, for example, by using multiple engines for one cluster.

There are several potential solutions that are grouped from the following components: controller, conductor, engine, agent.

We should take a look at all of the potential components and at production installations of OpenStack to choose the right way to solve scalability problem.

It's strongly connected with Heat integration.

Additional subtopics related to the failure scenarios handling:

* VM provisioning failure - cluster should be usable in case of 1/1000 VMs with only slave processes failed to be able to just add missed VMs instead of cluster reprovisioning;
* timeouts - we should add timeouts for all parts of provisioning process.

(Session proposed by Sergey Lukjanov)


Friday November 8, 2013 2:20pm - 3:00pm
AWE Level 2, Room 201A

3:10pm

Further OpenStack integration
Etherpad: https://etherpad.openstack.org/p/savanna-icehouse-integration

This session will include the following subject(s):

Future of CI:

We need to have CI and gating tests.

Currently we're using private lab for running integration tests, it should be eventually moved to the OpenStack Infra.

Subtopics:

* integration tests in Tempest
* integration with DevStack
* adding Savanna to Gating

(Session proposed by Alexander Ignatov)

Metering/monitoring using Ceilometer:

There are several needed directions for integration with Ceilometer:

* monitoring of internal Savanna state including number of provisioned clusters, amount of used CPUs, RAM, etc.
* monitoring of internal provisioned clusters state including number of currently running jobs, free/busy mappers and reducers.

(Session proposed by Sergey Lukjanov)

Baremetal using Ironic:

Savanna should use Ironic to provision bare metal and hybrid clusters.

(Session proposed by Sergey Lukjanov)


Friday November 8, 2013 3:10pm - 3:50pm
AWE Level 2, Room 201A

4:10pm

Savanna in Icehouse
Etherpad: https://etherpad.openstack.org/p/savanna-icehouse-roadmap

This session will include the following subject(s):

Savanna roadmap for Icehouse:

This session should finalize discussions about Savanna at design summit to define scope and roadmap for further Icehouse release cycle.

(Session proposed by Sergey Lukjanov)

EDP in Icehouse:

We should discuss further roadmap for Elastic Data Processing.

* Overall direction of EDP.
* Short-term and long-term goals.


(Session proposed by Sergey Lukjanov)


Friday November 8, 2013 4:10pm - 4:50pm
AWE Level 2, Room 201A