Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Tuesday, May 13 • 2:00pm - 2:40pm
Technical Deep Dive: Big Data Computations Using Elastic Data Processing in OpenStack Cloud

Sign up or log in to save this to your schedule and see who's attending!

The Sahara project (ex. Savanna), integrated project in Juno under the OpenStack Data Processing program, provides users an ability to provision and manage Hadoop clusters on OpenStack, and has seen a great deal of progress, development, and changes during the Icehouse development cycle. The focus of the project is on two primary use cases: on-demand cluster provisioning and on-demand Hadoop tasks execution (Elastic Data Processing).

This presentation takes an in-depth look at Savanna’s EDP facilities. Since Savanna’s initial release, this key feature has been hardened and expanded to support streaming MapReduce and Java workflows, operation over private Neutron networks and execution on transient clusters. We’ll start with a description of EDP’s general concepts and a definition of terms, then its current status in Savanna, supported Data Sources, Job Types, data locality and the roadmap for the Juno release cycle.

Lastly, we’ll show a live demo of EDP to bring all of these concepts together. The demo will cover job and data source definition, job execution and collection of job results.



Speakers
avatar for Alexander Ignatov

Alexander Ignatov

Senior Software Engineer, Mirantis, Mirantis Inc.
Alexander Ignatov (aignatov on irc) is a Senior Software Engineer at Mirantis. He has expertise in networks, Java, high scalability and distributed systems (Hadoop, HBase, Cassandra). Alexander has been involved in the OpenStack Savanna project since its beginning. He is the main author of the Vanilla Hadoop plugin and actively participated in the EDP architecture/implementation. He is the author of the Heat provisioning engine for Savanna and... Read More →
avatar for Sergey Lukjanov

Sergey Lukjanov

Principal Software Engineer, Mirantis, Mirantis
Sergey is the Project Technical Lead of OpenStack Data Processing program ("Sahara", ex. "Savanna"). He has been involved in the project from the first days. One of his main responsibilities is architecture design and community-related work in Sahara. Also he is a top contributor and reviewer of Sahara and he oversees all Launchpad and Gerrit activity. Sergey is experienced in Big Data projects and technologies (Hadoop, HDFS, Cassandra, Twitter... Read More →
TM

Trevor McKay

Senior Software Engineer, Red Hat, Red Hat, Inc.
Trevor McKay is a Sahara core team member and has been working on Sahara | since mid 2013. He is one of the designers of Sahara's Elastic Data | Processing (EDP) facilities and continues to be a primary contributor to | EDP. Trevor has broad experience in distributed computing, user | interface development, client server applications and control systems.


Tuesday May 13, 2014 2:00pm - 2:40pm
Room B102

Attendees (262)