Distributed mixture-of-experts for Big Data using PETUUM framework

Billy Peralta, Luis Parra, Oriel Herrera, Luis Caro

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Today, organizations are beginning to realize the importance of using as much data as possible for decision-making in their strategy. The finding of relevant patterns in enormous amount of data requires automatic machine learning algorithms, among them, a popular option is the mixture-of-experts that allows to model data using a set of local experts. The problem of using typical learning algorithms over Big Data is the handling of these large datasets in primary memory. In this paper, we propose a methodology to learn a mixture-of-experts in a distributed way using PETUUM platform. Particularly, we propose to learn the parameters of mixture-of-experts by adapting the standard stochastic gradient descent in a distributed way. This methodology is applied to people detection with standard real datasets considering accuracy and precision metrics among other. The results show a consistent performance of mixture-of-experts models where the best number of experts varies according to the particular dataset. We also evidence the advantages of the distributed approach by showing the almost linear decreasing of average training time according to the number of processors. In a future work, we expect to apply this methodology to mixture-of-experts with embedded variable selection.

Original languageEnglish
Title of host publication2017 36th International Conference of the Chilean Computer Science Society, SCCC 2017
PublisherIEEE Computer Society
Pages1-7
Number of pages7
Volume2017-October
ISBN (Electronic)9781538634837
DOIs
Publication statusPublished - 5 Jul 2018
Event36th International Conference of the Chilean Computer Science Society, SCCC 2017 - Arica, Chile
Duration: 16 Oct 201720 Oct 2017

Publication series

NameProceedings - International Conference of the Chilean Computer Science Society, SCCC
Volume2017-October
ISSN (Print)1522-4902

Conference

Conference36th International Conference of the Chilean Computer Science Society, SCCC 2017
Country/TerritoryChile
CityArica
Period16/10/1720/10/17

ASJC Scopus subject areas

  • Engineering(all)
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Distributed mixture-of-experts for Big Data using PETUUM framework'. Together they form a unique fingerprint.

Cite this