Joint sparse regularization based Sparse Semi-Supervised Extreme Learning Machine (S3ELM) for classification

Xiaozhuo Luo, F. Liu, Shuyuan Yang, Xiaodong Wang, Zhiguo Zhou

Research output: Contribution to journalArticle

17 Scopus citations

Abstract

Extreme Learning Machine (ELM) has received increasing attention for its simple principle, low computational cost and excellent performance. However, a large number of labeled instances are often required, and the number of hidden nodes should be manually tuned, for better learning and generalization of ELM. In this paper, we propose a Sparse Semi-Supervised Extreme Learning Machine (S3ELM) via joint sparse regularization for classification, which can automatically prune the model structure via joint sparse regularization technology, to achieve more accurate, efficient and robust classification, when only a small number of labeled training samples are available. Different with most of greedy-algorithms based model selection approaches, by using ℓ2,1-norm, S3ELM casts a joint sparse constraints on the training model of ELM and formulate a convex programming. Moreover, with a Laplacian, S3ELM can make full use of the information from both the labeled and unlabeled samples. Some experiments are taken on several benchmark datasets, and the results show that S3ELM is computationally attractive and outperforms its counterparts.

Original languageEnglish (US)
Pages (from-to)149-160
Number of pages12
JournalKnowledge-Based Systems
Volume73
DOIs
StatePublished - Jan 1 2015

Keywords

  • Extreme learning machine
  • Joint sparse regularization
  • Laplacian
  • Sparse semi-supervised learning
  • ℓ -Norm

ASJC Scopus subject areas

  • Management Information Systems
  • Software
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Joint sparse regularization based Sparse Semi-Supervised Extreme Learning Machine (S3ELM) for classification'. Together they form a unique fingerprint.

  • Cite this