Hierarchical Deep Learning for Text classification

Declined again - no sources added, still the same reasons. Might also be excessively (probably solely) based on primary sources. 198.84.253.202 (talk) 23:49, 11 March 2018 (UTC)

Machine learning and data mining
Problems Classification Clustering Regression Anomaly detection AutoML Association rules Reinforcement learning Structured prediction Feature engineering Feature learning Online learning Semi-supervised learning Unsupervised learning Learning to rank Grammar induction
Supervised learning (classification • regression) Decision trees Ensembles Bagging Boosting Random forest k-NN Linear regression Naive Bayes Artificial neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH CURE Hierarchical k-means Expectation–maximization (EM) DBSCAN OPTICS Mean-shift
Dimensionality reduction Factor analysis CCA ICA LDA NMF PCA t-SNE
Structured prediction Graphical models Bayes net Conditional random field Hidden Markov
Anomaly detection k-NN Local outlier factor
Artificial neural networks Autoencoder Deep learning DeepDream Multilayer perceptron RNN LSTM GRU) Restricted Boltzmann machine SOM Convolutional neural network U-Net
Reinforcement learning Q-learning SARSA Temporal difference (TD)
Theory Bias-variance dilemma Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory
Machine-learning venues NIPS ICML ML JMLR ArXiv:cs.LG
Glossary of artificial intelligence Glossary of artificial intelligence
Related articles List of datasets for machine-learning research Outline of machine learning

Hierarchical Deep Learning for Text Classification (HDLTex) is the machine learning task with the "hierarchical labeled" data (a classification or categorization). Since the examples given to the learner are hierarchical labeled, the evaluation is based on the accuracy or F1-measure based on multi level of the model hierarchy. This model have been used for text classification, as in HDLTex: Hierarchical Deep Learning for Text Classification where HDLTex employs stacks of deep learning architectures to provide specialized understanding at each level of the document hierarchy.

Approaches as part of HDLTex include:

• convolution neural network
• recurrent neural network
• Deep neural network

Hierarchical Deep Learning

Hierarchical Deep Learning is the machine learning task with the "hierarchical labeled" data (a classification or categorization). Since the examples given to the learner are hierarchical labeled, the evaluation is based on the accuracy or F1-measure based on multi level of the model hierarchy. This model have been used for text classification, as in Hierarchical Deep Learning employs stacks of deep learning architectures to provide specialized understanding at each level of the data hierarchy. The primary contribution of this technique is hierarchical classification. of documents. A traditional multi-class classification technique can work well for a limited number classes, but performance drops with increasing number of categories or classes, as is present in hierarchically organized documents. Many techniques works on Hierarchical Attention for text classification. Hence, they provide extensions over current methods for document classification that only consider the multi-class problem. The methods described as HDLTex can improved in multiple ways. Additional training and testing with other hierarchically structured document data sets will continue to identify architectures that work best for these problems. Also, it is possible to extend the hierarchy to more than two levels to capture more of the complexity in the hierarchical classification. For example, if keywords are treated as ordered then the hierarchy continues down multiple levels. HDLTex can also be applied to unlabeled (unsupervised) documents, such as those found in news or other media outlets. In hierarchical deep learning model, this problem is solved by creating architectures that specialize deep learning approaches for their level of the document hierarchy. The structure of Hierarchical Deep Learning for Text (HDLTex) architecture for each deep learning model is as follows:

• convolution neural network
• recurrent neural network
• Deep neural network

HDLTex: Hierarchical Deep Learning for Text Classification

Hierarchical Deep Learning

Method of moments

Document classification is an important problem to address, given the growing size of scientific literature and other document sets. When documents are organized hierarchically, multi-class approaches are difficult to apply using traditional supervised learning methods. HDLTex combines multiple deep learning approaches to produce hierarchical classifications. The deep learning methods can provide improvements for document classification and that they provide flexibility to classify documents within a hierarchy. Hence, they provide extensions over current methods for document classification that only consider the multi-class problem. The methods described as HDLTex can improved in multiple ways. Additional training and testing with other hierarchically structured document data sets will continue to identify architectures that work best for these problems. Also, it is possible to extend the hierarchy to more than two levels to capture more of the complexity in the hierarchical classification. For example, if keywords are treated as ordered then the hierarchy continues down multiple levels. HDLTex can also be applied to unlabeled (unsupervised) documents, such as those found in news or other media outlets.

See also

• Hierarchical Deep Learning
• Deep Learning
• Natural language processing
• Document classification
• Image classification
• classification

Further reading

• K. Kowsari, D. E. Brown, M. Heidarysafa, K. Jafari Meimandi, M. S. Gerber and L. E. Barnes, "HDLTex: Hierarchical Deep Learning for Text Classification", 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 364-371. doi: 10.1109/ICMLA.2017.0-134
• LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444.
• Deng, Li, and Dong Yu. "Deep learning: methods and applications." Foundations and Trends® in Signal Processing 7.3–4 (2014): 197-387.
• Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural networks, 61, 85-117.

This article "Hierarchical Deep Learning for Text classification" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:Hierarchical Deep Learning for Text classification. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.

📰 Article(s) of the same category(ies)

• DeepSea Technologies
• Multimodel Deep Learning
• Deep feature synthesis
• Media synthesis (AI)
• Hands-On Machine Learning with Scikit-Learn & TensorFlow
• Causal Neural Paradox (Thought Curvature)
• Bing Predicts

---