Attention-based Random Forest and Contamination Model
TL;DR: In this article , an attention-based random forest (ABRF) model is proposed to assign attention weights with trainable parameters to decision trees in a specific way, where the attention weights depend on the distance between an instance which falls into a corresponding leaf of a tree, and training instances which fall in the same leaf.
read more
About: This article is published in Neural Networks. The article was published on 08 Jan 2022. and is currently open access. The article focuses on the topics: Medicine & Computer science.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
VAR-tree model based spatio-temporal characterization and prediction of O3 concentration in China.
TL;DR: Wang et al. as mentioned in this paper proposed a vector autoregression (VAR), Kriging method and XGBoost (Extreme Gradient Boosting) model to obtain the spatial distribution of ozone concentration over a continuous period of time.
54
Robust Statistical Comparison of Random Variables with Locally Varying Scale of Measurement
TL;DR: In this paper , a generalized stochastic dominance (GSD) order is proposed to exploit the entire information encoded in the non-standard spaces of multidimensional data, based on the sets of expectations of random variables mapping into such spaces.
7
Exploration of m6A methylation regulators as epigenetic targets for immunotherapy in advanced sepsis
TL;DR: In this article , the authors explored the relationship between m6A methylation modification and peripheral immune cells in patients with advanced sepsis and mine potential epigenetic therapeutic targets by analyzing the differential expression patterns.
AGBoost: Attention-based Modification of Gradient Boosting Machine
Andrei V. Konstantinov,Lev V. Utkin,Stanislav Kirpichenko +2 more
- 27 Apr 2022
TL;DR: The main idea behind the proposed AGBoost model is to assign attention weights with trainable parameters to iterations of GBM under condition that decision trees are base learners in GBM.
AGBoost: Attention-based Modification of Gradient Boosting Machine
27 Apr 2022
TL;DR: In this article , a new attention-based model for the gradient boosting machine (GBM) called AGBoost is proposed for solving regression problems, which assigns attention weights with trainable parameters to iterations of GBM under condition that decision trees are base learners in GBM.
6
References
Random Forests
Leo Breiman
- 01 Oct 2001
TL;DR: Internal estimates monitor error, strength, and correlation and these are used to show the response to increasing the number of features used in the forest, and are also applicable to regression.
•Proceedings Article
Attention is All you Need
Ashish Vaswani,Noam Shazeer,Niki Parmar,Jakob Uszkoreit,Llion Jones,Aidan N. Gomez,Lukasz Kaiser,Illia Polosukhin +7 more
- 12 Jun 2017
TL;DR: This paper proposed a simple network architecture based solely on an attention mechanism, dispensing with recurrence and convolutions entirely and achieved state-of-the-art performance on English-to-French translation.
•Proceedings Article
Neural Machine Translation by Jointly Learning to Align and Translate
Dzmitry Bahdanau,Kyunghyun Cho,Yoshua Bengio +2 more
- 01 Jan 2015
TL;DR: It is conjecture that the use of a fixed-length vector is a bottleneck in improving the performance of this basic encoder-decoder architecture, and it is proposed to extend this by allowing a model to automatically (soft-)search for parts of a source sentence that are relevant to predicting a target word, without having to form these parts as a hard segment explicitly.
25.7K
•Posted Content
Neural Machine Translation by Jointly Learning to Align and Translate
TL;DR: In this paper, the authors propose to use a soft-searching model to find the parts of a source sentence that are relevant to predicting a target word, without having to form these parts as a hard segment explicitly.
20.9K