Open AccessProceedings Article
On Estimation and Selection for Topic Models
Matt Taddy
- 21 Mar 2012
- pp 1184-1193
TL;DR: In this paper, the authors describe posterior maximization for topic models, identifying computational and conceptual gains from inference under a non-standard parametrization, and show that fitted parameters can be used as the basis for a novel approach to marginal likelihood estimation, via block-diagonal approximation to the information matrix, that facilitates choosing the number of latent topics.
read more
Abstract: This article describes posterior maximization for topic models, identifying computational and conceptual gains from inference under a non-standard parametrization. We then show that fitted parameters can be used as the basis for a novel approach to marginal likelihood estimation, via block-diagonal approximation to the information matrix, that facilitates choosing the number of latent topics. This likelihood-based model selection is complemented with a goodness-of-fit analysis built around estimated residual dispersion. Examples are provided to illustrate model selection as well as to compare our estimation against standard alternative techniques.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
stm: An R Package for Structural Topic Models
TL;DR: This paper demonstrates how to use the R package stm for structural topic modeling, which allows researchers to flexibly estimate a topic model that includes document-level metadata.
LDAvis: A method for visualizing and interpreting topics
Carson Sievert,Kenneth E. Shirley +1 more
- 01 Jan 2014
TL;DR: LDAvis, a web-based interactive visualization of topics estimated using Latent Dirichlet Allocation that is built using a combination of R and D3, and a novel method for choosing which terms to present to a user to aid in the task of topic interpretation is proposed.
A model of text for experimentation in the social sciences
TL;DR: A hierarchical mixed membership model for analyzing topical content of documents, in which mixing weights are parameterized by observed covariates is posit, enabling researchers to introduce elements of the experimental design that informed document collection into the model, within a generally applicable framework.
652
cisTopic: cis-regulatory topic modeling on single-cell ATAC-seq data
Carmen Bravo González-Blas,Liesbeth Minnoye,Dafni Papasokrati,Sara Aibar,Gert Hulselmans,Valerie Christiaens,Kristofer Davie,Jasper Wouters,Stein Aerts +8 more
TL;DR: As an unsupervised Bayesian framework, cisTopic classifies regions in scATAC-seq data into regulatory topics, which are used for clustering and provides insight into the mechanisms underlying regulatory heterogeneity in cell populations.
CEO Behavior and Firm Performance
TL;DR: A new method to measure CEO behavior in large samples via a survey that collects high-frequency, high-dimensional diary data and a machine learning algorithm that estimates behavioral types reveals two types: “leaders,” who do multifunction,High-level meetings, and “managers,’ who do individual meetings with core functions.
References
The Analysis of Residuals in Cross-Classified Tables
TL;DR: This paper used residual analysis for quantal response and for complete and incomplete r X c contingency tables, and used it for analysis of quasi-independence models in incomplete R X c tables and for use in logit analysis.
1K
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation
Yee Whye Teh,David Newman,Max Welling +2 more
- 04 Dec 2006
TL;DR: This paper proposes the collapsed variational Bayesian inference algorithm for LDA, and shows that it is computationally efficient, easy to implement and significantly more accurate than standard variationalBayesian inference for L DA.
•Book
Numerical analysis for statisticians
Kenneth Lange
- 01 Jan 1999
TL;DR: This book focuses on the principles of numerical analysis and is intended to equip those readers who use statistics to craft their own software and to understand the advantages and disadvantages of different numerical methods.
A Bayesian Hierarchical Topic Model for Political Texts: Measuring Expressed Agendas in Senate Press Releases
TL;DR: A statistical model is introduced that attends to the structure of political rhetoric when measuring expressed priorities: statements are naturally organized by author to simultaneously estimate the topics in the texts, as well as the attention political actors allocate to the estimated topics.
What Drives Media Slant? Evidence From U.S. Daily Newspapers
TL;DR: The authors construct a new index of media slant that measures the similarity of a news outlet's language to that of a congressional Republican or Democrat, and find that readers have an economically significant preference for like-minded news.