A Scalable, Interpretable, and Data-driven
Approach to Analyzing Unstructured Information
Abstract :
We introduce a general framework for analyzing large-scale text-based data, combining the strengths of neural network language models and generative statistical modeling. Our methodology generate textual factors by (i) representing texts using vector word embedding, (ii) clustering words using locality-sensitive hashing, and (iii) identifying spanning vector clusters through topic modeling. Our data-driven approach captures complex linguistic structures while ensuring computational scalability and economic interpretability. We also discuss applications of textual factors in (i) prediction and inference, (ii) interpreting existing models and variables, and (iii) constructing new metrics and explanatory variables, with illustrations using topics in finance and economics such as macroeconomic forecasting and factor asset pricing.