Automated sentiment analysis for web-based stock and cryptocurrency news summarization with transformer-based models

Abstract

In the fast-paced realm of global financial markets, characterized by rapid trading of both stocks and cryptocurren-cies, it has become essential to grasp the influence of sentiment on market dynamics. With more than 630,000 publicly traded companies worldwide and major stock exchanges like the NYSE handling a substantial portion of global equity transactions, the inherent volatility of the stock market is well-established. Over the past decade, various factors have contributed to the consistent fluctuations in stock prices. One key factor is the influence of investor reviews sourced from diverse news outlets and social media platforms such as Twitter. Understanding how these reviews can be collected and effectively summarized is crucial. This paper centers on the intricate field of market sentiment analysis and its profound impact on user sentiment, subsequently affecting price fluctuations in both stocks and cryptocurrencies. In this study, we present a comprehensive exploration of the development and evaluation of an automated sentiment analysis system tailored for summarizing web-based news related to stocks and cryptocurrencies.We have implemented BERT (Bidirectional Encoder Representations from Transformers) in combination with NLTK for text summarization, a highly accurate model with a performance level of 95.84%, as part of our proposed approach.