Sentiment Analysis - An optimized Weighted Horizontal Ensemble approach

Abstract

Sentiment Analysis has gained authority as one of the primary means of analyzing feedbacks and opinion by individuals, organizations and governments. The result of sentiment analysis informs an organization on areas to improve and how best to manage customers. While sentiment analysis may be misleading as no algorithm has been considered 100% efficient, the choice of algorithms can optimize the result based on the dataset in question. This paper aims at studying various algorithms and implementing a weighted horizontal ensemble algorithm as a panacea to low confidence level in the results of sentiment analysis. We designed a system that implements the original Naive Bayes algorithm, Multinomial Naïve Bayes algorithm, Bernoulli Native Bayes algorithm, Logistic Regression algorithm, Linear Support Vector Classifier algorithm and the Stochastic Gradient Descent algorithm. Our dataset was sourced from the Stanford University. It contains fifty thousand (50,000) movie reviews. Dataset from the Nigerian movie review was used to test the models. The reviews were encoded as a sequence of word indices. An accuracy of over 91% was achieved. The Ensemble technique delivered an F1-measure of 90%. Ensemble technique provides a more reliable confidence level on sentiment analysis. The researchers also discovered that change in writing style can affect the performance of sentiment analysis