What is the accuracy in text analysis

Published on — Written by Wonderflow

what is accuracy in text analysis - Wonderflow

Probably, the most frequent question about text analysis is “what is the accuracy?”. So, today we will tell you what to measure in order to determine the quality of your analysis.

Let’s start by saying that what we usually call accuracy in text analysis, is the mix of two main indicators, called precision and recall.

Recall

In simple words, the recall in text analysis measures how many times the system is able to identify a specific topic from an unstructured text, over the total amount of times when the topic is really mentioned in that text.

Imagine a random text where the author talks about the Sun in 10 different sentences, plus some other sentences about the moon and some others about Mars. Suppose that a text-analysis algorithm designed to identify expressions related to the Sun extracts 7 expressions from that text, of which only 5 of them are really related to the Sun. In that case, its recall is 5 out of 10, which means 50%.

Precision

On the other side, Precision measures how many times the system has identified a topic correctly, amongst all the times that topic has been identified by the system itself.

Suppose a random text where the author talks about the Sun in 10 different sentences, plus some other sentences about the moon and some others about Mars. If a text-analysis algorithm tries to identify expressions related to the Sun, extracts a total of 7 expressions from that text, whether only 5 of them are really related to the Sun, and the other two to the moon, its precision would be 5 out of 7, which means approximately 70%.

To sum it up, we can consider accuracy as a score derived by the capability of the machine to extract topics from a given text, and its ability to make sure many of these extracted topics are correct.

If you want to know how good are humans in performing text analysis, watch this video.

About Wonderflow

Wonderflow empowers businesses with quick and impactful decision-making because it helps automate and deliver in-depth consumer and competitor insights. All within one place, results are simplified for professionals across any high-UGC organization, and department to access, understand, and share easily. Compared to hiring more analysts, Wonderflow’s AI eliminates the need for human-led setup and analysis, resulting in thousands of structured and unstructured reviews analyzed within a matter of weeks and with up to 50% or more accurate data. The system sources relevant private and public consumer feedback from over 200 channels, including emails, forums, call center logs, chat rooms, social media, and e-commerce. What’s most unique is that its AI is the first ever to help recommend personalized business actions and predict the impact of those actions on key outcomes. Wonderflow is leveraged by high-grade customers like Philips, DHL, Beko, Lavazza, Colgate-Palmolive, GSK, Delonghi, and more.

Start making winning decisions based on customer feedback todayGet a free demo

Krisiana Dumi

Interview · Apr 07, 2022

WonderStudent: Krisiana Dumi, Grant Recipient & Epicode IT Grad

The Wonder Foundation is a charity of Wonderflow. As part of its mission to help disadvantaged students and families gain easier access to tech-related jobs and education, its board members have partnered with Epicode, a rigorous coding school that preps passionate professionals for a career in IT. Together, we’ve scouted talented young individuals, particularly those interested in AI, computer science, and web development, to provide them with scholarships, training resources, internships, and more. In our…

simone sciuto

Interview · Feb 10, 2022

WonderStudent: Simone Sciuto, Grant Recipient & Epicode IT Grad

The Wonder Foundation is a charity of Wonderflow. As part of its mission to help disadvantaged students and families gain easier access to tech-related jobs and education, its board members have partnered with Epicode, a rigorous coding school that preps passionate professionals for a career in IT. Together, we’ve scouted talented young individuals, particularly those interested in AI, computer science, and web development, to provide them with scholarships, training resources, internships, and more. In our…

Emiliano Varrasi

Human Resources · Oct 28, 2021

Employee Spotlight: Emiliano Varrasi, Client Director & Proud Dad

Part of our recent achievements and growth has been mainly due to the people. So, we’re excited to feature another hard-working team member in our Employee Spotlight of The Month. Meet long-time team member Emiliano Varrasi, one of the Client Directors from our Customer Success Management team and who has been with us for nearly five years or since 2016.  Born and raised in Sicily, Italy, Emiliano is currently based in Amsterdam. Before Wonderflow, he…