Benchmarking a custom chatbot's metrics is primordial. Benchmark the right metrics will allow you to follow your solution's progress over the next years. Having data points you can measure and track over that period of time will be extremely valuable, making sure you work towards the right KPI for your project.
In a break from my usual 'only speak human' efforts, this post is going to get a little geeky. We are going to look at how chatbots learn over time, what chatbot training data is and some suggestions on where to find open source training data. So, let's get a wiggle on.
It's a brave new world out there. Everyone from the c-suite to the marketing execs is scrambling to learn all they can about chatbots. What problems can they solve, what are the best practices and most importantly... where's the evidence?
Thousands of chatbots have been developed and released into the wild, but, like most things in life, not all things are created equal. Across the typical chatbot use cases, there are shining examples of what works great and not-so-shining examples of what doesn't work at all.