Suumit Shah, the CEO of Bengaluru-based Dukaan, said the chatbot answered customer queries in 2 minutes — a task that took the humans over 2 hours.
This is so true. The ability for human beings to game any metric you put out there is pretty legendary. I’ve seen it in action so many times. Measure people on a single metric and they will sacrifice every other aspect of your business to make that metric look good.
Reminds me of the story about the British India Company putting a bounty on snales to combat an infestation. People started breeding snakes to claim the bounties. When the government caught up to that, they stopped giving bounties for snales heads. So people released all their snakes into the wild, making the infestation worse than it was.
Do you mean that GDP is not the most important measure of a success of a country?
Isn’t the GDP itself a roll-up of dozens or hundreds of other metrics, making it nigh impossible to game? Gaming the metric is the problematic part of identifying metrics to track performance being referred to.