Analyst Gene Munster gives Apple’s Siri a grade D for precision
Piper Jaffray analyst Gene Munster has put Siri to the test, asking his iPhone 1,600 questions in total to find out how accurate the 4S’s personal assistant is.
Fortune reports that Munster split the questions into two halves, asking 800 on a busy street and 800 in a quiet room. Munster then published his results in a note to clients on Thursday.
When testing Google, the search engine understood 100 per cent of the typed in questions and replied accurately 86 per cent of the time, earning a B+ from the analyst.
Siri understood 83 per cent of the queries in noisy conditions, and 89 per cent in a quiet room. Siri gave an accurate reply 62 per cent of the time on the busy streets and 68 per cent in a quiet environment. This earned Siri a grade D for accuracy, according to Munster.
“In order to become viable mobile search alternative, Siri must match or exceed Google’s precision of B and change from a grade D to some B or greater,” authored Munster.
The discharge of iOS 6 this fall and also the reduction in reliance upon Google may help Siri get caught up, stated Munster, who believes the iPhone’s assistant is 2 years behind Google in the learning curve.
But Bing is fighting back using its own smart assistant, Google Now, that was announced in the company’s annual I/O developer conference on Wednesday.
“Breaking lower Siri’s reliance further, Google provides 100 percent of navigation results, 61 percent of knowledge results, 48 percent of commerce results and 42 percent of local results,” authored Munster. “Among other result aggregators, Yelp provided probably the most local results (51 percent) and commerce results (51 percent), while WolframAlpha provided 34 percent of knowledge results.”
Using the discharge of iOS 6, Apple’s new maps service will give you all the navigation results, Yahoo Sports is going to be added for sports information, Open Table will give you detail about restaurants, Rotten Tomato plants can give movie show occasions and Fandango allows ticket purchases. How these changes will affect Siri’s precision isn’t yet known.
Munster highlighted several kinds of mistakes produced by Siri in the test, the most typical error as being a response with the solution to the prior query.
When requested where Elvis was hidden, Siri stated “I can’t answer that for you personally,Inches mistaking ‘Elvis buried’ for the an individual.
The pin would sometimes stop by the incorrect place when Munster requested Siri “Where shall we be held?Inches
Other examples demonstrated how Siri can detect particular words inside a query, supplying related information that doesn’t answer the issue requested.
Apple co-founder Steve Wozniak lately stated he thinks Apple destroyed Siri, calling the voice recognition assistant “poo-poo”. Charming.
How have you ever found your knowledge about Siri? Tell us within the comments section below.