New research indicates that the cost of using AI models varies significantly across different languages, with token consumption differing by up to 17 times.
IT Home reported on October 30 that users of less widely spoken languages may face higher costs when using AI services compared to users of English and other major languages. According to a report by foreign media outlet Rest of World on the 28th local time, a study released last month by the Artificial Intelligence Language Equity Research Consortium found that AI models can consume vastly different numbers of tokens when processing various languages. Tokens are the basic units through which AI models process text and other data...
AI NEWS.cc