To leverage Ask Sage, the Army secured access to 100 million tokens through an annual “Enterprise Pack” subscription. Each token represents a unit of output from a language model (LLM), equating to approximately 3.7 characters of text or an image, as detailed in documents reviewed by WIRED. During the 38-day Operation Epic Fury in Iran, the Pentagon expended an astonishing 20 billion tokens daily, according to Breaking Defense.
Despite inquiries, neither the Army nor the Department of Defense provided comments regarding Ask Sage.
It remains unclear if tokens used by regular Department of Defense employees share the same pool as those utilized by individuals working with classified information. Nevertheless, the Department of Defense is maintaining its commitment to AI. Recently, The Intercept reported that the Pentagon is increasing its reliance on AI tools while downsizing staff at the Civilian Protection Center of Excellence, designed to prevent civilian casualties, opting instead to develop AI tools that expedite assessments typically conducted by center personnel.
The Army is not alone in exploring the vast potential of generative AI. Following the initiative for employees to “tokenmaxx,” Mehta discreetly decommissioned Leaderboard—a tool tracking token usage—and is now attempting to manage its usage more effectively. Just last week, Adam Mosseri, head of Instagram at Meta, suggested capping token usage per engineer. Furthermore, a report by Fortune highlighted that Uber’s engineers exhausted an entire year’s worth of AI tokens in just four months.
An Army official expressed skepticism regarding the effectiveness of generative AI tools, noting that when used, they often proved unreliable. One model even falsely claimed to have completed an unmet task. “While there may be areas within the U.S. federal bureaucracy where these tools could be beneficial, careless application will not yield effective, efficient, or dependable outcomes,” he stated.
This story was originally featured on Wired.com.
Source: arstechnica.com