Actual Model Maximum Token Limit

m7777
Tera Guru

Can I view the actual usage of Request token amount, Response token amount, and Buffer token amount?

I want to estimate token usage. I want to conduct tests in the development environment and base the estimate on the test results.

 

Regarding Response Token Amount
For example, if an AI agent's script (tool) retrieves 20,000 records from the incident table, will this be counted toward the response token amount?

0 REPLIES 0