-
Notifications
You must be signed in to change notification settings - Fork 42
Open
Labels
[Priority] LowNot essential work but deemed nice to haveNot essential work but deemed nice to have
Description
The TokenUsage DTO right now has a couple of limitations to it:
- It can't be null in the
GenerativeAiResultDTO, so it's assumed to always be supplied - The individual properties of
TokenUsageare all non-nullable, so they must also be supplied
The work around for this has been to do something like new TokenUsage(0, 0, 0) to indicate the values weren't provided. This is confusing and makes it hard to distinguish between statistics not being provided versus actual values. This will become even more important if we add additional properties in the future that only some providers support.
I recommend making the properties nullable as well as the TokenUsage instance nullable in GenerativeAiResult.
Metadata
Metadata
Assignees
Labels
[Priority] LowNot essential work but deemed nice to haveNot essential work but deemed nice to have