timestamp
, model used
, latency
, cost
, prompt
, and response
for every request, regardless of whether it was successful or not.
This provides you with a rich dataset that can be used to analyze the performance of your models and identify any potential issues. With the added feature of logging failed requests, you can also use this information to improve the resilience and reliability of your models.