Rather than write free-form answers, it returns a label, decision or score with a probability. Target uses include support-request routing and automated checks.
Baseten reports median latency of 20 milliseconds for an average 2,000-token request. That measurement depends on its test configuration and does not establish latency for every deployment. Users must assess accuracy on their own data before delegating sensitive decisions.