How do you do OOD detection on a closed LLM API with no latent access?
Classical OOD detection assumes you can see the model. Mahalanobis on features and energy on logits are typical, and both require cracking the model open. With closed LLM APIs you get text in, text out, and maybe top K
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/artificial
Originally published by r/artificial. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.