Not Pinning Your OpenRouter Provider Might Invalidate Your Research
Please share this with anyone doing AI research with 3rd party providers so that they can ensure their research won’t be corrupted.When you ask OpenRouter[1] to give you tokens from a given model, OpenRouter sends your request to a random available provider.OpenRouter providers have variable quality. Ensuring that your provider is high quality is really difficult. There is precedent for an AI safety paper accepted to NeurIPS having its core results entirely overturned by these issues.A review of
By Matthew Khoriaty