AI brief
Microsoft Research described an approach to evaluating Microsoft Copilot at enterprise scale that uses synthetic enterprise data, because real organizational data contains sensitive information that cannot be used for evaluation.
Why it matters: It points to synthetic data as a way to test enterprise AI assistants without exposing sensitive organizational information.
Written by AI from Microsoft Research's published text.
Background
From our own funding, model and news trackers, not from the source.
Microsoft
- Newest model on the API
- Phi 4 · 10 Jan 2025 · $0.07 in / $0.14 out per million tokens
- Last 30 days
- 58 news stories
Source
“Evaluating Microsoft Copilot at enterprise scale requires test data that captures the full complexity of real organizations, yet real enterprise data contains sensitive information that cannot be used for evaluation under any circumstances.”
A paper, laboratory publication or research report.
Read original story ↗