Welcome to this Cloud Wars Agent and Copilot Minute. In these discussions, I’ll be analyzing opportunities, impact, and outcomes possible with AI; today’s I share learnings from Community Summit NA on the importance of AI having access to business knowledge and processes.
Highlights
00:18 — At Community Summit NA, I heard recurring examples of AI failing to reflect company-specific context. In one case, an agent’s answer differed from a Power BI report because users meant fiscal year when they said “last year;” a paragraph of instructions resolved the mismatch. Dynamic Communities’ VP of AI Analysis and Training Dewain Robinson pointed out that models do not know a company’s processes by default.
01:48 — To give one example, a skill encoding a company’s process passed 36 out of 36 quality checks; without it, the result was 69 percent. The examples pointed to business knowledge—not the model alone—as a key factor in AI effectiveness. Much organizational knowledge remains unwritten and lives in employees’ heads.
03:07— During the conference, I captured nine recordings totaling nearly 10 hours, along with photos of relevant slides. AI helped turn these materials into session briefs, searchable transcripts, a slide library, and handouts. Recording conversations and leveraging AI for summaries can make knowledge easier to preserve and share, as I did with a colleague I met at the conference.
More CIO and AI Agent Insights:
- Before Deploying Autopilot, Establish Clear Human Oversight and Permissions
- ‘Software Is Dead’ Nonsense
- Cowork Experiment Delivers Powerful AI Cost Lessons
- Governance, Billing Considerations With the Always-On Microsoft Scout
- 4 Requirements to Drive Results That Go Beyond ‘AI Theater’
Kenny Mullican
CIO
Paragon Films
Related Posts
