DOMAIN OF KNOWLEDGE | WHAT PEOPLE NEED TO UNDERSTAND | WHAT THIS ENTAILS | HOSPITALITY EXAMPLES |
|---|
1. WHERE AI IS ALREADY PRESENT | AI is not limited to LLMs or generative AI. AI may enter the organisation without a deliberate decision to “buy AI”. The concept of shadow AI | Recognise AI embedded in existing software, introduced through vendors, brought in by employees, added through software updates, or contained in everyday consumer tools. Understand that shadow AI creates governance risk and why visibility is the starting point for governance. | ChatGPT used by staff to respond to emails; AI features added to Microsoft 365; dynamic pricing in revenue management; AI in CRM or PMS platforms; a marketing agency using AI to process guest information. |
2. WHAT AN AI SYSTEM IS INTENDED AND NOT INTENDED TO DO | Every AI system should have an approved purpose and defined operating boundaries. | Understand the system's intended purpose, approved users, permitted data, decisions it may influence and activities it is prohibited from performing. Recognise when use has expanded beyond the approved purpose. Understand that an AI system may have limitations, uncertainty or reliability constraints that affect whether it is suitable for a particular purpose or context. | A guest chatbot may answer questions about check-in times and restaurant hours, but should not approve refunds, waive cancellation fees or change reservation records. A marketing AI may draft content but not publish unreviewed legal or privacy claims. |
3. WHAT DATA IT USES AND WHO CAN ACCESS IT | AI governance requires visibility of what data enters a system, where it comes from, where it goes and who is responsible for it. | Understand data sources, data ownership, data lineage, access, vendor processing and traceability. Recognise the roles of the data steward, AI system owner, technical owner and vendor/procurement owner. | Guest reservation data moves from the PMS to the CRM, then to an AI personalisation tool. Employees should understand what information is used, who owns it, who can access it and whether a vendor can process it. |
4. THE DIFFERENCE BETWEEN AI OUTPUT AND AUTHORITATIVE SYSTEM STATE | AI-generated information is not automatically the organisation's authoritative system state or official business record. | Understand the distinction between model output - generated, predicted, inferred or recommended information - and the authoritative system state maintained by the organisation's designated system of record. Know when AI output must be verified. Understand that AI outputs may be inaccurate, incomplete, misleading or generated with unwarranted confidence, and should be interpreted in the context in which the system is being used. | A chatbot says a guest has a reservation, but the PMS shows none. The PMS prevails. An AI pricing system recommends a 15% rate increase, but the approved rate in the PMS/revenue system is the authoritative state. |
5. WHO IS ACCOUNTABLE FOR APPROVAL, OPERATION AND INCIDENTS | Accountability remains with people and the organisation; it cannot be transferred to the AI or vendor. | Understand accountability across the lifecycle: approval, operation, oversight, escalation and incident response. Recognise the different roles of the executive sponsor, AI system owner, business owner, technical owner and data steward. | An executive approves deployment of a guest chatbot; the AI system owner oversees it; Guest Experience owns operational outcomes; IT manages integrations; the data steward governs guest data; an identified owner coordinates an incident. |
6. WHEN A HUMAN MUST INTERVENE OR TAKE OWNERSHIP | AI may assist, recommend, predict or generate, but it cannot accept accountability or organisational authority. | Recognise when human review, approval, intervention or escalation is required. Understand human-in-the-loop, human-on-the-loop and human-out-of-the-loop oversight. Recognise situations where AI exceeds its purpose, uses unauthorised data, produces harmful or unexpected outcomes, or conflicts with authoritative records. Understand that human oversight should also consider fairness, bias, transparency and the potential impact of AI-assisted decisions on people. | A chatbot recommends a refund but a human approves it. AI may screen CVs, but humans make employment decisions. A revenue AI recommends pricing, but management decides. A chatbot conflicts with the PMS and staff verify the authoritative record. A recruitment AI consistently ranks candidates from one demographic group disproportionately lower than candidates from other groups. A human must not simply accept the recommendation; the outcome should be questioned, investigated and escalated where appropriate. |
7. HOW TO REPORT SHADOW AI, ERRORS, HARMFUL OUTCOMES OR SUSPECTED MISUSE | Governance depends on people surfacing concerns. If AI use or problems are not reported, they cannot be governed. | Recognise shadow AI, incorrect outputs, harmful outcomes, data concerns, suspected misuse and vendor changes. Know what to report, where to report it and what information will support investigation and remediation. | An employee uses a personal ChatGPT account for guest communications; a chatbot gives incorrect booking information; an employee uploads guest information to an unapproved tool; a vendor introduces a new AI feature without notification. |
8. HOW GUEST, EMPLOYEE, VENDOR AND JURISDICTIONAL CONTEXT CHANGES RISK | AI risk is determined not only by the technology but by how, where and on whom it is used. | Understand how guest impact, employee impact, data sensitivity, vendor involvement, jurisdiction, property characteristics and deployment scale affect the level of governance, oversight and accountability required. Understand that risk can change after deployment when the system, data, vendor, users, purpose, scale or operating environment changes, and that governance may therefore require reassessment. | A chatbot answering restaurant hours at one boutique hotel may present relatively limited risk. The same technology handling reservations and loyalty information for a global hotel group across multiple jurisdictions creates significantly greater governance requirements. |