Deep Insight // Appendix worksheetAll worksheets  /  Appendix B

Appendix B | Companion to Chapter 2: Mapping the Depths

AI Tool Comparison Sheet

Match the tool to the job, not the job to whatever tool is already open.


Autosaves on this device PDF version

AI is a toolbox, not a tool. Vendors will happily demo the shiny parts. Your job is to test what happens when your real, messy data hits it. Evaluate up to three options against the friction point from Appendix A.

Part 1

Compare the candidates

Tool 1
Technical lift
Fit for my friction point (1 to 5)
Tool 2
Technical lift
Fit for my friction point (1 to 5)
Tool 3
Technical lift
Fit for my friction point (1 to 5)
Part 2

Run the evaluation questions

Answer for each tool: Y (yes), N (no), or ? (not sure yet). A ? is a homework assignment, not a pass.

QuestionTool 1Tool 2Tool 3
Accurate on my real data, and repeatable?
Not frustrating to use?
Guardrails to handle my data securely (no leaking)?
I understand how it reaches conclusions well enough to trust it?
Likely to still exist in two years?
Integrates with systems I already use?
Approved for use by my organization?
Part 3

Gut check

Did the top tool work as advertised?
Would you trust it inside your workflow?
Part 4

Methodology framework

The tool is the easy part. Run the method around it so the choice holds up when someone asks why.

StepKey questionAction itemMy notes
Problem definitionWhat is my core intelligence need?Map workflow, identify bottlenecks
Data assessmentIs my data usable and ethical?Audit and prepare data
Function selectionWhat AI capabilities fit my needs?Match tasks to AI functions
Human oversightHow will I validate outputs?Plan review and feedback loops
ExperimentationHow will I test and refine my approach?Pilot projects, document lessons
Risk managementWhat are the risks and how will I mitigate them?Identify, monitor, and address risks
AdaptationHow will I update my process over time?Schedule regular reviews
Deliverable

Capability assessment

Reminder: forcing one model to do everything is like asking the sandwich maker to bake a cake. Bias flags go to Appendix C.

Deep Insight: AI for the Intelligence Analyst by Rae Bakerdeepinsightbook.com