We asked it to be our shared memory. It could not be — and understanding exactly why turned out to be more useful than the tool itself.
NotebookLM answers questions using only the sources you give it, with citations back to the exact passage. That one constraint is the whole product, and it is genuinely valuable. It is also why it could not do the job we first asked of it.
You give it a fixed set of sources — documents, pages, uploads — and it answers questions from those, citing which source produced each claim. It will also generate summaries, study material and audio overviews of the same set.
The discipline is the feature. A general assistant will happily fill a gap from general knowledge; this one stays inside the material you supplied, which makes it checkable in a way that ordinary chat is not. Google has been folding it into the wider Gemini product line and it now also appears under the name Gemini Notebook, so expect the branding to keep moving.
The question we actually askedThat was the real starting point, and it is the same question most organisations arrive at: our files are a mess, could an AI layer sit on top and make sense of them. It is an appealing idea because it promises to skip the boring part.
We wrote the answer down, and it was no. The reasoning is the useful bit:
It sits on top of the chaos; it does not cure it. Its sources still come from the same disorganised store. Garbage in, confident garbage out — and the confidence is the dangerous part, because a well-cited answer drawn from three stale documents reads exactly like a good one.
A tool that grounds its answers in your sources inherits the quality of those sources completely. If nobody can say which version of a document is current, the citation tells you where the claim came from but not whether it is true. Grounding is not the same as governance.
Where it landedRather than drop it, we narrowed it. The rule we settled on is simple enough to state in a sentence: the notebook is a rendered view of the source of truth, never the source of truth itself. If the notebook and the canonical record disagree, the record wins and the notebook gets rebuilt.
That reframing made it genuinely useful. Pointed at a curated, clean source set, it is very good at exactly what the team likes it for: grounded question and answer over a defined body of material, and audio overviews for the times when reading is not practical. Pointed at everything, it is a liability.
We maintain a notebook holding a curated export of our knowledge base, refreshed from the canonical record rather than edited in place. Two refresh behaviours exist and the difference matters more than it sounds: one creates a fresh notebook each time, the other replaces the contents of the existing one. Choosing the wrong one silently orphans whatever people had already been working against.
That is a mundane operational detail, and it is precisely the kind of thing that decides whether an AI tool is trusted six months in.
Getting data in and outWe initially recorded that there was no programmatic way in at all. On checking properly, that was wrong, and the corrected picture is worth knowing before anyone plans around it:
Ruling that third option out cost us convenience and was still obviously correct. A workflow that depends on an unofficial integration is a workflow with a hidden expiry date.
Where it stopsUsed inside those lines, it earns its place. It is one of the clearest examples we have of a tool that got more useful once we asked it to do less.
Usually it cannot, on its own. The first conversation is free and will tell you which order to do things in.
Request a Consultation