Navigating the AI WorldPart B · Deciding what to learnChapter 7 of 28

Build a roadmap you can revise

Use four buckets: Now, Next, Later and Ignore for now. Place a skill according to the work it enables, then revise the placement when your responsibilities change. “Ignore for now” preserves attention without making a permanent judgement about the technology.

Current directionNowNextLaterIgnore for now
Business or operationsSafe use, task framing, evidence checksRepeatable templates and approved automationAPIs for repetitive workModel training and CUDA
Software to AI applicationsModel calls, schemas, evaluation baselineAuthorized retrieval and narrow toolsAgents or MCP when neededFoundation-model pretraining
Infrastructure to AI platformsInference, memory, containersServing, monitoring and load testingDistributed inference and profilingUnrelated prompt-framework churn

For each work cycle, name the problem, the current baseline and the improvement you expect to observe. “Learn agents” is too broad. “Reduce the time to produce a reviewed incident summary while preserving all material evidence” gives you something you can actually test.

Start with ten representative examples you can judge. Record the current effort and the errors that matter. Try the simplest approved design, inspect what fails and change only what the evidence points to. Keep a short decision record so an approach you rejected for a reason does not return later under a new product name.

When a new technology appears, first ask what job it performs. Then ask what it replaces, which constraints it changes, and what migration or operating work it introduces. Your evaluation should be able to detect the benefit being claimed. A promising demonstration is a reason to test, not evidence that your system needs the technology.

There is another useful question: what happens if you wait six months? If very little changes, your attention may be better spent finishing the current workflow. If a new requirement makes the technology necessary, move it into Now and give it a concrete test.

The five labs in chapters 27 and 28 are designed for that kind of test. Completing one carefully, including the failed cases, is more informative than following several tutorials whose outputs you never check.

Report a correction

Corrections go to the editor and are never published automatically. No account needed.