I think a KEY 'working with code llms' skill we've not yet codified is the 'distillation' steps. Those passes after each chunk of implemented functionality to remove the 'code llm smell' - helpers, extensions, duplicate services, word lists and hard coded 'memory store' logic.
THIS is where 'non-technical vibe coded' apps and systems fall apart. Code LLMs add technical debt before the system is even running.
Like having teams of senior developers ina bunch of offices who only communicate through notes left at the end of every day...oh and they forget stuff by design when they get tired (context compaction). They forget to mention the new service they created, that new 'stopwords' list they added etc...Finding them would mean other teams parsing that specific bit of code - when working on unrelated funcitonalty...why would it? (in Code LLMs, spending THOUSANDS of tokens to review stuff it's not 'workign on').
*DISTILLATION* is the new skill, the ability to remove that stank to get to a REAL system rather than the technical debt pile with a nice UX 99% of vibe coded stuff is released as.
It actually reminds me of one of my first jobs on the
ASP.NET team, to review all the WebForms data controls and systems.
We had (I'll miss MANY)
Repeaters, DataLists, DataGrids, Detail Views etc...
There had been a Providers system developed (a common interface before EF was a thing) but MANY of the older controls were never upgraded.
NONE of the controls had common behaviorual interfaces so you used them ALL slightly differently.
Different PMs had specced each one to meet their particular user requirement, they were all CORRECT...but they were all wrong when we needed to build a scaffolding system using them. (IIRC this was one of the first
David Fowler ASP.NET features he worked on as a dev back in the day with Scott Hunter as PM..probably not, I'm OLD!)
NOW this is just industrialised, these 'different pms' are different code llm sessions. A mess that used to take Microsoft and a team of 100 developers, PMs, QAs etc 6 years to make *you can now do solo in a week*.