There's a fundamental difference though. The LLM is itself inscrutable, while all of these programs used to be written and understood by humans. The language used for programming used to be specified and have unique (hopefully) coherent syntax and abstraction boundaries. Now it's "anything goes" and nobody seems to know how this stuff ends up getting used...

Someone might accidentally find it works well and then we might all end up writing fairytales in iambic pentameter describing the use cases of software we want...