The only reason I do not do that is so I can run a setup intent scan and the files it needs it will actually bring into the project. Some projects (small ones only) I do actually build the ism on the dev box, but most smaller ones I run setup intent, apply my template, and build only the ism in the vm session.