Yes, "springs" are indeed used for softbodies because you have to simulate the forces/elasticity between the "cloth" grid points. Do "draw" the cloth you would indeed have to tinker with the vertices - of course.

The point is how you simulate the softbody in order to collide with the geometry. And therefore, I think, a SDK like PhysX would be great for you.