Since DirectX is based on the COM model which dictates that every newer version has to be 100% downward compatible your software will still work if it uses DirectX 9 even if there is DirectX 12 installed.
At least it has always been that way and I didn't hear from any changes to that.