dmd CI tests should not run when only spec is changed

[ntrel]

Following the move of dlang.org spec folder to the dmd repo, spec wording changes such as dlang/dmd#22808 trigger all of dmd's tests. It only needs to run the dlang.org ones.