As a software engineer who has written a similar system before for a simulation company - I can tell you it can be done.
It would require the mod publisher to write a script. All the program would need to do is download the files, execute the script and then perform file validation. This results in the creator/publisher doing the work, not ED.
As stated in the original post - with the implementation of a reporting and voting system, ED would not have to manage this - it would be done by the community - simple as flagging something as not working, which could also assist with housekeeping and reducing storage on EDs servers currently by removing unfixed files - which would also make it easier to find stuff.