Thanks for all the reply's, i didn't found the problem yet. After a fresch install of windows 7 and a fresch instal of vista SP1 on a different machine i noticed it happens on both OS just random with 178.. driver and 180.. drivers.(i tested this day) have one SLI rig and one rig with a single GTX260 both dual Core CPU.
Both rigs are highly stable and run every game (DX 9 and 10) flawless.
On the fresch vista install the error came right after setting the native resolution for the monitor wich is 1680X1050, when i hit the okay button it showed the desktop with the error mentioned. On the W7 install it went better, but after i crashed in the Campain ( i selected Dusk ) i wanted to fly again by hitting the fly again button, after doing that i was promted again by the mentioned error message! I' am running W7 for a long time now and BS is installed more then 3 to 4 weeks without any problems, i didn't chance anything. So sometimes it happens and completely random! The game is playble but its irritating when you fly a mission and want to refly right away after a crash or being shot down. The only thing i can think off is the SSD's i use becouse thats the only thing thats nconfentional, on the other hand if two OS can run on those and several games like LOMAC without any problems i have my doubts . I also think its kinda strange the error is comming very early right after hitting the fly botton to start a mission or hit the OK butten to confirm the resolution settings. I mean when it executes without error it runs flawless(no graphical arifacts whatsoever). I am out of idea's and tryed alot other stuf like audio settings and drivers, run as admin and compatibilty mode etc.....
I wonder if starforce checks after executing the game or a mission i mean the error occurs at the same time you have to enter the serial on a new install:suspect:
EDIT: Found it! For some reason the PhysX software was disabled, enableing did the trick. Happy again. thanks for the support!