Just had same issue when updating TH3 and it appears even with admin rights or via Administrator account the file cannot be deleted. As I have a support contract with Microsoft got them involved and here is the solution:
here's how to get into safe mode :
Please press windows key or start menu
>> type in run
>> click run
>> type in msconfig, hit enter
>> browse the tabs and click
boot >> from the boot put a check into the
safe option and make sure that the button under it is set to
minimal (
To get back to normal mode just uncheck the safe mode and that should get you to boot to normal mode)
>> after checking those click apply and then ok
> > that would ask you to restart your computer for the changes to apply.
Once in safe mode the file can be deleted.