Per cancellarli davvero, togliere -WhatIf
Get-ChildItem -LiteralPath 'D:\data' -Filter '~$*' -File -Recurse -Force | Remove-Item -Force -WhatIf