The Preview functionality uses the same preview method as Explorer and so you should the same thing happen if you try previewing a file in Explorer.
The issue is, normally, that you've installed the 64-bit version of Outlook, which doesn't support Explorer preview.