I believe that there is no OOTB way to achieve this. Previewing attachment of various type may be achieved by using third party APIs and you may have to write a lot of code and spend a lot of effort in achieving it.
Note that the case attachments of type image/video/pdf can now be viewed inline by clicking on case attachment link or thumbnail from the attachments gadget of case.
pyWorkAttachmentIcon , pyAttachmentFeedDescription controls are used in the OOTB case attachments
please could you take a look at the following posts: