I've read a couple of non-fiction works related to this topic and enjoyed them. If you're interested about how the science behind it could or could not work, then you could check out these:

Travels in Four Dimensions: The Enigmas of Space and Time by Robin Le Poidevin
This book tries to define space and time in an understandable way and examine the physics (properties, forces, constants, etc.) to think about the nature of time (what is it? does it have a beginning? how can it be altered? etc.)

Physics of the Impossible: A Scientific Exploration into the World of Phasers, Force Fields, Teleportation, and Time Travel by Michio Kaku
This book is written with enthusiasm, but a bit less profound than the other one. It's more a showcase of how science is helping make many of the previously-held fantasies come to real life.

As far as fiction goes... I think there are quite a few works you could look at. I mean, isn't A Christmas Carol technically a time-travel work?