Ah, but matter can be created out of energy, thus demonstrating that the "matter cannot be created or destroyed" mantra is only true if you look at it in a wider context. Given that, I see no reason why matter moving between two times would be problematic; it's not being created or destroyed in the context of the entire timeline.
What energy was used to create this extra matter (you)? The energy you used to power your time machine still exists in the earlier time, and now so does the duplicate you, so you have both the original energy and the new matter that's been created. The two yous then destroy the time machine when you realize how dangerous it is, and go on about your merry way. You've just added matter to the universe, at no net cost!
So... time travel into the past is not possible.
---------------
You miss my point. Any matter that is "created" in the past is "destroyed" simultaneously in the future. Thus balance is maintained. The energy thing was just a parallel observation.
No different than moving matter around in our usual 3 dimensions, really. Just a bit more loopy.
Destroying the time machine you used would be something you'd only do if you were really, really angry at the universe. Or wanted to see what happened. Either way, probably not good.