This is probably not the type of question for this sub. It might get deleted, but my suggestion would be to visit an amazing historical site which interests you. The Roman Forum, Stonehenge, Athens, the Forbidden City... The memories and pictures you obtain in such a place would be better than any object.

What's amazing to you and what's amazing to someone else will differ. I always recommend checking out garage sales and especially estate sales.

buy a Roman coin.

http://www.forumancientcoins.com/

Consider going to used book stores and check out what you can find (perhaps on the dustiest shelves in the back?).

• Search for first editions of pieces you enjoy or recognize and keep them forever - they may have more personal meaning for you than monetary value, but are history nonetheless.
• Or pick up books with long past print dates that you don't recognize and do a little research on them. For example, I found a beautiful, delicate, leather-bound book printed in the 18th century - in Latin. I had no idea what it was, but after a little research I found it was a history of Rome. Very little idea what it says of course, but the point was to own a very dated piece of history - even if it was only valuable to me!

Good luck, enjoy!