You have to keep all the records that will support your claims as filed in your returns.
The records must allow you to determine how much tax you owe, or the tax, duties, or other amounts to be collected, withheld, or deducted.
The records must be supported by original documents such as:
For information on how long to keep it, see retention of books and records.