I bought a frame for my first published piece of writing. It was a Cracked.com Photoshop contest, but it's mostly writing, and they published it, so it counts.
I bought a new frame for my first rejection letter as well, because I can't find the one I bought years ago. It's empty because I haven't received a rejection letter yet. Although, I just submitted a poem to Poetry Magazine because I'm required to for my creative writing class, so I should have one in 6 to 8 weeks, then I'll be a real writer!