Well they are public, but people usually don't look back very far in Twitter feeds. Especially on accounts that have a lot of tweets. It can be far too time consuming. There's also no way to search... so you need to paginate backwards and save off pages, building your own local cache, then search through that. Very tedious.