When I was growing up in the 1950s and '60s, "Negro" and "colored" were used pretty much interchangeably. As I recall, most of the mainstream media were using "black" by 1970.
When I was a child in the 1960s, I was taught that the polite term was "colored". I remember my 1974 World Book Encyclopedia still using the term "Negro".