All of the definitions that I see include not only that it is a belief that race determines character and culture (a belief which the Justice in question held), but also prejudice and discrimination based on the belief in race (which the Justice in question demonstrated). Take a look at the "Definitions" section of the Wiki page on "Racism" for an overview.