"Nor should it be forgotten that, just as different nations of people differ from one another in race [genus], customs [mores], language [lingua], and laws [leges], so the holy universal church spread throughout the whole world, although united in the unity of faith, nevertheless differs from one another in ecclesiastical customs."
There were other factors that distinguished "The Other" from oneself: religion, economic class, geographic origin, even clothing. The illustration you can see if you follow the link in the first paragraph uses a turban and bushy beard to indicate a man from Africa, not skin color.
It would be difficult to argue that religion was a prime factor in distinguishing race, and such a strong part of a cultural identity that those of other religions were a danger to the self and the body politic. Although using factors that indicate a different race did not necessarily lead to racism, religion as a factor led to outright hostility.
Of course the primary example of religion-based race leading to prominent racism is the Western European attitude toward Jews:
...the periodic exterminations of Jews in Europe, the demand that they mark their bodies and the bodies of their children with a large visible badge, the herding of Jews into specific towns in England to monitor their livelihoods, and the vilification of Jews for supposedly possessing a fetid stench, a male menses, subhuman and bestial qualities, and a congenital need to ingest the blood of Christian children whom they tortured and crucified to death... [source]
For Western Europe, and particularly countries who wholly expelled Jews, religion was the deciding factor.
Jews were not the only religion that came under fire. Bernard of Clairvaux, asked to write a rule for the newly formed Knights of the Order of the Temple (Templars), proclaims that the killing of Muslims was not homicide by malicide, the killing of evil. The Crusades could be seen as a form of institutionalized racism.
The Fourth Lateran Council in 1215 called by Pope Innocent III published Canon 68, cementing racist law against Jews. We'll look at the details and outcome tomorrow.