Initially, it was a complex of larger dimensions, since it occupied the whole block, peeking one of the side facades to the street Chavarri and another to the path of Orusco. With such dimensions, the original palace housed a main space destined to be used as a residence, next to a work house with a Toledo courtyard.
The Barrientos family, the original owner of the palace, is known for its illustrious military members who served important figures in the history of Spain as Hernán Cortés, the Duke of Alba or Juan de Austria. One of them, the captain Diego Barrientos, is buried in the parochial church of Carabaña. Throughout the centuries the property has been changing owners, just as it has done its physiognomy and use. During the Civil War it was used to store material and, after it, it was transformed into a prison. It is currently a nursing home.
Architecturally it is a simple style building, with a façade of a piece in brick in which the nobiliary shield and the stone ashlar cover stand out. Two of the windows retain the old trellis that can be seen in other similar style houses, such as the House of the Garnica, in front of the east facade of the Church of the Assumption of Our Lady. Its name derives from the fact that one of the relatives of Captain Barrientos, Doctor Diego Barrientos, was in the service of the viceroys of New Spain like governor of Tlaxcala (Mexico).