c. 1600, "ruined, destroyed," from past participle of obsolete verb downcast "to overthrow, demolish" (c. 1300), from down (adv.) + cast (v.). Figurative sense of "dejected" is by 1630s, probably from the notion of having the eyes directed downward.
downcast after his defeat
a downcast glance