in figurative sense of "withdraw a charge," 1859, American English, from the notion of descending a ladder, etc. (such a literal sense is attested by 1849); from back (v.) + down (adv.).