1550s, "estate manager's office," from Middle French factorie, from Late Latin factorium "office for agents (factors)," also "oil press, mill," from Latin factor "doer, maker" (see factor (n.)). Sense of "building for making goods" is first attested 1610s. Factory farm attested from 1890.