outsider (n.)

1800, from outside; figurative sense of "a person isolated from conventional society" is first recorded 1907. The sense of race horses "outside" the favorites is from 1836; hence outside chance (1909).