Old English þæt, "that, so that, after that," neuter singular demonstrative pronoun ("A Man's a Man for a' that"), relative pronoun ("O thou that hearest prayer"), and demonstrative adjective ("Look at that caveman go!"), corresponding to masc. se, fem. seo. From Proto-Germanic *that, from PIE *tod-, extended form of demonstrative pronominal base *-to- (see -th (1)).
With the breakdown of the grammatical gender system, it came to be used in Middle English and Modern English for all genders. Germanic cognates include Old Saxon that, Old Frisian thet, Middle Dutch, Dutch dat "that," German der, die, das "the."
Generally more specific or emphatic than the, but in some cases they are interchangeable. From c. 1200 opposed to this as indicating something farther off. In adverbial use ("I'm that old"), in reference to something implied or previously said, c. 1200, an abbreviation of the notion of "to that extent," "to that degree." As a conjunction ("Not that I loved Caesar less, but that I loved Rome more") it was originally the neuter pronoun or adjective that used practically as a definite article qualifying the whole sentence.
Slang that way "in love" first recorded 1929. That-a-way "in that direction" is recorded from 1839. "Take that!" said while delivering a blow, is recorded from early 15c.
by 1912, American English, first attested in baseball slang; as a type of music, attested by 1915. Perhaps ultimately from slang jasm(1860) "energy, vitality, spirit," perhaps especially in a woman. This is perhaps from earlier gism in the same sense (1842).
By the end of the 1800s, "gism" meant not only "vitality" but also "virility," leading to the word being used as slang for "semen." But — and this is significant — although a similar evolution happened to the word "jazz," which became slang for the act of sex, that did not happen until 1918 at the earliest. That is, the sexual connotation was not part of the origin of the word, but something added later. [Lewis Porter, "Where Did 'Jazz,' the Word, Come From?" http://wbgo.org Feb. 26, 2018]
Meaning "rubbish, unnecessary talk or ornamentation" is from 1918. Slang all that jazz "et cetera" first recorded 1939. Further observations from Porter's summation of the research:
"Jazz" seems to have originated among white Americans, and the earliest printed uses are in California baseball writing, where it means "lively, energetic." (The word still carries this meaning, as in "Let’s jazz this up!") The earliest known usage occurs on April 2, 1912, in an article discovered by researcher George A. Thompson, and sent to me courtesy of [Professor Gerald ] Cohen.
... By 1915, jazz was being applied to a new kind of music in Chicago. It seems to have been first applied to Tom Brown's all-white band, which hailed from New Orleans. This was followed by many printed references to jazz as a musical style.
Old English eall "every, entire, the whole quantity of" (adj.), "fully, wholly, entirely" (adv.), from Proto-Germanic *alnaz (source also of Old Frisian, Old High German al; German all, alle; Old Norse allr; Gothic alls), with no certain connection outside Germanic. As a noun, in Old English, "all that is, everything."
Combinations with all meaning "wholly, without limit" were common in Old English (such as eall-halig "all-holy," eall-mihtig "all-mighty") and the method continued to form new compound words throughout the history of English. Middle English had al-wher "wherever; whenever" (early 14c.); al-soon "as soon as possible," al-what (c. 1300) "all sorts of things, whatever."
Of the common modern phrases with it, at all "in any way" is from mid-14c., and all "and everything (else)" is from 1530s, all but "everything short of" is from 1590s. First record of all out "to one's full powers" is 1880. All clear as a signal of "no danger" is recorded from 1902. All right, indicative of assent or approval, is attested by 1837; the meaning "satisfactory, acceptable" is by 1939, from the notion of "turning out well."
The use of a, a' as an abbreviation of all (as in Burns' "A Man's a Man for A' that") is a modern Scottishism but has history in English to 13c.
1921; see jazz (n.); popularized 1922 in writings of F. Scott Fitzgerald; usually regarded as the years between the end of World War I (1918) and the Stock Market crash of 1929.
We are living in a jazz age of super-accentuated rhythm in all things; in a rhythm that (to "jazz" a word) is super-normal, a rhythm which is the back-flare from the rhythm of a super war. ["Jacobs' Band Monthly," Jan. 1921]
1829, U.S. slang, said to be a euphemism for hell-fired, but perhaps it is what it says, with all as an intensive.