The -ish in verbs (abolish, establish, finish, punish, etc.) is a mere terminal relic from the Old French present participle.
Latin adjectives in -orius, according to "An Etymological Dictionary of the French Language," tended to "indicate a quality proper to the action accomplished by the agent; as oratorius from orator; laudatorius from laudator. The neuter of these adjectives was early employed as a substantive, and usually denoted the place of residence of the agent or the instrument that he uses; as praetorium from praetor; dormitorium from dormitor; auditorium, dolatorium.
"These newer words, already frequent under the Empire, became exceedingly numerous at a later time, especially in ecclesiastical and scholastic Latin; as purgatorium, refectorium, laboratorium, observatorium, &c." [transl. G.W. Kitchin, Oxford, 1878]
diminutive suffix, first attested late 12c. in proper names adopted from Flanders and Holland. As it is not found in Old English it probably is from Middle Dutch -kin, properly a double-diminutive, from -k + -in. Equivalent to German -chen. Also borrowed in Old French as -quin, where it usually has a bad sense.
This suffix, which is almost barren in French, has been more largely developed in the Picard patois, which uses it for new forms, such as verquin, a shabby little glass (verre); painequin, a bad little loaf (pain); Pierrequin poor little Pierre, &c. ["An Etymological Dictionary of the French Language," transl. G.W. Kitchin, Oxford, 1878]
Used in later Middle English with common nouns. In some words it is directly from Dutch or Flemish.
word-forming element attached to verbs to form abstract nouns of process or fact (convergence from converge), or of state or quality (absence from absent); ultimately from Latin -antia and -entia, which depended on the vowel in the stem word, from PIE *-nt-, adjectival suffix.
Latin present-participle endings for verbs stems in -a- were distinguished from those in -i- and -e-. Hence Modern English protestant, opponent, obedient from Latin protestare, opponere, obedire.
As Old French evolved from Latin, these were leveled to -ance, but later French borrowings from Latin (some of them subsequently passed to English) used the appropriate Latin form of the ending, as did words borrowed by English directly from Latin (diligence,absence).
English thus inherited a confused mass of words from French (crescent/croissant), and further confused it since c. 1500 by restoring -ence selectively in some forms of these words to conform with Latin. Thus dependant, but independence, etc.
often before vowels pseud-, word-forming element meaning "false; feigned; erroneous; in appearance only; resembling," from Greek pseudo-, combining form of pseudēs "false, lying; falsely; deceived," or pseudos "falsehood, untruth, a lie," both from pseudein "to tell a lie; be wrong, break (an oath)," also, in Attic, "to deceive, cheat, be false," but often regardless of intention, a word of uncertain origin. Words in Slavic and Armenian have been compared; by some scholars the Greek word is connected with *psu- "wind" (= "nonsense, idle talk"); Beekes suggests Pre-Greek origin.
Productive in compound formation in ancient Greek (such as pseudodidaskalos "false teacher," pseudokyon "a sham cynic," pseudologia "a false speech," pseudoparthenos "pretended virgin"), it began to be used with native words in later Middle English with a sense of "false, hypocritical" (pseudoclerk "deceitful clerk;" pseudocrist "false apostle;" pseudoprest "heretical priest;" pseudoprophete; pseudofrere) and has been productive since then; the list of words in it in the OED print edition runs to 13 pages. In science, indicating something deceptive in appearance or function.