A grimoire is a book of magic spells, from French, from Latin, and I think related to Ancient Greek grammata = letters.
Those who can read and write may cast spells. They may be glamorous, glammar being a Scots variant. And so we see those who can read, write, spell, may bewitch and fascinate. Letters are dangerous.