Certain formulae have to be learnt –– heart.

The correct preposition to use after 'learnt' when referring to memorization is 'by'. Therefore, 'learnt by heart' is the correct phrase.