I have not enabled linum globally.
Instead, I enable linum for the main mode in which I want. For example:
(add-hook 'clojure-mode-hook '(lambda () (linum-on)))
or simply:
(add-hook 'clojure-mode-hook 'linum-mode)
Related here:
Enabling linum mode in python / c mode
and here:
Emacs Org-Mode: disable line numbers
Tacticalcoder
source share