That should do the trick. What does your \FancyVerbLine look like? Please note that it is not enough to enable formatting - you also need to enable the counter command:
\renewcommand\theFancyVerbLine{\large\arabic{FancyVerbLine}}
That should work.
source share