After years of trial and error I found a rule that works for me:
+ Practice with click
+ Record without it (band always recording all together, ready to redo vocals at separate session to a pre-mixed track)
It's useful though, to have a click starter to make sure each take will start at the same tempo. I usually make a final take up of two different ones or just need to replace the end, etc.
I've also been recording with a drummer who kept the same tempo without click nor even starter for 7 takes so I could replace any bar from the entire session and it always matched perfectly