Dumbledore och McGonagall berör detta i det första kapitlet:
"It all gets so confusing if we keep saying 'You-Know-Who.' I have never seen any reason to be frightened of saying Voldemort's name.
"I know you haven 't, said Professor McGonagall, sounding half exasperated, half admiring. "But you're different. Everyone knows you're the only one You-Know- oh, all right, Voldemort, was frightened of."
Och Hagrid förklarade det för Harry ganska bra lite senare:
"Well -- I don' like sayin' the name if I can help it. No one does."
"Why not?"
"Gulpin' gargoyles, Harry, people are still scared. Blimey, this is difficult. See, there was this wizard who went... bad. As bad as you could go. Worse. Worse than worse.
De är rädda. Det är ganska dumt, men folk är konstiga. Annat än det verkar det inte finnas någon anledning att inte säga namnet.
And it turns out that there did end up being a reason not to say it with the taboo in book 7.