Yeah, it sounds like a good idea.
I was thinking of another idea, too.
If someone comes in, and their nick / hostname has never been seen by the bot, it could give them a one time message or notice to explain some newbie stuff to them.
Another thing I would like to do, I think PlayingOP suggested this, but I never got around to writing it: A tutorial system. If you've ever seen #Tutorial on Quakenet you'll know what I mean. Instead of just having irc generic tutorials, we could run a system like OP2 game tutorials, OP2 coding tutorials, etc.