I was kind of wondering if it was okay that the oblique holder gets a little ink on it whenever I dip it in, I guess it isn't.
Oh, I think you might get away with it once in a while.

Seriously, it's bound to happen, and how diligent you are about cleaning it off is up to you. If ink creeps inside a brass flange that usually means that you'll have a struggle getting the nib out, but it's nothing that the studious application of a pair of pliers and a modicum of brute force won't sort out if necessary.
I wouldn't worry about it too much, after all pen holders are tools.
This gallery of well-used holders might be reassuring.