We introduced brush size defined in screen size exactly for this purpose: we realized that every time we decreased brush size we always had to zoom in as well. So, if you use brush size relative to screen size option (default) then you just need to set an approximate brush size once (dictated by how accurately you can move your mouse pointer) and you do the fine brush sizing by zooming the image in/out.