At every start, GIMP selects the brush, color, pattern you used when quitting your previous session because the Save input device settings on exit in Preferences/Input Devices, is checked by default. If you uncheck it, GIMP will use a color, a brush and a pattern by default, always the same.