What is that 5th gear noise coming from my 2006 Suzuki DRZ400 Super Moto?

I don't want to split the case unless I have to. I did notice a sloppy spacer in place of the kick starter mechanism. This bike was sold without kick start back up.