Controllers are not merely the dominant interface to interact in virtual reality (VR); they also are the main resource for haptically perceiving the virtual world. As standard VR controllers fail in generating realistic haptic feedback, we designed HapticCollider, a kinetic controller rendering force feedback, e.g., to simulate a collision when hammering or hitting against a virtual object. In our user study, we demonstrated that HapticCollider significantly increases realism in tool usage compared with a standard VR controller. As key factors for tool use realism in VR, we identified force feedback, controller weight, and grip shape in combination with software solutions, namely collision prediction, and control-display ratio to render the force timing, as well as, the tool position according to the user’s expectations.