(vb.net 3.5) How can I prevent validating when closing form?

I am a newbie. I am using validating procedures to validate user input from 4 text boxes. I am experiencing an issue using the 'x' button to close my form if invalid or no data is present in the textbox with focus when I click the 'x' button. Validating triggers and the message box appears. You can change the data to something valid and close fine but this is aggrevating. I changed the forms causevalidation attribute to false and created a sub to handle formclosing. In that sub I specified that causevalidation for all textboxes be disabled and also set e cancel to false. After that I tested with bad data and the message box showed again, but when I closed it the form closed also. This is better than before but I would like the message box to not show at all. Any suggestions?