Hi
Tax code deletion not advisable,as your system must have historical tranaction data( PO,GR and IV) with that old tax code.Instead of deltion of old tax code ,just change validity period for old tax code to previous date with respective tax condition type in T.code:FV12 and save.
Regards,
Biju K