As long as you are not using his Apple ID for anything, he cannot track you. Go to Settings > Mail and delete all accounts there. Add a new Mobile Me or iCloud account - depending on your OS version - and use your Apple ID to set up Find my Phone.
This is the feature he would use to track your phone, but his Apple ID would have to still be defined in the accounts section