Variables that you create in a script should be removed after the script completes.
But not so in ISE I'm afraid.
The 'proper' way to do this is that your script cleans up at the end what it created.
And you can always do
Get-Variable-Name MyVar |Remove-Variable-Confirm:$false