How to Stop Your Past from Poisoning Your Future