Is There a Portrait in Your Past?