When the curse washes over us, it will send us all back. Nothing will be left behind… including your memories. It’s just what the curse does. Storybrooke will no longer exist. It won’t ever have existed. So these last years, will be gone from both your memories. Now we just go back to being stories again.