I totally agree with you! Sometimes when I am having a really anxious week I will notice myself forgetting so many things. I didn't realise this was actually a symptom of anxiety and oh my goodness it made me feel a lot better when I realised this! Something that helps me is keeping my diary up to date, writing lots of lists and scheduling reminders in my phone.
I hope these are some things you can try do too but also don't be so hard on yourself when you do forget things - the world is such a busy place nowadays and it's easy to get caught up forgetting half our to-do-lists!