I'm sorry to hear that you are in a tough, anxious headspace right now- navigating a relationship can be challenging, especially when we are confused about where we stand and how to move forward in a way that is good for the both of you.
It seems like you have discussed the issue with him at length which is a great start- I encourage you to continue this opn, honest dialogue even if you guys become friends. Have you sought out relationship counselling? It sounds like something you could benefit from, so you can get some clarity. If nothing else, professional help may help you manage your anxiety and guide you through whatever direction the relationship take.
What do you think?