If a person that you love constantly tells you the following – “You will never understand me!” “You never listen to me!” “You never remember anything about me!” - and if that same person gets repeatedly offended by things you say or do, it’s probably better to back off and leave that person alone. At least for quite some time.
The problem, if you can use that word, probably lies with both of you. You may not have the time or patience for taking care of the other person. And/or the other person is not in a position or is incapable of understanding your limitations. Don’t take the brunt of the burden to correct things all by yourself. Efforts have to be bilateral.