Is it possible for this to be something mostly psychological?

you could try talking *it through with a therapist. they often find interesting insights and suggestions