There is no “WE”. There is us and ours, and you and yours, and they and theirs, and cooperation with you or they, under your or their parasitism, is no longer preferable to separation, war, or even extermination. It is a purely empirical question.
Cooperation is only valuable until it is not. Under certain conditions cooperation is profitable – when it is not parasitic. Under other conditions predation is preferable to parasitism. The only question I have is whether separation, enslavement, or destruction is preferable. That is a purely empirical question.
The subject of morality is a condition of cooperation outside of cooperation all questions are amoral. Under parasitism only predation is rational. It is a purely empirical question.