If the self is infinite, nothing essential separates us. If there is no self (anattā), there is nothing to separate us. It is often easier to expand out to include everything than to shrink down to nothing. I think the Buddha would agree.
This episode with Doug Kraft was recorded at a retreat given at the Auburn Mercy Center in November 2015.