I find this to be a very important and advanced dialogue/ exchange. Lord Buddha's position is very special and totally unique! However, as a spiritual/religious figurehead the examples and principles he sets are of global consequences or repercussions.

It is undeniable that the presence of both mother and father is crucial and fundamental for humans young ones. This is also the case in some other species in nature. But as humans we have intelligence that can guide us, so we have a greater sense of responsibility and our karmic implications will be more consequential.

Due to Lord Buddha's lack insight and patience as well as sufficient foresight in waiting to conclude family life before retiring into absorption in the ultimate spiritual liberation, even today can be observed positions from his followers such as the one in the segment highlighted from the distinguished ajahn video presentation.

To flip this ethical/moral/religious/spiritual question on to the family members that would be left wanting, is ultimately superficial in consideration. That said his answer or explanations do not have to take into account a continuation or a prolongation of the practice of deep meditation even beyond the expiration of the physical body. 

Kryia considerations are of a totally different order, because indeed and in a way, never mind the family members wallowing in their sorrow and selfish need for never ending burdensome association, the real concern is the repercussion of such a neglect in the future times of meditation, well beyond the present considerations. 

Obviously, these aspects and complixities are presumably resolved in the case of the Lord, unfortunately, because the same may not be said of any regular follower, in this case immitation of a divine master can very well prove disastrous, since his teaching or example is flawed from a mere human perspective. 

This distinction is of utmost importance, and the lack of it will remain problematic forevermore. It is not logical to labor for the ending of suffering as a solution of existence by imposinig the same upon others providentially placed in our care, or discharging the responsibility of their care onto others by default, when eternity can simply wait.