Regardless on many game scenarios and only based on ur scenario i see that u dont wish to give up on attacking but ur partner already has. Therefore he move back to one side. Lets put into this, the forecourt player (in attacking) has the right to control the rotation from attack to defense. Simply because u can see him but he cant see u. So after u do a drop and u see him moving back, it becomes ur responsibility to cover ur own side since u are now in defense.