Breakout session assignment by device affiliation

Presented herein are techniques in which a device connects a plurality of user devices to a communication session in which a plurality of participants of the respective plurality of user devices communicate using audio and/or video and determines respective locations of the plurality of user devices. The devices receives, from a particular user device of the plurality of user devices, a request to group the user devices into a plurality of groups to form one or more breakout communication sessions off of the communication session, assigns user devices to respective ones of the plurality of groups based on the respective locations such that user devices at a common location are assigned to a same group, and transmits information identifying the plurality of groups to the particular user device.