Transmission and reception of raw video using scalable frame rate

An apparatus includes an input interface and transmit-side circuitry. The input interface is configured to receive a sequence of packets that carries a stream of video frames. The transmit-side circuitry is configured to divide the sequence of packets into multiple interleaved sub-sequences, wherein each sub-sequence carries a respective sub-stream of the stream of video frames, and wherein at least one of the sub-streams is self-contained and viewable independently of any other sub-stream, and to transmit the multiple sub-sequences of packets to a communication network over respective, different packet flows.