Key information

Title
Method, system and computer program product for determining congestion of a communication link transmitting a media stream over the communication link
Application number
20220967
Case type
National
Status
29.04.2024 Patent meddelt (B1)
Filed
09.09.2022
Priority
18.11.2021 NO 20211386
Effective date
09.09.2022
Publicly available
19.05.2023
Next annual fee due
30.09.2027
Applicant
PEXIP AS (NO)
Owner
PEXIP AS (NO)
Inventor
Tulio Beloqui (NO) et al.
Agent
ACAPO ONSAGERS AS (NO)
Granted
29.04.2024
Patent number
347894
Expiry date
09.09.2042

Abstract and drawing


Disclaimer: This text has been machine-scanned and may contain errors – please refer to "Publications" for legally binding content.
System and method for determining congestion of a communication link transmitting a media stream over the communication link from a sender device to a receiving device. The method comprising transmitting media packets into the media stream, each media packet having a packet identifier; transmitting recovery packets into the media stream, each recovery packet having a packet identifier and is adapted to replace a missing packet of the media stream; mapping for each packet in the media stream the packet identifier, a transmission timestamp and a packet size; - mapping for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace; transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp; determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet; determining a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet; and determining a packet recovery success rate by dividing a total number of packets determined as recovered within a first sliding window with a total number of packets determined as missing within the first sliding window; and determining that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.

Publications


B1A1
Checking availability of the latest published version...

Documents


Expand Download files (24)
Date
Date Doc. No. Process Case number In/Out Journal description To/from
07.05.2024 11-03 Saksbehandling 20220967(347894) INN NO347894 ACAPO ONSAGERS AS
07.05.2024 11-02 Saksbehandling 20220967(347894) INN 01-PT Registreringsbrev nasjonal patent (15) ( ACAPO ONSAGERS AS
07.05.2024 11-01 Saksbehandling 20220967(347894) INN Korrespondanse (Hovedbrev inn) ACAPO ONSAGERS AS
02.05.2024 10-01 Saksbehandling 20220967(347894) UT PT Registreringsbrev nasjonal patent (15) (PT20220967)
11.03.2024 09-01 Saksbehandling 20220967 UT Intention to grant ONSAGERS AS
23.11.2023 08-05 Saksbehandling 20220967 INN P28598NO00_Patent specification RFP_markup ONSAGERS AS
23.11.2023 08-04 Saksbehandling 20220967 INN P28598NO00_Patent specification RFP ONSAGERS AS
23.11.2023 08-03 Saksbehandling 20220967 INN P28598NO00 Reply 23 Nov 2023 ONSAGERS AS
23.11.2023 08-02 Saksbehandling 20220967 INN P28598NO00 Patentkrav Norsk oversettelse ONSAGERS AS
23.11.2023 08-01 Saksbehandling 20220967 INN Korrespondanse (Hovedbrev inn) ONSAGERS AS
11.11.2023 07-01 Saksbehandling 20220967 UT Substantive examination ONSAGERS AS
05.07.2023 06-02 Saksbehandling 20220967 INN P28598NO00 Reply 5 Jul 2023 ONSAGERS AS
05.07.2023 06-01 Saksbehandling 20220967 INN Korrespondanse (Hovedbrev inn) ONSAGERS AS
10.05.2023 05-01 Saksbehandling 20220967 UT PT Bekreftelse på fristutsettelse ONSAGERS AS
10.11.2022 04-02 Saksbehandling 20220967 INN PDF_515021922 ONSAGERS AS
10.11.2022 04-01 Saksbehandling 20220967 INN Korrespondanse (Hovedbrev inn) ONSAGERS AS
10.11.2022 03-02 Saksbehandling 20220967 UT PT report 09:18:37
10.11.2022 03-01 Saksbehandling 20220967 UT Substantive examination ONSAGERS AS
09.09.2022 02-01 Saksbehandling 20220967 UT Informasjon til oppfinner Håvard Graff
09.09.2022 01-05 Saksbehandling 20220967 INN P28598NO00 English specification ONSAGERS AS
09.09.2022 01-04 Saksbehandling 20220967 INN P28598NO00 Declaring rights to invention form ONSAGERS AS
09.09.2022 01-03 Saksbehandling 20220967 INN P28598NO00 Drawings ONSAGERS AS
09.09.2022 01-02 Saksbehandling 20220967 INN NO General PoA, Pexip AS ONSAGERS AS
09.09.2022 01-01 Saksbehandling 20220967 INN Søknadsskjema Patent ONSAGERS AS

Description, claims and drawings


Disclaimer: This text has been machine-scanned and may contain errors – please refer to "Publications" for legally binding content. Description
Method, system and computer program product for determining congestion of a communication link transmitting a media stream over the communication linkTechnical fieldThe present invention relates video conferencing, in particular to providing a method, system and computer program product for determining congestion of a communication link transmitting a media stream over the communication link from a sender device to a receiving device.BackgroundTransmission of audio and moving pictures in real-time is employed in several applications like e.g. video conferencing, team collaboration software, net meetings and video telephony. Terminals and endpoints being able to participate in a conference may be traditional stationary video conferencing endpoints, external devices, such as mobile and computer devices, smartphones, tablets, personal devices and PCs, and browser-based video conferencing terminals.Video conferencing systems allow for simultaneous exchange of audio, video and data information among multiple conferencing sites. For performing multipoint video conferencing, there usually is a Multipoint Conferencing Node (MCN) that provides switching and layout functions to allow the endpoints and terminals of multiple sites to intercommunicate in a conference. Such nodes may also be referred to as Multipoint Control Units (MCUs), Multi Control Infrastructure (MCI), Conference Nodes and Collaborations Nodes (CNs). MCU is the most commonly used term, and has traditionally has been associated with hardware dedicated to the purpose, however, the functions of an MCN could just as well be implemented in software installed on general purpose servers and computers, so in the following, all kinds of nodes, devices and software implementing features, services and functions providing switching and layout functions to allow the endpoints and terminals of multiple sites to intercommunicate in a conference, including (but not excluding) MCUs, MCIs and CNs are from now on referred to as MCNs.The MCN links sites, endpoints and participants together by receiving conference signals from the sites/endpoints, processing the received signals, and transmitting the processed signals to appropriate sites/endpoints. The conference signals include audio, video, data and control information. The MCN processes the received conference signals from one or more sites/endpoints based on the requirements/capabilities of each site/endpoint receiving signals from the MCN. Fig. 1 schematically illustrates multi-point videoconferencing system 100 with three videoconferencing terminals 101, 102, 103 in communication with a multipoint conferencing node (MCN) 104. In the multi-point videoconferencing system 100 media passes through the MCN 104. Input audio and video 101a, 102a, 103a captured at the videoconferencing terminals 101, 102, 103 is transmitted to the MCN 104, mixed with the audio and video from the other videoconferencing terminals, and the mixed audio and video 101b, 102b, 103b is transmitted back to the videoconferencing terminals 101, 102, 103.An transcoding MCN comprises a plurality of encoders that may translate signals from one video or audio codec to another codec, change picture size, change video quality, change audio quality, change bitrate, combine conference signals from multiple participants into various layouts etc.A switching MCN receives video and audio from each site/endpoint in a plurality of audio qualities, video qualities, picture sizes, and corresponding bitrates, and the switching MCU forwards audio and media streams to other sites/endpoints based on their capabilities and/or requirements. A switching MCN may for example receive four different media stream resolutions; 1080p: 5000Kbps video, 256Kbps audio, 720p: 2500Kbps video, 256Kbps audio, 560p: 1500Kbps video, 256Kbps audio, and/or 360p: 500Kbps video, 128Kbps audio.Network resources are in general limited. A video conferencing session may occupy a considerable part of available network resources, in particular in home-networks, when the media transmitted from the MCN are of high quality and/or sent with high bitrates. Congestion occurs when more data is sent than a receiving network is capable of receiving. In this state packet delay and packet loss occur, and the quality of service is poor. A participant in a video conferencing session on a congested network may then experience frozen images, broken audio etc. The participant may perceive this as a problem at the video conferencing service provider, e.g. the MCN, even when it the participant’s home network that is to blame. It is therefore necessary to provide congestion control at the sender side to avoid sending more data than a network path to a receiver can handle. Upon determining a candidate congestion state, the sender side will then reduce the sent bitrate, i.e. perform downspeeding of the video conferencing link between the MCN and the participant/endpoint. Downspeeding can be defined as adjusting the bit rate down for adapting to reduced available bandwidths, when encoding media at multiple bit rates is possible.However, the candidate congestion state may instead of congestion be due to a high constant packet loss over the communication link. Packed loss resilience methods, such as Forward Error Correction (FEC) and RTP retransmission (RTX) transmits recovery packets into the media stream, each recovery packet adapted to replace a missing packet of the media stream, such that the participants in the video conferencing session does not experience frozen images etc. Downspeeding the media stream in such a situation would reduce, rather than increase, the quality of service for a participant on the lossy network.Fig. 2 is a schematic illustration of a prior art message flow 200 between a sender device 201 and a receiving device 202, the sender device transmitting a media stream 203 over a communication link to the receiving device 202. Transport-wide Congestion Control (TWCC) is an extension of the Real-time Transport Protocol (RTP) and Real-Time Transport Control Protocol (RTCP) for use in congestion control algorithms for RTP-based media flow. The packets of the media stream 203 comprises a RTP header extension containing a transport-wide packet sequence number, i.e. a packet identifier. TWCC proposes that the receiving device transmits an RTCP feedback message 204 feeding back the arrival times and sequence numbers of the packets of the media stream 203 received over the connection. The sender device keeps a map of in-flight packets, and upon receiving the feedback message 204 looks up the transmission timestamp of the corresponding packet. From these two timestamps the sender can compute metrics such as inter-packet delay variation and estimated queueing delay.One prior art implementation of TWCC for congestion control is the Google Congestion Control (GCC) algorithm. In this algorithm an inter-arrival time, t(i) -t(i-1), is defined as the difference in arrival time of two packets or two groups of packets. Correspondingly, an inter-departure time, T(i) - T(i-1), is defined as the difference in departure-time of two packets or two groups of packets. The GCC algorithm determines that congestion is present when the inter-arrival time is larger than the inter-departure time. A problem with the GCC algorithm is that it is very sensitive for network jitter, thus the GCC algorithm may determine that the connection between sender and receiver is congested and initiate downspeeding when there is no congestion. This will reduce the quality of the video conferencing session when there really was no need to do so, hence reducing the user experience for a participant in the video conferencing session.It is therefore a need in the art for a system and method for sender side congestion determination of a media stream transmitted over a communication link from the sender device to a receiving device.SummaryIn view of the above, an object of the present invention is to overcome or at least mitigate drawbacks of prior art video conferencing systems.In a first aspect the invention provides a method for determining congestion of a communication link transmitting a media stream over the communication link from a sender device to a receiving device, the method comprising the steps of -transmitting media packets into the media stream, each media packet having a packet identifier;-transmitting recovery packets into the media stream, each recovery packet having a packet identifier and is adapted to replace a missing packet of the media stream; - mapping for each packet in the media stream the packet identifier, a transmission timestamp and a packet size;-mapping for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace;- transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp;-determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet;-determining a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet;-determining a packet recovery success rate by dividing a total number of packets determined as recovered within a first sliding window with a total number of packets determined as missing within the first sliding window; and -determining that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.The present invention provides an accurate method for a sender device to differentiate between congestion of a communication link and high constant packet loss over the communication link.In one embodiment, the congestion threshold may be in in the range 0.6 – 1.0, preferably 0.8In one embodiment, the method may comprising initiating the step of transmitting recovery packets into the media stream upon determining that the communication link is in a candidate congestion state.In one embodiment, the method may comprising determining that the communication link is in a candidate congestion state, comprising-determining a transmission rate for a second sliding window of N transmitted packets by dividing a packet size sum of the N transmitted packets with a time difference between a transmission time stamp of the last of the N transmitted packets and a transmission time stamp of the first of the N transmitted packets; -determining a received rate for the second sliding winding of the N transmitted packets by dividing the packet size sum of the N transmitted packets with a time difference between the arrival time stamp of the last of the N transmitted packets and the arrival time stamp of the first of the N transmitted packets; and -determining that the communication link is in a candidate congestion state when for the second sliding window of the N transmitted packets the difference between the transmission rate and the received rate divided by the transmission rate is above a candidate congestion state threshold.In one embodiment, the candidate congestion state threshold may be in the range 0.1 – 0.4, preferably 0.25In one embodiment, the method may comprising measuring a round trip delay from the receiving device requests a recovery packet to the feedback message comprises the packet identifier of the recovery packet, and waiting the at least one round trip delay before determining the packet recovery rate.In a second aspect the invention provides a system for determining congestion of a communication link transmitting a media stream transmitted over the communication link from a sender device to a receiving device, the system being adapted to-transmitting, with the sender device, media packets into the media stream, each media packet having a packet identifier;-transmitting, with the sender device, recovery packets into the media stream, each recovery packet adapted to replace a missing packet of the media stream- mapping, with the sender device, for each packet in the media stream a packet identifier, a transmission timestamp and a packet size;-mapping, with the sender device, for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace;- transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp;-determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet;-determining, with the sender device, a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet; and-determining, with the sender device, a packet recovery success rate by dividing a total number of packets determined as recovered within a second sliding window with a total number of packets determined as missing within the second sliding window; determining, with the sender device, that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.In one embodiment, the congestion threshold may be in in the range 0.6 – 1.0, preferably 0.8In one embodiment, the system may be further adapted to initiating the step of transmitting recovery packets into the media stream upon determining that the communication link is in a candidate congestion state.In one embodiment, determining that the communication link is in a candidate congestion state may comprising- determining, with the sender device, a transmission rate for a second sliding window of N transmitted packets by dividing a packet size sum of the N transmitted packets with a time difference between a transmission time stamp of the last of the N transmitted packets and a transmission time stamp of the first of the N transmitted packets;-determining, with the sender device, a received rate for the second sliding winding of the N transmitted packets by dividing the packet size sum of the N transmitted packets with a time difference between the arrival time stamp of the last of the N transmitted packets and the arrival time stamp of the first of the N transmitted packets; anddetermining, with the sender device, that the communication link is in a candidate congestion state when for the second sliding window of the N transmitted packets the difference between the transmission rate and the received rate divided by the transmission rate is above a candidate congestion state threshold.In one embodiment, the candidate congestion state threshold may be in the range 0.1 – 0.4, preferably 0.25.In one embodiment, the sender device may be further adapted to measuring a round trip delay from the receiving device requests a recovery packet to the feedback message comprises the packet identifier of the recovery packet, and waiting the at least one round trip delay before determining the packet recovery rate.In a third aspect the invention provides a computer program product comprising instructions that when executed on a processor performs the method of the first aspect of the invention.The second and the third aspect of the invention provides the same advantages as the first aspect of the invention. Brief description of the drawingsFigure 1 is a schematic illustration of a multi-point videoconferencing system.Figure 2 is a schematic illustration of a message flow between a sender device and a receiving device.Figure 3 is an exemplary flowchart illustrating an exemplary embodiment of the present invention.Figure 4 is an exemplary flowchart illustrating an exemplary embodiment of the present invention.Figure 5 is a schematically illustration of an exemplary sender device of the present invention.Detailed descriptionAccording to embodiments of the present invention as disclosed herein, the abovementioned disadvantages of solutions according to prior art are eliminated or at least mitigated.Fig. 3 is a schematic illustration of an exemplary method 300 for determining congestion of a communication link transmitting a media stream over the communication link from the sender device 201 to the receiving device 202 in a multi-point videoconferencing system 100. The sender device 201 is preferably a MCN 104, however, the method 300 may also be performed by a videoconferencing endpoint 101a, 101b, 101c. The first step 301 comprises transmitting media packets into the media stream 203, each media packet having a packet identifier. The next step 302 comprises transmitting recovery packets into the media stream 203, each recovery packet adapted to replace a missing packet of the media stream 203. The recovery packets have a packet identifier similar to the media packets. The next step 303 comprises mapping for each packet in the media stream 203 the packet identifier, a transmission timestamp and a packet size. The packet identifier and the transmission timestamp may in one embodiment be implemented according to the definitions of TWCC. The packet size is a measurement of the size of the packet in the media stream in e.g. bits or bytes. Further, step 304 comprises mapping for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace.The next step 305 comprises transmitting for each packet received at the receiving device 202 a feedback message 204 to the sender device 201, the feedback message 204 comprising the packet identifier and an arrival timestamp. Thus, the receiving device 202 determines the arrival time of each packet in the media stream 203 and returns the arrival time in the arrival timestamp of the feedback message 204.In the next step 306, the sender device 201 determines a packet as missing when none of the feedback messages 204 comprises the packet identifier of the packet. Then in step 307, the sender device determines a packet as recovered when a feedback message 204 comprises the packet identifier of a recovery packet corresponding to the missing packet.Then in step 308, the sender device 201 determines a packet recovery success rate by dividing a total number of packets determined as recovered within a first sliding window with a total number of packets determined as missing within the first sliding window, and determines that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold, CT. The first sliding window of N transmitted packets may in one embodiment be the number of packets, e.g. 25 packets, or a time frame, e.g. 100 ms.packet_recovery_success_rate = (number of recovered packets)/(number of missing packets).The congestion threshold, CT, is in the range 0.6 – 1.0, preferably 0.8.The method 300 of determining the packet recovery success rate, may in one embodiment further comprising the step of measuring a round trip delay from the receiving device 202 requests a recovery packet to the feedback message 204 comprises the packet identifier of the recovery packet, and waiting the at least one round trip delay before determining the packet recovery rate. The measurement of the round-trip delay gives packet loss resilience methods time to recover the missing packet before performing the determination.In one embodiment, the step 302 of transmitting of transmitting recovery packets into the media stream 203 is initiated upon determining that the communication link is in a candidate congestion state, such as determining packet delay, packet loss occur or other reasons for poor quality of service (QoS).Figure 4 illustrates one exemplary method 400 of determining that the communication link 203 is in a candidate congestion state. In the first step 401, the sender device 201 determines a transmission rate for a second sliding window of N transmitted packets by dividing a packet size sum of the N transmitted packets with a time difference between a transmission time stamp of the last of the N transmitted packets and a transmission time stamp of the first of the N transmitted packets. The transmission rate is typically determined in bits/second. When determining the transmission rate for the second sliding window of N transmitted packets, the transmission rate is determined for consecutive windows of length N each time a new packet is transmitted from the sender device 201. The second sliding window of N transmitted packets may in one embodiment be the number of packets, e.g. 25 packets, or a time frame, e.g. 100 ms. Similarly, in the next step 402, the sender device 201 determines a received rate for the second sliding winding of the N transmitted packets by dividing the packet size sum of the N transmitted packets with a time difference between the arrival time stamp of the last of the N transmitted packets and the arrival time stamp of the first of the N transmitted packets.Then in step 403, the sender device 201, determines that the communication link is in a candidate congestion state when for the second sliding window of the N transmitted packets the difference between the transmission rate and the received rate divided by the transmission rate is above a candidate congestion state threshold, CCT, i.e. norm_rate_delta >CCT, wherenorm_rate_delta = (transmission rate - received rate)/(transmission rate). The candidate congestion state threshold, CCT, is in the range 0.1 – 0.4, preferably 0.25. One advantage of determining the communication link is in a candidate congestion state based on calculations of transmitted and received transmission rate is that the determination is resistant to network jitter.If the sender device 201 comprises and encoder, e.g. is a transcoding MCN 104 or a videoconferencing endpoint 101a, 101b, 101c, the MCN 104 may instruct the encoder to reduce the transmission rate of the media stream.In the sender device 201 does not comprises an encoder, e.g. a switching MCN 104, the MCN 104 may selecting and forwarding a media stream having a lower transmission rate than another media stream from an encoder providing a plurality of media streams at different transmission rates.Turning now to figure 5, a schematically illustrated multipoint conferencing node (MCN) 500. The MCN 500 comprises an input/output circuitry 502, at least one processor 501 and a memory 503. The memory 503 contains instructions executable by the processor 501, cause the MCN 500 totransmitting media packets into the media stream, each media packet having a packet identifier; -transmitting recovery packets into the media stream, each recovery packet having a packet identifier and is adapted to replace a missing packet of the media stream; - mapping for each packet in the media stream the packet identifier, a transmission timestamp and a packet size;-mapping for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace;- transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp;;-determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet;-determining a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet; and -determining a packet recovery success rate by dividing a total number of packets determined as recovered within a first sliding window with a total number of packets determined as missing within the first sliding window; and -determining that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.The instructions that are executable by the processor 501 may be software in the form of a computer program 504. The computer program 504 may be contained in or by a carrier 505, which may provide the computer program 501 to the memory 503 and processor 501. The carrier 505 may be in any suitable form including an electronic signal, an optical signal, a radio signal or a computer readable storage medium.As used herein, the term “computer readable medium” may be a universal serial bus (USB) memory, a digital versatile disc (DVD), a Blu-ray disc, a software module that is received as a stream of data, a Flash memory, a hard drive, a memory card, such as a MemoryStick, a multimedia card (MMC), secure digital (SD) card, etc. One or more of the aforementioned examples of computer readable medium may be provided as one or more computer program products.In the preceding description, various aspects of the method and imaging processing device according to the invention have been described with reference to the illustrative embodiment. For purposes of explanation, specific numbers, systems and configurations were set forth in order to provide a thorough understanding of the system and its workings. However, this description is not intended to be construed in a limiting sense. Various modifications and variations of the illustrative embodiment, as well as other embodiments of the method and image processing device, which are apparent to persons skilled in the art to which the disclosed subject matter pertains, are deemed to lie within the scope of the present claims.
Claims
CLAIMS1. A method for determining congestion of a communication link transmitting a media stream over the communication link from a sender device to a receiving device, the method comprising the steps of-transmitting media packets into the media stream, each media packet having a packet identifier;-transmitting recovery packets into the media stream, each recovery packet having a packet identifier and is adapted to replace a missing packet of the media stream; - mapping for each packet in the media stream the packet identifier, a transmission timestamp and a packet size;-mapping for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace;- transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp;;-determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet;-determining a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet; and -determining a packet recovery success rate by dividing a total number of packets determined as recovered within a first sliding window with a total number of packets determined as missing within the first sliding window; and -determining that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.2. The method of claim 1, comprising initiating the step of transmitting recovery packets into the media stream upon determining that the communication link is in a candidate congestion state.3. The method of claim 2, wherein determining that the communication link is in a candidate congestion state comprising- determining a transmission rate for a second sliding window of N transmitted packets by dividing a packet size sum of the N transmitted packets with a time difference between a transmission time stamp of the last of the N transmitted packets and a transmission time stamp of the first of the N transmitted packets; -determining a received rate for the second sliding winding of the N transmitted packets by dividing the packet size sum of the N transmitted packets with a time difference between the arrival time stamp of the last of the N transmitted packets and the arrival time stamp of the first of the N transmitted packets; and -determining that the communication link is in a candidate congestion state when for the second sliding window of the N transmitted packets the difference between the transmission rate and the received rate divided by the transmission rate is above a candidate congestion state threshold.4. The method of claim 1, wherein the method further comprising the step of measuring a round trip delay from the receiving device requests a recovery packet to the feedback message comprises the packet identifier of the recovery packet, and waiting the at least one round trip delay before determining the packet recovery rate.5. The method of claim 1, wherein the congestion threshold is in the range 0.6 – 1.0, preferably 0.8.6. The method of claim 2, wherein the candidate congestion state threshold is in the range 0.1 – 0.4, preferably 0.25.7. System for determining congestion of a communication link transmitting a media stream transmitted over the communication link from a sender device to a receiving device, the system being adapted to-transmitting, with the sender device, media packets into the media stream, each media packet having a packet identifier;-transmitting, with the sender device, recovery packets into the media stream, each recovery packet adapted to replace a missing packet of the media stream- mapping, with the sender device, for each packet in the media stream a packet identifier, a transmission timestamp and a packet size;-mapping, with the sender device, for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace;- transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp;-determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet;-determining, with the sender device, a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet; and-determining, with the sender device, a packet recovery success rate by dividing a total number of packets determined as recovered within a second sliding window with a total number of packets determined as missing within the second sliding window;determining, with the sender device, that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.8. System of claim 7, wherein the system is further adapted to initiating the step of transmitting recovery packets into the media stream upon determining that the communication link is in a candidate congestion state.9. System of claim 8, wherein determining that the communication link is in a candidate congestion state comprising:- determining, with the sender device, a transmission rate for a second sliding window of N transmitted packets by dividing a packet size sum of the N transmitted packets with a time difference between a transmission time stamp of the last of the N transmitted packets and a transmission time stamp of the first of the N transmitted packets;-determining, with the sender device, a received rate for the second sliding winding of the N transmitted packets by dividing the packet size sum of the N transmitted packets with a time difference between the arrival time stamp of the last of the N transmitted packets and the arrival time stamp of the first of the N transmitted packets; anddetermining, with the sender device, that the communication link is in a candidate congestion state when for the second sliding window of the N transmitted packets the difference between the transmission rate and the received rate divided by the transmission rate is above a candidate congestion state threshold.10. The system of claim 7, wherein the sender device is further adapted to measuring a round trip delay from the receiving device requests a recovery packet to the feedback message comprises the packet identifier of the recovery packet, and waiting the at least one round trip delay before determining the packet recovery rate.11. The system of claim 7, wherein the congestion threshold is in the range 0.6 – 1.0, preferably 0.8.12. The system of claim 9, wherein the candidate congestion state threshold is in the range 0.1 – 0.4, preferably 0.25.13. Computer program product comprising instructions that when executed on a processor performs the method of clams 1 – 6.PATENTKRAV1. Fremgangsmåte (300, 400) for å bestemme overbelastning av en kommunikasjonslink som sender en mediastrøm (203) over kommunikasjonslinken fra en senderinnretning (201) til en mottakerinnretning (202), der fremgangsmåten omfatter trinnene -sending (301) av mediapakker inn i kommunikasjonslinken, der hver mediapakke har en pakkeidentifikator;-sending (302) av gjenopprettingspakker inn i mediastrømmen (203), der hver gjenopprettingspakke har en pakkeidentifikator og er tilpasset å erstatte en tapt pakke i mediastrømmen (203);-mapping (303) for hver pakke i mediastrømmen (203) pakkeidentifikatoren, et sendetidsstempel og en pakkestørrelse;karakterisert ved at fremgangsmåten omfatter trinnene-mapping (304) for hver gjenopprettingspakke pakkeidentifikatoren for gjenopprettingspakken og pakkeidentifikatoren for pakken gjenopprettingspakken er tilpasset å erstatte; -sending (305) for hver pakke mottatt av mottakerinnretningen (202) en tilbakekoblingsmelding (204) til senderinnretningen (201), tilbakekoblingsmeldingen (204) omfattende pakkeidentifikatoren og et ankomsttidsstempel;-bestemmelse (306) av en pakke som tapt når ingen av tilbakekoblingsmeldingene (204) omfatter pakkens pakkeidentifikator;-bestemmelse (307) av en pakke som gjenopprettet når en tilbakekoblingsmelding (204) omfatter pakkeidentifikatoren for en gjenopprettingspakke samsvarende med den tapte pakken; og-bestemmelse (308) av en pakkegjenopprettingssuksessrate ved å dividere et totalt antall pakker bestemt som gjenopprettet innenfor et første glidende vindu med et totalt antall pakker bestemt som tapt innenfor det første glidende vinduet; og-bestemme at kommunikasjonslinken er overbelastet når for det første glidende vinduet av N sendte pakker så er pakkegjenopprettingsraten under en overbelastningsterskel.2. Fremgangsmåten (300, 400) ifølge krav 1, omfattende innledning av trinnet sending (302) av gjenopprettingspakker inn i mediastrømmen (203) ved bestemmelse av at kommunikasjonslinken er i en kandidatoverbelastningstilstand.3. Fremgangsmåten (300, 400) ifølge krav 2, der bestemmelse av at kommunikasjonslinken er i en kandidatoverbelastningstilstand omfatter:-bestemmelse (401) av en senderate for et andre glidende vindu av N sendte pakker ved dividering av en pakkestørrelsessum av de N sendte pakkene med en tidsdifferanse mellom sendetidsstempelet for den siste av de N sendte pakkene og et sendetidsstempel for den første av de N sendte pakkene;-bestemmelse (402) av en mottaksrate for det andre glidende vinduet av de N sendte pakkene ved dividering av pakkestørrelsessummen for de N sendte pakkene med en tidsdifferanse mellom ankomsttidsstempelet for den siste av den N sendte pakkende og et ankomsttidsstempelet for den første av den N sendte pakkene; og-bestemmelse (403) av at kommunikasjonslinken er i en kandidatoverbelastningstilstand når for det andre glidende vinduet av de N sendte pakkene forskjellen mellom senderaten og mottaksraten dividert med senderaten er over en kandidatoverbelastningstilstandsterskel.4. Fremgangsmåten (300, 400) ifølge krav 2, der fremgangsmåten videre omfatter trinnet måling av rundturforsinkelse fra mottakerinnretningen (202) ordrer en gjenopprettingspakke til tilbakekoblingsmeldingen (204) omfatter pakkeidentifikatoren for gjenopprettingspakken, og venting minst én rundturforsinkelse før bestemmelse av pakkegjenopprettingssuksessraten.5. Fremgangsmåten ifølge krav1, der overbelastningsterskelen er i området 0,6 – 1,0, fortrinnsvis 0,8.6. Fremgangsmåten ifølge krav 3, der kandidatoverbelastningstilstandsterskelen er i området 0,1 – 0,4, fortrinnsvis 0,25.7. System for å for å bestemme overbelastning av en kommunikasjonslink som sender en mediastrøm (203) over kommunikasjonslinken fra en senderinnretning (201) til en mottakerinnretning (202), der systemet er tilpasset-sending, med senderinnretningen (201), av mediapakker inn i kommunikasjonslinken, der hver mediapakke har en pakkeidentifikator;-sending, med senderinnretningen (201), av gjenopprettingspakker inn i mediastrømmen (203), der hver gjenopprettingspakke har en pakkeidentifikator og er tilpasset å erstatte en tapt pakke i mediastrømmen (203);-mapping, med senderinnretningen (201), for hver pakke i mediastrømmen (203) pakkeidentifikatoren, et sendetidsstempel og en pakkestørrelse;karakterisert ved at systemet er tilpasset-mapping, med senderinnretningen (201), for hver gjenopprettingspakke pakkeidentifikatoren for gjenopprettingspakken og pakkeidentifikatoren for pakken gjenopprettingspakken er tilpasset å erstatte;-sending, med mottakerinnretningen (202), for hver pakke mottatt av mottakerinnretningen (202) en tilbakekoblingsmelding (204) til senderinnretningen (201), tilbakekoblingsmeldingen (204) omfattende pakkeidentifikatoren og et ankomsttidsstempel;-bestemmelse, med senderinnretningen (201), av en pakke som tapt når ingen av tilbakekoblingsmeldingene (204) omfatter pakkens pakkeidentifikator;-bestemmelse, med senderinnretningen (201), av en pakke som gjenopprettet når en tilbakekoblingsmelding (204) omfatter pakkeidentifikatoren for en gjenopprettingspakke samsvarende med den tapte pakken; og-bestemmelse, med senderinnretningen (201), av en pakkegjenopprettingssuksessrate ved å dividere et totalt antall pakker bestemt som gjenopprettet innenfor et første glidende vindu med et totalt antall pakker bestemt som tapt innenfor det første glidende vinduet; og-bestemme, med senderinnretningen (201), at kommunikasjonslinken er overbelastet når for det første glidende vinduet av N sendte pakker så er pakkegjenopprettingsraten under en overbelastningsterskel.8. Systemet ifølge krav 7, der systemet videre er tilpasset innledning av trinnet sending av gjenopprettingspakker inn i mediastrømmen (203) ved bestemmelse av at kommunikasjonslinken er i en kandidatoverbelastningstilstand.9. Systemet ifølge krav 8, der bestemmelse av at kommunikasjonslinken er i en kandidatoverbelastningstilstand omfatter:-bestemmelse, med senderinnretningen (201), av en senderate for et andre glidende vindu av N sendte pakker ved dividering av en pakkestørrelsessum av de N sendte pakkene med en tidsdifferanse mellom sendetidsstempelet for den siste av de N sendte pakkene og et sendetidsstempelet for den første av de N sendte pakkene;-bestemmelse, med senderinnretningen (201), av en mottaksrate for det andre glidende vinduet av de N sendte pakkene ved dividering av pakkestørrelsessummen for de N sendte pakkene med en tidsdifferanse mellom ankomsttidsstempelet for den siste av den N sendte pakkende og et ankomsttidsstempel for den første av den N sendte pakkene; og -bestemmelse, med senderinnretningen (201), av at kommunikasjonslinken er i en kandidatoverbelastningstilstand når for det andre glidende vinduet av de N sendte pakkene forskjellen mellom senderaten og mottaksraten dividert med senderaten er over en kandidatoverbelastningstilstandsterskel.10. Systemet ifølge krav 7, der senderinnretningen (201) videre er tilpasset måling av rundturforsinkelse fra mottakerinnretningen (202) ordrer en gjenopprettingspakke til tilbakekoblingsmeldingen (204) omfatter pakkeidentifikatoren for gjenopprettingspakken, og venting minst én rundturforsinkelse før bestemmelse av pakkegjenopprettingssuksessraten.11. Systemet ifølge krav 7, der overbelastningsterskelen er i området 0,6 – 1,0, fortrinnsvis 0,8.12. Systemet ifølge krav 9, der kandidatoverbelastningstilstandsterskelen er i området 0,1 – 0,4, fortrinnsvis 0,25.13. Datamaskinprogramprodukt omfattende instruksjoner som når eksekvert på en prosessor utfører fremgangsmåten ifølge krav 1 – 6.
Drawings

Priority


18.11.2021 NO 20211386

Patent classes


IPC classesH04L 47/19H04L 47/10H04L 47/35H04L 43/0876H04L 1/00CPC classesH04L 47/19H04L 47/10H04L 47/35H04L 43/0876H04L 1/00

Citations


EP 2019522 A2 (A2)WO 2014160926 A1 (A1)US 2022255866 A1 (A1)

Applicants, owners and inventors


Owners
PEXIP AS
Lilleakerveien 2 A 0283 OSLO NO (OSLO Municipality, Oslo county)Org. number: 819850232
Inventors
Tulio Beloqui
Konows gate 35 0196 OSLO NO (OSLO Municipality, Oslo county)
Håvard Graff
Finnhaugveien 16 0760 OSLO NO (OSLO Municipality, Oslo county)
Knut Inge Hvidsten
Rådyrstien 6 1164 OSLO NO (OSLO Municipality, Oslo county)

Agent


ACAPO ONSAGERS AS
ACAPO ONSAGERS AS

Org. number: 932214636

Name and address are automatically synchronized with the Brønnøysund Register Centre.

Open in The Brønnøysund Register Centre
Edvard Griegs vei 1 5059 BERGEN NO (BERGEN Municipality, Vestland county)
Org. number: 932214636
Reference: P28598NO00

Status history


Payment history


Oppositions and appeals


No oppositions or appeals

Administrative limitation


No administrative limitation

Liens and licences


No liens or licenses registered

Gazette entries


No Gazette entries foundOnly events from 2024.03.04 and onwards are shown.