Key information

Title
A system for recording interaction between at least two parties in a session
Application number
20231235
Case type
National
Status
Filed
14.11.2023
Effective date
14.11.2023
Publicly available
15.05.2025
Next annual fee due
30.11.2027
Applicant
VIVID-EDTECH AS (NO)
Owner
VIVID-EDTECH AS (NO)
Inventor
Vivian Wam Fjell (NO)
Agent
ACAPO ONSAGERS AS (NO)
Granted
16.06.2025
Patent number
348834
Expiry date
14.11.2043

Abstract and drawing


Disclaimer: This text has been machine-scanned and may contain errors – please refer to "Publications" for legally binding content.
A system for recording interaction between at least two parties in a session comprises a communication module configured to send and receive information representing the interaction between the parties during the session, at least two user interfaces configured to present the information representing the interaction between the parties, an information storage, and a processing module connected to the communication module, user interfaces, and the information storage. The processing module is configured to store the information representing the interaction between the parties together with time information to create a seamless, synchronized time line.

Publications


B1A1
Checking availability of the latest published version...

Documents


Expand Download files (24)
Date
Date Doc. No. Process Case number In/Out Journal description To/from
02.10.2025 12-01 Saksbehandling 20231235(348834) UT PT Varsel om betaling av første årsavgift (3317) (PT20231235) ACAPO ONSAGERS AS
20.06.2025 11-01 Saksbehandling 20231235(348834) UT PT Registreringsbrev nasjonal patent (15) (PT20231235)
24.04.2025 10-01 Saksbehandling 20231235 UT PT Meddelelse om patent ACAPO ONSAGERS AS
18.03.2025 09-05 Saksbehandling 20231235 INN P28616NO00 trykningsklare dokumenter cc ACAPO ONSAGERS AS
18.03.2025 09-04 Saksbehandling 20231235 INN P28616NO00 trykningsklare dokumenter ACAPO ONSAGERS AS
18.03.2025 09-03 Saksbehandling 20231235 INN P28616NO00 Norsk oversettelse av krav ACAPO ONSAGERS AS
18.03.2025 09-02 Saksbehandling 20231235 INN P28616NO00 Brev til Patentstyret ACAPO ONSAGERS AS
18.03.2025 09-01 Saksbehandling 20231235 INN Korrespondanse (Hovedbrev inn) ACAPO ONSAGERS AS
20.12.2024 08-01 Saksbehandling 20231235 UT Realitet patent ACAPO ONSAGERS AS
15.11.2024 07-04 Saksbehandling 20231235 INN P28616NO00 Brev til Patentstyret ACAPO ONSAGERS AS
15.11.2024 07-03 Saksbehandling 20231235 INN P28616NO00 amended claims November 2024 wc 1198028 ACAPO ONSAGERS AS
15.11.2024 07-02 Saksbehandling 20231235 INN P28616NO00 amended claims November 2024 1198026 ACAPO ONSAGERS AS
15.11.2024 07-01 Saksbehandling 20231235 INN Korrespondanse (Hovedbrev inn) ACAPO ONSAGERS AS
08.11.2024 06-02 Saksbehandling 20231235 INN Korrespondanse (Hovedbrev inn) ACAPO ONSAGERS AS
08.11.2024 06-01 Saksbehandling 20231235 INN PDF_642354752 ACAPO ONSAGERS AS
16.05.2024 05-02 Saksbehandling 20231235 UT PT report 09:58:59
16.05.2024 05-01 Saksbehandling 20231235 UT Realitet patent ACAPO ONSAGERS AS
24.11.2023 04-02 Saksbehandling 20231235 INN P28616NO00 Power of Attorney ONSAGERS AS
24.11.2023 04-01 Saksbehandling 20231235 INN Korrespondanse (Hovedbrev inn) ONSAGERS AS
15.11.2023 03-01 Saksbehandling 20231235 UT Formalia 1 ONSAGERS AS
15.11.2023 02-01 Saksbehandling 20231235 UT Informasjon til oppfinner Vivian Wam Fjell
14.11.2023 01-03 Saksbehandling 20231235 INN P28616NO00 SPECIFICATION AS FILED ONSAGERS AS
14.11.2023 01-02 Saksbehandling 20231235 INN P28616NO00 DRAWINGS AS FILED ONSAGERS AS
14.11.2023 01-01 Saksbehandling 20231235 INN Søknadsskjema Patent ONSAGERS AS

Description, claims and drawings


Disclaimer: This text has been machine-scanned and may contain errors – please refer to "Publications" for legally binding content. Description
The invention regards a system and method for interacting between at least two parties located remote to each other. More specifically, the invention regards a system and method where the parties are in a teaching situation, for example one being a teacher or a representation of teaching material, and at least one being a student.Today there are many platforms for interacting remotely between two parties, where several of these have been utilized for teaching situations, even though most of them are designed for meetings.A problem with such prior art systems is that they do not ensure that students physically present and those who sit at home (participate digitally) receive the same follow-up from the teacher. This makes the lessons much less inspiring and contributes to students being distracted, and in worst case dropping out.Another problem is that most education and health software don't talk to each other. For an optimal user experience, there is a need to make it possible for teachers and students to interact across faculties and departments.There is thus a need for a software that makes it possible to talk to other software in a synchronous timeline, which is much more user-friendly for the education sector and the health service.US11128483 describes a system and method for providing a meeting record for playback to participants in an online meeting. The record is the same for all participants and there are no possibilities for the participants to store individual content.US20220327309 and US20220141532 describes background technology.The object of the invention is to provide a system for recording interaction between at least two parties in a session that eliminates the problems of prior art.The object of the invention is achieved by means of the patent claims.In one embodiment, there is provided a system for recording interaction between at least two parties in a session, where the system comprises:- a communication module configured to send and receive information representing the interaction between the parties during the session,- at least two user interfaces configured to present the information representing the interaction between the parties,- an information storage, and- a processing module connected to the communication module, user interfaces, and the information storage, and wherein the processing module is configured to store the information representing the interaction between the parties together with time information.The information representing interaction between parties can comprise at least one of voice communication, written text, video, images, sound, symbols.The user interface can be configured to display separate information in separate display windows so that the display windows are represented on the user interface without overlap.The processing module can be configured to associate information received from one party with a point in time. The point in time represents the real time point in time when the information was executed.The system may further comprise a sign language module, configured to translate voice text to sign language during a session and display a representation of the sign language to at least one of the parties on the at least one user interface. This may for example be done by means of an AI module and/or machine learning. The representation of sign language can for example be in the form of an avatar or other figure mimicking or otherwise representing the individual signs that constitutes the sign language translation.The communication module can be configured to fetch information from the information storage, dependent on input from one of the user interfaces.The processing module is configured to store information representing the start of the session and the end of a session together with time information, and to associate a session ID with the information stored in the time period between the start of the session and the end of the session.The processing module may also be configured to create timeline and also a visualization of the timeline of the session, comprising a visualization of the start of the session, the end of the session and all information stored during the session. By using the system in a teaching context, the user experience will be more optimal compared to prior art solutions. By using the archive/storage functionality, users will more easily be able to find back to important points in the teaching and notes they have made at the current times. Users can receive targeted guidance based on their activity and presence through the system.Examples of possible functions and interaction with the archive/storage:If a user has a question during a lesson, this can be flagged through the question function. If the archive module is enabled, the time the question was asked will be saved and appear as a flag on the timeline in the archive. If the question was in text form, you will also be able to see the question and any answer that was given in the archive.When storing notes, these will also be flagged on the timeline in the archive module, as well as stored associated with the teaching so that the user can easily retrieve notes based on teaching afterwards.The user can choose to manually add a flag to the timeline and link, for example, a search query in Google Translate function to the toolbox of this flag.Another possibility is logging of answers and results through a quiz functionality, ie, integrating a quiz in the session to check if the user has learned the required lesson and the user will be able to see if they need further follow-up or repetition. If consent has been given for the storage of data, users can also look at the individual's activity in the teaching based on relevant questions asked and quiz results. One can look at trends based on this data to draw conclusions about whether the user is at risk of dropping out.The invention will now be described by means of an example and by reference to the accompanying figures.Figure 1 illustrates an overview of a system according to the invention.Figure 2 illustrates a workflow for sharing content.Figure 3 illustrates a workflow for creating or updating notes.Figure 4 illustrates a workflow for creating a time line.Figure 1 illustrates schematically a system 1 for recording interaction between at least two parties A, B. The system comprises a communication module 12 configured to send and receive information representing the interaction between the parties. The information representing interaction between parties can for example be one or more of voice communication, written text, video, images, sound, symbols. The two parties in the illustrated embodiment, have each a user interface 14, 15 configured to present the information representing the interaction between the parties. The user interface may comprise a display device, speakers, etc., for ie. showing video images, still images, play sound, etc.The user interfaces can be configured to display separate information in separate display windows in such a way that the display windows are represented on the user interface without overlap. For example, can the user interface show a video stream of the interacting parties, such as a teacher and a student, and simultaneously show pictures illustrating the topic the teacher is talking about. The user interface may then show the video streams side by side and the pictures beside, above or below the video streams, thereby giving the parties A, B access to all the information simultaneously.The system further comprises an information storage 10, illustrated here as a cloud, ie. the information storage can be a remote storage/server that can communicate with the user interfaces 14, 15 of the two parties.A processing module 11 is connected to the communication module 12, user interfaces14, 15, and the information storage 10, and is configured to store the information representing the interaction between the parties together with time information representing the time where the interaction occurred.The processing module can also be configured to store information representing the start of the session and the end of a session together with time information, and to associate a session ID with the information stored in the time period between the start of the session and the end of the session.Further, each party can submit information, for example a text message, a symbol, etc. and the processing module can thus be configured to associate information received from the relevant party with a point in time where the information was received.In one embodiment, the system can comprise a sign language module 13, configured to translate voice text to sign language during a session and display a representation of the sign language to at least one of the parties on the at least one user interface. This can be implemented as an artificial intelligence unit (AI), with machine learning abilities.The following describes an example of the progression of a session.In the description of the example, the term time stamp shall mean time information representing a point in time when an interaction happens.1. The session will be scheduled by an organizer.The organizer may or may not be one of the parties to interact during the session. The processing module 11 will then create a session ID and an activity table with scheduled start time and store the activity table in the information storage.2. The scheduled time has come, and the session is started in step at a specific point of time.The start session is associated with session id and stored in the activity table in the information storage 10 with a start timestamp, ie. time information representing the actual starting time. 3. The Organizer then starts webcam sharing, ie. a video stream.The start webcam activity is saved together with a timestamp in the activity table.4. The Organizer will share their screen.Start screen sharing activity is created and saved in the activity table together with a timestamp.5. Organizer stops sharing of screen.The activity table will be updated with stop time for the screen sharing feature and information about the video file saved. A stop activity is added to the activity table. Figure 2 illustrates a workflow for detecting and storing information of a shared video stream/display by one of the parties attending a session.6.Session is finished.The Organizer stops webcam sharing. The end webcam activity is saved in the activity table together with information representing the webcam stream. A stop activity is created and stored in the activity table.7.Session closes.A stop/end time is stored in the information storage. If there are any remaining activities these will also be ended and will be updated with stop times.If a question, note, quiz, etc. is recorded during the session, they will, like the camera and screen, be stored in the information storage, in the activity table, together with a timestamp.Figure 3 illustrates the workflow for storing notes that are made during a session. In this example, one user/party presses a button to activate storage of the event using the user interface, for example a keyboard key, touching a touch screen, etc. In other embodiment, the system may be set up to automatically store all or a selection of events. The information that is stored in the information storage in this example is student id, the associated session id, institute id (the teaching institute), text of the note, and note id.As the session continues, the student may add or amend the notes, and the system continuously updates the note until the session is ended. The note may be stored separately and/or sent to the student as e-mail, but will always be part of the session for the student to read later.When the active session is ended it will be made available with all activities linked in the archive, as a timeline. The timeline is built based on the session start and stop timestamps and all linked activities. This is achieved by means of the communication module that is configured to fetch information from the information storage, dependent on input from one of the user interfaces. For example, a user wants to review a specific session, this session with its session ID can be searched for and brought up on the user interface. Figure 4 illustrates an example of this process.To this effect, the processing module is configured to create a visualization of the timeline of the session, comprising a visualization of the start of the session, the end of the session and all information stored during the session.Activities are placed on the timeline based on their timestamp relative to the start/stop of the session. Such activities include but are not limited to: recording of shared tCam/screen, question, note saved, and quiz. When "searching" the timeline (dragging current time) the correct shared screen/tCam video clip will be selected based on relative timestamp.
Claims
CLAIMS1. A system (1) for recording interaction between at least two parties in a session, where the system comprises:- a communication module (12) configured to send and receive information representing the interaction between the parties during the session,- at least two user interfaces (14, 15) configured to present the information representing the interaction between the parties,- an information storage (10), and- a processing module (11) connected to the communication module, user interfaces, and the information storage, and wherein the processing module is configured to store the information representing the interaction between the parties together with time information, characterized in thatthe processing module (11) is configured to store a note that is made by one party during the session, together with the information representing the interaction between the parties.2. The system (1) according to claim 1, where the information representing interaction between parties comprises at least one of voice communication, written text, video, images, sound, symbols.3. The system (1) according to claim 1 or 2, where the user interface (14, 15) is configured to display separate information in separate display windows, where the display windows are represented on the user interface without overlap.4. The system (1) according to one of the previous claims, where the processing module (11) is configured to associate information received from one party with a point in time, where the point in time represents the real time point in time when the information was executed.5. The system (1) according to one of the previous claims, where the system comprises a sign language module (13), configured to translate voice text to sign language during a session and display a representation of the sign language to at least one of the parties on the at least one user interface.6. The system (1) according to one of the previous claims, where the communication module is configured to fetch information from the information storage (10), dependent on input from one of the user interfaces (14, 15).7. The system (1) according to one of the previous claims, where the processing module (11) is configured to store information representing the start of the session and the end of a session together with time information, and to associate a session ID with the information stored in the time period between the start of the session and the end of the session.8. The system (1) according to one of the previous claims, where the processing module (11) is configured to create a visualization of the timeline of the session, comprising a visualization of the start of the session, the end of the session and all information stored during the session.9. The system (1) according to one of the previous claims, where the processing module (11) is configured to store student id, the associated session id, and note id together with the text of the note.PATENTKRAV1. Et system (1) for opptak av interaksjon mellom minst to parter i en økt, der systemet omfatter:- en kommunikasjonsmodul (12) konfigurert til å sende og motta informasjon som representerer interaksjonen mellom partene under økten,- minst to brukergrensesnitt (14, 15) konfigurert til å presentere informasjonen som representerer interaksjonen mellom partene,- et informasjonslager (10), og- en prosesseringsmodul (11) forbundet med kommunikasjonsmodulen, brukergrensesnitt og informasjonslageret, og hvor prosesseringsmodulen er konfigurert til å lagre informasjonen som representerer interaksjonen mellom partene sammen med tidsinformasjon, karakterisert vedat prosesseringsmodulen (11) er konfigurert til å lagre et notat som er laget av en part under økten, sammen med informasjonen som representerer interaksjonen mellom partene.2. Systemet (1) i henhold til krav 1, der informasjonen som representerer interaksjon mellom parter omfatter minst én av talekommunikasjon, skrevet tekst, video, bilder, lyd, symboler.3. Systemet (1) i henhold til krav 1 eller 2, der brukergrensesnittet (14, 15) er konfigurert til å vise separat informasjon i separate visningsvinduer, der visningsvinduene er representert på brukergrensesnittet uten overlapping.4. Systemet (1) i henhold til et av de tidligere kravene, der prosesseringsmodulen (11) er konfigurert til å knytte informasjon mottatt fra en part til et tidspunkt, der tidspunktet representerer sanntidstidspunktet da informasjonen ble utført.5. Systemet (1) i henhold til et av de tidligere kravene, der systemet omfatter en tegnspråkmodul (13), konfigurert til å oversette taletekst til tegnspråk under en sesjon og vise en representasjon av tegnspråket til minst én av partene på minst ett brukergrensesnitt.6. Systemet (1) i henhold til et av de tidligere kravene, der kommunikasjonsmodulen er konfigurert til å hente informasjon fra informasjonslageret (10), avhengig av input fra et av brukergrensesnittene (14, 15).7. Systemet (1) i henhold til et av de tidligere kravene, der prosesseringsmodulen (11) er konfigurert til å lagre informasjon som representerer starten av økten og slutten av en økt sammen med tidsinformasjon, og til å knytte en økt -ID til informasjonen som er lagret i tidsperioden mellom starten av økten og slutten av økten.8. Systemet (1) i henhold til et av de tidligere kravene, der prosesseringsmodulen (11) er konfigurert til å lage en visualisering av tidslinjen for økten, omfattende en visualisering av starten av økten, slutten av økten og all informasjon som er lagret under økten.9. Systemet (1) i henhold til et av de tidligere kravene, der prosesseringsmodulen (11) er konfigurert til å lagre student-ID, tilhørende økt-ID og notat-ID sammen med teksten i notatet.
Drawings

Priority


No priority

Patent classes


IPC classesG09B 5/00G09B 5/06G09B 5/02G09B 5/04G09B 5/08G09B 5/10G09B 5/12G09B 5/14H04L 65/403CPC classesG09B 5/00G09B 5/06G09B 5/02G09B 5/067G09B 5/04G09B 5/08G09B 5/10G09B 5/12G09B 5/14H04L 65/403

Citations


US 11128483 B1 (B1)US 2022327309 A1 (A1)US 2022141532 A1 (A1)

Applicants, owners and inventors


Owners
VIVID-EDTECH AS
Vragesløyfen 120 4625 FLEKKERØY NO (KRISTIANSAND Municipality, Agder county)Org. number: 917265585
Inventors
Vivian Wam Fjell
Vragesløyfen 120 4625 FLEKKERØY NO (KRISTIANSAND Municipality, Agder county)

Agent


ACAPO ONSAGERS AS
ACAPO ONSAGERS AS

Org. number: 932214636

Name and address are automatically synchronized with the Brønnøysund Register Centre.

Open in The Brønnøysund Register Centre
Edvard Griegs vei 1 5059 BERGEN NO (BERGEN Municipality, Vestland county)
Org. number: 932214636
Reference: P28616NO00

Status history


Payment history


Oppositions and appeals


No oppositions or appeals

Administrative limitation


No administrative limitation

Liens and licences


No liens or licenses registered

Gazette entries


No Gazette entries foundOnly events from 2024.03.04 and onwards are shown.