Key information

Title
System and method for estimating weight of biomass
Application number
20220528
Case type
National
Status
06.03.2024 P.g.a. manglende svar. Søker har ikke begjært gjenopptakelse
Filed
09.05.2022
Effective date
09.05.2022
Publicly available
10.11.2023
Applicant
OPTIMAR AS (NO)
Inventor
Daniel Kvam (NO) et al.
Agent
BRYN AARFLOT AS (NO)

Abstract and drawing


Disclaimer: This text has been machine-scanned and may contain errors – please refer to "Publications" for legally binding content.
A system for estimating weight of biomass 1, comprising: a conveyor 2a, 2b with the biomass 1, one or more laser units 3 and/or one or more cameras 4 scanning the biomass, one or more light sources to illuminate the biomass, a computer unit 5, receiving input data from the one or more laser units 3 and/or one or more cameras 4, the computer unit 5 includes software that provides height map and outer measurements of the biomass from the input data and estimates the weight of the biomass 1 based on product data, biological ratios and possible adjustment factors, and where the system include artificial intelligence and machine learning to continuously improved the system and the weight estimation.

Publications


A1
Checking availability of the latest published version...

Documents


Expand Download files (23)
Date
Date Doc. No. Process Case number In/Out Journal description To/from
10.07.2024 13-01 Saksbehandling 20220528 UT Endelig henleggelse NO BRYN AARFLOT AS
09.04.2024 12-01 Saksbehandling 20220528 UT PT Varsel om betaling av første årsavgift (3317) (PT20220528) BRYN AARFLOT AS
15.03.2024 11-01 Saksbehandling 20220528 UT Henlagt manglende svar NO BRYN AARFLOT AS
06.12.2023 10-01 Saksbehandling 20220528 UT Realitet patent BRYN AARFLOT AS
10.05.2023 09-05 Saksbehandling 20220528 INN Response NIPO 139098 BRYN AARFLOT AS
10.05.2023 09-04 Saksbehandling 20220528 INN Maskinsynbeskrivelse BRYN AARFLOT AS
10.05.2023 09-03 Saksbehandling 20220528 INN Amended claims -Marked -139098 BRYN AARFLOT AS
10.05.2023 09-02 Saksbehandling 20220528 INN Amended claims -Clean -139098 BRYN AARFLOT AS
10.05.2023 09-01 Saksbehandling 20220528 INN Korrespondanse (Hovedbrev inn) BRYN AARFLOT AS
02.12.2022 08-02 Saksbehandling 20220528 UT PT report 08:32:09
02.12.2022 08-01 Saksbehandling 20220528 UT Realitet patent BRYN AARFLOT AS
07.06.2022 07-01 Saksbehandling 20220528 UT Infobrev til oppfinner BRYN AARFLOT AS
02.06.2022 06-03 Saksbehandling 20220528 INN Power of Attorney Optimar AS_signed GIN ag BRYN AARFLOT AS
02.06.2022 06-02 Saksbehandling 20220528 INN Declaration of rights to invention Optimar AS_signed GIN ag BRYN AARFLOT AS
02.06.2022 06-01 Saksbehandling 20220528 INN Korrespondanse (Hovedbrev inn) BRYN AARFLOT AS
25.05.2022 05-01 Saksbehandling 20220528 INN Korrespondanse (Hovedbrev inn) Eivind Storøy
20.05.2022 04-01 Saksbehandling 20220528 INN Korrespondanse (Hovedbrev inn) BRYN AARFLOT AS
09.05.2022 03-01 Saksbehandling 20220528 UT Formalia 1 BRYN AARFLOT AS
09.05.2022 02-01 Saksbehandling 20220528 UT Informasjon til oppfinner Emil Bjørlykhaug
09.05.2022 01-04 Saksbehandling 20220528 INN DRAWINGS 139098 BRYN AARFLOT AS
09.05.2022 01-03 Saksbehandling 20220528 INN DESCRIPTION AND ABSTRACT 139098 BRYN AARFLOT AS
09.05.2022 01-02 Saksbehandling 20220528 INN CLAIMS 139098 BRYN AARFLOT AS
09.05.2022 01-01 Saksbehandling 20220528 INN Søknadsskjema Patent BRYN AARFLOT AS

Description, claims and drawings


Disclaimer: This text has been machine-scanned and may contain errors – please refer to "Publications" for legally binding content. Description
System and method for estimating weight of biomassINTRODUCTIONThe present invention relates to a system for estimating weight of biomass and a method for estimating weight of biomass transported on a conveyor.BACKGROUNDSeveral devices for weighing of biomass such as fish, based on mechanical or electronic techniques are known. Many processing plants primary sort products, for example fish, by that an operator observes the sizes and lifts the product for primary sorting in different weight classes. A grading weight is often located adjacent, which measures weight of the product.It is desirable for most food producers to have continuously control of the biomass in production in different processes. For example, sorting fish into different sizes and/or weight classes, or counting or measuring total biomass that passes through a process plant. The biomass from the net-pen is an estimate from growth factors, but actual biomass to slaughter is unknown until the fish passes graders. Knowing the actual amount of biomass as early as possible in the process is desirable to plan post-processing and sales to customers. Therefore, the present innovation which can be on any conveyor at any point in the factory, is a useful tool for fish processing plants.Counting biomass of cleaner fish is also desirable for the fish processers and will become a demand. On processing vessels, catch needs to be logged. When combining the present method with species recognition in the vision module, each species can have a logged total biomass.NO 336911 B1 discloses a method for estimating the weight of fish, comprising transporting the fish on a conveyor belt with associated sensor for measuring the speed of the conveyor belt. The fish passing one or more recording units which recording data on the part of the fish passing under a light source. The height profile of the fish is divided according to variation in density of different parts of the fish for the current species. The volume of the fish is estimated for each part of the height profile. US2008137104 discloses a method for recording and estimation of the weight of fish. A number of cameras, especially CCD-cameras, record pictures of fish moving by the cameras in a transfer conduit. The fish is illuminated from different sides in the transfer conduit and pictures of different parts of the fish are recorded by a sequence control, in such a way that a compound image recording is made, which is used as a base for an estimation of the weight of fish. The present invention relies only on capturing images from one side, and combining the heightmap with images to estimate a volume. The “empty” space below the midpoint of the fish’s height is removed from the volume estimation through relationships between height (thickness) and volume.There is a need of a method for estimating weight of biomass transported on a conveyor in an effective way and that provides accurate results in a user-friendly way. It is further desirable that a system could handle and collect a very large amount of data and where the data could be stored, reported and possibly used quickly and effectively. It is an aim of the present invention to provide a system and method for estimating weight of biomass transported on a conveyor, that addresses at least one of these problems while retaining the benefits of prior art. Current weight estimation systems relies on “one and one” fish entering the system, whilst the present innovation calculates the entire biomass on a conveyor and only requires the fish to not overlap significantly.SUMMARY OF THE INVENTIONThis is achieved according to the present invention by providing a system 10 for estimating weight of biomass 1, comprising: a conveyor 2a, 2b with the biomass 1, one or more laser units 3 and/or one or more cameras 4 scanning the biomass, one or more light sources to illuminate the biomass, a computer unit 5, receiving input data from the one or more laser units 3 and/or one or more cameras 4, the computer unit 5 includes software that provides height map and outline / outer measurements of the biomass from the input data and estimates the weight of the biomass 1 based on product data, biological ratios and possible adjustment factors, and where the system include artificial intelligence and machine learning to continuously improved the system and the weight estimation. In another aspect, the present invention provides a method for estimating weight of biomass 1 transported on a conveyor 2a, 2b, where the biomass 1 enters the conveyor 2a, 2b and passes one or more laser units 3 and/or one or more cameras 4 scanning the biomass 1, and providing input data to a computer unit 5, where the input data are processed in the computer unit 5 which gives height map and outline / outer measurements of the biomass, and by use of product data, biological ratios and possible adjustment factors estimating the weight of the biomass 1, and continuously improving the method by using machine learning and artificial intelligence to improve the weight estimation.In yet another aspect, the present invention concerns use of the system 10 to provide, collect and report data of biomass weight or number of biomass such as marine products e.g. fish and crabs etc., passing on a conveyor, and optionally to sort different species and/or to sort the biomass product based on weight or volume of the biomass.Further advantageous features of the present invention are defined in the dependent claims.BRIEF DESCRIPTION OF DRAWINGSExample embodiments will now be described with reference to the following drawings, where:Figure 1 is a schematic representation of a conveyor-belt where the biomass is e.g. fish.Figure 2 shows a schematic representation of a channel including product transport equipment with fish as the biomass.Figure 3 shows a schematic block diagram of a computer unit receiving input data from the laser units and/or cameras, including artificial intelligence.DETAILED DESCRIPTIONIn the following, general embodiments as well as particular exemplary embodiments of the invention will be described. References will be made to the accompanying drawings. It shall be noted, however, that the drawings are exemplary embodiments only, and that other features and embodiments may well be within the scope of the invention as claimed.In one aspect, the present invention relates to a system 10 as shown in figure 1 and figure 2, for estimating weight of biomass 1. The system comprises a conveyor 2a, 2b with the biomass 1, one or more laser units 3 and/or one or more cameras 4 scanning the biomass. The system can optionally comprise one or more light sources to illuminate the biomass and reflecting colours of the biomass. As shown in shown in figure 1 and figure 2 the conveyor 2a, 2b could be a conveyor-belt, moving gutter or a moving channel including product transport equipment.The laser units 3 and/or cameras 4 and light sources are positioned in a suitable distance from the conveyor 2a, 2b, and the biomass 1 which enters the conveyor 2a, 2b passes the laser 3 and/or camera 4 and light sources if required. The laser unit 3 points directly down and camera unit 4 should be angled such that the center of the cone "hits" the laser line. The cameras used could be black and white or colour cameras. A stereo camera, with the ability to capture three-dimensional images, could also be used. The laser units 3 could be of any known type, a.o. laser triangulation units, a time-of-flight camera and structured light.The system also includes a computer unit 5, as shown in figure 3, receiving input data from the one or more laser units 3 and/or one or more cameras 4, where the computer unit 5 includes software that provides height map and outline / outer measurements of the biomass from the input data and estimates the weight of the biomass 1 based on product data, biological ratios and possible adjustment factors. The product data are e.g. density and biological ratios are outer dimensions as length, width and height of the biomass. It is different adjustment factors for different species.The blocks illustrated in figure 3 are explained in more detail below;Laser beam: line laser emitting a line across the conveyor.Laser triangulation: camera is angled such that it’s focus point is on the laser line. Camera capture: 1mm resolution, e.g. one image is stripped to 1mm in height across the conveyor width. Laser line “hits” the 1mm strip, which gives an intensity value of the laser beam across the 1mm strip.Images: A builds up of 1mm strips continuously. The different 1mm strips are accumulated into whole images up to a certain value, at which point a new image is started and the following 1mm strips are accumulated into an image.Defining height map and outline / outer measurements: The camera is angled such that the focus point hits the laser beam. The beam will have a light intensity depending on how high it is, and the different intensities build up a height map of the fish. The height map consequently also produces the outer measurements, due to threshold values for the height map. Calculate biomass weight: Volume x weight ratio.Biomass ratios: Found through feed backing actual weight of total biomass and number of fish to the weight estimation system.Weight of biomass: From downstream weighing operations / the predicted biomass from volume x weight ratio.Artificial intelligence improvements: Continuously improving the factors by utilizing data from downstream processes to increase prediction accuracy.Biomass data: Data from weighing system downstream.The system 10 according to the invention will be continuously improved by using machine learning and artificial intelligence to improve the weight estimation. By use of artificial intelligence and machine learning algorithms the system can analyze large amounts of data with accurate results. Adjustment factors are provided by machine learning and the adjustment factors used can be improved through a control loop, as shown in figure 3, that returns e.g. the weight of biomass to the system if the biomass is weighed later downstream. Information is retrieved from the grading system (package system) about total biomass and number of fish, and this information fed to the algorithm. In this way, the algorithm is continuously improved. The system 10 further comprises a human-machine interface (HMI) for collecting and reporting data.In an embodiment the system comprises a biomass 1 weight-sorting unit downstream the conveyor 2a, 2b. Different density factors for different species can be used, where different density factor for different species is provided from a weight reference. Based on the weight estimation from the computer unit 5, the system is used for sorting of different species. The biomass product 1 is marine products such as fish and crabs etc., and the system 10 is located on a fishing vessel or onshore.In another aspect the invention concerns method for estimating weight of biomass 1 transported on a conveyor 2a, 2b, where the biomass 1 enters the conveyor 2a, 2b and passes one or more laser units 3 and/or one or more cameras 4 scanning the biomass 1, and providing input data to a computer unit 5. The input data are processed in the computer unit 5 which gives height map and outer measurements of the biomass, and by use of product data, biological ratios and possible adjustment factors estimating the weight of the biomass 1. The method for estimating weight of biomass is continuously improved by using machine learning and artificial intelligence.The reference used in the machine learning is a weight unit downstream or from the slaughter report, i.e total biomass for each species slaughtered divided on the number of fish counted. During the development, reports were received after the slaughtering, i.e. of the total biomass and the number of fish. When the fish have been graded, it has also been weighed, but this happened much later in the process than desired by the customers. This information is now, according to the invention, included in the machine learning algorithm, and it is now possible to estimate total biomass and count the number of fish as soon as it enters the fish slaughterhouse. This is very beneficial to the customers compared to the previous solution, when they do not have to wait until all the fish have been packed to know the exact number fish and biomass. This allows the customers to plan/staff postprocessing (packaging, etc.) earlier, as well as allowing adjustment of the sales predictions and then sold more accurate fish/biomass. Previously, the fish was sold based on estimates, and the error range was often large. This error range is now significantly reduced because the adjustment can be done earlier.The adjustment factors are provided by machine learning and the adjustment factors are improved by a control loop that returns e.g. the weight of biomass to the system when the biomass is weighed later downstream. The method according to the invention, further comprises collecting and reporting data of the biomass 1 by a human-machine interface.In an embodiment the method of the invention comprises weight sorting of the biomass 1 by a weight-sorting unit downstream the conveyor 2a, 2b. The biomass product is marine products such as fish and crabs etc. entering the conveyor 2a, 2b, and the fish could be gutted or ungutted.The present invention also concerns use of the system to provide, collect and report data of biomass weight or number of biomass such as marine products e.g. fish and crabs etc., passing on a conveyor, and optionally to sort different species and/or to sort the biomass product based on weight or volume of the biomass.The system for weight estimation provided by the invention is based on outer measurements, it gives accurate results and provides continuously control of the biomass. It is also advantageously by the present invention that it is continuously improved by using machine learning and artificial intelligence to improve the weight estimation. The system could easily store, report and use a very large amount of data i.a. by that the system include a human-machine interface for collecting and reporting data. By the present invention a large amount of data can be handled, stored and reported quickly and efficiently. By estimating biomass early in the slaughter process, it is easier to plan the sale of fish more accurately and also know the needed amount of operators for the machines doing post processing. This reduces waste and increases the price for the fish, by not having the price dumped if a rest of fish is present in the factory when everything is sold based on early estimates.Having described example embodiments of the invention it will be apparent to those skilled in the art that other embodiments incorporating the concepts may be used. These and other examples illustrated above are intended by way of example only and the actual scope of the invention is to be determined from the following claims.
Claims
CLAIMS1. A system (10) for estimating weight of biomass (1), comprising:- a conveyor (2a, 2b) with the biomass (1),- one or more laser units (3) and/or one or more cameras (4),- one or more light sources,- a computer unit (5), receiving input data from the one or more laser units (3) and/or one or more cameras (4), the computer unit (5) includes software that provides height map and outline / outer measurements of the biomass from the input data and estimates the weight of the biomass (1) based on product data, biological ratios and possible adjustment factors, and where the system (10) include artificial intelligence and machine learning to continuously improved the system and the weight estimation.2. The system (10) according to claim 1, where the one or more laser units (3) and/or one or more cameras (4) are positioned in a suitable distance from the conveyor (2a, 2b), and where the biomass (1) enters the conveyor (2a, 2b) and passes the laser (3) and/or camera (4).3. The system (10) according to any of the preceding claim, wherein the product data are e.g. density, and biological ratios are outer dimensions as length, width and height of the biomass.4. The system (10) according to any of the preceding claim, wherein adjustment factors are provided by machine learning and the adjustment factors used can be improved through a control loop that returns e.g. the weight of biomass to the system if the biomass is weighed later downstream.5. The system (10) according to any of the preceding claim, where the one or more laser units (3) are laser triangulation unit(s), a time-of-flight camera(s) or structured light.6. The system (10) according to any of the preceding claim, where the system (10) comprises a human-machine interface for collecting and reporting data, and optionally a biomass (1) weight-sorting unit downstream the conveyor (2a, 2b).7. The system (10) according to any of the preceding claim, where different density factors for different species are used, and based on the weight estimation from the computer unit (5), the system is optionally used for sorting of different species.8. The system (10) according to any of the preceding claim, where the biomass product (1) is marine products such as fish and crabs etc., and the system (10) is located on a fishing vessel or onshore.9. The system (10) according to any of the preceding claim, where the conveyor (2a, 2b) is a conveyor-belt, gutter or channel including product transport equipment.10.A method for estimating weight of biomass (1) transported on a conveyor (2a, 2b), where the biomass (1) enters the conveyor (2a, 2b) and passes one or more light sources illuminating the biomass, and one or more laser units (3) and/or one or more cameras (4) scanning the biomass (1), which provides input data to a computer unit (5), andprocessing the input data in the computer unit (5) which gives height map and outline / outer measurements of the biomass, andestimating the weight of the biomass (1) by use of product data, biological ratios and possible adjustment factors, andcontinuously improving the method by using machine learning and artificial intelligence to improve the weight estimation.11.The method according to any of the preceding claim 10-12, wherein the adjustment factors are provided by machine learning and the adjustment factors are improved by a control loop that returns e.g. the weight of biomass to the system when the biomass is weighed later downstream.12.The method according to any of the preceding claim 10-13, further comprising collecting and reporting data of the biomass (1) by a human-machine interface, and optionally weight sorting the biomass (1) by a weight-sorting unit downstream the conveyor (2a, 2b).13.The method according to any of the preceding claim 10-14, where the biomass product is marine products such as fish and crabs etc. entering the conveyor (2a, 2b), and where the conveyor (2a, 2b), the one or more laser units (3) and/or one or more cameras (4) and the computer unit (5) are located on board a vessel or onshore.14.The method according to claim 13, where the fish is gutted or ungutted.15.Use of the system (10) according to any of claims 1-9 to provide, collect and report data of biomass weight or number of biomass such as marine products e.g. fish and crabs etc., passing on a conveyor, and optionally to sort different species and/or to sort the biomass product based on weight or volume of the biomass.
Drawings

Priority


No priority

Patent classes


IPC classesG01G 11/18G06T 7/60G06N 20/00A01K 61/90A22C 25/08CPC classesG01G 11/18G06T 7/60G06N 20/00A01K 61/90A22C 25/08

Citations


ES 2478420 A1 (A1)WO 2016126835 A1 (A1)ES 2552397 B1 (B1)CN 109332207 A (A)WO 2021059631 A1 (A1)NO 336911 B (B)WO 2022076542 A1 (A1)CN 113155198 A (A)NO 20050517 L (L)

Applicants, owners and inventors


Applicants
OPTIMAR AS
Valderøyvegen 1129 6050 VALDERØYA NO (GISKE Municipality, Møre og Romsdal county)Org. number: 985426813
Inventors
Daniel Kvam
Sorenskriver Bulls gate 66 6002 ÅLESUND NO (Ã…LESUND Municipality, Møre og Romsdal county)
Marius Nedrelid
Brunholmgata 32 B 6004 ÅLESUND NO (Ã…LESUND Municipality, Møre og Romsdal county)
Eivind Storøy
Røsvikgarden 61 6040 VIGRA NO (GISKE Municipality, Møre og Romsdal county)
Johan Espelund
Storfarvegen 313 6057 ELLINGSØY NO (Ã…LESUND Municipality, Møre og Romsdal county)
Emil Bjørlykhaug
Solstrandvegen 99 A 6264 TENNFJORD NO (HARAM Municipality, Møre og Romsdal county)

Agent


BRYN AARFLOT AS
BRYN AARFLOT AS

Org. number: 979993269

Name and address are automatically synchronized with the Brønnøysund Register Centre.

Open in The Brønnøysund Register Centre
Stortingsgata 8 0161 OSLO NO (OSLO Municipality, Oslo county)
Org. number: 979993269
Reference: 139098/LBA

Status history


Payment history


Oppositions and appeals


No oppositions or appeals

Administrative limitation


No administrative limitation

Liens and licences


No liens or licenses registered

Gazette entries


No Gazette entries foundOnly events from 2024.03.04 and onwards are shown.