Can machine studying assist save the whales? How PNW researchers use tech instruments to observe orcas

Aerial picture of endangered Southern Resident killer whales in Okay pod. The picture was obtained utilizing a remotely piloted octocopter drone that was flown throughout well being analysis by Dr. John Durban and Dr. Holly Fearnbach. (Vulcan Image)

Being an orca isn’t straightforward. Despite an absence of pure predators, these superb mammals face many severe threats – most of them led to by their human neighbors. Understanding the pressures we placed on killer whale populations is important to the environmental coverage selections that may hopefully contribute to their ongoing survival.

Fortunately, marine mammal researchers like Holly Fearnbach of Sealife Response + Rehab + Research (SR3) and John Durban of Oregon State University are working laborious to usually monitor the situation of the Salish Sea’s southern resident killer whale inhabitants (SKRW). Identified as J pod, Okay pod and L pod, these orca communities have migrated by way of the Salish Sea for millennia. Unfortunately, in recent times their numbers have dwindled to solely 75 whales, with one new calf born in 2021. This is the bottom inhabitants determine for the SRKW in 30 years.

For greater than a decade, Fearnbach and Durban have flown photographic surveys to seize aerial photographs of the orcas. Starting in 2008, picture surveys have been carried out utilizing manned helicopter flights. Then starting in 2014, the crew transitioned to unmanned drones.

As the remote-controlled drone flies 100 toes or extra above the whales, photographs are captured of every of the pod members, both individually or in teams. Since the drone can be outfitted with a laser altimeter, the precise distance is understood making calculations of the whale’s dimensions very correct. The photographs are then analyzed in what’s known as a “photogrammetric health assessment.” This evaluation helps decide every whale’s bodily situation, together with any proof of being pregnant or vital weight reduction as a consequence of malnourishment.

“As a research tool, the drone is very cost effective and it allows us to do our research very noninvasively,” Fearnbach mentioned. “When we do detect health declines in individuals, we’re able to provide management agencies with these quantitative health metrics.”

Dr. John Durban (proper) and Dr. Holly Fearnbach (SR3) maintain a customized analysis drone used to gather aerial photographs to measure the physique situation of endangered Southern Resident killer whales. (Photo courtesy of Eric Guth)

But whereas the picture assortment stage is comparatively cheap, processing the info has been pricey and time-consuming. Each flight can seize 2,000 photographs with tens of hundreds of photographs captured for every survey. Following the drone work, it sometimes takes about six months to manually full the evaluation on every season’s batch of photographs.

Obviously, half a yr is a really very long time should you’re ravenous or pregnant, which is one purpose why SR3’s new partnership with Vulcan is so necessary. Working collectively, the organizations developed a brand new method to course of the info extra quickly. The Aquatic Mammal Photogrammetry Tool (AMPT) makes use of machine studying and an end-user instrument to speed up the laborious course of, dramatically shortening the time wanted to research, establish and categorize the entire photographs.

Aerial picture of an grownup feminine (J35) together with her new child calf (J57) from the endangered Southern Resident killer whale inhabitants. (Vulcan Image)

Applying machine studying strategies to the issue has already yielded big outcomes, lowering a six-month course of to simply six weeks with room for additional enhancements. Machine studying is a department of computing that may enhance its efficiency by way of expertise and use of knowledge. The quicker turnaround time will make it doable “to more quickly identify whales of concern and provide health metrics to management groups to allow for adaptive decision making,” based on Vulcan.

“We’re trying to make and leave the world a better place, primarily through ocean health and conservation,” mentioned Sam McKennoch, machine studying crew supervisor at Vulcan. “We got connected with SR3 and realized this was a great use case, where they have a large amount of existing data and needed help automating their workflows.”

AMPT is predicated on 4 totally different machine studying fashions. First, the orca detector identifies these photographs which have orcas in them and locations a field round every whale. The subsequent ML mannequin absolutely outlines the orca’s physique, a course of recognized within the machine studying subject as “semantic segmentation.” After that comes the landmark detector which detects the podium (or snout) of the whale, the dorsal fins, blowhole, form of the attention patches, fluke notch and so forth. This permits the software program to measure and calculate the form and proportions of varied elements of the physique.

Of specific curiosity is whether or not the whale’s facial fats deposits are so low they lead to indentations of the top that marine biologists discuss with as “peanut head.” This solely seems when the orca has misplaced a major quantity of physique fats and is in peril of hunger.

Finally, the fourth machine studying mannequin is the identifier. The form of the grey saddle patch behind the whale’s dorsal fin is as distinctive as a fingerprint, permitting every of the people within the pod to be recognized.

There are numerous totally different varieties of data wanted for this sort of automation. Fortunately, Vulcan has been capable of leverage a few of SR3’s prior guide work to bootstrap their machine studying fashions.

“We really wanted to understand their pain points and how we could provide them the tools they needed, rather than the tools we might want to give them,” McKennoch mentioned.

As profitable as AMPT has been, there’s numerous information and knowledge that has but to be integrated into its machine studying fashions. As a outcome, there’s nonetheless the necessity to have customers in-the-loop in a semi-supervised approach for a number of the ML processing. The interface hastens consumer enter and standardizes measurements made by totally different customers.

McKennoch believes there might be beneficial properties with every batch they course of for a number of cycles to come back. Because of this, they hope to proceed to enhance efficiency by way of accuracy, workflow and compute time to the purpose that all the course of finally takes days, as an alternative of weeks or months.

This is essential as a result of AMPT will present info that guides coverage selections at many ranges. Human impression on the orca’s setting shouldn’t be diminishing and if something, is growing. Overfishing is lowering meals sources, notably chinook salmon, the orca’s most well-liked meal. Commercial transport and leisure boats proceed to trigger harm and their extreme noise interferes with the orca’s capability to hunt salmon. Toxic chemical compounds from stormwater runoff and different air pollution injury the marine mammals’ well being. Ongoing monitoring of every particular person whale might be important to sustaining their wellbeing and the well being of the native marine ecosystem.

Vulcan plans to open-source AMPT, giving it a lifetime of its personal within the marine mammal analysis group. McKennoch mentioned they hope to increase the instrument so it may be used for different killer whale populations, totally different giant whales, and in time, presumably smaller dolphins and harbor seals.


Please enter your comment!
Please enter your name here