Pages

Tuesday 1 November 2022

ObsIdentify - the Truth

Against my better instincts I tried a seawatch this morning. Thirty-odd minutes of almost nothing in a raging gale was more than enough, and I was soon back home to a hot cuppa. Breakfast Twitter was unsurprisingly light on mothy content for a change, but something about the ObsIdentify app popped up, and I thought it was about time to do an in-depth NQS review. This afternoon I was stupidly out in the relentless hoolie once more. In 4.5 miles of foot-slog I am pretty sure I saw absolutely no birds at all, but had plenty of time to think about my approach to a post about ObsIdentify. So, here it is...

First, what is ObsIdentify?

It is a smartphone app with which you can identify stuff. I use it mainly for moths, but have also tried it with beetles, bugs and whatnot. You input a photo, and it does the rest.

How good is it?

Ah, now you're asking...

I am old enough to have gone to school with a slide-rule in my briefcase. I can remember when the first electronic calculators began to appear, and how they were not allowed in exams. Why not? Because they made tricky sums way too easy. To use a calculator was basically cheating.

In reality of course, it was quite possible to use a calculator and come up with the wrong answer. You still needed to understand the problem you were trying to solve, to input the correct numbers and do the correct things with them, to press the correct buttons in the correct order. In other words, you still needed to think. Because a calculator is not a brain.

And if you approach ObsIdentify with the same mindset, it is - in my opinion - brilliant.

Some folk appear to have done all sorts of careful analysis of its performance, far more than I could be bothered with. To me it is just a tool, and here is one real-life example of how I have used it...

A few nights ago I caught a very small micro around 5mm long. It reminded me of the Beet Moth (Scrobipalpa ocellatella) that occurred in big numbers back in August, but was obviously smaller. I recalled that the Beet Moth was one of the Gelechiidae, so went to that family in my field guide and picked slowly through them all. Nothing quite seemed to match, and I wondered if it might be something else. So I took a ropey pot shot and ran it through ObsIdentify. The result was pretty rubbish...

Technically this is known as 'inconclusive'.

On the upside, both suggestions are gelechiids, so it looked like I was on the right track. As far as I could discern, the Potato Tuber Moth Pthorimaea operculella has never occured in Britain. But the Tomato Leaf-miner has. It is listed as an adventive and immigrant species. The photo in my field guide didn't quite match my moth, but I found some photos online which were spot on. Anyway, I took some better snaps and tried ObsIdentify again...

82% confidence! Okay. Now we're talking.

I asked the Twitter experts and got a general thumbs-up. I'm glad, because Tuta absoluta has got to be one of the coolest scientific names ever, and I am delighted to have it on my list. There are about 10 records on the Dorset Living Record map, and the occurrence fits nicely with recent mothy goings-on. Common in southern Europe, it seems very plausible that my moth was caught up in the huge late-autumn immigration event that we've been experiencing, and has likely been whipped up from Spain or suchlike. Here it is again, compared with a superb shot of this species taken in Worcestershire by Patrick Clement, which can be found on UK Moths...

Top photo by Patrick Clement (and identity confirmed by gen det, i.e. dissection); below is mine. The spitting image, if you ask me. Among other things, I learned that the stripey legs and palps are excellent pointers.

I'm not sure if the record will pass muster 'officially' but it is easily good enough to satisfy my needs, which basically means I can happily label my photos thus...



So, what we have here is an example of ObsIdentify as a tool. From initially having no clue, I was able to use ObsIdentify to give me some pointers. All the legwork was then down to me. Anyone can do this, using books and easily accessible online resources.

Next, two examples of ObsIdentify getting it totally wrong, and why that doesn't matter...

First, this cracker...

Blair's Wainscot

This moth is one of my autumn gems, but I was very cautious with the ID. The fieldguide was pointing me at Blair's Wainscot, and I knew that the first for Portland had very recently been recorded, but it is a rare moth and I could see the potential for error. So I decided to run it through ObsIdentify to confirm my suspicions. The result was a bit of a surprise...

Oh...

There is a small version of Large Wainscot, so now I was wondering whether that's what I had here. More research, more checking. In the end it was obvious that ObsIdentify was wrong, and I can only assume that Blair's Wainscot is not yet in its repertoire, or database, or whatever. Anyway, the point is this: despite ObsIdentify's conspicuous failure to correctly identify my moth, ultimately I wound up even more confident that it was definitely Blair's because I was forced to look more deeply.

And another huge ObsIdentify fail...

Back in June, we caught a rare migrant plume moth called called Scarce Light Plume or Crombrugghia laetus. I only ever got pot shots...

Crombrugghia laetus

Initial identification was made by using the Manley field guide. An obvious confusion species is Crombrugghia distans or Breckland Plume, but in the field guide that moth looks noticeably darker than our beast. However, I sought ID confirmation from a local contact in the Dorset Moth Group, who ran it past a very expert adjudicator. Thankfully he confirmed the identification. Job done.

Around this time I began to use ObsIdentify, and as an afterthought ran our Scarce Light Plume through the app...

Oh...

100% wrong! Again, I assume Crombrugghia laetus is not in the Obsidentify database. In my experience, when there are two very similar species, ObsIdentify struggles to decide one way or the other. You get results like 59% for one, 41% for the other, and so forth. A good example is the Wormwood Pug / Currant Pug pair. I played around a lot with those two species on ObsIdentify, and rarely (if ever?) got a really decisive result. So, a 100% confidence in Crombrugghia distans made it pretty clear that C. laetus was not in the app's system at all.

The whole point of this post is to illustrate that ObsIdentify is just a tool. Like most tools, there are things it cannot do, that it is not (yet?) capable of. If you accept those limitations, it can frequently be a massive help to your ID process. I have read comments that it is useless - frequently highlighting its gross errors - or that it leads to lazy habits. I disagree. My experience of this imperfect app is very positive. It has helped me out many times. Often it has pointed me in the right direction when I've been stuck. And on the rare occasions it hasn't, I have still learned stuff.

All along I have tried to remember that one important principle: like the electronic calculator, ObsIdentify is not a brain. When it comes to thinking, the responsibility is all mine.

17 comments:

  1. You can have quite a lot of fun asking obsidentify to identify humans. It has remained very confident over the last few months that my one year old daughter is some kind of fish, although the exact species has varied from time to time. My wife is apparently a long eared owl.

    ReplyDelete
    Replies
    1. I have been missing out on this handy bonus attribute of ObsIdentify! Thanks for the tip. 😊

      Delete
  2. Hi Gavin,
    Despite living in Australia I always enjoyed reading your blog posts. I was interested in your comments about Obsidentify so I thought I would try it out. When I went to the Google Play Store I discovered that this App is not available in Australia. I thought that this was a bit odd so I looked into Obsidentify a little further and discovered it uses an API to the iNaturalist database to access the object image identification feature of iNaturalist. I have been using iNaturalist for years so your comments about it not having matching images makes sense as iNaturalist relies on users submitting observations to grow its knowledge base. When you use Obsidentify your images are not actually submitted to iNaturalist so are not added to the database of observations. If you submit your observations to iNaturalist directly you still get the object identification suggestions but you are able to suggest a species that is not in the database. The suggestion will be moderated by the subject area specialists and if they agree it will be added to the database as a new species, thereby increasing the accuracy of future observation searches.
    Kind regards,
    Roman

    ReplyDelete
    Replies
    1. Hi Roman, many thanks for your interesting comment. I shall investigate...

      Delete
    2. As you pointed out Gavin these applications are just tools to help you but the fact that iNaturalist uses new observations to become more comprehensive and accurate is a big plus.

      Delete
  3. Gav, I was thinking about just what Roman mentioned myself. The data base would become more accurate as more verified records are submitted. A virtuous circle to which your own records would play a part.

    ReplyDelete
    Replies
    1. Yes, Ric. That makes total sense. I will definitely investigate...

      Delete
  4. Actually, just to be pedantic, "Image recognition in ObsIdentify is made possible by observations from Waarneming.nl, Waarneming.be and Observation.org.” I think it tends to be strongest with species found in Belgium and the Netherlands because that’s where those projects originated. By contrast, the app Seek is powered by iNaturalist, and it seems less good for the UK in my experience because it’s less regionally focussed: more US suggestions and things.
    I also think Seek has a worse interface, including the fact that it makes you choose whether you want English or Latin names instead of just displaying both, but I still turn to it occasionally.
    Obsidentify does allow you to submit records to Observation.org, btw, and I’m pretty sure Seek does the same for iNaturalist if you choose to use it that way.

    ReplyDelete
    Replies
    1. Many thanks for your comment, Harry. Clearly I have some research to do. I like ObsIdentify, and use it quite frequently. It would obviously be in my own interests to help it improve if I can. 👍

      Delete
  5. Wow! Just tried it on some recent moth photos and it agreed with my id gained from field guides. This should speed up the morning trap search.

    ReplyDelete
    Replies
    1. Normally I resist the temptation to use Obsidentify unless I'm struggling. At which point it usually speeds things up nicely. 😊

      Delete
  6. You might be right Harry as I don't know much about Obsidentify but I found the following information on the iNaturalist forum:

    The api is used in:
    -Obsidentify https://forum.waarneming.nl/index.php/board,220.0.html
    -The add Observation screen, with a disclaimer https://observation.org/pages/disclaimer-obsidentify/
    -The observations detail screen
    -The automatic validation of observations. until 2020-06-11 10% of all photo sightings, could be much more if turned on for more species
    -Via the apps iObs, ObsMapp, (Bird Finder)
    this results in 2000-11,000 calls to this api per hour

    Prior to iNaturalist I used to record/research my observations on two Australian systems, Altas of Living Australia (ALA) and NatureMapr. When iNaturalist appeared its advanced AI image matching capability was clearly a game changer. I believe both ALA and NatureMapr now feed their observations into iNaturalist so it has become a goto site for recording and identifying observations in Australia (at least for me anyway). I am even thinking of using it to recored bird observations in addition to eBird and Birdlife Birdata.

    ReplyDelete
  7. Hi Gav

    Interesting post - I've been using ObsIdentify a bit on trickier moths here , much as you have done - its a "phone a friend" option to get a useful steer, but as you say, you do need to think about the results!
    Initially I tried to set up the app to upload my records, but because I'm in Ireland and the app is intended for use in Belgium, and the Netherlands and Germany (I think), it didnt want my records so I can only use it for ID hints. Guessing it would be similar for you. This is also probably why it doesnt always have an answer for every species you ask it about, if they don't occur in its core range.
    Been too wet and windy for any mothing here of late anyway....

    Cheers,
    Colin

    ReplyDelete
    Replies
    1. Hi Col, thanks for your comment. Mothing has been off the agenda here too, for the same reasons! Obsidentify is the only AI app I've tried so far. I like it's user interface, but maybe I ought to investigate others. Perhaps there is one more appropriate for users on this side of the Channel...

      Delete
  8. Having only recently become a smartphone user (why oh why did I put it off for so long??) I've not had a great deal of experience with ID apps. I downloaded Google Lens and was surprised how good it was with plant IDs, which is my main area of interest at the moment. I only really use it when I'm struggling to put a name to a grotty bunch of basal leaves or somesuch, but several times it's put me in the right family and I've sorted it out for myself after that. As far as that goes I think it's amazingly helpful, but I'd never use it without doing my own checking up afterwards, that's just asking for misidentifications.

    ReplyDelete
    Replies
    1. Smartphones are amazing, aren't they? Thankfully brain still in play though. Long may that be so. 😄

      Delete
    2. There is an interesting review of plant ID apps by Atomic Shrimp on YouTube - with some salutary warnings of water hemlock being misidentified as edible !

      Delete