Author Topic: French Company offers Sarcasm Detector for internet comments  (Read 708 times)

Syt

  • Blessed by Valmy
  • **************
  • Posts: 27949
http://www.bbc.co.uk/news/technology-23160583

Quote
Authorities 'use analytics tool that recognises sarcasm'

French company Spotter has developed an analytics tool that claims to be able to identify sarcastic comments posted online.

Spotter says its clients include the Home Office, EU Commission and Dubai Courts.

The algorithm-based analytics software generates reputation reports based on social and traditional media material.

However some experts say such tools are often inadequate because of the nuance of language.

A spokeswoman for the Home Office said she should not comment at this time.

Spotter's UK sales director Richard May said the company monitored material that was "publicly available".

Its proprietary software uses a combination of linguistics, semantics and heuristics to create algorithms that generate reports about online reputation. It says it is able to identify sentiment with up to an 80% accuracy rate.

The company says these reports can also be verified by human analysts if the client wishes.

Algorithms had been developed to reflect various tones in 29 different languages including Chinese, Russian and Arabic, said Mr May.

"Nothing is fool-proof - we are talking about automated systems," he told the BBC.

"But five years ago you couldn't get this level of accuracy - we were at the 50% mark."

Mr May added one of the most common subjects for sarcasm was bad service - such as delayed journeys.

"One of our clients is Air France. If someone has a delayed flight, they will tweet, 'Thanks Air France for getting us into London two hours late' - obviously they are not actually thanking them," he said.

"We also have to be very specific to specific industries. The word 'virus' is usually negative. But if you're talking about virus in the context of the medical industry, it might not be."

Spotter charged a minimum of £1,000 per month for its services, Mr May said.

Human effort

Simon Collister, who lectures in PR and social media at the London College of Communication, told the BBC there was "no magic bullet" when it came to analytics that recognise tone.

"These tools are often next to useless - in terms of understanding tone, sarcasm, it's so dependent on context and human languages," he said.

"It's social media and what makes it interesting and fascinating is the social side - machines just can't comprehend that side of things in my opinion."

Mr Collister added that human interpretation was still vital.

"The challenge that governments and businesses have is whether to rely on automated tools that are not that effective or to engage a huge amount of human effort."
:hmm:
“There is a theory which states that if ever anyone discovers exactly what the Universe is for and why it is here, it will instantly disappear and be replaced by something even more bizarre and inexplicable.

There is another theory which states that this has already happened.”


― Douglas Adams, The Restaurant at the End of the Universe

Weijun

  • Mouth Sugar
  • **
  • Posts: 65
Re: French Company offers Sarcasm Detector for internet comments
« Reply #1 on: July 06, 2013, 05:01:24 am »
That will definitely end all misunderstanding online.

Eddie Teach

  • Neil
  • ***************
  • Posts: 34396
Re: French Company offers Sarcasm Detector for internet comments
« Reply #2 on: July 06, 2013, 07:34:53 am »
80% is fairly good. I think there's a few posters here who don't manage that.
You know I'm going to lose
And gambling's for fools
But that's the way I like it
Baby, I don't want to live forever.

The Brain

  • Blessed by Valmy
  • **************
  • Posts: 27798
  • All man
Re: French Company offers Sarcasm Detector for internet comments
« Reply #3 on: July 06, 2013, 08:13:47 am »
I am happy that this scientific breakthrough came in my lifetime.
You are gay.

DontSayBanana

  • Can I Be: Ottoman Empire
  • ***********
  • Posts: 7119
  • Heute ist ein guter Tag zum sterben!
Re: French Company offers Sarcasm Detector for internet comments
« Reply #4 on: July 06, 2013, 10:01:52 am »
Quote
"But five years ago you couldn't get this level of accuracy - we were at the 50% mark."

:lol: That's basically just saying they hadn't started on the algorithm.  Getting it to generate a random "yes/no" to "is it sarcasm" would eventually even out at 50%.
Your freedom of speech doesn't mean I have to listen to you.

Admiral Yi

  • Neil
  • ***************
  • Posts: 39723
Re: French Company offers Sarcasm Detector for internet comments
« Reply #5 on: July 06, 2013, 01:11:23 pm »
:lol: That's basically just saying they hadn't started on the algorithm.  Getting it to generate a random "yes/no" to "is it sarcasm" would eventually even out at 50%.

Only if the underlying population distribution is 50%.  Otherwise it takes work to get to 50% accurate. :nerd:
I'm up $25 on DGuller.

Maximus

  • Furry
  • *********
  • Posts: 3676
Re: French Company offers Sarcasm Detector for internet comments
« Reply #6 on: July 06, 2013, 01:43:24 pm »
:lol: That's basically just saying they hadn't started on the algorithm.  Getting it to generate a random "yes/no" to "is it sarcasm" would eventually even out at 50%.

Only if the underlying population distribution is 50%.  Otherwise it takes work to get to 50% accurate. :nerd:

50% correct when yes is correct
50% correct when no is correct
= 50% correct independently of what the distribution of actual answers is

DGuller

  • Blessed by Valmy
  • **************
  • Posts: 21187
Re: French Company offers Sarcasm Detector for internet comments
« Reply #7 on: July 06, 2013, 01:44:43 pm »
:lol: That's basically just saying they hadn't started on the algorithm.  Getting it to generate a random "yes/no" to "is it sarcasm" would eventually even out at 50%.

Only if the underlying population distribution is 50%.  Otherwise it takes work to get to 50% accurate. :nerd:
Actually, DSB is, as always, correct.

mongers

  • Blessed by Valmy
  • **************
  • Posts: 16488
  • Embrace the solitude
Re: French Company offers Sarcasm Detector for internet comments
« Reply #8 on: July 06, 2013, 02:10:16 pm »
:lol: That's basically just saying they hadn't started on the algorithm.  Getting it to generate a random "yes/no" to "is it sarcasm" would eventually even out at 50%.

Only if the underlying population distribution is 50%.  Otherwise it takes work to get to 50% accurate. :nerd:
Actually, DSB is, as always, correct.

You don't say. 

(see if the detector can work that one out)  :)
"We have it in our power to begin the world over again"

Admiral Yi

  • Neil
  • ***************
  • Posts: 39723
Re: French Company offers Sarcasm Detector for internet comments
« Reply #9 on: July 06, 2013, 02:21:09 pm »
50% correct when yes is correct
50% correct when no is correct
= 50% correct independently of what the distribution of actual answers is

You're right.  Takes backs.
I'm up $25 on DGuller.

Darth Wagtaros

  • Can I Be: Ottoman Empire
  • ***********
  • Posts: 6284
  • In my pajamas
Re: French Company offers Sarcasm Detector for internet comments
« Reply #10 on: August 27, 2019, 02:06:46 pm »
I made a sarcastic comment to someone on Facebook that I thought would understand it was sarcastic. Instead of asking me my meaning she assumed I was a radical right winger and got very upset and complained to my wife. :(

Even if you do not have a sarcasm detector it might not hurt to ask people if they meant something seriously or not, if nothing else give them an opportunity to apologize instead of getting hurt and angry and assuming the worst.
Jaron Is.

Eddie Teach

  • Neil
  • ***************
  • Posts: 34396
Re: French Company offers Sarcasm Detector for internet comments
« Reply #11 on: August 27, 2019, 02:17:52 pm »
It lives!
You know I'm going to lose
And gambling's for fools
But that's the way I like it
Baby, I don't want to live forever.