|

CROWD SCIENCE SEMINAR

"Feet-on-street Crowdsourcing"

Speaker: Evgenii Konovalov, Yandex

|
CROWD SCIENCE SEMINAR
"Feet-on-street crowdsourcing"

Speaker: Evgenii Konovalov, Yandex

About the talk

<div style="font-size:32px;" data-customstyle="yes"></div>

Crowdsourcing relies on the contributions of many workers to accomplish tasks that are usually easier for humans than for computers. This talk will introduce feet-on-street crowdsourcing, also known as spatial crowdsourcing, which implies performing the given task in a real-world location. We will overview the successful applications of spatial crowdsourcing in Yandex company and outside. Also, we will discuss the specifics of the feet-on-street tasks and managing them in human-in-the-loop pipelines.

Come and learn how feet-on-street crowdsourcing helps to digitalize the offline world!

Evgenii Konovalov is the Head of the Spatial crowdsourcing service at Yandex. He has 6+ years of expertise in shipping business-critical crowdsourcing processes for Yandex Search, Taxi, Maps, Voice Assitance (Alice), and other services.

This talk will introduce feet-on-street crowdsourcing, also known as spatial crowdsourcing, which implies performing the given task in a real-world location. We will overview the successful applications of spatial crowdsourcing in Yandex company and outside. Also, we will discuss the specifics of the feet-on-street tasks and managing them in human-in-the-loop pipelines.

Come and learn how feet-on-street crowdsourcing helps to digitalize the offline world!

We are hosting a seminar series where crowd researchers can discuss their work, exchange ideas, and establish new collaborations.

Featured talks

Mohamed Amgad Northwestern University; NuCLS: A scalable crowdsourcing approach and dataset for nucleus classification, localisation and segmentation; Recording link=https://www.youtube.com/watch?v=gL2MmFqajm0 Jorge Ramírez University of Trento; On the state of reporting in crowdsourcing experiments; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/279289721/ Nikolay Babakov Skoltech; Detecting Inappropriate Messages on Sensitive Topics that Could Harm Company's Reputation; Recording link=https://www.youtube.com/watch?v=WeYyTKzawHw/ Seid Muhie Yimam University of Hamburg;Quality Control in Crowdsourcing; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/278340856/ Nihar Shah Carnegie Mellon University;Two F-words in Peer Review (Fraud and Feeback); Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/278186605/ Yevgeny Seldin University of Copenhagen; Second Order PAC-Bayesian Bounds for the Weighted Majority Vote; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/278186605/ Alex Olshevsky Boston University; Crowdsourcing Through Robust Rank-One Matrix Factorization; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/277263053/ Elena Tutubalina, Insilico Medicine Ilseyar Alimova, Kazan Federal University ; Adverse Drug Reaction Corpus Ground Truth Annotation with Crowdsourcing; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/276988500/ Olga Megorskaya Toloka; May the Crowd be with You: Advancing Business with Advanced Crowdsourcing; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/276709860/ Omar Alonso Instacart; The Practice of Crowdsourcing; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/276416418/ Philip Chapkovski Higher School of Economics; Conducting Behavioral Studies on Crowdsourcing Platforms; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/276149041/ Ivan Stelmakh Carnegie Mellon University; Towards Principled Design of Human Decision-Making Systems; Recording link=https://www.youtube.com/watch?v=jIaT2lMNoDQ Fabio Casati ServiceNow; Ethics and Bias in Crowdsourced Data Collection; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/275624044/ Alexey Drutsa, Alexey Volobuev Toloka; Crowd Research at NeurIPS: Overview of the Works and Future Directions; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/275104418/ Vladislav Korablinov Toloka; RuBQ: Challenging AI with Russian Quiz Questions; Meetup Page link=https://www.meetup.com/crowd-science-seminar/events/274818712/ Pavel Braslavsky Ural Federal University; Does the Crowd Have a Sense of Humor? Large-Scale Crowdsourced Jokes Evaluation; Recording link=https://www.youtube.com/watch?v=_BIJiS7gLBA

Want to give a talk?

Fill out a short form and we will be in touch very soon

Name

E-mail

Talk title

Seminar

Inappropriate

2021-07-21 15:16 Blog

NLP team of Skolkovo Institute of Science and Technology trained Neural Network which will help dialogue agents not to discuss "sensitive" topic in dangerous manner.

Problem: neural networks do not understand what they say. After training on big text datasets from social networks, they can suddenly begin to justify slavery and racism, as well as tell a person the right ways to harm themselves.

Solution: a neural model that detects "inappropriate" statements related to these "sensitive" topics for further content filtering.

So far, 18 topics were defined as "sensitive", including drugs, pornography, politics, religion, suicide and crime. The main criterion of relevance is whether the statement can harm the human interlocutor or spoil the reputation of the chatbot owner. The data for training the neural network was taken from Dvach and OtvetiMail.ru.

Official press release: https://www.skoltech.ru/en/2021/07/neural-model-seeks-inappropriateness-to-reduce-chatbot-awkwardness/

Published article about the research for deeper understanding: https://aclanthology.org/2021.bsnlp-1.4/
Pre-trained model for inappropriate utterances detection: https://huggingface.co/Skoltech/russian-inappropriate-messages