# English follows Japanese
早稲田大学現代政治経済研究所実験政治学研究部会では、ヒューストン大学の阿津坂祐貴助教授をお迎えして、以下の国際ワークショップを開催します。どうぞ奮ってご参加ください。
＜日時と場所＞
* 2024年12月19日（木）10時40分-12時20分
* 早稲田大学11号館903号室
* 対面開催のみ
* 使用言語：英語 ※Q&Aセッションは日本語可
＜講演内容＞
発表者：ヒューストン大学 阿津坂祐貴 助教授
タイトル：“Addressing Measurement Errors in Ranking Questions for the Social Sciences”
概要：Social scientists often use ranking questions to study people’s opinions and preferences. However, little is understood about the general nature of measurement errors in such questions, let alone their statistical consequences and what researchers can do about them. We introduce a statistical framework to improve ranking data analysis by addressing measurement errors in ranking questions. First, we characterize measurement errors from random responses—arbitrary and meaningless responses based on a wide range of random patterns. We then quantify bias due to random responses, show that the bias may change our conclusion in any direction, and clarify why item order randomization alone does not solve the statistical issue. Next, we introduce our methodology based on two key design-based considerations: item order randomization and the addition of an “anchor” ranking question with known correct answers. They allow researchers to (1) learn about the direction of the bias and (2) estimate the proportion of random responses, enabling our bias-corrected estimators. We illustrate our methods by studying the relative importance of people’s partisan identity compared to their racial, gender, and religious identities in American politics. We find that about 30% of respondents offered random responses and that these responses may affect our substantive conclusions.
メソッド論文はこちらからダウンロードすることができます。
https://github.com/sysilviakim/rankingQ
——-
The Waseda Institute of Political Economy’s Experimental Political Science Research Project will be holding the following international workshop with assistant professor Yuki Atsusaka at University of Houston. We hope you will join us.
<Date and Time and Location>
* Thursday, December 19, 2024, 10:40 a.m. – 12:20 p.m.
* Room 903, Building 11, Waseda University
* Face-to-face only
* Language: English * Q&A session in Japanese is also acceptable
＜Lecture content＞
Presenter： Yuki Atsusaka, Assistant Professor at University of Houston
Title：Addressing Measurement Errors in Ranking Questions for the Social Sciences”
Abstract: Social scientists often use ranking questions to study people’s opinions and preferences. However, little is understood about the general nature of measurement errors in such questions, let alone their statistical consequences and what researchers can do about them. We introduce a statistical framework to improve ranking data analysis by addressing measurement errors in ranking questions. First, we characterize measurement errors from random responses—arbitrary and meaningless responses based on a wide range of random patterns. We then quantify bias due to random responses, show that the bias may change our conclusion in any direction, and clarify why item order randomization alone does not solve the statistical issue. Next, we introduce our methodology based on two key design-based considerations: item order randomization and the addition of an “anchor” ranking question with known correct answers. They allow researchers to (1) learn about the direction of the bias and (2) estimate the proportion of random responses, enabling our bias-corrected estimators. We illustrate our methods by studying the relative importance of people’s partisan identity compared to their racial, gender, and religious identities in American politics. We find that about 30% of respondents offered random responses and that these responses may affect our substantive conclusions. The proposed methods are available athttps://github.com/sysilviakim/rankingQ.
