Vignette study for the analysis of labor recruitmenta critical perspective

  1. Martínez Pastor, Juan Ignacio 1
  2. Fernánez Lozano, Irina 1
  1. 1 Universidad Nacional de Educación a Distancia
    info

    Universidad Nacional de Educación a Distancia

    Madrid, España

    ROR https://ror.org/02msb5n36

Journal:
Papers: revista de sociología

ISSN: 0210-2862,  2013-9004

Year of publication: 2022

Volume: 107

Issue: 4

Type: Article

DOI: 10.5565/REV/PAPERS.3075 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Papers: revista de sociología

Abstract

A vignette study is, in essence, an ad hoc survey designed to evaluate fictitious scenarios on the part of respondents, so that opinions or attitudes can be inferred from such an evaluation that are not usually revealed in traditional surveys. Its main advantages are twofold: firstly, that, by virtue of the survey design, existing correlations between variables that always occur in real populations are eliminated and the effects of these variables can be better disentangled; and secondly, that respondents respond indirectly to the research questions, so this technique tries to eliminate social desirability biases. After reviewing the basic characteristics of the technique, the article considers its usefulness from a critical point of view in relation to the following aspects: social desirability biases; the fact of posing hypothetical situations and not analysing real behaviour and, above all, the external validity when applied to very specific groups (or the extent to which research results can be generalized).

Bibliographic References

  • Auspurg, Katrin y Hinz, Thomas (2015). Factorial Survey Experiments. Los Ángeles: Sage Series Quantitative Applications in the Social Sciences, nº. 175. https://doi.org/10.4135/9781483398075
  • Auspurg, Katrin y Jäckle, Annette (2015). «First Equals Most Important? Order Effects in Vignette-Based Measurement». Sociological Methods & Research. https://doi.org/10.1177/0049124115591016
  • Beek, Krijn van; Koopmans, Carl y Praag, Bernard van (1997). «Shopping at the labour market: A real tale of fiction». European Economic Review, 41, 295-317. https://doi.org/10.1016/S0014-2921(96)00037-2
  • Benard, Stephen y Correll, Shelley J. (2010). «Normative Discrimination and the Motherhood Penalty». Gender & Society, 24, 616-46. https://doi.org/10.1177/0891243210383142
  • Biesma, Regien; Pavlova, Milena; Merode, Frits van y Groot, Wim (2007). «Using Conjoint Analysis to Estimate Employers Preferences for Key Competencies of Master Level Dutch Graduates Entering the Public Health Field». Economics of Education Review, 26 (3), 375-386. https://doi.org/10.1016/j.econedurev.2006.01.004
  • Booth, Alison y Leigh, Andrew (2010). «Do employers discriminate by gender? A field experiment in female-dominated occupations». Economics Letters, 107 (2), 236-238. https://doi.org/10.1016/j.econlet.2010.01.034
  • Castilla, Emilio J. y Bernard, Stephen (2010). «The paradox of Meritocracy in Organizations». Administrative Science Quarterly, 55 (6), 543-576. https://doi.org/10.3905/JOI.2010.19.1.032
  • CIS (2019). La encuesta social europea 9, sesión de formación. Centro de Investigaciones Sociológicas, octubre de 2019, presentación disponible en
  • Correll, Shelley J.; Benard, Stephen y Paik, In (2007). «Getting a Job: Is There a Motherhood Penalty?». American Journal of Sociology, 112 (5), 1.297-1.339. https://doi.org/10.1086/511799
  • Cortina, Clara; Rodríguez, Jorge y González, M. J. (2021). «Mind the Job: The Role of Occupational Characteristics in Explaining Gender Discrimination». Social Indicators Research, 156, 91-110. https://doi.org/10.1007/s11205-021-02646-2
  • Cuddy, Amy J. C.; Fiske, Susan T. y Glick, Peter (2004). «When Professionals Become Mothers, Warmth Doesn’t Cut the Ice». Journal of Social Issues, 60 (4), 701-718. https://doi.org/10.1111/j.0022-4537.2004.00381.x
  • Damelang, Andreas y Abraham, Martin (2016). «You Can Take Some of It with You! A Vignette Study on the Acceptance of Foreign Vocational Certificates and Ethnic Inequality in the German Labour Market». Zeitschrift Für Soziologie, 45 (2), 91-106. https://doi.org/10.1515/zfsoz-2015-1005
  • Di Stasio, Valentina (2014a). «Education as a Signal of Trainability: Results from a Vignette Study with Italian Employers». European Sociological Review, 30 (4), 796-809. https://doi.org/10.1093/esr/jcu074
  • Di Stasio, Valentina (2014b). Why education matters to employers: a vignette study in Italy, England and the Netherlands. Ámsterdam: University of Amsterdam.
  • Di Stasio, Valentina y Gërxhani, Klarita (2015). «Employers’ Social Contacts and Their Hiring Behaviour in a Factorial Survey». Social Science Research, 51, 93-107. https://doi.org/10.1016/j.ssresearch.2014.12.015
  • Di Stasio, Valentina y Werfhorst, Herman G. van de (2016). «Why Does Education Matter to Employers in Different Institutional Contexts? A Vignette Study in England and the Netherlands». Social Forces, 95 (1), 77-106. https://doi.org/10.1093/sf/sow027
  • Dülmer, Hermann (2007). «Experimental Plans in Factorial Surveys. Random or Quota Design?». Sociological Methods & Research, 35 (3), 1-28. https://doi.org/10.1177/0049124106292367
  • Eifler, Stefanie y Petzold, Knut (2019). «Validity Aspects of Vignette Experiments: Expected “What-If” Differences Between Reports of Behavioral Intentions and Actual Behavior». En: Lavrakas, Paul J.; Traugott, Michael W.; Kennedy, Courtney; Holbrook, Allyson L.; Leeuw, Edith D. de y West, Brady T. (eds.). Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment. JohnWiley & Sons, Inc. https://doi.org/10.1002/9781119083771.ch20
  • Escot, Lorenzo; Belope-Nguema, Sabina; Fernánez-Cornejo, José Andrés; Pozo-García, Eva del; Castellanos-Serrano, Cristina y Cruz-Calderón, Selene Fabiola (2021). «Can the legal framework for prostitution influence the acceptability of Buying sex?». Journal of Experimental Criminology. https://doi.org/10.1007/s11292-021-09465-y
  • Falk, Armin y Heckman, James J. (2009). «Lab Experiments are a Major Source of Knowledge in the Social Sciences». Science, 326, 535-538. https://doi.org/10.1126/science.1168244
  • Fernández-Lozano, Irina; González, M. José; Jurado-Guerrero, Teresa y Martínez-Pastor, Juan-Ignacio (2020). «The Hidden Cost of Flexibility: A Factorial Survey Experiment on Job Promotion». European Sociological Review, 36 (2), 265-283. https://doi.org/10.1093/esr/jcz059
  • Gaddis, Michael S. (2015). «Discrimination in the credential society: An audit study of race and college selectivity in the labor market». Social Forces, 93 (4), 1.451-1.459. https://doi.org/10.1093/sf/sou111
  • Gerring, John (2014). Metodología de las ciencias sociales. Madrid: Alianza.
  • Gniza, Jan; Martin, Abraham; Lehman, Isabella y Lorek, Kerstin (2022). «Expecting equality or efficiency? A factorial survey on the justive percepcion of regional redistributive policies». Regional Studies. https://doi.org/10.1080/00343404.2021.2018129
  • Gutfleisch, Tamara; Robin, Samuel y Sacchi, Stefan (2021). «The application of factorial surveys to study recruiters’ hiring intentions: comparing designs based on hypothetical and real vacancies». Quality & Quantity, 55, 775-804. https://doi.org/10.1007/s11135-020-01012-7
  • Hainmueller, Jens; Hangartner, Dominik y Yamamoto, Teppei (2015). «Validating vignette and conjoint survey experiments against real-world behavior». PNAS, 112 (8), 2.395-2.400. https://doi.org/10.1073/pnas.1416587112
  • Henkens, Kène; Solinge, Hanna van y Cozijnsen, Rabina (2009). «Let Go or Retain? A Comparative Study of the Attitudes of Business Students and Managers about the Retirement of Older Workers». Journal of Applied Social Psychology, 39 (7), 1.562-1.588. https://doi.org/10.1111/j.1559-1816.2009.00495.x
  • Humburg, Martin y Velden, Rolf van der (2014). Skills and the Graduate Recruitment Process: Evidence From Two Discrete Choice Experiments. Research Centre for Education and the Labour Market. https://doi.org/10.1016/j.econedurev.2015.07.001
  • Jacobs, Jerry A. y Gerson, Kathleen (2016). «Unpacking americans’ views of the employment of mothers and fathers using national vignette survey data: SWS Presidential Address». Gender & Society, 30 (3), 413-441. https://doi.org/10.1177/0891243215597445
  • Karpinska, Kasia; Henkens, Kène y Schippers, Joop (2011). «The Recruitment of Early Retirees: A Vignette Study of the Factors That Affect Managers’ Decisions». Ageing and Society, 31 (4), 570-589. https://doi.org/10.1017/S0144686X10001078
  • Karpinska, Kasia; Henkens, Kène y Schippers, Joop (2013). «Retention of Older Workers: Impact of Managers’ Age Norms and Stereotypes». European Sociological Review, 29 (6), 1.323-1.335. https://doi.org/10.1093/esr/jct017
  • Karpinska, Kasia; Henkens, Kène; Schippers, Joop y Wang, Mo (2015). «Training Opportunities for Older Workers in the Netherlands: A Vignette Study». Research in Social Stratification and Mobility, 41, 103-112. https://doi.org/10.1016/j.rssm.2015.03.002
  • Karren, Ronald J. y Barringer, Melissa Woodbard (2022). «A Review and Analysis of the Policy-Capturing Methodology in Organizational Research: Guidelines for Research and Practice». Organizational Research Methods, 5 (4), 337-361. https://doi.org/10.1177/109442802237115
  • Kennedy, Courtney y Hartig, Hannah (2019). «Response rates in telephone surveys have resumed their decline». Pew Research Center. https://pewrsr.ch/2XqxgTT
  • Keuschnigg, Marc y Wolbring, Tobias (2016). «The Use of Field Experiments to Study Mechanisms of Discrimination». Analyse & Kritik. Zeitung für linke Debatte und Praxis, 38 (1), 179-202. https://doi.org/10.1515/auk-2016-0109
  • King, Gary; Keohane, Robert O. y Verba, Sidney (2005). El diseño de la investigación social. La inferencia científica en los estudios cualitativos. Madrid: Alianza.
  • Kootstra, Anouk (2016). «Deserving and Undeserving Welfare Claimants in Britain and the Netherlands: Examining the Role of Ethnicity and Migration Status Using a Vignette Experiment». European Sociological Review, 32 (3), 325-338. https://doi.org/10.1093/esr/jcw010
  • Kübler, Dorothea; Schmid, Julia y Stüber, Robert (2018). «Gender discrimination in hiring across occupations: a nationally-representative vignette study». Labour Economics, 55, 215-229. https://doi.org/10.1016/j.labeco.2018.10.002
  • Laenen, Tigs; Hootegem, Arno van y Rossetti, Federica (2022). «The multidimensionality of public support for basic income: a vignette experiment in Belgium». Journal of European Public Policy, online. https://doi.org/10.1080/13501763.2022.2055112
  • Liechti, Fabienne; Fossati, Flavia; Bonoli, Giuliano y Auer, Daniel (2017). «The Signalling Value of Labour Market Programmes». European Sociological Review, 33 (2), 257-274. https://doi.org/10.1093/esr/jcw061
  • Martínez Pastor, Juan Ignacio (2019). Los datos sin tapujos. Cómo interpretar y difundir las estadísticas sociales. Madrid: Los Libros de la Catarata.
  • McDonald, Patrick (2019). «How Factorial Survey Analysis Improves Our Understanding of Employer Preferences». Swiss Journal of Sociology, 45 (2), 237-260. https://doi.org/10.2478/sjs-2019-0011
  • Mulders, Jaap; Dalen, Hendrik van; Henkens, Kène y Schippers, Joop (2014). «How Likely Are Employers to Rehire Older Workers after Mandatory Retirement? A Vignette Study Among Managers». De Economist, 162, 415-431. https://doi.org/10.1007/s10645-014-9234-8
  • Oesch, Daniel; Lipps, Oliver y McDonald, Patrick (2017). «The Wage Penalty for Motherhood: Evidence on Discrimination From Panel Data and a Survey Experiment for Switzerland». Demographic Research, 37, 1.793-1.824. https://doi.org/10.4054/DemRes.2017.37.56
  • Rudman, Laurie A. y Mescher, Kris (2013). «Penalizing men who request a family leave: Is flexibility stigma a femininity stigma?». Journal of Social Issues, 69 (2), 322-340. https://doi.org/10.1111/josi.12017
  • Shi, Lulu P.; Imdorf, Christian; Samuel, Robin y Sacchi, Stefan (2018). «How Unemployment Scarring Affects Skilled Young Workers: Evidence From a Factorial Survey of Swiss Recruiters». Journal for Labour Market Research, 52 (7), 1-15. https://doi.org/10.1186/s12651-018-0239-7
  • Steiner, Peter, M.; Atzmüller, Christiane y Su, Dan (2016). «Designing Valid and Reliable Vignette Experiments for Survey Research: A Case Study on the Fair Gender Income Gap». Journal of Methods and Measurement in the Social Sciences, 7 (2), 52-94. https://doi.org/10.2458/jmm.v7i2.20321
  • Sterkens, Philippe; Baert, Stijn; Rooman, Claudia y Derous, Eva (2020). «As If it Weren’t Hard Enough Already: Breaking Down Hiring Discrimination Following Burnout». IZA Institute of Labor Economics, Discussion Paper Series No. 13514. https://doi.org/10.2139/ssrn.3660260
  • Wallander, Lisa (2009). «25 years of factorial surveys in sociology: A review». Social Science Research, 38 (3), 505-520. https://doi.org/10.1016/j.ssresearch.2009.03.004
  • Wolf, Inge de y Velden, Rolf van der (2001). «Selection Processes for Three Types of Academic Jobs: An Experiment Among Dutch Employers of Social Sciences Graduates». European Sociological Review, 17 (3), 317-330. https://doi.org/10.1093/esr/17.3.317
Data source: Dialnet