TY - JOUR
T1 - CPNCoverageAnalysis
T2 - An R package for parameter estimation in conceptual properties norming studies
AU - Canessa, Enrique
AU - Chaigneau, Sergio E.
AU - Moreno, Sebastián
AU - Lagos, Rodrigo
N1 - Publisher Copyright:
© 2022, The Psychonomic Society, Inc.
PY - 2023/2
Y1 - 2023/2
N2 - In conceptual properties norming studies (CPNs), participants list properties that describe a set of concepts. From CPNs, many different parameters are calculated, such as semantic richness. A generally overlooked issue is that those values are only point estimates of the true unknown population parameters. In the present work, we present an R package that allows us to treat those values as population parameter estimates. Relatedly, a general practice in CPNs is using an equal number of participants who list properties for each concept (i.e., standardizing sample size). As we illustrate through examples, this procedure has negative effects on data’s statistical analyses. Here, we argue that a better method is to standardize coverage (i.e., the proportion of sampled properties to the total number of properties that describe a concept), such that a similar coverage is achieved across concepts. When standardizing coverage rather than sample size, it is more likely that the set of concepts in a CPN all exhibit a similar representativeness. Moreover, by computing coverage the researcher can decide whether the CPN reached a sufficiently high coverage, so that its results might be generalizable to other studies. The R package we make available in the current work allows one to compute coverage and to estimate the necessary number of participants to reach a target coverage. We show this sampling procedure by using the R package on real and simulated CPN data.
AB - In conceptual properties norming studies (CPNs), participants list properties that describe a set of concepts. From CPNs, many different parameters are calculated, such as semantic richness. A generally overlooked issue is that those values are only point estimates of the true unknown population parameters. In the present work, we present an R package that allows us to treat those values as population parameter estimates. Relatedly, a general practice in CPNs is using an equal number of participants who list properties for each concept (i.e., standardizing sample size). As we illustrate through examples, this procedure has negative effects on data’s statistical analyses. Here, we argue that a better method is to standardize coverage (i.e., the proportion of sampled properties to the total number of properties that describe a concept), such that a similar coverage is achieved across concepts. When standardizing coverage rather than sample size, it is more likely that the set of concepts in a CPN all exhibit a similar representativeness. Moreover, by computing coverage the researcher can decide whether the CPN reached a sufficiently high coverage, so that its results might be generalizable to other studies. The R package we make available in the current work allows one to compute coverage and to estimate the necessary number of participants to reach a target coverage. We show this sampling procedure by using the R package on real and simulated CPN data.
KW - Conceptual properties norming studies
KW - Parameter estimation
KW - Property listing task
KW - Sample coverage
KW - Sample size determination
UR - http://www.scopus.com/inward/record.url?scp=85126878011&partnerID=8YFLogxK
U2 - 10.3758/s13428-022-01811-w
DO - 10.3758/s13428-022-01811-w
M3 - Comment/debate
AN - SCOPUS:85126878011
SN - 1554-351X
VL - 55
SP - 554
EP - 569
JO - Behavior Research Methods
JF - Behavior Research Methods
IS - 2
ER -