{"corpus_id":199449193,"paper_sha":"84fd70753195a16725489c3299a7d3504248af3b","doi":"10.1111/bmsp.12175","arxiv_id":null,"pmid":31385609,"pmcid":null,"mag_id":2965280548,"dblp_id":null,"acl_id":null,"title":"A mixture model for responses and response times with a higher-order ability structure to detect rapid guessing behaviour.","year":2020,"publication_date":"2020-05-01","venue":"British Journal of Mathematical & Statistical Psychology","journal":{"name":"The British journal of mathematical and statistical psychology","pages":null,"volume":null},"journal_issn":null,"journal_title":null,"publication_types":["JournalArticle"],"pubmed_pub_types":["Journal Article","Research Support, Non-U.S. Gov't"],"s2_fields_of_study":["Medicine","Mathematics","Education","Psychology"],"reference_count":58,"citation_count":37,"influential_citation_count":1,"is_open_access":false,"arxiv_categories":null,"arxiv_license":null,"arxiv_journal_ref":null,"mesh_headings":[{"d":"Bias","mj":false,"ui":"D015982"},{"d":"China","mj":false,"ui":"D002681"},{"d":"Computer Simulation","mj":false,"ui":"D003198"},{"d":"Data Interpretation, Statistical","mj":false,"ui":"D003627"},{"d":"Educational Measurement","mj":false,"qs":[{"q":"methods","mj":true,"ui":"Q000379"},{"q":"statistics & numerical data","mj":false,"ui":"Q000706"}],"ui":"D004521"},{"d":"Humans","mj":false,"ui":"D006801"},{"d":"Likelihood Functions","mj":false,"ui":"D016013"},{"d":"Markov Chains","mj":false,"ui":"D008390"},{"d":"Mathematics","mj":false,"qs":[{"q":"education","mj":false,"ui":"Q000193"}],"ui":"D008433"},{"d":"Models, Psychological","mj":true,"ui":"D008960"},{"d":"Models, Statistical","mj":false,"ui":"D015233"},{"d":"Monte Carlo Method","mj":false,"ui":"D009010"},{"d":"Psychometrics","mj":false,"qs":[{"q":"statistics & numerical data","mj":true,"ui":"Q000706"}],"ui":"D011594"},{"d":"Reaction Time","mj":true,"ui":"D011930"},{"d":"Students","mj":false,"qs":[{"q":"psychology","mj":false,"ui":"Q000523"}],"ui":"D013334"}],"chemicals":null,"comments_corrections":null,"source_flags":5,"s2_open_access_pdf_url":null,"s2_open_access_landing_url":null,"s2_open_access_license":null,"s2_open_access_status":null,"pmc_open_access_pdf_url":null,"pmc_open_access_landing_url":null,"pmc_open_access_license":null,"pmc_open_access_status":null,"unpaywall_open_access_pdf_url":null,"unpaywall_open_access_landing_url":null,"unpaywall_open_access_license":null,"unpaywall_open_access_status":null,"abstract":"Many educational and psychological assessments focus on multidimensional latent traits that often have a hierarchical structure to provide both overall-level information and fine-grained diagnostic information. A test will usually have either separate time limits for each subtest or an overall time limit for administrative convenience and test fairness. In order to complete the items within the allocated time, examinees frequently adopt different test-taking behaviours during the test, such as solution behaviour and rapid guessing behaviour. In this paper we propose a new mixture model for responses and response times with a hierarchical ability structure, which incorporates auxiliary information from other subtests and the correlation structure of the abilities to detect rapid guessing behaviour. A Markov chain Monte Carlo method is proposed for model estimation. Simulation studies reveal that all model parameters could be recovered well, and the parameter estimates had smaller absolute bias and mean squared error than the mixture unidimensional item response theory (UIRT) model. Moreover, the true positive rate of detecting rapid guessing behaviour is also higher than when using the mixture UIRT model separately for each subscale, whereas the false detection rate is much lower than the mixture UIRT model. The deviance information criterion and the logarithm of the pseudo-marginal likelihood are employed to evaluate the model fit. Finally, a real data analysis is presented to demonstrate the practical value of the proposed model.","claims":[{"public_id":"cl_b7c44a75361e2505de34445ef945ee95","status":"active","text":"A Markov chain Monte Carlo method is proposed for model estimation.","confidence":0.98,"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/claims/cl_b7c44a75361e2505de34445ef945ee95"},{"public_id":"cl_d486a1ff57ced7e9e04a920b91e8ed63","status":"active","text":"A new mixture model for responses and response times with a hierarchical ability structure is proposed to detect rapid guessing behaviour using auxiliary information from other subtests and the correlation structure of abilities.","confidence":0.98,"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/claims/cl_d486a1ff57ced7e9e04a920b91e8ed63"},{"public_id":"cl_f46ef8263a7c08a657e1a40532e735a8","status":"active","text":"Deviance information criterion and logarithm of the pseudo-marginal likelihood are used to evaluate model fit, and a real data analysis demonstrates the practical value of the proposed model.","confidence":0.93,"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/claims/cl_f46ef8263a7c08a657e1a40532e735a8"},{"public_id":"cl_ed1d782b45e167bd8d2a59e206bf5041","status":"active","text":"Simulation studies show that the model parameters can be recovered well and that the parameter estimates have smaller absolute bias and mean squared error than the mixture unidimensional item response theory model.","confidence":0.97,"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/claims/cl_ed1d782b45e167bd8d2a59e206bf5041"},{"public_id":"cl_416067db074eb6389ae3ec81184f1d5c","status":"active","text":"The proposed model achieves a higher true positive rate and a much lower false detection rate for rapid guessing behaviour than applying the mixture unidimensional item response theory model separately to each subscale.","confidence":0.97,"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/claims/cl_416067db074eb6389ae3ec81184f1d5c"}],"concepts":[{"public_id":"co_071c0b91c09c290fc1b225000f1c2651","status":"active","name":"Markov chain Monte Carlo method","description":"A simulation-based estimation procedure for fitting the proposed model.","types":["estimation method"],"aliases":["MCMC"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_071c0b91c09c290fc1b225000f1c2651"},{"public_id":"co_11b10bbb91a82f2a8d8c467a9cae6a61","status":"active","name":"real data analysis","description":"An empirical application of the proposed model to observed assessment data.","types":["analysis"],"aliases":[],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_11b10bbb91a82f2a8d8c467a9cae6a61"},{"public_id":"co_16032e3735dce6cc0eac962ddc8f1c03","status":"active","name":"true positive rate","description":"The proportion of actual rapid guessing cases correctly detected.","types":["evaluation metric"],"aliases":["TPR"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_16032e3735dce6cc0eac962ddc8f1c03"},{"public_id":"co_20c7d36cb049e98c166e1eea192d5218","status":"active","name":"simulation studies","description":"Synthetic-data experiments used to assess parameter recovery and classification performance.","types":["evaluation study"],"aliases":[],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_20c7d36cb049e98c166e1eea192d5218"},{"public_id":"co_223e5137a1c5da06c84d825e607aedcd","status":"active","name":"logarithm of the pseudo-marginal likelihood","description":"A criterion used to compare model fit across competing models.","types":["model fit criterion"],"aliases":["LPML"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_223e5137a1c5da06c84d825e607aedcd"},{"public_id":"co_2a79d10a8e48e4ad1a0c582327d1dcab","status":"active","name":"mixture model for responses and response times","description":"A statistical model that jointly represents item responses and response times with latent classes or mixture components.","types":["statistical model"],"aliases":[],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_2a79d10a8e48e4ad1a0c582327d1dcab"},{"public_id":"co_50ae6fd006b7e0df824c5d7fdeef0d20","status":"active","name":"mixture unidimensional item response theory model","description":"A mixture item response theory model applied separately to one dimension or subscale.","types":["baseline model"],"aliases":["mixture UIRT model"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_50ae6fd006b7e0df824c5d7fdeef0d20"},{"public_id":"co_58940cbad0ec8a7e9051fbf55fa6d260","status":"active","name":"deviance information criterion","description":"A Bayesian model selection criterion used to assess fit.","types":["model fit criterion"],"aliases":["DIC"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_58940cbad0ec8a7e9051fbf55fa6d260"},{"public_id":"co_6761a75d8e3080e783e9a41fa3870543","status":"active","name":"false detection rate","description":"The proportion of non-rapid-guessing cases incorrectly flagged as rapid guessing.","types":["evaluation metric"],"aliases":[],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_6761a75d8e3080e783e9a41fa3870543"},{"public_id":"co_9265ef6e58abc5d22c841a499f1b1ddb","status":"active","name":"auxiliary information from other subtests","description":"Information borrowed from additional subtests to inform estimation or classification in the model.","types":["covariate information"],"aliases":["other subtests information"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_9265ef6e58abc5d22c841a499f1b1ddb"},{"public_id":"co_acb7718edfb8717baaae3df299d9cce0","status":"active","name":"mean squared error","description":"A metric that combines bias and variance to assess estimation accuracy.","types":["evaluation metric"],"aliases":["MSE"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_acb7718edfb8717baaae3df299d9cce0"},{"public_id":"co_b58cfdbffec6ff0154b27cc3f5fcd310","status":"active","name":"absolute bias","description":"The magnitude of systematic error in estimated model parameters.","types":["evaluation metric"],"aliases":[],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_b58cfdbffec6ff0154b27cc3f5fcd310"},{"public_id":"co_c89c5f22cc0b970260ae4e0991b1e1e6","status":"active","name":"hierarchical ability structure","description":"A nested latent ability structure that captures both overall and subtest-level traits.","types":["latent structure"],"aliases":["higher-order ability structure"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_c89c5f22cc0b970260ae4e0991b1e1e6"},{"public_id":"co_e518e096d8e1889d6d21a78cb8c423a3","status":"active","name":"rapid guessing behaviour","description":"Test-taking behaviour in which examinees respond quickly without fully solving items.","types":["test-taking behaviour"],"aliases":["rapid guessing behavior"],"contributors":[{"id":1,"public_id":"12632b8b5f","public_label":"Anonymous (12632b8b5f)","roles":["extraction"],"url":"https://sah.borca.ai/u/12632b8b5f"}],"url":"https://sah.borca.ai/concepts/co_e518e096d8e1889d6d21a78cb8c423a3"}],"external_ids":{"DOI":"10.1111/bmsp.12175","ArXiv":null,"PubMed":31385609,"PubMedCentral":null,"MAG":2965280548,"DBLP":null,"ACL":null},"open_access":{"is_open_access":false,"pdf_url":null,"landing_url":"https://sah.borca.ai/papers/199449193","source":null,"pdf_url_source":null,"license":null,"reason":"pdf_url_not_indexed"},"reference_availability":{"status":"available","references_indexed":true,"full_text_available":false,"full_text_source":null,"count_basis":"semantic_scholar_metadata","extraction_status":"not_applicable","reason":null},"source":{"provider":"episteme2","base_corpus":"semantic_scholar_dump","freshness_mode":"unknown","basis":["semantic_scholar_metadata","postgres_metadata"],"limits":["paper metadata is based on indexed upstream scholarly datasets","claims and concepts are available only for extracted papers","absence of claims or concepts means no extracted graph data is available in this response"],"status":"available","degraded":false,"degraded_reasons":[],"diagnostics":{"status":"available","degraded":false,"degraded_reasons":[],"metadata_status":"available","graph_status":"available","abstract_status":"available"},"source_flags":5},"paper_id":632271,"paper_uid":"6292964a-b9f0-4ec2-bdcd-f045f978d8dc","canonical_identity":{"paper_id":632271,"paper_uid":"6292964a-b9f0-4ec2-bdcd-f045f978d8dc","identity_status":"available","lookup_basis":"semantic_scholar_external_id","compatibility_path":"corpus_id"},"url":"https://sah.borca.ai/papers/199449193"}