Restricted Latent Class Models for Nominal Response Data: Identifiability and Estimation

Ying Liu; Steven Andrew Culpepper

doi:10.1007/s11336-023-09940-7

Restricted Latent Class Models for Nominal Response Data: Identifiability and Estimation

Published online by Cambridge University Press: 27 December 2024

Ying Liu and

Steven Andrew Culpepper

Show author details

Ying Liu: Affiliation:
University of Illinois at Urbana-Champaign
Steven Andrew Culpepper*: Affiliation:
University of Illinois at Urbana-Champaign
*: Correspondence should be made to Steven Andrew Culpepper, Department of Statistics, University of Illinois at Urbana-Champaign, Computing Applications Building, Room 152, 605 E. Springfield Ave., Champaign, IL61820, USA. Email: [email protected]

Article contents

Abstract
Introduction
Overview of Mixture Models for Nominal Responses
Identifiability Issue
Bayesian Formulation for the Nominal RLCM
Monte Carlo Simulation Study
Applications
Discussion
Footnotes
References

Rights & Permissions

Abstract

Restricted latent class models (RLCMs) provide an important framework for diagnosing and classifying respondents on a collection of multivariate binary responses. Recent research made significant advances in theory for establishing identifiability conditions for RLCMs with binary and polytomous response data. Multiclass data, which are unordered nominal response data, are also widely collected in the social sciences and psychometrics via forced-choice inventories and multiple choice tests. We establish new identifiability conditions for parameters of RLCMs for multiclass data and discuss the implications for substantive applications. The new identifiability conditions are applicable to a wealth of RLCMs for polytomous and nominal response data. We propose a Bayesian framework for inferring model parameters, assess parameter recovery in a Monte Carlo simulation study, and present an application of the model to a real dataset.

Keywords

restricted latent class models nominal response data cognitive diagnosis model identifiability Bayesian

Type: Theory and Methods
Information: Psychometrika , Volume 89 , Issue 2 , June 2024 , pp. 592 - 625

DOI: https://doi.org/10.1007/s11336-023-09940-7 [Opens in a new window]
Copyright: Copyright © 2023 The Author(s), under exclusive licence to The Psychometric Society

1. Introduction

Mixture models for multivariate, unordered categorical data, which are also referred to as nominal data, are widely used as a data reduction technique to uncover a partition of latent classes. Nominal response data arises naturally in a diverse collection of fields and associated latent class models have been applied to uncover the structure underlying positional dependence of nucleotides (Dunson & Xing, Reference Dunson and Xing2009), surveys responses for political elections (DeYoreo et al., Reference DeYoreo, Reiter and Hillygus2017), anuran abundance using calling survey data (Royle & Link, Reference Royle and Link2005), as well as for multiple imputation of educational (Si & Reiter, Reference Si and Reiter2013) and social science (Murray & Reiter, Reference Murray and Reiter2016; Vermunt et al., Reference Vermunt, Van Ginkel, Van der Ark and Sijtsma2008) surveys. In short, nominal mixture models serve an important role across the physical and social sciences.

Recent psychometric research introduced a class of restricted latent class models (RLCMs) that use a more parsimonious formulation for describing the structure underlying multivariate nominal data (e.g., see Chen & Zhou, Reference Chen and Zhou2017, Fang et al., Reference Fang, Liu and Ying2019, Templin et al., Reference Templin, Henson, Rupp, Jang and Ahmed2008) than the traditional framework, which we refer to as unrestricted latent class models (ULCMs). For instance, a popular application of nominal RLCMs is to understand how latent classes relate to target and distractor responses on multiple choice tests (e.g., see Bradshaw & Templin, Reference Bradshaw and Templin2014, De La Torre, Reference De La Torre2009, DiBello et al., Reference DiBello, Henson and Stout2015, Ku et al., Reference Kuo, Chen, Yang and Mok2016, Shear & Roussos, Reference Shear and Roussos2017, Yigit et al., Reference Yigit, Sorrel and de la Torre2019). In order to distinguish RLCMs and ULCMs we let $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} denote the emission parameters that govern the likelihood that latent classes select different options on J variables with M unordered options for each variable. If C denotes the number of latent classes, the classic ULCM framework includes $J \times M \times C$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J\times M\times C$$\end{document} parameters to relate latent class membership to observed responses. In contrast, RLCMs impose structure on the elements of $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} by constraining some elements to be equal. Accordingly, RLCMs include fewer parameters than ULCMs. Furthermore, as we demonstrate below, RLCMs generally offer a more interpretable framework for understanding the latent structure (i.e., the relationship between the latent classes and observed variables). In fact, the pattern of equal and unequal elements in the RLCM $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} parameter provides researchers with a guide for interpreting the impact of latent class membership on response probabilities.

Although prior research developed several general models for nominal RLCMs, there are at least two limitations with existing research that limits widespread applicability of these methods for statistical research in education and the social sciences. First, existing methods are primarily confirmatory in nature given that researchers must prespecify the manner by which latent classes relate to observed response probabilities. Specifically, let $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} be the RLCM parameter with $J \times (M - 1) \times C$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J\times (M-1)\times C$$\end{document} binary elements that indicate which elements of $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} are equal (we formally define the $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} matrix below with examples). Currently deployed nominal RLCMs must specify every element of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} , which may be challenging for some research applications. Whereas researchers may be able to correctly articulate the latent structure in $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} for some applications (e.g., target and distractor responses on some multiple choice tests), the general unavailability of substantive theory would limit widespread application of nominal RLCMs. Second, numerous studies developed RLCMs for multivariate nominal data, yet there has been limited research on conditions that are needed to ensure model parameters are identified. It is important to note that several studies discussed identifiability for ULCMs (e.g., see Allman et al., Reference Allman, Matias and Rhodes2009); however, current results are not specific for RLCMs given that Allman et al. (Reference Allman, Matias and Rhodes2009) consider an unrestricted parameter space whereas the parameter space for our RLCM is restricted by the structure of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} . Consequently, the parameter space falls into a measure zero set with respect to the whole parameter space of ULCMs as discussed in Allman et al. (Reference Allman, Matias and Rhodes2009), so identifiability conditions mentioned above for ULCMs cannot be directly applied to our RLCMs. Furthermore, our paper contributes to literature on the identifiability RLCMs. An extensive collection of literatures have delved into local identifiability issues, which aim to ensure the model parameters are identifiable in a neighborhood of the true parameters. McHugh (Reference McHugh1956) proposed sufficient conditions to determine the local identifiability condition for latent class model with binary response. Goodman (Reference Goodman1974) extended the conditions for latent class models with polytomous response. Huang and Bandeen-Roche (Reference Huang and Bandeen-Roche2004) proposed local identifiability conditions for latent class models with covariates. For global identifiability issue, there are numerous papers proposing strict and generic identifiability conditions for binary response data (Chen et al., Reference Chen, Liu, Xu and Ying2015, Reference Chen, Culpepper and Liang2020; Xu, Reference Xu2017; Xu & Shang, Reference Xu and Shang2018) and strict identifiability conditions for polytomous response data (Culpepper, Reference Culpepper2019; Fang et al., Reference Fang, Liu and Ying2019). Additionally, Gu and Dunson (Reference Gu and Dunson2021) establish strict and generic identifiability conditions for a multiclass, multilayer latent structure model. Gu and Dunson (Reference Gu and Dunson2021) could be viewed as a more general model than the one we consider as it admits a multilayered, hierarchical structure for attributes. One strength of our paper relative to Gu and Dunson (Reference Gu and Dunson2021) is that our identifiability conditions provide practitioners with clear guidance for designing nominal response assessments (e.g., forced-choice inventories). Furthermore, our identifiability conditions also provide generic conditions that are applicable to polytomous RLCMs.

Accordingly, the goal of our study is to address the aforementioned shortcomings in the literature. That is, we propose a fully exploratory framework for inferring nominal RLCM parameters and present new theory regarding model identification. The identifiability of model parameters is critical for statistical inference and we also provide researchers with guidance for designing multivariate nominal response studies.

It is also important to distinguish the models we explore in this study in comparison to polytomous latent class models. Specifically, researchers advanced RLCMs for polytomous data for both confirmatory (e.g., see Ma & de la Torre, Reference Ma and de la Torre2016; Reference Ma and de la Torre2019) and exploratory methods (Culpepper, Reference Culpepper2019; Culpepper & Balamuta, Reference Culpepper and Balamuta2021; Jimenez et al., Reference Jimenez, Balamuta and Culpepper2023). There are also several studies (Bacci et al., Reference Bacci, Bartolucci and Gnaldi2014; Bartolucci, Reference Bartolucci2007; Gnaldi et al., Reference Gnaldi, Bacci, Kunze and Greiff2020) described latent class models within an item response theory (IRT) framework with at least three link functions (i.e., graded response, partial credit, and continuation ratio). These prior studies made important contributions and demonstrated how to use link functions for modeling ordered, polytomous response data with latent class models. In contrast, an important innovation of our study is that we deploy the multinomial logistic link function, which is suitable for unordered, nominal responses.

The remainder of this paper includes six sections. The first section provides a general introduction to ULCMs and RLCMs for nominal data and the second section presents new theoretical results concerning the identifiability of RLCMs (please see Appendix for related proofs). The third section outlines a Bayesian formulation for inferring the RLCM parameter posterior distribution. The fourth section reports Monte Carlo results concerning the accuracy of the developed algorithm and the fifth section reports results from an application. The final section discusses the implications of this study and provides concluding remarks.

2. Overview of Mixture Models for Nominal Responses

We consider the setting where multivariate, nominal response data are available such that $Y_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Y_j$$\end{document} (for $j = 1, \dots, J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\dots ,J$$\end{document} ) is a random categorical (or nominal) response with a realization $y_{j} \in (0, \dots, M_{j} - 1)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$y_j\in \left\{ 0,\dots ,M_j-1\right\} $$\end{document} where $M_{j} \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j\ge 2$$\end{document} denotes the number of unordered response options. We denote the random J-vector by $Y = {(Y_{1}, \dots, Y_{J})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}=(Y_1,\dots , Y_J)^\top $$\end{document} and the observed vector of responses as $y = {(y_{1}, \dots, y_{J})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}= (y_{1},\dots ,y_{J})^\top $$\end{document} . The support for $Y$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}$$\end{document} is defined as $y \in \times_{j = 1}^{J} (0, \dots, M_{j} - 1)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}\in \times _{j=1}^J \left\{ 0,\dots ,M_j-1\right\} $$\end{document} , which implies there are $\prod_{j = 1}^{J} M_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\prod _{j=1}^JM_j$$\end{document} possible observed response patterns. The purpose of this section is discuss the role of mixture models in understanding the multivariate, nominal response patterns. The first subsection reviews existing unstructured latent class models (ULCMs) for nominal, unordered response data. ULCMs offer a powerful framework for uncovering substantively meaningful latent classes. However, the results from ULCMs data analyses may not always be easily interpretable as researchers must decipher the meaning of latent classes by comparing many latent class parameters. Accordingly, the second subsection introduces a new general restricted latent class model (RLCM) framework, which has the benefit of directly uncovering the latent structure by providing researchers with a $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} parameter for more easily interpreting the class labels.

2.1. Unstructured Latent Class Models (ULCMs)

The goal of this section is to review the traditional ULCM framework. Let $c \in {0, \dots, C - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c\in \{0,\dots ,C-1\}$$\end{document} index the C underlying latent classes. In the case of nominal data, the unstructured model includes a $M_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j$$\end{document} -vector of category response probabilities for each class and item denoted by $θ_{jc} = {(θ_{j c 0}, \dots, θ_{j c, M_{j} - 1})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\theta }_{jc}=(\theta _{jc0},\dots ,\theta _{jc,M_j-1})^\top $$\end{document} so that the probability of observing a response of m on item j for members of class c is $θ_{jcm} = P (Y_{j} = m | c)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jcm}=P(Y_j=m|c)$$\end{document} . We define $Θ_{j} = (θ_{j 0}, \dots, θ_{j, C - 1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_j=(\varvec{\theta }_{j0},\dots ,\varvec{\theta }_{j,C-1})$$\end{document} as the $M_{j} \times C$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j\times C$$\end{document} matrix of response probabilities by response option and latent class. The goal of ULCMs is to describe the $\prod_{j = 1}^{J} M_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\prod _{j=1}^J M_j$$\end{document} possible response patterns. ULCMs consider the case where latent classes differ in their chances of responding according to a given response pattern. The probability vector that governs the chance members of class c respond according to one of the $\prod_{j = 1}^{J} M_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\prod _{j=1}^J M_j$$\end{document} possible response patterns is $P_{c} = ⨂_{j = 1}^{J} θ_{jc}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathbb {P}_c = \bigotimes _{j=1}^J\varvec{\theta }_{jc}$$\end{document} where $\otimes$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\otimes $$\end{document} denotes a Kronecker product. Let $π = {(π_{0}, \dots, π_{C - 1})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }=(\pi _0,\dots ,\pi _{C-1})^\top $$\end{document} be a C-vector of structural probabilities such that $π_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\pi _c$$\end{document} denotes the chance of membership in class c and note that the model implied response pattern probability vector is $P = \sum_{c = 0}^{C - 1} π_{c} P_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathbb {P}=\sum _{c=0}^{C-1}\pi _c \mathbb {P}_c$$\end{document} .

2.2. Restricted Latent Class Models (RLCMs)

This subsection introduces a RLCM for nominal data which offers a more interpretable solution by imposing restrictions on the ULCM $θ_{jc}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\theta }_{jc}$$\end{document} parameters. In particular, the RLCM adapts the ULCM to describe the $\prod_{j = 1}^{J} M_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\prod _{j=1}^JM_j$$\end{document} response patterns by reparameterizing both the latent space and parameters. First, the RLCM defines the latent classes using a $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} binary attribute vector $α = {(α_{1}, \dots, α_{K})}^{⊤} \in {0, 1}^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(\alpha _1,\dots ,\alpha _K)^\top \in \{0,1\}^K$$\end{document} . Therefore, the connection between the number of classes in the ULCM and the RLCM is $C = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$C=2^K$$\end{document} . An advantage of using the binary attribute profile is that researchers can interpret $α_{k} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _k=1$$\end{document} as denoting possession or mastery of attribute k and $α_{k} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _k=0$$\end{document} otherwise. The relationship between the ULCM and RLCM is also apparent when using a bijection between the binary attribute profile $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} and the integers $c \in {0, \dots, 2^{K} - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c\in \{0,\dots , 2^K-1\}$$\end{document} by defining class $c = α^{⊤} v \in {0, \dots, 2^{K} - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c=\varvec{\alpha }^\top \varvec{v}\in \{0,\dots , 2^K-1\}$$\end{document} with $v = {(2^{K - 1}, 2^{K - 2}, \dots, 1)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{v}=(2^{K-1},2^{K-2},\dots ,1)^\top $$\end{document} .

Second, the RLCM reparameterizes the elements of $θ_{jc}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\theta }_{jc}$$\end{document} using the following multinomial logit-link function

(1)

\begin{matrix} θ_{jcm} = \frac{exp (a_{c}^{⊤}, β_{jm})}{\sum_{m^{'} = 0}^{M_{j} - 1} exp (a_{c}^{⊤}, β_{j m^{'}})} \end{matrix}

where $a_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}_c$$\end{document} is a design vector for the attribute profile for class c and $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} is a P-vector of coefficients for item j and option m (i.e., P depends on the order of the model, $P = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$P=2^K$$\end{document} if we include main and all interaction-effect terms for latent class). Note that the restriction $β_{j 0} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{j0}=\varvec{0}$$\end{document} is deployed for all j to identify the model. Furthermore, the restriction on $β_{j 0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{j0}$$\end{document} implies that $y_{j} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$y_j=0$$\end{document} is the reference response so that $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} for $m > 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m>0$$\end{document} quantifies the impact of the attributes on response values of $y_{j} = m$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$y_j=m$$\end{document} versus $y_{j} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$y_j=0$$\end{document} on item j. Let the $M_{j} \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j\times 2^K$$\end{document} matrix of coefficients for item j be denoted as $B_{j} = {(β_{j 0}, \dots, β_{j, M_{j} - 1})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_j=(\varvec{\beta }_{j0},\dots ,\varvec{\beta }_{j,M_j-1})^\top $$\end{document} .

An important implication of reparameterizing $θ_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jcm}$$\end{document} with a multinomial logit-link is that the transformed $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} parameters provide a more coherent interpretation regarding the process by which the underlying attributes relate to observed responses. For instance, we define the $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} -vector $a_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}_c$$\end{document} as including main- and interaction-effect terms for latent class $α^{⊤} v = c$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }^\top \varvec{v}=c$$\end{document} . Consequently, the elements of $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} indicate the manner by which the attributes translate into preferences for response option m relative to response option zero.

We next present an example to further illustrate the link between ULCMs and RLCMs and the interpretation of the $a_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}_c$$\end{document} and $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} parameters.

Example 1

Suppose $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document} and $M_{j} = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j=3$$\end{document} , so $y_{j} \in {0, 1, 2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$y_j\in \{0,1,2\}$$\end{document} . In this case, the matrix of ULCM parameters is,

(2)

\begin{matrix} Θ_{j} = (\begin{matrix} θ_{j 00} & θ_{j 10} & θ_{j 20} & θ_{j 30} & θ_{j 40} & θ_{j 50} & θ_{j 60} & θ_{j 70} \\ θ_{j 01} & θ_{j 11} & θ_{j 21} & θ_{j 31} & θ_{j 41} & θ_{j 51} & θ_{j 61} & θ_{j 71} \\ θ_{j 02} & θ_{j 12} & θ_{j 22} & θ_{j 32} & θ_{j 42} & θ_{j 52} & θ_{j 62} & θ_{j 72} \end{matrix}) \end{matrix}

where we note that $θ_{j c 0} = 1 - \sum_{m = 1}^{M_{j}} θ_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jc0}=1-\sum _{m=1}^{M_j}\theta _{jcm}$$\end{document} for all $c \in {0, 1, \dots, 7}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c\in \{0,1,\dots ,7\}$$\end{document} . In this setting, the ULCM includes $2 \times 8 = 16$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2\times 8=16$$\end{document} parameters for each item. Moreover, in order to understand the meaning of the latent classes researchers would need to interpret differences in the $16 \cdot J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$16\cdot J$$\end{document} total class probabilities, which may be challenging for even a modest number of items J. The RLCM attempts to address this problem by reparameterizing both the latent classes and item parameters. In the case with $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document} , we define the arbitrary design vector $a$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}$$\end{document} as:

(3)

\begin{matrix} a^{⊤} = (1, α_{1}, α_{2}, α_{3}, α_{1} α_{2}, α_{1} α_{3}, α_{2} α_{3}, α_{1} α_{2} α_{3}) \end{matrix}

so that $a$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}$$\end{document} includes all main-effect and interaction terms among the attributes and we use $a_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}_c$$\end{document} to refer to the design vector for attribute profile $α^{⊤} v = c$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }^\top \varvec{v}=c$$\end{document} . The matrix of reparameterized parameters $β_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_j$$\end{document} for relating $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} to $Y_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Y_j$$\end{document} is

(4)

\begin{matrix} B_{j} = (\begin{matrix} β_{j 00} & β_{j 10} & β_{j 20} & β_{j 30} & β_{j 40} & β_{j 50} & β_{j 60} & β_{j 70} \\ β_{j 01} & β_{j 11} & β_{j 21} & β_{j 31} & β_{j 41} & β_{j 51} & β_{j 61} & β_{j 71} \\ β_{j 02} & β_{j 12} & β_{j 22} & β_{j 32} & β_{j 42} & β_{j 52} & β_{j 62} & β_{j 72} \end{matrix}) . \end{matrix}

Note we can view $a_{c}^{⊤} β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}_c^\top \varvec{\beta }_{jm}$$\end{document} as the latent response propensity for members of class c to pick option m vs. option 0. Therefore, the definition of $a$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}$$\end{document} implies that $β_{j 0 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j0m}$$\end{document} is an intercept term that corresponds with the latent propensity for the latent class with $α = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=\varvec{0}$$\end{document} to select option m vs. 0. Furthermore, the main-effects for $α_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _1$$\end{document} , $α_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _2$$\end{document} , and $α_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _3$$\end{document} for distinguishing response m from 0 are $β_{j 1 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j1m}$$\end{document} , $β_{j 2 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j2m}$$\end{document} , and $β_{j 3 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j3m}$$\end{document} , respectively. Furthermore, the two-way interaction terms are $α_{1} α_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _1\alpha _2$$\end{document} , $α_{1} α_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _1\alpha _3$$\end{document} , and $α_{2} α_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _2\alpha _3$$\end{document} with effects $β_{j 4 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j4m}$$\end{document} , $β_{j 5 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j5m}$$\end{document} , and $β_{j 6 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j6m}$$\end{document} , respectively, and the three-way interaction effect is $β_{j 7 m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j7m}$$\end{document} . In general positive coefficients suggest preference for option m to option 0 and the interactive effects provide researchers with insight regarding the extent to which preferences are determined by a complex interplay of the attributes.

The aforementioned example demonstrates the ability of the RLCM to provide researchers with a more clear interpretation of the latent structure (i.e., the relationship between attributes and observed responses). Still, each $β_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_j$$\end{document} includes many parameters to estimate and interpret. A further refinement we advance to support coherent inferences about the latent structure is to incorporate variable selection methods into the RLCM to infer which of the elements of $β_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_j$$\end{document} are active (i.e., different from zero) versus inactive (i.e., equal to or near zero). In fact, the pattern of active vs. inactive elements of $β_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_j$$\end{document} indicates the underlying structure and describes the process by which attributes relate to the observed response $Y_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Y_j$$\end{document} . Accordingly, we introduce a $M_{j} \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j\times 2^K$$\end{document} binary matrix $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} in order to indicate which elements of $β_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{j}$$\end{document} are active. Specifically, $δ_{jpm} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{jpm}=1$$\end{document} to denote that $β_{jpm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{jpm}$$\end{document} is active (i.e., nonzero) and $δ_{jpm} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{jpm}=0$$\end{document} if $β_{jpm} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{jpm}=0$$\end{document} (i.e., inactive). Note that we generally always include the intercept and fix $δ_{j 0 m} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{j0m}=1$$\end{document} for all $m \in {1, \dots, M_{j} - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m\in \{1,\dots ,M_j-1\}$$\end{document} .

We next revisit Example 1 to highlight the role of $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} in interpreting the latent structure.

Example 2

Reconsider the case with $M_{j} = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j=3$$\end{document} and $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document} . In this case, $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} is generally written as

(5)

\begin{matrix} Δ_{j} = (\begin{matrix} δ_{j 00} & δ_{j 10} & δ_{j 20} & δ_{j 30} & δ_{j 40} & δ_{j 50} & δ_{j 60} & δ_{j 70} \\ δ_{j 01} & δ_{j 11} & δ_{j 21} & δ_{j 31} & δ_{j 41} & δ_{j 51} & δ_{j 61} & δ_{j 71} \\ δ_{j 02} & δ_{j 12} & δ_{j 22} & δ_{j 32} & δ_{j 42} & δ_{j 52} & δ_{j 62} & δ_{j 72} \end{matrix}) . \end{matrix}

Note that $δ_{j p 0} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{jp0}=0$$\end{document} for all $p = 0, \dots, 2^{K} - 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p=0,\dots , 2^K-1$$\end{document} to identify the model parameters and that terms for the intercepts are generally specified as active so $δ_{j 01} = δ_{j 02} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{j01}=\delta _{j02}=1$$\end{document} .

Remark 1

If $Δ_{j} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j = \varvec{1}$$\end{document} for all $j = 1, \dots, J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1, \ldots , J$$\end{document} , which implies that all coefficients in $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} are active, the latent classes have distinct response probabilities, and the RLCM is equivalent to a ULCM in this case. For additional discussion see Example 1 of Chen et al. (Reference Chen, Culpepper and Liang2020) for an exposition involving the binary response RLCM.

Note that the pattern of 1’s and 0’s in $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} convey different types of relationships and structures. The structure of an item is referred to as simple structure for attribute k if the response probabilities only differ by levels of $α_{k}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _k$$\end{document} .

Definition 1

The structure of $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} , which is a slice of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} for item j, is referred to as simple structure for attribute k if it satisfies the following structure:

(6)

\begin{matrix} Δ_{j} = {(\begin{matrix} 0 & 0 & \dots & 0 & 0 & 0 & \dots & 0 \\ 1 & 0 & \dots & 0 & δ_{j k 1} & 0 & \dots & 0 \\ ⋮ & ⋮ & ⋮ & ⋮ & ⋮ & ⋮ \\ 1 & 0 & \dots & 0 & δ_{j k, M_{j} - 1} & 0 & \dots & 0 \end{matrix})}_{M_{j} \times P}, \end{matrix}

and $\sum_{m = 1}^{M_{j} - 1} δ_{jkm} \geq 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sum _{m=1}^{M_j-1} \delta _{jkm}\ge 1$$\end{document} where P generally equals $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} .

Remark 2

Note that for convenience of notation that our identifiability proof below supposes that item j is simple structure for attribute j.

Example 3

Consider $M_{1} = M_{2} = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_1=M_2=3$$\end{document} , $P = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$P=2^K$$\end{document} and $J = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J=2$$\end{document} and note that examples of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} matrices that satisfy simple structure according to Definition 1 are:

(7)

\begin{matrix} Δ_{1} = (\begin{matrix} 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 & 0 \end{matrix}), \end{matrix}

(8)

\begin{matrix} Δ_{2} = (\begin{matrix} 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 & 0 \end{matrix}) . \end{matrix}

Items 1 and 2 suppose the item is simple structure such that the probability of selecting the responses only relates to standing on $α_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _1$$\end{document} in $Δ_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_1$$\end{document} and $α_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _2$$\end{document} for $Δ_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_2$$\end{document} . $Δ_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_1$$\end{document} indicates that only the main-effect for $α_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _1$$\end{document} differentiates between response option 1 vs. 0 and 2 vs. 0. In contrast, for item 2, $Δ_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_2$$\end{document} represents the case where the main-effect for $α_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _2$$\end{document} is only active for differentiating between response option 2 vs. 0. The associated $B_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_1$$\end{document} and $B_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_2$$\end{document} matrices for the structure parameters $Δ_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_1$$\end{document} and $Δ_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_2$$\end{document} are:

(9)

\begin{matrix} B_{1} = (\begin{matrix} 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ β_{101} & β_{111} & 0 & 0 & 0 & 0 & 0 & 0 \\ β_{102} & β_{112} & 0 & 0 & 0 & 0 & 0 & 0 \end{matrix}), \end{matrix}

(10)

\begin{matrix} B_{2} = (\begin{matrix} 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ β_{201} & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ β_{202} & 0 & β_{222} & 0 & 0 & 0 & 0 & 0 \end{matrix}) . \end{matrix}

Let $Θ_{j} (B_{j})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_j(\varvec{B}_j)$$\end{document} denote the latent class response probabilities associated with the RLCM $B_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_j$$\end{document} matrix. The presence of structure in $B_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_j$$\end{document} and $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} implies that elements of $Θ_{j} (B_{j})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_j(\varvec{B}_j)$$\end{document} are restricted to be equal.

Example 4

The rows of $Δ_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_1$$\end{document} in Eq. 7 imply that certain latent classes have a common probability of selecting response 1 vs 0 and 2 vs. 0. That is, latent classes that do not possess the first attribute such that $α = (0, α_{2}, α_{3})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(0,\alpha _2,\alpha _3)$$\end{document} have common response probabilities for selecting options 0, 1, and 2 of $θ_{100}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{100}$$\end{document} , $θ_{101}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{101}$$\end{document} , and $θ_{102}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{102}$$\end{document} , respectively, whereas classes with the first attribute with $α = (1, α_{2}, α_{3})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(1,\alpha _2,\alpha _3)$$\end{document} have common response probabilities of $θ_{140}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{140}$$\end{document} , $θ_{141}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{141}$$\end{document} , and $θ_{142}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{142}$$\end{document} . The $Θ_{1} (B_{1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_1(\varvec{B}_1)$$\end{document} in this case is

(11)

\begin{matrix} Θ_{1} (B_{1}) = (\begin{matrix} θ_{100} & θ_{100} & θ_{100} & θ_{100} & θ_{140} & θ_{140} & θ_{140} & θ_{140} \\ θ_{101} & θ_{101} & θ_{101} & θ_{101} & θ_{141} & θ_{141} & θ_{141} & θ_{141} \\ θ_{102} & θ_{102} & θ_{102} & θ_{102} & θ_{142} & θ_{142} & θ_{142} & θ_{142} \end{matrix}), \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Theta }_1(\varvec{B}_1) = \begin{bmatrix} \theta _{100}&{}\quad \theta _{100}&{}\quad \theta _{100}&{}\quad \theta _{100}&{}\quad \theta _{140}&{}\quad \theta _{140}&{}\quad \theta _{140}&{}\quad \theta _{140}\\ \theta _{101}&{}\quad \theta _{101}&{}\quad \theta _{101}&{}\quad \theta _{101}&{}\quad \theta _{141}&{}\quad \theta _{141}&{}\quad \theta _{141}&{}\quad \theta _{141}\\ \theta _{102}&{}\quad \theta _{102}&{}\quad \theta _{102}&{}\quad \theta _{102}&{}\quad \theta _{142}&{}\quad \theta _{142}&{}\quad \theta _{142}&{}\quad \theta _{142}\\ \end{bmatrix}, \end{aligned}$$\end{document}

where the columns of $Θ_{1} (B_{1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_1(\varvec{B}_1)$$\end{document} are organized according to the binary-integer bijection and

(12)

\begin{matrix} θ_{10} = {(θ_{100}, θ_{101}, θ_{102})}^{⊤} = \frac{1}{\sum_{m = 0}^{2} exp (β_{10 m})} (1, exp (β_{101}), exp (β_{102})), \end{matrix}

(13)

\begin{matrix} θ_{14} = {(θ_{140}, θ_{141}, θ_{142})}^{⊤} = \frac{1}{\sum_{m = 0}^{2} exp (β_{10 m} + β_{11 m})} (1, exp (β_{101} + β_{111}), exp (β_{102} + β_{112})) . \end{matrix}

In contrast, the rows of $Δ_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_2$$\end{document} in Eq. 8 imply a different collection of elements are constrained equal in $Θ_{2} (B_{2})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_2(\varvec{B}_2)$$\end{document} . Latent classes that do not possess the second attribute such that $α = (α_{1}, 0, α_{3})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(\alpha _1,0,\alpha _3)$$\end{document} have common response probabilities for selecting options 0, 1, and 2 of $θ_{200}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{200}$$\end{document} , $θ_{201}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{201}$$\end{document} , and $θ_{202}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{202}$$\end{document} , respectively, whereas classes with the second attribute with $α = (α_{1}, 1, α_{3})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(\alpha _1,1,\alpha _3)$$\end{document} have common response probabilities of $θ_{220}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{220}$$\end{document} , $θ_{221}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{221}$$\end{document} , and $θ_{222}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{222}$$\end{document} . The $Θ_{2} (B_{2})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_2(\varvec{B}_2)$$\end{document} in this case is

(14)

\begin{matrix} Θ_{2} (B_{2}) = (\begin{matrix} θ_{200} & θ_{200} & θ_{220} & θ_{220} & θ_{200} & θ_{200} & θ_{220} & θ_{220} \\ θ_{201} & θ_{201} & θ_{221} & θ_{221} & θ_{201} & θ_{201} & θ_{221} & θ_{221} \\ θ_{202} & θ_{202} & θ_{222} & θ_{222} & θ_{202} & θ_{202} & θ_{222} & θ_{222} \end{matrix}), \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Theta }_2(\varvec{B}_2) = \begin{bmatrix} \theta _{200}&{}\quad \theta _{200}&{}\quad \theta _{220}&{}\quad \theta _{220}&{}\quad \theta _{200}&{}\quad \theta _{200}&{}\quad \theta _{220}&{}\quad \theta _{220}\\ \theta _{201}&{}\quad \theta _{201}&{}\quad \theta _{221}&{}\quad \theta _{221}&{}\quad \theta _{201}&{}\quad \theta _{201}&{}\quad \theta _{221}&{}\quad \theta _{221}\\ \theta _{202}&{}\quad \theta _{202}&{}\quad \theta _{222}&{}\quad \theta _{222}&{}\quad \theta _{202}&{}\quad \theta _{202}&{}\quad \theta _{222}&{}\quad \theta _{222}\\ \end{bmatrix}, \end{aligned}$$\end{document}

where the columns of $Θ_{2} (B_{2})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_2(\varvec{B}_2)$$\end{document} are organized according to the binary-integer bijection and

(15)

\begin{matrix} θ_{20} = {(θ_{200}, θ_{201}, θ_{202})}^{⊤} = \frac{1}{\sum_{m = 0}^{2} exp (β_{20 m})} (1, exp (β_{201}), exp (β_{202})), \end{matrix}

(16)

\begin{matrix} θ_{22} = {(θ_{220}, θ_{221}, θ_{222})}^{⊤} = \frac{(1, exp (β_{201}), exp (β_{202} + β_{222}))}{1 + exp (β_{201}) + exp (β_{202} + β_{222})} . \end{matrix}

Remark 3

Note that $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} can also denote different structures where multiple attributes relate to response variables. For instance, $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} might specify the inclusion of interaction terms so that response probabilities are shaped by a more complex relationship of the attributes. Furthermore, we can also draw a connection between the ULCM and RLCM where $Δ_{j} = {(0, 1_{M_{j} - 1}^{⊤})}^{⊤} 1_{P}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j=(0,\varvec{1}_{M_j-1}^\top )^\top \varvec{1}_P^\top $$\end{document} corresponds with the ULCM setting with distinct elements in $Θ_{j} (B_{j})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }_j(\varvec{B}_j)$$\end{document} .

3. Identifiability Issue

3.1. Model Identifiability

As introduced in the previous section, the probability distribution of latent classes is given by $π = {(π_{c})}^{⊤} \in {[0, 1]}^{2^{K}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }=(\pi _c)^\top \in [0,1]^{2^K}$$\end{document} with $\sum π_{c} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sum \pi _c =1$$\end{document} . Coefficients array $B = (B_{1}, \dots, B_{J})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}=(\varvec{B}_1, \ldots ,\varvec{B}_J)$$\end{document} is a three-dimensional array, where $B_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_j$$\end{document} is the j-th slice of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} with size $M_{j} \times P$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j\times P$$\end{document} . Then, we denote the parameter space of $(π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\varvec{\pi },\varvec{B})$$\end{document} by

(17)

\begin{matrix} Ω (π, B) = {(π, B) : π \in Ω (π), B \in Ω (B)}, \end{matrix}

where $Ω (π) = {π \in {[0, 1]}^{2^{K}} : \sum_{c} π_{c} = 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{\pi })=\{\varvec{\pi }\in [0,1]^{2^K}:\sum _c \pi _c =1\}$$\end{document} , and $Ω (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{B})$$\end{document} represents the parameter space of the coefficients array $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} , which could be the whole real space $R^{J \times P \times \sum_{j} M_{j}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {R}}^{J\times P\times \sum _j M_j}$$\end{document} , or a subset of $R^{J \times P \times \sum_{j} M_{j}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathbb R^{J\times P\times \sum _j M_j}$$\end{document} if constrained by the $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} .

Definition 2

(Strict Identifiability) The parameters $(π, B) \in Ω (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\varvec{\pi }, \varvec{B}) \in \Omega (\varvec{\pi }, \varvec{B})$$\end{document} are identifiable if

\begin{matrix} P (Y = y ∣ π, B) = P (Y = y ∣ \bar{π}, \bar{B}) ⟺ (π, B) \sim (\bar{π}, \bar{B}), \end{matrix}

where $(\bar{π}, \bar{B})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\bar{\varvec{\pi }}, \bar{\varvec{B}})$$\end{document} is another value from the parameter space $Ω (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{\pi }, \varvec{B})$$\end{document} and “ $\sim$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sim $$\end{document} ” means two parameter values are equivalent up to label switching of attributes.

3.2. Generic Identifiability

Generic identifiability, which is a weaker notion of identifiability than Definition 2, was first introduced in Allman et al. (Reference Allman, Matias and Rhodes2009). Generic identifiability allows the existence of some exceptional values of parameters for which strict identifiability does not hold, as long as all non-identifiable parameters form a Lebesgue measure zero set within the parameter space. Given that non-identifiable parameters exist in a set of measure zero, one is unlikely to face identifiability problems in performing inference. Thus, generic identifiability is generally sufficient for data analysis purposes.

However, the generic identifiability condition shown in Allman et al. (Reference Allman, Matias and Rhodes2009) cannot be applied in this paper. Under the setting of Allman et al. (Reference Allman, Matias and Rhodes2009), the parameter space $Ω (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{B})$$\end{document} is the whole real space $R^{J \times P \times \sum_{j} M_{j}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathbb R^{J\times P\times \sum _j M_j}$$\end{document} , whereas the parameter space $Ω (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{B})$$\end{document} in our RLCM is restricted by the structure of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} . The dimension of $Ω (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{B})$$\end{document} might vary with different $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} arrays, i.e., the parameter space of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} restricted by $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} might be a measure zero subspace of another parameter space of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} restricted by $\tilde{Δ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tilde{\varvec{\Delta }}$$\end{document} . So, it is important to discuss the generic identifiability issue within a parameter space with a fixed $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} .

Therefore, in order to discuss generic identifiability for our RLCM, we need to define the parameter space $Ω (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{B})$$\end{document} by taking into account the sparsity structure due to the $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} array. Similar to Definition 17, we denote the model parameter space with a given $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} by

(18)

\begin{matrix} Ω_{Δ} (π, B) = {(π, B) : π \in Ω (π), B \in Ω_{Δ} (B)} . \end{matrix}

Coefficients in $Ω_{Δ} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{B})$$\end{document} are active when corresponding elements in $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} are equal to 1, so the parameter space $Ω_{Δ} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{B})$$\end{document} would be $R^{∣ Δ ∣}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathbb R^{\mid \varvec{\Delta }\mid }$$\end{document} , where $∣ Δ ∣$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mid \varvec{\Delta }\mid $$\end{document} is the total sum of entries of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} . For generic identifiability, it suffices to consider the parameter space $Ω_{Δ} (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{\pi }, \varvec{B})$$\end{document} with a given sparsity structure $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} .

Let $S_{Δ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S_{\varvec{\Delta }}$$\end{document} denote the set of non-identifiable parameters from $Ω (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{\pi },\varvec{B})$$\end{document} :

(19)

\begin{matrix} \begin{matrix} S_{Δ} = {(π, B) : & P (Y = y ∣ π, B) = P (Y = y ∣ \bar{π}, \bar{B}), \\ (π, B) ≁ (\bar{π}, & \bar{B}), (π, B) \in Ω_{Δ} (π, B), (\bar{π}, \bar{B}) \in Ω_{\bar{Δ}} (π, B)} . \end{matrix} \end{matrix}

Remark 4

The non-identifiable parameters $(π, B) \in S_{Δ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\varvec{\pi }, \varvec{B}) \in S_{\varvec{\Delta }}$$\end{document} could be due to some other parameters $(\bar{π}, \bar{B})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\bar{\varvec{\pi }}, \bar{\varvec{B}})$$\end{document} with a different sparsity structure $\bar{Δ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\bar{\varvec{\Delta }}$$\end{document} .

If the non-identifiable parameter set $S_{Δ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S_{\varvec{\Delta }}$$\end{document} is of measure zero within parameter space $Ω_{Δ} (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{\pi },\varvec{B})$$\end{document} , then we say $Ω_{Δ} (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{\pi },\varvec{B})$$\end{document} is a generically identifiable parameter space.

Definition 3

(Generic Identifiability) The parameter space $Ω_{Δ} (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{\pi },\varvec{B})$$\end{document} is generically identifiable, if the Lebesgue measure of $S_{Δ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S_{\varvec{\Delta }}$$\end{document} with respect to parameter space $Ω_{Δ} (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{\pi },\varvec{B})$$\end{document} is zero.

3.3. Identifiability Conditions

In this section, we propose strict and generic identifiability conditions for our RLCM. We start with introducing the form of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} as follows.

The sparse 3-dimensional array $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} takes the form

\begin{matrix} Δ = (\begin{matrix} Δ^{1} \\ Δ^{2} \\ Δ^{'} \end{matrix}) \end{matrix}

after a permutation of items, where $Δ^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^1$$\end{document} and $Δ^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^2$$\end{document} contain K slices of $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} and $Δ^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^\prime $$\end{document} contains the rest of $J - 2 K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J-2K$$\end{document} slices. We use $Δ_{j}^{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j^i$$\end{document} to denote the j-th slice of $Δ^{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^i$$\end{document} for item j.

Theorem 1

(Strict Identifiability) The parameter space $Ω (π, B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{\pi },\varvec{B})$$\end{document} is strictly identifiable if the following two conditions are satisfied:

For $j = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,K$$\end{document} , $Δ_{j}^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _j^1$$\end{document} and $Δ_{j}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _{j}^2$$\end{document} satisfy simple structure shown in Definition 1 and Remark 2;
For any two classes of subjects, there exists at least one item in $Δ^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^\prime $$\end{document} such that they have different positive response probabilities for some response option.

Remark 5

The $Δ_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_j$$\end{document} shown in Example 3 satisfies the structure in A1.

Theorem 2

For $j = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,K$$\end{document} , $Δ_{j}^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _j^1$$\end{document} and $Δ_{j}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _{j}^2$$\end{document} satisfy the following structure:
(20) $\begin{matrix} Δ_{j} = {(\begin{matrix} 0 & 0 & \dots & 0 & 0 & 0 & \dots & 0 \\ * & * & \dots & * & δ_{j j 1} & * & \dots & * \\ ⋮ & ⋮ & ⋮ & ⋮ & ⋮ & ⋮ \\ * & * & \dots & * & δ_{j j, M_{j} - 1} & * & \dots & * \end{matrix})}_{M_{j} \times P}, \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Delta }_j= \begin{bmatrix} 0&{}0&{}\cdots &{}0&{}0&{}0&{}\cdots &{}0\\ *&{}*&{}\cdots &{}*&{}\delta _{jj1}&{}*&{}\cdots &{}*\\ \vdots &{}\vdots &{}&{}\vdots &{}\vdots &{}\vdots &{}&{}\vdots \\ *&{}*&{}\cdots &{}*&{}\delta _{jj,M_j-1}&{}*&{}\cdots &{}*\\ \end{bmatrix}_{M_j \times P}, \end{aligned}$$\end{document}
and $\sum_{m = 1}^{M_{j} - 1} δ_{jjm} \geq 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sum _{m=1}^{M_j-1} \delta _{jjm}\ge 1$$\end{document} , where $*$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$*$$\end{document} can be either 0 or 1, P generally equals $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} .
$Δ^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^{\prime }$$\end{document} satisfies the condition that for every $k = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k=1,\ldots ,K$$\end{document} there exists a $j > 2 K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j > 2K$$\end{document} , such that $\sum_{m = 1}^{M_{j} - 1} δ_{jkm} \geq 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sum _{m=1}^{M_j-1} \delta _{jkm}\ge 1$$\end{document} .

Remark 6

Condition (B2) requires that there is a least one item in the last $J - 2 K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J-2K$$\end{document} items where attribute k loads onto the main-effect for at least one response option.

4. Bayesian Formulation for the Nominal RLCM

Following the same setting in previous sections, consider a RLCM with N subjects, J items with $M_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j$$\end{document} ( $j = 1, \dots, J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,J$$\end{document} ) unordered response options for each item j, and K skills. We use subscript $i = 1, \dots, N$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i=1,\ldots ,N$$\end{document} to index subjects, $j = 1, \dots, J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,J$$\end{document} to index items, $m = 0, \dots, M_{j} - 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m=0,\ldots ,M_j-1$$\end{document} to index options of each item, and $c = 0, \dots, 2^{K} - 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c=0,\ldots ,2^K-1$$\end{document} to index latent classes. Let $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{i}$$\end{document} denote the attribute profile of subject i, and $Y_{ij}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Y_{ij}$$\end{document} denote the response of subject i to item j. The likelihood of observing a sample of N responses to J items is

(21)

\begin{matrix} p (Y = y ∣ B, π) = \prod_{i = 1}^{N} \sum_{α_{c} \in {0, 1}^{K}} π_{c} \prod_{j = 1}^{J} \prod_{m = 0}^{M_{j} - 1} {(\frac{exp (a_{i}^{⊤}, β_{jm})}{\sum_{m^{'} = 0}^{M_{j} - 1} exp (a_{i}^{⊤}, β_{j m^{'}})})}^{1 (y_{ij} = m)} . \end{matrix}

The posterior distribution of all parameters for the nominal RLCM is given by

(22)

\begin{matrix} p (α, B, Δ, γ, σ_{β}^{2}, π | y) \propto p (y | α, B) p (α | π) p (π) p (B | Δ, σ_{β}^{2}) p (σ_{β}^{2}) p (Δ | γ) p (γ) . \end{matrix}

Then, we formulate the RLCM Bayesian model as follows.

We outline our Bayesian model and priors. Specifically, we use a categorical likelihood conditioned upon attributes and item parameters,

(23)

\begin{matrix} Y_{ij} | α^{⊤} v = c, B_{j} \sim categorical (θ_{jc}, (B_{j})) . \end{matrix}

We also use a categorical prior for attributes conditioned upon the latent class probabilities,

(24)

\begin{matrix} α_{i} | π \sim categorical (π) \end{matrix}

and a conjugate Dirichlet prior for the latent class probabilities, $π \sim Dirichlet (d_{0})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }\sim \text {Dirichlet}(\varvec{d}_0)$$\end{document} where $d_{0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{d}_0$$\end{document} is a fixed constant vector.

We use a stochastic search variable selection priors for the (j, p, m) elements of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} and $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} :

(25)

\begin{matrix} β_{jpm} & ∣ δ_{jpm}, σ_{β}^{2} \sim (\begin{matrix} N (0, σ_{β}^{2}) & δ_{jpm} = 1 \\ N (0, σ_{β}^{2} / D) & δ_{jpm} = 0 \end{matrix}), \end{matrix}

(26)

\begin{matrix} δ_{jpm} & ∣ γ \sim B e r n o u l l i (γ), \end{matrix}

where $B = {(B_{1}, \dots, B_{J})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}=(\varvec{B}_1,\dots ,\varvec{B}_J)^\top $$\end{document} satisfies the generic identifiable condition shown in Theorem 2, and the intercept is always set active with $δ_{j 0 m} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{j0m}=1$$\end{document} . Furthermore, D is a large fixed constant (e.g., we consider $D = 100$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$D=100$$\end{document} , 1000) that is used reduce the variance for the spike distribution for the case with $δ_{jpm} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{jpm}=0$$\end{document} . The priors for the hyper-parameters for the coefficients and activeness parameters are:

(27)

\begin{matrix} σ_{β}^{2} & \sim I G a m m a (α_{σ}, β_{σ}), \end{matrix}

(28)

\begin{matrix} γ & \sim B e t a (a, b) . \end{matrix}

Here $(α_{σ}, β_{σ}, D, a, b, d_{0})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\alpha _{\sigma },\beta _{\sigma },D,a,b,\varvec{d}_0)$$\end{document} are hyper-parameters.

Model parameters of the nominal RLCM are inferred through applying the Polya-gamma data augmentation approach for multinomial logistic regression (Holmes & Held, Reference Holmes and Held2006; Polson et al., Reference Polson, Scott and Windle2013) along with the stochastic search variable selection algorithm (George & McCulloch, Reference George and McCulloch1993) to infer the latent structure. Then, the Gibbs sampling algorithm is implemented from the posterior distribution of model parameters, which is given in Appendix 7. Full sampling algorithm is represented in Algorithm 1. In order to address issues with respect to poor starting values we use a combination of k-means clustering and factor analysis to specify starting values (see the description in Appendix 7).

5. Monte Carlo Simulation Study

5.1. Settings

In this section, we report results from a Monte Carlo experiment to evaluate the performance of Algorithm 1. We conducted the simulation study under different number of attributes (i.e., $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document} and 3), correlations among the attributes (i.e., $ρ = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho =0$$\end{document} and 0.25), and sample size (i.e., $N = 1000$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N=1000$$\end{document} , 2000, 5000 and 10000).

For the $ρ = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho =0$$\end{document} case, the attribute profile $α = {(α_{1}, \dots, α_{K})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(\alpha _{1},\ldots ,\alpha _{K})^{\top }$$\end{document} is generated uniformly from all possible $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} cases, so the latent class membership probabilities are $π = {(1 / 2^{K}, \dots, 1 / 2^{K})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }= (1/2^K,\ldots ,1/2^K)^\top $$\end{document} . For the $ρ > 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho >0$$\end{document} case, the dependence among attribute profiles is introduced using the method of Chiu et al. (Reference Chiu, Douglas and Li2009). Suppose $Z = {(Z_{1}, \dots, Z_{K})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Z}=(Z_1,\ldots ,Z_K)^{\top }$$\end{document} follows a multivariate normal distribution $N (0, Σ)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N(\varvec{0}, \varvec{\Sigma })$$\end{document} with unit variance and correlation $ρ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho $$\end{document} , where $Σ = (1 - ρ) I_{K} + ρ 1_{K} 1_{K}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Sigma }=(1-\rho )\varvec{I}_K + \rho \varvec{1}_{K}\varvec{1}_{K}^\top $$\end{document} and $1_{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{1}_{K}$$\end{document} is a column vector of 1 with length K. Then, the attribute profile $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} is given by $α_{k} = I (Z_{k} \geq Φ^{- 1} (\frac{k}{K + 1}))$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _{k}={\mathcal {I}}(Z_k \ge \Phi ^{-1}(\frac{k}{K+1}))$$\end{document} , $k = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k=1,\ldots ,K$$\end{document} , where $Φ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Phi $$\end{document} is the cumulative distribution function of the standard normal distribution. In this case, the data generating values for $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} are computed from integrals of the multivariate normal distribution (Chen et al., Reference Chen, Liu, Xu and Ying2015; Culpepper & Balamuta, Reference Culpepper and Balamuta2021).

We assume that there are $J = 18$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J=18$$\end{document} items, and $M_{j} = 4$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j=4$$\end{document} unordered options for each item j. For reparameterized latent class variable $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} shown in Eq. 3, we only include two-way interaction terms among the attributes. Our model does not explicitly contain $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices, therefore, we recover the $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices, implied by $Δ_{m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }_m$$\end{document} for each option $m = 1, 2, 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m=1,2,3$$\end{document} , using the method shown in Chen et al. (Reference Chen, Culpepper and Liang2020). Then, the true $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} and true $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices for each option are shown as follows (columns in $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} follow the same order as the design vector shown in Eq. 3):

$Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} cube with $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document}
(29) $\begin{matrix} Δ_{m = 1} = (\begin{matrix} 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \end{matrix}), Δ_{m = 2} = (\begin{matrix} 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \end{matrix}), Δ_{m = 3} = (\begin{matrix} 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Delta }_{m=1}= \left( \begin{array}{llll} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \end{array}\right) , \quad \varvec{\Delta }_{m=2}=\left( \begin{array}{llll} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \end{array}\right) , \quad \varvec{\Delta }_{m=3}=\left( \begin{array}{llll} 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \end{array}\right) \end{aligned}$$\end{document}
$Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} cube with $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document}
(30) $\begin{matrix} Δ_{m = 1} = (\begin{matrix} 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \end{matrix}), Δ_{m = 2} = (\begin{matrix} 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \end{matrix}), Δ_{m = 3} = (\begin{matrix} 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Delta }_{m=1}= \left( \begin{array}{llllllll} 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \end{array}\right) , \varvec{\Delta }_{m=2}= \left( \begin{array}{llllllll} 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \end{array}\right) , \varvec{\Delta }_{m=3}= \left( \begin{array}{llllllll} 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \end{array}\right) \end{aligned}$$\end{document}
$Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices with $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document}
(31) $\begin{matrix} Q_{m = 1} = (\begin{matrix} 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \end{matrix}), Q_{m = 2} = (\begin{matrix} 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 1 & 0 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 0 & 1 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \end{matrix}), Q_{m = 3} = (\begin{matrix} 1 & 0 \\ 0 & 1 \\ 0 & 1 \\ 1 & 0 \\ 1 & 0 \\ 1 & 0 \\ 1 & 0 \\ 0 & 1 \\ 0 & 1 \\ 0 & 1 \\ 1 & 0 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 0 & 1 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} {\varvec{Q}}_{m=1}= \left( \begin{array}{ll} 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \end{array}\right) , \quad {\varvec{Q}}_{m=2}=\left( \begin{array}{ll} 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 0 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \end{array}\right) , \quad {\varvec{Q}}_{m=3}=\left( \begin{array}{ll} 1 &{} 0 \\ 0 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 1 &{} 0 \\ 1 &{} 0 \\ 0 &{} 1 \\ 0 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 0 &{} 1 \end{array}\right) \end{aligned}$$\end{document}
$Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices with $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document}
(32) $\begin{matrix} Q_{m = 1} = (\begin{matrix} 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \end{matrix}), Q_{m = 2} = (\begin{matrix} 0 & 1 & 0 \\ 0 & 1 & 0 \\ 0 & 1 & 0 \\ 0 & 1 & 0 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \\ 1 & 0 & 0 \\ 1 & 0 & 0 \\ 1 & 0 & 0 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \end{matrix}), Q_{m = 3} = (\begin{matrix} 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} {\varvec{Q}}_{m=1}= \left( \begin{array}{lll} 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \end{array}\right) , \quad {\varvec{Q}}_{m=2}=\left( \begin{array}{lll} 0 &{} 1 &{} 0 \\ 0 &{} 1 &{} 0 \\ 0 &{} 1 &{} 0 \\ 0 &{} 1 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \end{array}\right) , \quad {\varvec{Q}}_{m=3}=\left( \begin{array}{lll} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \end{array}\right) \end{aligned}$$\end{document}

Given $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} , we generate coefficients in $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} according to their prior distribution shown in Eq. 25 using $σ_{β}^{2} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sigma _\beta ^2 = 1$$\end{document} . For hyper-parameters presented in the previous section, we have $α_{σ} = β_{σ} = a = b = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha _{\sigma }=\beta _{\sigma }=a=b=1$$\end{document} , $d_{0} = 1_{2^{K}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{d}_0 = \varvec{1}_{2^K}$$\end{document} , and $D = 100$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$D= 100$$\end{document} . We use a Markov chain of length 20,000 with a 10,000 burn-in period for $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K = 2$$\end{document} , and a chain length of 30,000 with a 20,000 burn-in period for $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K = 3$$\end{document} .

5.2. Results

We repeated the simulation study 100 times for each setting. For model performance, we use several metrics to evaluate parameter recovery. Specifically, we report the average element-wise accuracy rate (EAR) for $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} by comparing the estimated $\hat{Q}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{Q}}$$\end{document} and the true $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrix, where $\hat{Q}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{Q}}$$\end{document} is recovered by aggregating $\hat{B}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{B}}$$\end{document} samples after burn-in period (Chen et al., Reference Chen, Culpepper and Liang2020). Note that we transform $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} to $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} for every sampled value using Eq. 1 and compute the point estimate $\hat{Θ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{\Theta }}$$\end{document} as the mean of all sampled $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} arrays after the burn-in period. We compute the mean absolute deviation (MAD) to assess the accuracy of the estimated latent class response probabilities $\hat{Θ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{\Theta }}$$\end{document} , and report the proportion of attribute profiles that are correctly estimated.

It is important to mention how we address the label-switching problem for the RLCM and ULCM. Similar to latent class models, the exploratory RLCM is identified up to label-switching. However, the RLCM has fewer permutations than the ULCM. For instance, the ULCM as $(2^{K})!$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(2^K)!$$\end{document} possible arrangements whereas the RLCM has $K! \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K!\times 2^K$$\end{document} arrangements (i.e., there are K! ways to permute the order of attributes and $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} ways of permuting the attribute levels). Note that for each replication we draw values from the posterior and then compare posterior means of our parameters (e.g., the $θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta $$\end{document} ’s or $β$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta $$\end{document} ’s) with all $K! \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K!\times 2^K$$\end{document} arrangements with the data generating model parameters in order to evaluate parameter recovery. We select the permutations for the ULCM and RLCM that minimizes the difference between the estimates and data generating value. It is important to note that we do not find evidence of label-switching within chain.

Simulation results in Table 1 show a good recovery for model parameters. It suggests that for fixed K, as the sample size gets larger, the MAD of $\hat{Θ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{\Theta }}$$\end{document} and $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} become smaller and the EARs of $\hat{Q}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{Q}}$$\end{document} matrices become larger. The EARs of $\hat{Q}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{Q}}$$\end{document} matrices are higher for smaller K, which is expected given that the number of unknown model parameters that must be estimated increases with larger K. The simulation results also provide evidence that a positive correlation among attributes, represented by $ρ > 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho > 0$$\end{document} , results in slightly larger MADs for $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} in some instances, and this impact is more systematic for $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document} . Although $ρ = 0.25$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rho =0.25$$\end{document} slightly decreases recovery of $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} , $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} , and $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} , the results in Table 1 show attribute classification accuracy improves by a few percentage points. Overall, the classification accuracy is at acceptable levels and generally exceeds 70% for most scenarios.

We also conduct Monte Carlo experiment for denser $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} and $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} compared with those shown in Eqs. 29 − 32, true $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} , $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices and simulation results are given in Appendix 7. Table 6 shows similar model parameter recovery compared with the results shown in Table 1.

5.3. Unstructured Latent Class Models (ULCMs)

We want to compare our model performance with ULCMs, which assume that there’s no latent structure between latent attribute classes and observed response variables. Following the same setting as we represented for the nominal RLCM, the likelihood of observing a sample of N independent responses to J items is

(33)

\begin{matrix} p (Y = y | α, Θ) = \prod_{j = 1}^{J} \prod_{c = 0}^{2^{K} - 1} \prod_{m = 0}^{M_{j} - 1} θ_{jc}^{n_{jcm}}, \end{matrix}

where $n_{jcm} = \sum_{i = 1}^{n} = I (y_{ij} = m) I (α_{i}^{⊤} v = c)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n_{jcm}=\sum _{i=1}^n={\mathcal {I}}(y_{ij}=m)\mathcal I(\varvec{\alpha }_{i}^\top \varvec{v}=c)$$\end{document} . Then, the posterior distribution of all parameters for the nominal ULCM is given by

(34)

\begin{matrix} p (α, Θ, π | y) \propto p (y | α, Θ) p (Θ) p (α | π) p (π) . \end{matrix}

Below is the Bayesian framework for our nominal ULCM. Given attribute profile $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} and class-response probability matrix $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} , response data follow a categorical distribution

(35)

\begin{matrix} Y_{ij} | α_{i}^{⊤} v = c, θ_{jc} \sim Categorical (θ_{jc}) . \end{matrix}

We use a Dirichlet prior for the class-response probability vectors

(36)

\begin{matrix} θ_{jc} \sim Dirichlet (d_{M_{j}}), \end{matrix}

and a categorical prior for attributes conditioned upon the latent class probabilities,

(37)

\begin{matrix} α_{i} | π \sim Categorical (π) \end{matrix}

with a conjugate Dirichlet prior for the latent class probabilities $π \sim Dirichlet (d_{0})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }\sim \text {Dirichlet}(\varvec{d}_0)$$\end{document} , where $d_{M}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{d}_M$$\end{document} and $d_{0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{d}_0$$\end{document} are constant vectors.

We applied Gibbs sampling algorithm to estimate model parameters via their posterior distributions.

$θ_{jc} ∣ y_{1 : n}, α_{1 : n} \sim Dirichlet (n_{jc} + d_{M_{j}})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\theta }_{jc}\mid \varvec{y}_{1:n},\varvec{\alpha }_{1:n}\sim \text {Dirichlet}(\varvec{n}_{jc}+\varvec{d}_{M_j})$$\end{document}
(38) $\begin{matrix} p (θ_{jc} ∣ y_{1 : n}, α_{1 : n}) & \propto p (y_{Ij} ∣ α_{I}, θ_{jc}) p (θ_{jc}) \\ \propto \prod_{m = 0}^{M_{j}} θ_{jcm}^{n_{jcm}} \cdot \prod_{m = 0}^{M_{j}} θ_{jcm}^{1 - 1}, \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\varvec{\theta }_{jc}\mid \varvec{y}_{1:n},\varvec{\alpha }_{1:n})&\propto p(\varvec{y}_{Ij}\mid \varvec{\alpha }_{I},\varvec{\theta }_{jc})p(\varvec{\theta }_{jc})\nonumber \\&\propto \prod _{m=0}^{M_j}\theta _{jcm}^{n_{jcm}}\cdot \prod _{m=0}^{M_j}\theta _{jcm}^{1-1}, \end{aligned}$$\end{document}
where $n_{jc} = {(n_{j c 0}, \dots, n_{j c, M_{j} - 1})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{n}_{jc} = (n_{jc0},\ldots ,n_{jc,M_j-1})^\top $$\end{document} and $I = (i : α_{i}^{⊤} v = c)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$I = \left\{ i:\varvec{\alpha }_{i}^\top \varvec{v}=c \right\} $$\end{document} .
$π | α \sim D i r i c h l e t (n + d_{0})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }|\varvec{\alpha }\sim Dirichlet(\varvec{n}+\varvec{d}_0)$$\end{document}
(39) $\begin{matrix} p (π ∣ α_{1 : n}) \propto p (α_{1 : n} ∣ π) p (π) \sim Dirichlet (n + d_{0}), \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\varvec{\pi }\mid \varvec{\alpha }_{1:n})\propto p(\varvec{\alpha }_{1:n}\mid \varvec{\pi })p(\varvec{\pi }) \sim \text {Dirichlet}(\varvec{n}+\varvec{d}_0), \end{aligned}$$\end{document}
where $π \sim Dirichlet (d_{0})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }\sim \text {Dirichlet}(\varvec{d}_0) $$\end{document} and $n = {(n_{0}, \dots, n_{2^{K} - 1})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{n}=(n_0,\cdots ,n_{2^K-1})^\top $$\end{document} represents the frequencies of each attribute pattern $α_{i}^{⊤} v = c$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{i}^\top \varvec{v}=c$$\end{document} , $c = 0, \dots, 2^{K} - 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c=0,\ldots ,2^K-1$$\end{document} .
$α_{i} ∣ α_{(i)}, y_{1 : n}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i\mid \varvec{\alpha }_{(i)},\varvec{y}_{1:n}$$\end{document} We update $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} while integrating $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} out
(40) $\begin{matrix} p (α_{1}, \dots, α_{N}) & = \int p (α_{1}, \dots, α_{N} ∣ π) p (π) d π \\ = \frac{1}{B (d_{0})} \int (\prod_{c = 0}^{2^{K} - 1}, π_{c}^{n_{c} + d_{0, c} - 1}) d π \\ = \frac{B (n + d_{0})}{B (d_{0})} . \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\varvec{\alpha }_1,\ldots ,\varvec{\alpha }_N)&= \int p(\varvec{\alpha }_1,\ldots ,\varvec{\alpha }_N\mid \varvec{\pi })p(\varvec{\pi })d\varvec{\pi }\nonumber \\&=\dfrac{1}{B(\varvec{d}_0)} \int \left( \prod _{c=0}^{2^K-1} \pi _{c}^{n_{c}+d_{0,c}-1}\right) \textrm{d} \varvec{\pi }\nonumber \\&=\dfrac{B(\varvec{n} + \varvec{d}_0)}{B(\varvec{d}_0)}. \end{aligned}$$\end{document}
Then, the full conditional distribution for $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} is
(41) $\begin{matrix} p (α_{i}^{⊤} v = c ∣ α_{(i)}) & = \frac{p (α_{1}, \dots, α_{N})}{p (α_{1}, \dots, α_{i - 1}, α_{i + 1}, \dots, α_{N})} \\ = \frac{n_{c (i)} + 1}{n - 1 + 2^{K}}, \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\varvec{\alpha }_i^{\top } \varvec{v}=c\mid \varvec{\alpha }_{(i)})&= \dfrac{p(\varvec{\alpha }_1,\ldots ,\varvec{\alpha }_N)}{p(\varvec{\alpha }_1,\ldots ,\varvec{\alpha }_{i-1},\varvec{\alpha }_{i+1},\ldots ,\varvec{\alpha }_N)}\nonumber \\&= \frac{n_{c(i)}+1}{n-1+2^K}, \end{aligned}$$\end{document}
where $n_{c (i)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n_{c(i)}$$\end{document} represents the number of individuals other than i that have attribute profile $α_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_c$$\end{document} . The full conditional distribution of $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} given $y_{1 : n}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}_{1:n}$$\end{document} and $α_{(i)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{(i)}$$\end{document} is
(42) $\begin{matrix} p (α_{i}^{⊤} v = c ∣ α_{(i)}, y_{1 : n}) & \propto p (α_{i}^{⊤} v = c ∣ α_{(i)}) p (y_{i} ∣ α_{i}^{⊤} v = c, Θ) \\ \propto (n_{c (i)} + 1) p (y_{i} ∣ α_{i}^{⊤} v = c, Θ), \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\varvec{\alpha }_i^{\top } \varvec{v}=c\mid \varvec{\alpha }_{(i)},\varvec{y}_{1:n})&\propto p(\varvec{\alpha }_i^{\top } \varvec{v}=c\mid \varvec{\alpha }_{(i)})p(\varvec{y}_i\mid \varvec{\alpha }_i^{\top } \varvec{v}=c,\varvec{\Theta })\nonumber \\&\propto (n_{c(i)}+1)p(\varvec{y}_i\mid \varvec{\alpha }_i^{\top } \varvec{v}=c,\varvec{\Theta }), \end{aligned}$$\end{document}
we update $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} sequentially with weight proportional to $(n_{c (i)} + 1) p (y_{i} ∣ α_{i}^{⊤} v = c, Θ)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(n_{c(i)}+1)p(\varvec{y}_i\mid \varvec{\alpha }_i^{\top } \varvec{v}=c,\varvec{\Theta })$$\end{document} .

The full Gibbs sampling steps of all parameters are shown in Algorithm 2.

In order to compare the model performance of the ULCM with the RLCM, we generate response data from the RLCM model, and then use both Algorithm 1 and to estimate model parameters in two models. We use same simulation settings as in our RLCM. For hyper-parameters in ULCM, we use $d_{M_{j}} = 1_{M_{j}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{d}_{M_j}=\varvec{1}_{M_j}$$\end{document} for $j = 1, \dots, J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,J$$\end{document} . Simulation results are shown in Table 1 and provide evidence the RLCM has better parameter recovery. Table 2 reports additional details regarding MADs for $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} at the item level for the RLCM and ULCM. The results show that the aggregate findings in Table 1 are consistent with item-level performance such that the RLCM has smaller MADs than the ULCM.

Results shown in Tables 1 and 2 indicate that for response data generated via RLCM, Algorithm 1 performs uniformly better than Algorithm 2, which implies that if there is structure in the latent relationship between attributes and observed variables, our RLCM can achieve better recovery for model parameters compared with the ULCM.

Table 1 Summary of simulation performance for RLCM and ULCM.

MAD = mean absolute deviation; EAR = element-wise accuracy rate; Accuracy = proportion of attribute profiles that are correctly estimated

Table 2 Summary of mean absolute deviations (MADs) of RLCM and ULCM item response probabilities by item for two selected conditions.

6. Applications

6.1. Wagner Preference Inventory

In this section, we apply Algorithm 1 to the dataset in the Wagner Preference Inventory (WAPI II) (Wagner & Wells, Reference Wagner and Wells1985). This data set contains nominal responses to $J = 12$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$J=12$$\end{document} items, each of which contains $M = 4$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M=4$$\end{document} choices. All 13, 502 participants completed the 12 questions, so we have $N = 13, 502$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N=13,502$$\end{document} . Table 3 presents the twelve items along with the marginal probability of selecting each response option. The twelve items were originally designed to distinguish preferences along the notion of activities that vary in Left vs. Right brain and logical vs. creative. The proposed two-by-two design included (a) Left, logical; (b) left, verbal; (c) right, manipulative/spatial; and (d) right, creative. A separate measure for left and right preference can be obtained by adding (a) and (b) and (c) and (d), respectively. In order to be consistent with (Wagner & Wells, Reference Wagner and Wells1985), we let $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document} to represent the left-right brain dominance dichotomy. We ran five Markov chains with $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document} for convergence diagnostics of the Markov chain.

Table 3 Wagner preference inventory items, anchors, and response frequencies.

a = left/logical; b = left/verbal; c = right/manipulative-spatial; d = right/creative

Figure 1 shows the plot of maximum proportional scale reduction factor (PSRF) (Brooks & Gelman, Reference Brooks and Gelman1998) for checking the convergence of Markov chain with multivariate parameters. The approximate convergence is achieved after 5, 000 iterations since the maximum PSRF remains below 1.1 after that. So we ran 100 Markov chains of length 20, 000 (with 10, 000 as burn-in) estimate the parameters and the results are shown in Table 4.

Figure 1 The maximum PSRF for Wagner Preference Inventory data.

Table 4 Estimated $\hat{Θ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{\Theta }}$$\end{document} for Wagner Preference Inventory data.

Note: The estimated probabilities in $\hat{Θ}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{\Theta }}$$\end{document} are averaged over 100 repetitions.

Table 4 implies that participants with attribute profiles $α_{i} = {(0, 1)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i = (0,1)^\top $$\end{document} , ${(1, 1)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(1,1)^\top $$\end{document} , ${(0, 0)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(0,0)^\top $$\end{document} and ${(1, 0)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(1,0)^\top $$\end{document} prefer option a, b, c and d, respectively. For instance, the choices for item 1 were “a. major in logic”, “b. write a letter”, “c. fix things at home”, and “d. major in art”. The estimates for $Θ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Theta }$$\end{document} in Table 4 indicate that members of class 01 were most likely to choose option “a” with an estimated response probability of 0.725. In contrast, members of class 00 had a 0.643 chance of selecting option “c” and respondents in the 10 class chose “d” with a probability equal to 0.693.

We also estimated the latent class probabilities of attribute profiles. Specifically, the proportions of each attribute profile pattern in an increasing order of the bijection $α_{c}^{⊤} v$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_c^\top \varvec{v}$$\end{document} are shown in Table 5. The latent classes are nearly equal in size with the most respondents of 0.290 classified with the 11 profile (i.e., Wagner’s left-verbal group) and the 00 class having 0.204 proportion of respondents (i.e., Wagner’s right-manipulative/spatial).

Table 5 Estimated distribution of attributes in Wagner Preference Inventory data.

Also, results shown in Table 4 can be used to evaluate the intended choice design for the items. Most items differentiated among one or two of the underlying latent classes. However, some options did not differentiate the latent classes as intended, such as item 2, 7 and 10. For item 2, Wagner originally specified option a as left-logical function and option d as right/creative function. However, according to probabilities represented in Table 4, people with attribute profile $α_{i} = {(0, 1)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i = (0,1)^\top $$\end{document} did not strongly prefer option a, and people with attribute profile $α_{i} = {(1, 0)}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i = (1,0)^\top $$\end{document} did not strongly prefer option d. The choice design for item 2 should be reconsidered.

7. Discussion

This paper focuses on the identifiability conditions of RLCMs. We proposed strict and generic identifiability conditions based on the unique condition of tensor decomposition shown in Kruskal theorem for the uniqueness of three-way arrays (Kruskal, Reference Kruskal1976, Reference Kruskal1977). The established identifiability conditions are applicable to a wealth of models for binary (e.g., Chen et al., Reference Chen, Liu, Xu and Ying2015; Reference Chen, Culpepper and Liang2020, de la Torre, Reference de la Torre2011), polytomous (e.g., Chen & de la Torre, Reference Chen and de la Torre2013, Culpepper, Reference Culpepper2019, Culpepper & Balamuta, Reference Culpepper and Balamuta2021), and nominal response data. Accordingly, the new identifiability results can guide researchers on the design of diagnostic interventions. Then, we developed a Bayesian formulation for the RLCMs where the generic identifiability conditions are taken into consideration. For our simulation study, we apply the Polya-gamma data augmentation for updating coefficients, and compared our algorithm results with ULCMs. Simulation results show that our algorithm can efficiently estimate model parameters, especially when the number of attribute profiles are small. Given latent structures, our model has better performance compared with ULRMs.

In this paper, we assume that the number of attribute profiles, K, is fixed and pre-specified. However, the prior knowledge for K may not be available in practice. Further study may consider K as an unknown parameter that needs to be estimated (e.g., see Chen et al., Reference Chen, Liu, Culpepper and Chen2021). Unknown K implies that the dimension of attribute profiles, category response probability array and coefficients array become unavailable, which can be quite challenging for future research.

Acknowledgements

The authors gratefully acknowledge the financial support of the National Science Foundation Grants 1758631 and SES 21-50628.

Appendix A Proof of Theorems

Preliminary Results

We start the proof with introducing some notation.

Definition 4

For a matrix $M$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{M}$$\end{document} , the Kruskal rank of $M$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{M}$$\end{document} is the largest number I such that every set of I columns in $M$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{M}$$\end{document} are linearly independent.

Remark 7

Compared with the rank of a matrix M, we have $r a n k_{K} (M) \leq r a n k (M)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(M)\le rank(M)$$\end{document} . If M has full column rank, then the equality holds.

Consider a tripartition of the set $J = {1, 2, \dots, J}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}=\{1,2,\ldots ,J\}$$\end{document} into three disjoint, non-empty subsets $J_{1} = {1, 2, \dots, K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}_1=\{1,2,\ldots ,K\}$$\end{document} , $J_{2} = {K + 1, \dots, 2 K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}_2=\{K+1,\ldots ,2K\}$$\end{document} and $J_{3} = {2 K + 1, \dots, J}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}_3=\{2K+1,\ldots ,J\}$$\end{document} . Then, the marginal distribution of response $Y$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}$$\end{document} can be represented as a three-way array $T$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}$$\end{document} decomposing $Y$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}$$\end{document} into three parts:

(A1)

\begin{matrix} \begin{matrix} T_{(y^{J_{1}}, y^{J_{2}}, y^{J_{3}})} & = P (Y^{J_{1}} = y^{J_{1}}, Y^{J_{2}} = y^{J_{2}}, Y^{J_{3}} = y^{J_{3}} ∣ π, B) \\ = \sum_{α} π_{α} P (Y^{J_{1}} = y^{J_{1}}, Y^{J_{2}} = y^{J_{2}}, Y^{J_{3}} = y^{J_{3}} ∣ B, α) \\ = \sum_{α} π_{α} P (Y^{J_{1}} = y^{J_{1}} ∣ B, α) P (Y^{J_{2}} = y^{J_{2}} ∣ B, α) P (Y^{J_{3}} = y^{J_{3}} ∣ B, α) . \end{matrix} \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \begin{aligned} \varvec{T}_{(\varvec{y}^{{\mathbb {J}}_1}, \varvec{y}^{{\mathbb {J}}_2},\varvec{y}^{{\mathbb {J}}_3})}&= P(\varvec{Y}^{{\mathbb {J}}_1}=\varvec{y}^{{\mathbb {J}}_1}, \varvec{Y}^{{\mathbb {J}}_2}=\varvec{y}^{{\mathbb {J}}_2},\varvec{Y}^{{\mathbb {J}}_3}=\varvec{y}^{{\mathbb {J}}_3}\mid \varvec{\pi }, \varvec{B})\\&=\sum _{\varvec{\alpha }} \pi _{\varvec{\alpha }} P(\varvec{Y}^{{\mathbb {J}}_1}=\varvec{y}^{{\mathbb {J}}_1}, \varvec{Y}^{{\mathbb {J}}_2}=\varvec{y}^{{\mathbb {J}}_2},\varvec{Y}^{{\mathbb {J}}_3}=\varvec{y}^{{\mathbb {J}}_3}\mid \varvec{B},\varvec{\alpha })\\&=\sum _{\varvec{\alpha }} \pi _{\varvec{\alpha }} P(\varvec{Y}^{{\mathbb {J}}_1}=\varvec{y}^{{\mathbb {J}}_1}\mid \varvec{B},\varvec{\alpha }) P(\varvec{Y}^{{\mathbb {J}}_2}=\varvec{y}^{{\mathbb {J}}_2}\mid \varvec{B},\varvec{\alpha }) P(\varvec{Y}^{{\mathbb {J}}_3}=\varvec{y}^{{\mathbb {J}}_3}\mid \varvec{B},\varvec{\alpha }). \end{aligned} \end{aligned}$$\end{document}

Let $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} , $T_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_2$$\end{document} , $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} represent distributions of $Y^{J_{1}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^{{\mathbb {J}}_1}$$\end{document} , $Y^{J_{2}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^{{\mathbb {J}}_2}$$\end{document} , $Y^{J_{3}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^{{\mathbb {J}}_3}$$\end{document} given values of attribute profile $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} . Then, the identifiability is equivalent to the uniqueness of the decomposition of the following tensor (Kruskal, Reference Kruskal1977)

(A2)

\begin{matrix} T = \sum_{α} π_{α} T_{1, α} \otimes T_{2, α} \otimes T_{3, α} = \sum_{α} {\tilde{T}}_{1, α} \otimes T_{2, α} \otimes T_{3, α}, \end{matrix}

where $T_{1, α}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{1, \varvec{\alpha }}$$\end{document} , $T_{2, α}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{2, \varvec{\alpha }}$$\end{document} , $T_{3, α}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{3, \varvec{\alpha }}$$\end{document} are the $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} -th column of $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} , $T_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_2$$\end{document} , $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} , and ${\tilde{T}}_{1, α} = π_{α} T_{1, α}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tilde{\varvec{T}}_{1, \varvec{\alpha }}= \pi _{\varvec{\alpha }} \varvec{T}_{1, \varvec{\alpha }}$$\end{document} .

We apply the following theorem shown in Kruskal (Reference Kruskal1977) for our proof.

Theorem 3

(Kruskal, Reference Kruskal1977) If

(A3)

\begin{matrix} r a n k_{K} (\tilde{T_{1}}) + r a n k_{K} (T_{2}) + r a n k_{K} (T_{3}) \geq 2 \cdot 2^{K} + 2, \end{matrix}

then the tensor decomposition of $T$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}$$\end{document} is unique up to simultaneous permutation and rescaling of the columns.

We have $r a n k_{K} (\tilde{T_{1}}) = r a n k_{K} (T_{1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\tilde{\varvec{T}_1})=rank_K(\varvec{T}_1)$$\end{document} since $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} has positive entries. Moreover, $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} , $T_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_2$$\end{document} and $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} are all stochastic matrices with column sum 1, so the decomposition of the tensor $T$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}$$\end{document} is unique up to permutations of columns if (A3) in Theorem 3 is satisfied, which implies model identifiability.

If items have M response levels, we will be able to construct $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} , $T_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_2$$\end{document} and $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} such that $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} , $T_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_2$$\end{document} are $M^{K} \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M^K\times 2^K$$\end{document} , and $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} is $M^{J - 2 K} \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M^{J-2K}\times 2^K$$\end{document} . So for the first set of K items, the probability matrix $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} is

\begin{matrix} T_{1} = (⨂_{j = 1}^{K} θ_{j 0}, \dots, ⨂_{j = 1}^{K} θ_{j, 2^{K} - 1}) . \end{matrix}

We multiply $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} by a collapsing matrix $A$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}$$\end{document} that makes $\underset{2^{K} \times M^{K}}{A} \underset{M^{K} \times 2^{K}}{T_{1}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\underset{2^K\times M^K}{\varvec{A}}\underset{M^K\times 2^K}{\varvec{T}_1}$$\end{document} a square matrix of size $2^{K} \times 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K \times 2^K$$\end{document} .

Definition 5

Matrix $A_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}_j$$\end{document} , with size $2 \times M$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2\times M$$\end{document} , is a collapsing matrix for item j. For the response probability vector $θ_{jc}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jc}$$\end{document} , $A_{j} θ_{jc}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}_j\theta _{jc}$$\end{document} only gives probabilities of selecting a given response level or not in class c.

Following is an example of matrix $A_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}_j$$\end{document} .

Example 5

Consider $M_{j} = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$M_j= 3$$\end{document} and we are collapsing on option 1. Let

\begin{matrix} A_{j} = (\begin{matrix} 1 & 0 & 1 \\ 0 & 1 & 0 \end{matrix}), \end{matrix}

and the response probability vector $θ_{jc} = (θ_{j c, 0}, θ_{j c, 1}, θ_{j c, 2})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jc}=(\theta _{jc,0},\theta _{jc,1},\theta _{jc,2})$$\end{document} for item j in class c. Then, we have

\begin{matrix} A_{j} θ_{jc} = (\begin{matrix} 1 & 0 & 1 \\ 0 & 1 & 0 \end{matrix}) (\begin{matrix} 1 - θ_{j c, 1} - θ_{j c, 2} \\ θ_{j c, 1} \\ θ_{j c, 2} \end{matrix}) = (\begin{matrix} 1 - θ_{j c, 1} \\ θ_{j c, 1} \end{matrix}) . \end{matrix}

Let $A = ⨂_{j = 1}^{K} A_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}=\bigotimes _{j=1}^K \varvec{A}_j$$\end{document} , where $A_{j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}_j$$\end{document} is defined in Definition 5. Compared with $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} , $A T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A} \varvec{T}_1$$\end{document} is a collapsed version of $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} which only contains probabilities of selecting a given response level or not by latent class membership. So we can write $A T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A} \varvec{T}_1$$\end{document} as

(A4)

\begin{matrix} A T_{1} & = ⨂_{j = 1}^{K} A_{j} (⨂_{j = 1}^{K} θ_{j 0}, \dots, ⨂_{j = 1}^{K} θ_{j, 2^{K} - 1}) \end{matrix}

(A5)

\begin{matrix} = (⨂_{j = 1}^{K} A_{j} ⨂_{j = 1}^{K} θ_{j 0}, \dots, ⨂_{j = 1}^{K} A_{j} ⨂_{j = 1}^{K} θ_{j, 2^{K} - 1}) \end{matrix}

(A6)

\begin{matrix} = (⨂_{j = 1}^{K} (A_{j} θ_{j 0}), \dots, ⨂_{j = 1}^{K} (A_{j} θ_{j, 2^{K} - 1})) . \end{matrix}

Proposition 1

If $Δ^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^1$$\end{document} follows a simple structure shown in Definition 1 and Remark 2, then we have

(A7)

\begin{matrix} A T_{1} = ⨂_{j = 1}^{K} (p_{j 0}, p_{j 1}) \end{matrix}

where $p_{j 0} = A_{j} θ_{j 0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j0}=\varvec{A}_{j}\varvec{\theta }_{j0}$$\end{document} and $p_{j 1} = A_{j} θ_{j, e_{j}^{⊤} v}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j1}=\varvec{A}_{j} \varvec{\theta }_{j,\varvec{e}_j^\top \varvec{v}}$$\end{document} .

Proof

Simple structure implies that we can then write $A T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}\varvec{T}_1$$\end{document} as a block matrix:

(A8)

\begin{matrix} A T_{1} & = (p_{10} \otimes (⨂_{j > 1}, A_{j}, θ_{j 0}), \dots, p_{10} \otimes (⨂_{j > 1}, A_{j}, θ_{j, 2^{K - 1} - 1}),) \\ (p_{11} \otimes (⨂_{j > 1}, A_{j}, θ_{j, 2^{K - 1}}), \dots, p_{11} \otimes (⨂_{j > 1}, A_{j}, θ_{j, 2^{K} - 1})) \\ = (p_{10} \otimes T_{(1) 0}, p_{11} \otimes T_{(1) 1}) . \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{A}\varvec{T}_1&=\left( \varvec{p}_{10}\otimes \left( \bigotimes _{j>1}\varvec{A}_{j}\varvec{\theta }_{j0}\right) ,\dots ,\varvec{p}_{10}\otimes \left( \bigotimes _{j>1}\varvec{A}_{j}\varvec{\theta }_{j,2^{K-1}-1}\right) ,\right. \nonumber \\&\left. \varvec{p}_{11}\otimes \left( \bigotimes _{j>1}\varvec{A}_{j}\varvec{\theta }_{j,2^{K-1}}\right) ,\dots ,\varvec{p}_{11}\otimes \left( \bigotimes _{j>1}\varvec{A}_{j}\varvec{\theta }_{j,2^K-1}\right) \right) \nonumber \\&=\left( \varvec{p}_{10}\otimes \varvec{T}_{(1)0},\varvec{p}_{11} \otimes \varvec{T}_{(1)1}\right) . \end{aligned}$$\end{document}

We next show that simple structure of item 1 implies that,

\begin{matrix} ⨂_{j > 1} A_{j} Θ_{j 0} = ⨂_{j > 1} A_{j} Θ_{j, 2^{K - 1}}, \dots, ⨂_{j > 1} A_{j} Θ_{j, 2^{K - 1} - 1} = ⨂_{j > 1} A_{j} Θ_{j, 2^{K} - 1} . \end{matrix}

Notice that items $j > 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j>1$$\end{document} are unrelated to attribute one. Let $α_{(1)} = {(α_{2}, \dots, α_{K})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{(1)}=(\alpha _2,\dots ,\alpha _K)^\top $$\end{document} denote the response pattern on attributes two through K. Simple structure of item 1 implies that classes with $α = {(0, α_{(1)})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(0,\varvec{\alpha }_{(1)})^\top $$\end{document} and $α = {(1, α_{(1)})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }=(1,\varvec{\alpha }_{(1)})^\top $$\end{document} will have identical response probabilities on items $j > 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j>1$$\end{document} . Stated differently, classes $(0, α_{(1)}) v = c_{0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(0,\varvec{\alpha }_{(1)})\varvec{v}=c_0$$\end{document} and $(1, α_{(1)}) v = c_{0} + 2^{K - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(1,\varvec{\alpha }_{(1)})\varvec{v}=c_0+2^{K-1}$$\end{document} have equivalent response probabilities on the remaining $j > 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j>1$$\end{document} items so that $⨂_{j > 1} A_{j} Θ_{j, c_{0}} = ⨂_{j > 1} A_{j} Θ_{j, c_{0} + 2^{K - 1}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\bigotimes _{j>1}\varvec{A}_j\varvec{\Theta }_{j,c_0}=\bigotimes _{j>1}\varvec{A}_j\varvec{\Theta }_{j,c_0+2^{K-1}}$$\end{document} for all $c_{0} \in {0, \dots, 2^{K - 1} - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c_0\in \{0,\dots ,2^{K-1}-1\}$$\end{document} . Consequently, $T_{(1) 0} = T_{(1) 1} = T_{(1)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{(1)0}=\varvec{T}_{(1)1}=\varvec{T}_{(1)}$$\end{document} and properties of the Kronecker product imply that

(A9)

\begin{matrix} A T_{1} = (p_{10} \otimes T_{(1)}, p_{11} \otimes T_{(1)}) = (p_{10}, p_{11}) \otimes T_{(1)} \end{matrix}

where

(A10)

\begin{matrix} T_{(1)} = (⨂_{j > 1} A_{j} Θ_{j 0}, \dots, ⨂_{j > 1} A_{j} Θ_{j, 2^{K - 1} - 1}) . \end{matrix}

Item two is also simple structure and repeating the aforementioned steps on $T_{(1)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{(1)}$$\end{document} implies that

(A11)

\begin{matrix} A T_{1} = (p_{10}, p_{11}) \otimes (p_{20}, p_{21}) \otimes T_{(1 : 2)} \end{matrix}

where

(A12)

\begin{matrix} T_{(1 : 2)} = (⨂_{j > 2} A_{j} Θ_{j 0}, \dots, ⨂_{j > 2} A_{j} Θ_{j, 2^{K - 2} - 1}) . \end{matrix}

Consequently, simple structure for the remaining $j \in {3, \dots, K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j\in \{3,\dots ,K\}$$\end{document} items implies that

(A13)

\begin{matrix} A T_{1} = ⨂_{j = 1}^{K} (p_{j 0}, p_{j 1}) . \end{matrix}

$□$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\square $$\end{document}

Remark 8

Note that properties of the Kronecker product and simple structure in $T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_1$$\end{document} imply that $A T_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}\varvec{T}_1$$\end{document} has rank $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} if $p_{j 0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j0}$$\end{document} and $p_{j 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j1}$$\end{document} are linearly independent for all j. According to Definition 1, there is at least one $β_{jjm} \neq 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{jjm}\ne 0$$\end{document} for $m \in {1, \dots, M_{j} - 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m\in \{1,\dots ,M_j-1\}$$\end{document} , which implies that $p_{j 0} \neq p_{j 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j0}\ne \varvec{p}_{j1}$$\end{document} .

Proposition 2

$r a n k (A^{i} T_{i}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^i\varvec{T}_i)=2^K$$\end{document} if and only if $r a n k (T_{i}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{T}_i)=2^K$$\end{document} , $i = 1, 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i=1,2$$\end{document} .

Proof

By Sylvester’s rank inequality (Matsaglia & Styan, Reference Matsaglia and Styan1974), we have

\begin{matrix} r a n k (A^{i}) + r a n k (T_{i}) - 2^{K} \leq r a n k (A^{i} T_{i}) \leq min {r a n k (A^{i}), r a n k (T_{i})} . \end{matrix}

Given $r a n k (A_{j}^{i}) = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}_j^i)=2$$\end{document} , and the property of the rank of a Kronecker product, we have $r a n k (A^{i}) = \prod_{j = 1}^{K} r a n k (A_{j}^{i}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^i)=\prod _{j=1}^{K}rank(\varvec{A}_j^i)=2^K$$\end{document} . Then, we get

\begin{matrix} r a n k (T_{i}) \leq r a n k (A^{i} T_{i}) \leq min {2^{K}, r a n k (T_{i})}, \end{matrix}

which implies that $r a n k (A^{i} T_{i}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^i\varvec{T}_i)=2^K$$\end{document} if and only if $r a n k (T_{i}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{T}_i)=2^K$$\end{document} . $□$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\square $$\end{document}

Proof of Theorem 1

By Proposition 2, it suffices to show that $r a n k (A^{1} T_{1}) = r a n k (A^{2} T_{2}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^1\varvec{T}_1)=rank(\varvec{A}^2\varvec{T}_2)=2^K$$\end{document} and $r a n k_{K} (T_{3}) \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_3)\ge 2$$\end{document} , where $A^{1} = ⨂_{j = 1}^{K} A_{j}^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}^1=\bigotimes _{j=1}^K \varvec{A}_j^1$$\end{document} and $A^{2} = ⨂_{j = 1}^{K} A_{j}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}^2=\bigotimes _{j=1}^K \varvec{A}_j^2$$\end{document} are collapsing matrices introduced in Definition 5. According to condition (A1) in Theorem 1, both $Δ^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^1$$\end{document} and $Δ^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^2$$\end{document} satisfy the simple structure, then by Proposition 1 and remark 8 we have $r a n k (A^{1} T_{1}) = r a n k (A^{2} T_{2}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^1\varvec{T}_1)=rank(\varvec{A}^2\varvec{T}_2)=2^K$$\end{document} . For $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} , since each element is nonnegative and each column sums to 1, then given condition (A2), for any two different classes c and $c^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c^\prime $$\end{document} , there must exist one item j such that $θ_{jcm} \neq θ_{j^{'} m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jcm}\ne \theta _{j^\prime m}$$\end{document} , so that $r a n k_{K} (T_{3}) \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_3)\ge 2$$\end{document} . By Theorem 3, the model is strictly identified.

Proof of Theorem 2

According to the tripartition of items set $J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}$$\end{document} , we can decompose $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} into $Δ^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^1$$\end{document} , $Δ^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^2$$\end{document} , $Δ^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^\prime $$\end{document} corresponding to $J_{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}_1$$\end{document} , $J_{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}_2$$\end{document} , $J_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {J}}_3$$\end{document} , respectively. Similarly, we can decompose parameter space $Ω (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega (\varvec{B})$$\end{document} into three parts, $Ω_{Δ} (B) = Ω_{Δ^{1}} \times Ω_{Δ^{2}} \times Ω_{Δ^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{B})=\Omega _{\varvec{\Delta }^1}\times \Omega _{\varvec{\Delta }^2}\times \Omega _{\varvec{\Delta }'}$$\end{document} . Therefore, to prove Theorem 2, it suffices to show that under conditions (B1) and (B2), $r a n k_{K} (T_{1}) = r a n k_{K} (T_{2}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_1)=rank_K(\varvec{T}_2)=2^K$$\end{document} and $r a n k_{K} (T_{3}) \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_3)\ge 2$$\end{document} hold almost everywhere in $Ω_{Δ^{1}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }^1}$$\end{document} , $Ω_{Δ^{2}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }^2}$$\end{document} , $Ω_{Δ^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }^\prime }$$\end{document} , respectively. Then, by Theorem 3, the identifiability holds almost everywhere in $Ω_{Δ} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{B})$$\end{document} .

Based on Theorem 3 and Proposition 2, we first show that $r a n k (A^{i} T_{i}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^i \varvec{T}_i)=2^K$$\end{document} holds almost everywhere in $Ω_{Δ^{i}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }^i}$$\end{document} , $i = 1, 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i=1,2$$\end{document} , given $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} satisfying the structure shown in Theorem 2. Let

(A14)

\begin{matrix} f_{i} (B) = d e t (A^{i} T_{i}) : Ω_{Δ^{i}} \to R \end{matrix}

denote the determinant of matrix $A^{i} T_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}^i\varvec{T}_i$$\end{document} , where $Δ^{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^i$$\end{document} satisfies condition (B1).

Proposition 3

$f_{i} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_{i}(\varvec{B})$$\end{document} is a real analytic function of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} .

Proof

\begin{matrix} f_{i} (B) = d e t (A^{i} T_{i}) = g (θ_{1, 0}, \dots, θ_{K, 2^{K} - 1}), \end{matrix}

where $θ_{jc} = {(θ_{j c 0}, \dots, θ_{j c, M_{j} - 1})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\theta }_{jc}=(\theta _{jc0},\ldots ,\theta _{jc,M_j-1})^\top $$\end{document} and $θ_{jcm} = \frac{exp (α_{c}^{⊤}, β_{jm})}{\sum_{m^{'} = 0}^{M_{j} - 1} exp (α_{c}^{⊤}, β_{j m^{'}})} = \frac{1}{1 + \sum_{m^{'} \neq m} exp (α_{c}^{⊤} β_{j m^{'}} - α_{c}^{⊤} β_{jm})}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jcm}=\frac{\exp \left( \varvec{\alpha }_c^\top \varvec{\beta }_{jm} \right) }{\sum _{m'=0}^{M_j-1}\exp \left( \varvec{\alpha }_c^\top \varvec{\beta }_{jm'} \right) }=\dfrac{1}{1+\sum _{m'\ne m}\exp \left( \varvec{\alpha }_c^\top \varvec{\beta }_{jm'}-\varvec{\alpha }_c^\top \varvec{\beta }_{jm} \right) }$$\end{document} .

$θ_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{jcm}$$\end{document} is an analytic function because exponential functions are positive analytic functions, and $g (θ_{1, 0}, \dots, θ_{K, 2^{K} - 1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$g(\varvec{\theta }_{1,0},\ldots ,\varvec{\theta }_{K,2^K-1})$$\end{document} is also a real analytic function of $(θ_{1, 0}, \dots, θ_{K, 2^{K} - 1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\varvec{\theta }_{1,0},\ldots ,\varvec{\theta }_{K,2^K-1})$$\end{document} given that it is a polynomial. Therefore, we know that $f_{i} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_{i}(\varvec{B})$$\end{document} is a real analytic function of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} , given the fact that the composition of real analytic functions is a real analytic function. $□$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\square $$\end{document}

Next we introduce the following lemma, which shows that the zero set of a real analytic function has Lebesgue measure zero if the function is not constantly equal to zero.

Lemma 1

(Mityagin, Reference Mityagin2020; Dang, Reference Dang2015) Let $f : R^{d} \to R$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f: {\mathbb {R}}^d\rightarrow {\mathbb {R}}$$\end{document} be a real analytic function on $R^{d}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbb {R}}^d$$\end{document} . If f is not identically zero, then its zero set ${x \in R^{d} : f (x) = 0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\{\varvec{x}\in {\mathbb {R}}^d: f(\varvec{x})=0\}$$\end{document} has Lebesgue measure zero.

Proposition 4

If $Δ^{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^i$$\end{document} satisfies the structure shown in Theorem 2, then there exists some $B \in Ω_{Δ^{i}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}\in \Omega _{\varvec{\Delta }^i}$$\end{document} , such that $f_{i} (B) \neq 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_i(\varvec{B})\ne 0$$\end{document} , $i = 1, 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i=1,2$$\end{document} .

Proof

As shown in condition B1 of Theorem 2, assume that for $j = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,K$$\end{document} , $Δ_{j}^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _j^1$$\end{document} and $Δ_{j}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _{j}^2$$\end{document} satisfy the following structure:

(A15)

\begin{matrix} Δ_{j} = {(\begin{matrix} 0 & 0 & \dots & 0 & 0 & 0 & \dots & 0 \\ 1 & 0 & \dots & 0 & δ_{j j 1} = 1 & 0 & \dots & 0 \\ 1 & 0 & \dots & 0 & 0 & 0 & \dots & 0 \\ ⋮ & ⋮ & ⋮ & ⋮ & ⋮ & ⋮ \\ 1 & 0 & \dots & 0 & 0 & 0 & \dots & 0 \end{matrix})}_{M_{j} \times P} . \end{matrix}

Then, we have

\begin{matrix} p_{j 0} = {(1 - \frac{exp (β_{j 01})}{exp (β_{j 01}) + h_{j}}, \frac{exp (β_{j 01})}{exp (β_{j 01}) + h_{j}})}^{⊤}, \\ p_{j 1} = {(1 - \frac{exp (β_{j 01} + β_{j j 1})}{exp (β_{j 01} + β_{j j 1}) + h_{j}}, \frac{exp (β_{j 01} + β_{j j 1})}{exp (β_{j 01} + β_{j j 1}) + h_{j}})}^{⊤}, \end{matrix}

where

\begin{matrix} h_{j} = \sum_{m^{'} \neq 1} exp (β_{j 0 m^{'}}) . \end{matrix}

As shown in Definition 1, $Δ_{j}^{1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _j^1$$\end{document} and $Δ_{j}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta _{j}^2$$\end{document} satisfy simple structure, and $p_{j 0}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j0}$$\end{document} and $p_{j 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{p}_{j1}$$\end{document} are linearly independent for $j = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j=1,\ldots ,K$$\end{document} due to $β_{j k 1} \neq 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{jk1}\ne 0$$\end{document} . Therefore, according to Proposition 1 and Remark 8, we have $r a n k (A^{i} T_{i}) = \prod_{j = 1}^{K} r a n k (p_{j 0}, p_{j 1}) = 2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank(\varvec{A}^i\varvec{T}_i)=\prod _{j=1}^{K}rank(\varvec{p}_{j0},\varvec{p}_{j1})=2^K$$\end{document} , which implies that $f_{i} (B) \neq 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_i(\varvec{B})\ne 0$$\end{document} , $i = 1, 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i=1,2$$\end{document} . $□$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\square $$\end{document}

Let $S_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S_i$$\end{document} denote the zero set of function $f_{i} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_i(\varvec{B})$$\end{document} :

\begin{matrix} S_{i} = {B \in Ω_{Δ^{i}} : f_{i} (B) = d e t (A^{i} T_{i}) = 0}, \end{matrix}

then by Lemma 1 we can conclude that $S_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S_{i}$$\end{document} is a measure zero set with respect to $Ω_{Δ^{i}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }^i}$$\end{document} provided $Δ^{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }^i$$\end{document} satisfies condition (B1).

For condition (B2), we need to show that $r a n k_{K} (T_{3}) \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_3)\ge 2$$\end{document} holds almost everywhere in $Ω_{Δ^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Omega }_{\varvec{\Delta }^\prime }$$\end{document} . Note $r a n k_{K} (T_{3}) \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_3)\ge 2$$\end{document} implies that for any two different attribute profiles $α_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_c$$\end{document} , $α_{c^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{c^\prime }$$\end{document} , there always exist one $j^{*} > 2 K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j^*>2K$$\end{document} , such that $θ_{j^{*} c m} \neq θ_{j^{*} c^{'} m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{j^*cm}\ne \theta _{j^*c^\prime m}$$\end{document} for some choice m with $0 < m < M_{j^{*}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0<m<M_{j^*}$$\end{document} . Note that the $α_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_c$$\end{document} -th and $α_{c^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{c^\prime }$$\end{document} -th columns of $T_{3}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_3$$\end{document} are $T_{3, α_{c}} = ⨂_{j > 2 K} θ_{j α_{c}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{3,\varvec{\alpha }_c}=\bigotimes _{j>2K}\varvec{\theta }_{j\varvec{\alpha }_c}$$\end{document} and $T_{3, α_{c^{'}}} = ⨂_{j > 2 K} θ_{j α_{c^{'}}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{3,\varvec{\alpha }_{c^\prime }}=\bigotimes _{j>2K}\varvec{\theta }_{j\varvec{\alpha }_{c^\prime }}$$\end{document} . Then, under condition B2, we have $θ_{j^{*} α_{c}} \neq θ_{j^{*} α_{c^{'}}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\theta }_{j^*\varvec{\alpha }_c}\ne \varvec{\theta }_{j^*\varvec{\alpha }_{c^\prime }}$$\end{document} , which implies $T_{3, α_{c}} \neq T_{3, α_{c^{'}}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{3,\varvec{\alpha }_c} \ne \varvec{T}_{3,\varvec{\alpha }_{c^\prime }}$$\end{document} . Therefore, $T_{3, α_{c}} = T_{3, α_{c^{'}}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{T}_{3,\varvec{\alpha }_c} = \varvec{T}_{3,\varvec{\alpha }_{c^\prime }}$$\end{document} holds only when $β_{j^{*} m k} = 0$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{j^*mk}=0$$\end{document} for some k and choice m with $δ_{j^{*} m k} = 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{j^*mk}=1$$\end{document} , which are of Lebesgue measure zero within $Ω_{Δ^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Omega }_{\varvec{\Delta }^\prime }$$\end{document} . That proves $r a n k_{K} (T_{3}) \geq 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$rank_K(\varvec{T}_3)\ge 2$$\end{document} almost everywhere within $Ω_{Δ^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Omega }_{\varvec{\Delta }^\prime }$$\end{document} .

Therefore, the inequality A3 shown in Theorem 3 holds almost everywhere in $Ω_{Δ} (B)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Omega _{\varvec{\Delta }}(\varvec{B})$$\end{document} .

Appendix B Posterior Inference

The goal of this section is to describe our strategy for inferring the nominal RLCM parameters. We first discuss the conditional likelihood and apply the Polya-gamma identity to augment the likelihood function. An important feature to note is that we collapse the conditional likelihood, which has the advantage of requiring fewer draws of Polya-gamma augmented variables. Then, we show the derivation of full conditional distributions for a Gibbs sampling algorithm.

Conditional Likelihood and Polya Gamma Data Augmentation

Let $i = 1, \dots, n$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i=1,\dots ,n$$\end{document} index individuals so that $y_{ij}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$y_{ij}$$\end{document} denotes the observed response for individual i to item j and $y_{i} = {(y_{i 1}, \dots, y_{iJ})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}_i=(y_{i1},\dots ,y_{iJ})^\top $$\end{document} is a J-vector of responses for individual i. Let $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} denote all of the item parameters. The conditional distribution of a sample of n responses is,

(B1)

\begin{matrix} p (y_{1 : n} | α_{1 : n}, B) = \prod_{i = 1}^{n} p (y_{i} | α_{i}, B) = \prod_{i = 1}^{n} \prod_{j = 1}^{J} \prod_{m = 0}^{M_{j} - 1} {(\frac{exp (a_{i}^{⊤}, β_{jm})}{\sum_{m^{'} = 0}^{M_{j} - 1} exp (a_{i}^{⊤}, β_{j m^{'}})})}^{1 (y_{ij} = m)} . \end{matrix}

where $y_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}_i$$\end{document} is the response vector for individual i, $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} is individual i’s attribute profile, $y_{1 : n} = {(y_{1}, \dots, y_{n})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}_{1:n}=(\varvec{y}_{1},\dots ,\varvec{y}_{n})^\top $$\end{document} is a $n \times J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n\times J$$\end{document} matrix of responses, and $α_{1 : n} = {(α_{1}, \dots, α_{n})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{1:n}=(\varvec{\alpha }_1,\dots ,\varvec{\alpha }_n)^\top $$\end{document} denotes all attribute profiles. An important feature to note about the conditional likelihood is that we can aggregate terms in the product for individuals who reside in the same class and select the same response options on items. That is, after switching the order of the i and j products and substituting $a_{i} = a_{α_{i}^{⊤} v}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{a}_i = \varvec{a}_{\varvec{\alpha }_i^\top \varvec{v}}$$\end{document} we can aggregate Eq. B1 as

(B2)

\begin{matrix} p (y_{1 : n} | α_{1 : n}, B) = \prod_{j = 1}^{J} \prod_{c = 0}^{2^{K} - 1} \frac{\prod_{m = 0}^{M_{j} - 1} {(exp (a_{c}^{⊤}, β_{jm}))}^{n_{jcm}}}{{(\sum_{m^{'} = 0}^{M_{j} - 1} exp (a_{c}^{⊤}, β_{j m^{'}}))}^{n_{c}}} \end{matrix}

where $n_{jcm} = \sum_{i = 1}^{n} 1 (y_{ij} = m) 1 (α_{i}^{⊤} v = c)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n_{jcm} = \sum _{i=1}^n \mathbb {1}(y_{ij}=m) \mathbb {1}(\varvec{\alpha }_i^\top \varvec{v}=c)$$\end{document} indicates the number of individuals within class c that select option m on item j and $n_{c} = \sum_{i = 1}^{n} 1 (α_{i}^{⊤} v = c)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n_c= \sum _{i=1}^n \mathbb {1}(\varvec{\alpha }_i^\top \varvec{v}=c)$$\end{document} is the number of individuals residing in class c.

The form of Eq. B2 enables us to adopt the Polya-Gamma data augmentation strategy for models involving logistic functions (Polson et al., Reference Polson, Scott and Windle2013). In particular, Polson et al. (Reference Polson, Scott and Windle2013) reported the following identity relating the logistic function with an integral for a Polya-Gamma (PG) random variable,

(B3)

\begin{matrix} \frac{{(e^{ψ})}^{a}}{{(1 + e^{ψ})}^{b}} = 2^{- b} e^{κ ψ} \int_{0}^{\infty} e^{- w ψ^{2} / 2} p (w) d w, a \in R, b > 0 \end{matrix}

where $κ = a - b / 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\kappa =a-b/2$$\end{document} and $w \sim PG (b, 0)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$w\sim \text {PG}(b,0)$$\end{document} . Equation B3 provides a data augmentation strategy for the random variable $ψ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\psi $$\end{document} that is conjugate with normal priors. For instance, see Polson et al. (Reference Polson, Scott and Windle2013) for a summary of a Gibbs sampling algorithm to infer the posterior distribution of logistic regression model parameters using Markov chain Monte Carlo (MCMC). Additionally, the PG strategy was also used for Bayesian estimation of the two parameter logistic item response theory model (Jiang & Templin, Reference Jiang and Templin2019) and binary diagnostic models (Balamuta & Culpepper, Reference Balamuta and Culpepper2022).

We apply the PG identity in Eq. B3 by rewriting the portion of the conditional likelihood in Eq. B2 that corresponds with item j in a logistic format. Specifically, as noted by Holmes and Held and Polson et al., the full conditional distribution for $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} can be written as,

(B4)

\begin{matrix} p (β_{jm} | y_{1 : n, j}, α_{1 : n}, B_{j (m)}) & = p (β_{jm}) p (y_{1 : n, j} | B_{j}) \\ \propto p (β_{jm}) \prod_{c = 0}^{2^{K} - 1} {(\frac{exp (η_{jcm})}{1 + exp (η_{jcm})})}^{n_{jcm}} {(\frac{1}{1 + exp (η_{ijm})})}^{n_{c} - n_{jcm}} . \end{matrix}

where $y_{1 : n, j} = (y_{1 j}, \dots, y_{nj})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}_{1:n,j}=(y_{1j},\dots ,y_{nj})$$\end{document} , $B_{j (m)} = (β_{j 0}, \dots, β_{j, m - 1}, β_{j, m + 1}, \dots, β_{j, M_{j} - 1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_{j(m)}=(\varvec{\beta }_{j0},\dots ,\varvec{\beta }_{j,m-1},\varvec{\beta }_{j,m+1},\dots ,\varvec{\beta }_{j,M_j-1})$$\end{document} excludes coefficients for response m on j, and

(B5)

\begin{matrix} η_{jcm} & = a_{c}^{⊤} β_{jm} - C_{jcm} \end{matrix}

(B6)

\begin{matrix} C_{jcm} & = ln (\sum_{m^{'} \neq m} exp (a_{c}^{⊤} β_{j m^{'}})) . \end{matrix}

Full Conditional Distributions

$δ_{jpm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{jpm}$$\end{document} and $γ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\gamma $$\end{document} The full conditional distribution for $δ_{jpm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\delta _{jpm}$$\end{document} is

(B7)

\begin{matrix} p (δ_{jpm} | β_{jpm}, γ, σ_{β}^{2}) \propto p (β_{jpm} | δ_{jpm}, σ_{β}^{2}) p (δ_{jpm} | γ) \end{matrix}

which is

(B8)

\begin{matrix} δ_{jpm} | β_{jpm}, γ \sim Bernoulli ({\tilde{γ}}_{jpm}) \end{matrix}

where

(B9)

\begin{matrix} {\tilde{γ}}_{jpm} = \frac{γ p (β_{jpm} | δ_{jpm} = 1, σ_{β}^{2})}{γ p (β_{jpm} | δ_{jpm} = 1, σ_{β}^{2}) + (1 - γ) p (β_{jpm} | δ_{jpm} = 0, σ_{β}^{2})} \end{matrix}

The full conditional distribution for $γ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\gamma $$\end{document} is

(B10)

\begin{matrix} p (γ | Δ) \propto p (Δ | γ) p (γ) = (\prod_{j = 1}^{J}, \prod_{p = 1}^{P - 1}, \prod_{m = 1}^{M_{j} - 1}, p, (δ_{jpm} | γ)) p (γ) \end{matrix}

(B11)

\begin{matrix} γ | Δ \sim Beta (\sum_{j = 1}^{J} \sum_{p = 1}^{P - 1} \sum_{m = 1}^{M_{j} - 1} δ_{jpm} + a, J (P - 1) (M - 1) - \sum_{j = 1}^{J} \sum_{p = 1}^{P - 1} \sum_{m = 1}^{M_{j} - 1} δ_{jpm} + b) \end{matrix}

$σ_{β}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sigma _{\beta }^2$$\end{document} The full conditional distribution for $σ_{β}^{2}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sigma _{\beta }^2$$\end{document} is

(B12)

\begin{matrix} σ_{β}^{2} ∣ B, Δ \sim I G a m m a (α_{σ} + \frac{1}{2} \sum_{j = 1}^{J} P (M_{j} - 1), β_{σ} + \frac{1}{2} \sum_{j = 1}^{J} \sum_{p = 0}^{P - 1} \sum_{m = 1}^{M_{j} - 1} β_{jpm}^{2} (D (1 - δ_{jpm}) + δ_{jpm})) \end{matrix}

$α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} and $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} We update $α$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }$$\end{document} while integrating $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} out

(B13)

\begin{matrix} p (α_{1}, \dots, α_{N}) & = \int p (α_{1}, \dots, α_{N} ∣ π) p (π) d π \\ = \frac{1}{B (d_{0})} \int (\prod_{c = 0}^{2^{K} - 1}, π_{c}^{n_{c} + d_{0, c} - 1}) d π \\ = \frac{B (n + d_{0})}{B (d_{0})} . \end{matrix}

Then, the full conditional prior distribution for $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} is

(B14)

\begin{matrix} p (α_{i}^{⊤} v = c ∣ α_{(i)}) & = \frac{p (α_{1}, \dots, α_{N})}{p (α_{1}, \dots, α_{i - 1}, α_{i + 1}, \dots, α_{N})} \\ = \frac{n_{c (i)} + 1}{n - 1 + 2^{K}}, \end{matrix}

where $n_{c (i)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n_{c(i)}$$\end{document} represents the number of individuals other than i that have attribute profile $α_{c}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_c$$\end{document} . Full conditional distribution of $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} given $y_{1 : n}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{y}_{1:n}$$\end{document} and $α_{(i)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_{(i)}$$\end{document} is

(B15)

\begin{matrix} p (α_{i}^{⊤} v = c ∣ α_{(i)}, y_{1 : n}, B^{(t - 1)}) & \propto p (α_{i}^{⊤} v = c ∣ α_{(i)}) p (y_{i} ∣ α_{i}^{⊤} v = c, B^{(t - 1)}) \\ \propto (n_{c (i)} + 1) p (y_{i} ∣ α_{i}^{⊤} v = c, B^{(t - 1)}), \end{matrix}

we update $α_{i}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\alpha }_i$$\end{document} sequentially with weight proportional to $(n_{c (i)} + 1) p (y_{i} ∣ α_{i}^{⊤} v = c, B^{(t - 1)})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(n_{c(i)}+1)p(\varvec{y}_i\mid \varvec{\alpha }_i^{\top } \varvec{v}=c,\varvec{B}^{(t-1)})$$\end{document} . For $π$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\pi }$$\end{document} , we have

(B16)

\begin{matrix} π ∣ α_{1 : n} \sim D i r i c h l e t (n + d_{0}), \end{matrix}

where $n = (n_{0}, \dots, n_{2^{K} - 1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{n}=(\varvec{n}_0,\ldots ,\varvec{n}_{2^K-1})$$\end{document} .

Item Parameters, $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} , and Augmented Parameters, $w_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$w_{jcm}$$\end{document} Applying the PG identity in Eq. B3 to Eq. B4 yields,

(B17)

\begin{matrix} p (β_{jm} | y_{1 : n, j}, A, B_{j (m)}, δ_{jm}, w_{jm}) & \propto p (β_{jm} | δ_{jm}) \prod_{c = 0}^{2^{K} - 1} \frac{{(exp (η_{jcm}))}^{n_{jcm}}}{{(1 + exp (η_{jcm}))}^{n_{c}}} \\ \propto p (β_{jm} | δ_{jm}) \prod_{c = 0}^{2^{K} - 1} exp ({\tilde{y}}_{jcm} η_{jcm} - \frac{w_{jcm} η_{jcm}^{2}}{2}), \end{matrix}

where ${\tilde{y}}_{jcm} = n_{jcm} - n_{c} / 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\tilde{y}}}_{jcm}=n_{jcm}-n_c/2$$\end{document} and $w_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$w_{jm}$$\end{document} is a $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} vector with element c defined as a PG random variable $w_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$w_{jcm}$$\end{document} with full conditional distribution of $w_{jcm} | A, B_{j} \sim PG (n_{c}, η_{jcm})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$w_{jcm}|\varvec{A},\varvec{B}_j\sim \text {PG}(n_c,\eta _{jcm})$$\end{document} . We see,

(B18)

\begin{matrix} p (β_{jm} | y_{1 : n, j}, A, B_{j (m)}, δ_{jm}, w_{jm}) \propto p (β_{jm} ∣ δ_{jm}) \prod_{c = 0}^{2^{K} - 1} exp (- \frac{ω_{jcm}}{2} {(\frac{{\tilde{y}}_{jcm}}{ω_{jcm}} - η_{jcm})}^{2}) \\ = p (β_{jm} ∣ δ_{jm}) \prod_{c = 0}^{2^{K} - 1} exp (- \frac{ω_{jcm}}{2} {(z_{jcm} - a_{c}^{⊤} β_{jm})}^{2}) \\ = p (β_{jm} ∣ δ_{jm}) exp (- \frac{1}{2} {(z_{jm} - A β_{jm})}^{⊤} Ω_{jm} (z_{jm} - A β_{jm})) \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned}&p(\varvec{\beta }_{jm}|\varvec{y}_{1:n,j},\varvec{A},\varvec{B}_{j(m)},\varvec{\delta }_{jm},\varvec{w}_{jm})\propto p(\varvec{\beta }_{jm}\mid \varvec{\delta }_{jm}) \prod _{c=0}^{2^K-1} \exp \left\{ -\frac{\omega _{jcm}}{2} \left( \frac{{{\tilde{y}}}_{jcm}}{\omega _{jcm}}-\eta _{jcm}\right) ^2\right\} \nonumber \\&\quad = p(\varvec{\beta }_{jm}\mid \varvec{\delta }_{jm}) \prod _{c=0}^{2^K-1} \exp \left\{ -\frac{\omega _{jcm}}{2} \left( z_{jcm}-\varvec{a}_c^\top \varvec{\beta }_{jm}\right) ^2\right\} \nonumber \\&\quad = p(\varvec{\beta }_{jm}\mid \varvec{\delta }_{jm}) \exp \left\{ -\frac{1}{2}\left( \varvec{z}_{jm}-{\textbf {A}}\varvec{\beta }_{jm}\right) ^\top \varvec{\Omega }_{jm}\left( \varvec{z}_{jm}-{\textbf {A}}\varvec{\beta }_{jm}\right) \right\} \end{aligned}$$\end{document}

where $A$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\textbf {A}}}$$\end{document} is a $2^{K} \times P$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K\times P$$\end{document} design matrix and

(B19)

\begin{matrix} z_{jcm} & = \frac{{\tilde{y}}_{jcm}}{ω_{jcm}} + C_{jcm} \end{matrix}

(B20)

\begin{matrix} z_{jm} & = {(z_{0 j m}, \dots, z_{2^{K} - 1, j m})}^{⊤} . \end{matrix}

Since the prior distribution of $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} given $δ_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\delta }_{jm}$$\end{document} is

(B21)

\begin{matrix} β_{jm} ∣ δ_{jm} \sim N (0, Σ_{jm}), \end{matrix}

where $Σ_{jm} = σ_{β}^{2} diag (v_{j m 0}, \dots, v_{j m, 2^{K} - 1})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Sigma }_{jm}=\sigma _\beta ^2 \text {diag}(v_{jm0},\dots ,v_{jm,2^K-1})$$\end{document} and $v_{jmp} = δ_{jmp} + (1 - δ_{jmp}) / D$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$v_{jmp}=\delta _{jmp}+(1-\delta _{jmp})/D$$\end{document} . Then, adding the prior term from the exponent for $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} yields the posterior distribution

(B22)

\begin{matrix} p (β_{jm} | y_{1 : n, j}, A, B_{j (m)}, δ_{jm}, w_{jm}) & \propto p (β_{jm} ∣ δ_{jm}) \prod_{c = 0}^{2^{K} - 1} exp (- \frac{ω_{jcm}}{2} {(\frac{{\tilde{y}}_{jcm}}{ω_{jcm}} - η_{jcm})}^{2}) \\ \propto exp (- \frac{1}{2} (β_{jm}^{⊤} Σ_{jm}^{- 1} β_{jm} + {(z_{jm} - A β_{jm})}^{⊤} Ω_{jm} (z_{jm} - A β_{jm}))) \\ \propto exp (- \frac{1}{2} {(β_{jm} - μ_{jm})}^{⊤} V_{jm} (β_{jm} - μ_{jm})) . \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\varvec{\beta }_{jm}|\varvec{y}_{1:n,j},\varvec{A},\varvec{B}_{j(m)},\varvec{\delta }_{jm},\varvec{w}_{jm})&\propto p(\varvec{\beta }_{jm}\mid \varvec{\delta }_{jm}) \prod _{c=0}^{2^K-1} \exp \left\{ -\frac{\omega _{jcm}}{2} \left( \frac{{{\tilde{y}}}_{jcm}}{\omega _{jcm}}-\eta _{jcm}\right) ^2\right\} \nonumber \\&\propto \exp \left\{ -\frac{1}{2}\left( \varvec{\beta }_{jm}^{\top }\varvec{\Sigma }_{jm}^{-1} \varvec{\beta }_{jm}+\left( \varvec{z}_{jm}-{{\textbf {A}}}\varvec{\beta }_{jm}\right) ^\top \varvec{\Omega }_{jm}\left( \varvec{z}_{jm}-{{\textbf {A}}}\varvec{\beta }_{jm}\right) \right) \right\} \nonumber \\&\propto \exp \left\{ -\frac{1}{2} \left( \varvec{\beta }_{jm}-\varvec{\mu }_{jm}\right) ^\top {\textbf{V}}_{jm} \left( \varvec{\beta }_{jm}-\varvec{\mu }_{jm}\right) \right\} . \end{aligned}$$\end{document}

Therefore, the full conditional distribution of $β_{jm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm}$$\end{document} is

(B23)

\begin{matrix} β_{jm} & ∣ Y_{1 : n, j}, A, B_{j (m)}, δ_{jm}, w_{jm} \sim N_{2^{K}} (μ_{jm}, V_{jm}) \end{matrix}

(B24)

\begin{matrix} V_{jm} & = A^{⊤} Ω_{jm} A + Σ_{jm}^{- 1} \end{matrix}

(B25)

\begin{matrix} μ_{jm} & = V_{jm}^{- 1} A^{⊤} Ω_{jm} z_{jm} = V_{jm}^{- 1} A^{⊤} ({\tilde{y}}_{jm} + Ω_{jm} C_{jm}) \end{matrix}

where $Σ_{jm} = σ_{β}^{2} diag (v_{j m 0}, \dots, v_{jmP})$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Sigma }_{jm}=\sigma _\beta ^2 \text {diag}(v_{jm0},\dots ,v_{jmP})$$\end{document} and $v_{jmp} = δ_{jmp} + (1 - δ_{jmp}) / D$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$v_{jmp}=\delta _{jmp}+(1-\delta _{jmp})/D$$\end{document} . Note we use the second equality in Eq. B25 to avoid numerical issues associated with dividing by a $ω_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\omega _{jcm}$$\end{document} that is zero.

Similarly, if we instead sample one coefficient at a time, we need the full conditional distribution of $β_{jmp}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{jmp}$$\end{document} as follows:

(B26)

\begin{matrix} p (β_{jmp} | y_{1 : n, j}, A, B_{j (m)}, q_{j}, w_{jm}) & \propto p (β_{jmp}) \prod_{c = 0}^{2^{K} - 1} exp (- \frac{ω_{jcm}}{2} {(\frac{{\tilde{y}}_{jcm}}{ω_{jcm}} - η_{jcm})}^{2}) \\ = p (β_{jmp}) exp (- \frac{1}{2} {(z_{jm} - A β_{jm})}^{⊤} Ω_{jm} (z_{jm} - A β_{jm})) \\ \propto exp (- \frac{β_{jmp}^{2}}{2 Σ_{jmp}}) exp (- \frac{1}{2} {({\tilde{z}}_{jm} - A_{p} β_{jmp})}^{⊤} Ω_{jm} ({\tilde{z}}_{jm} - A_{p} β_{jmp})) \\ \propto {(β_{jm} - μ_{jm})}^{⊤} V_{jm} (β_{jm} - μ_{jm}) . \end{matrix}

\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} p(\beta _{jmp}|\varvec{y}_{1:n,j},\varvec{A},\varvec{B}_{j(m)},\varvec{q}_j,\varvec{w}_{jm})&\propto p(\beta _{jmp}) \prod _{c=0}^{2^K-1} \exp \left\{ -\frac{\omega _{jcm}}{2} \left( \frac{{{\tilde{y}}}_{jcm}}{\omega _{jcm}}-\eta _{jcm}\right) ^2\right\} \nonumber \\&= p(\beta _{jmp}) \exp \left\{ -\frac{1}{2}\left( \varvec{z}_{jm}-{{\textbf {A}}}\varvec{\beta }_{jm}\right) ^\top \varvec{\Omega }_{jm}\left( \varvec{z}_{jm}-{{\textbf {A}}}\varvec{\beta }_{jm}\right) \right\} \nonumber \\&\propto \exp \left\{ -\frac{\beta _{jmp}^2}{2\varvec{\Sigma }_{jmp}} \right\} \exp \left\{ -\frac{1}{2} \left( \tilde{\varvec{z}}_{jm}-\varvec{A}_p\beta _{jmp}\right) ^\top \varvec{\Omega }_{jm}\left( \tilde{\varvec{z}}_{jm}-\varvec{A}_p\beta _{jmp}\right) \right\} \nonumber \\&\propto \left( \varvec{\beta }_{jm}-\varvec{\mu }_{jm}\right) ^\top {\textbf{V}}_{jm} \left( \varvec{\beta }_{jm}-\varvec{\mu }_{jm}\right) . \end{aligned}$$\end{document}

Therefore, the full conditional distribution for $β_{jmp}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta _{jmp}$$\end{document} given $Y_{1 : n, j}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}_{1:n,j}$$\end{document} , $A$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}$$\end{document} , $β_{j m (p)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\beta }_{jm(p)}$$\end{document} , and $B_{j (m)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_{j(m)}$$\end{document} is

(B27)

\begin{matrix} β_{jmp} ∣ Y_{1 : n, j}, δ_{jmp}, A, β_{j m (p)}, B_{j (m)} \sim N (μ_{jmp}, σ_{jmp}^{2}), \end{matrix}

(B28)

\begin{matrix} σ_{jmp}^{2} & = \frac{1}{A_{p}^{⊤} Ω_{jm} A_{p} + 1 / σ_{β}^{2} v_{jmp}}, \end{matrix}

(B29)

\begin{matrix} μ_{jmp} & = σ_{jmp}^{2} A_{p}^{⊤} Ω_{jm} {\tilde{z}}_{jm} = σ_{jmp}^{2} A_{p}^{⊤} ({\tilde{y}}_{jm} + Ω_{jm} C_{jm} - Ω_{jm} A_{(p)} β_{j m (p)}), \end{matrix}

(B30)

\begin{matrix} {\tilde{z}}_{jm} & = z_{jm} - A_{(p)} β_{j m (p)} = z_{jm} - A β_{jm} + A_{p} β_{jmp}, \end{matrix}

where $A_{p}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}_p$$\end{document} is column p of $A$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\textbf {A}}}$$\end{document} and $A_{(p)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\textbf {A}}}_{(p)}$$\end{document} excludes column p of $A$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\textbf {A}}}$$\end{document} . Note computation of the conditional mean and variance requires, $A_{p}^{⊤} Ω_{jm} A_{p} = \sum_{c = 0}^{2^{K} - 1} A_{pc} ω_{jcm}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\textbf {A}}}_{p}^\top \varvec{\Omega }_{jm}{{\textbf {A}}}_{p}=\sum _{c=0}^{2^K-1} \text{ A}_{pc}\omega _{jcm}$$\end{document} .

Appendix C Starting Values of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document}

In this appendix, we will show the starting value generation steps of coefficients in $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} .

Perform a $k -$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k-$$\end{document} means clustering (MacQueen, Reference MacQueen1967) on the observed responses.
1. First, define the binary response array $Y^{b}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^b$$\end{document} with size $N \times J \times M$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N\times J\times M$$\end{document} , where $Y_{ijm}^{b} = I (Y_{ij} = m)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Y_{ijm}^{b}=\varvec{I}\left\{ Y_{ij}=m \right\} $$\end{document} . Then, reshape the three dimensional array $Y^{b}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^b$$\end{document} into a matrix $Y^{*}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^*$$\end{document} with size $N \times J M$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N\times JM$$\end{document} , through combining columns of every slice of $Y^{b}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^b$$\end{document} .
2. Partition the $J M -$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$JM-$$\end{document} dimensional vectors corresponding to the N respondents $Y^{*} = {(y_{1}^{*}, \dots, y_{N}^{*})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Y^*=(y_1^*,\ldots ,y_N^*)^\top $$\end{document} into $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} distinct groups with $n_{c^{'}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n_{c^\prime }$$\end{document} respondents per group.
3. Initialize the category response probabilities described in Eq. 1 such that $θ_{j^{'} c^{'}} \in Θ_{J M \times 2^{K}}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{j^\prime c^\prime }\in \varvec{\Theta }_{JM\times 2^K}$$\end{document} is the $j^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j^\prime $$\end{document} -th element of the cluster center for group $c^{'}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c^\prime $$\end{document} .
Assuming K factors, perform an exploratory factor analysis (EFA) on the slices of observed responses array $Y_{m}^{b}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Y}^b_m$$\end{document} , $m = 1, \dots, M - 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m=1,\ldots ,M-1$$\end{document} .
1. Generate factor scores for the $i = 1, \dots, N$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$i = 1,\ldots ,N$$\end{document} respondents across the $j = 1, \dots, J$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$j = 1,\ldots ,J$$\end{document} items and $k = 1, \dots, K$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k = 1,\ldots ,K$$\end{document} attributes, ${\tilde{θ}}_{ik}^{m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tilde{\theta }_{ik}^m$$\end{document} .
2. Compute within-cluster averages of the factor scores ${\tilde{θ}}_{c^{^{'}} k}^{m} = \frac{1}{n_{c}^{^{'}}} \sum_{i^{c^{'}} = 1}^{n_{c^{'}}} {\tilde{θ}}_{i^{c^{'}} k}^{m}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tilde{\theta }_{c^{^\prime }k}^m = \dfrac{1}{n_c^{^\prime }}\sum _{i^{c^\prime }=1}^{n_{c^\prime }} \tilde{\theta }_{i^{c^\prime } k}^m$$\end{document} for each of the $2^{K}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K$$\end{document} groups.
3. Dichotomize the within-cluster factor score averages into pseudo-attributes as ${\tilde{α}}_{c^{^{'}} k}^{m} = I ({\tilde{θ}}_{c^{^{'}} k}^{m} > 0)$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tilde{\alpha }_{c^{^\prime }k}^m = I\left( \tilde{\theta }_{c^{^\prime }k}^m>0 \right) $$\end{document} .
Define the pseudo-attribute profiles ${\tilde{α}}_{c^{^{'}}}^{m} = {({\tilde{α}}_{c^{^{'}} 1}^{m}, \dots, {\tilde{α}}_{c^{^{'}} K}^{m})}^{⊤}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\tilde{\varvec{\alpha }}_{c^{^\prime }}^m = (\tilde{\alpha }_{c^{^\prime }1}^m,\ldots ,\tilde{\alpha }_{c^{^\prime }K}^m)^\top $$\end{document} in terms of the binary-integer bijection ${({\tilde{α}}_{c^{^{'}}}^{m})}^{⊤} v = c$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(\tilde{\varvec{\alpha }}_{c^{^\prime }}^m)^\top \varvec{v} = c$$\end{document} .
Based on the bijection integers in step 3, swap the label of latent class of the initialized category response probabilities matrix got in step 1.
For $m = 1, 2, \dots, M - 1$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$m=1,2,\ldots ,M-1$$\end{document} , initialize the m-th slice of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document} as follows:
1. Define the category response probability as $L o g i t^{- 1} (θ_{jcm}) = α_{c}^{⊤} β_{jm}^{(0)} \in M_{α β : J \times 2^{K}}^{(0)}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Logit^{-1}(\theta _{jcm}) = \varvec{\alpha }_c^\top \varvec{\beta }_{jm}^{(0)}\in \varvec{M}^{(0)}_{\alpha \beta :J\times 2^K}$$\end{document} .
2. Calculate $B_{m}^{(0)} = M_{α β}^{(0)} A {(A^{⊤} A)}^{- 1}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}_m^{(0)} = \varvec{M}^{(0)}_{\alpha \beta }\varvec{A}(\varvec{A}^\top \varvec{A})^{-1}$$\end{document} , where $A$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{A}$$\end{document} is the $2^{K} \times P$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2^K \times P$$\end{document} design matrix.

Appendix D Simulation Results for Dense $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document}

The unknown denser true $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} and true $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices for each option are shown as follows (columns in $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} follow the same order as the design vector shown in Eq. 3):

$Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} cube with $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document}
(B31) $\begin{matrix} Δ_{m = 1} = (\begin{matrix} 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 1 & 1 & 1 \\ 1 & 1 & 1 & 1 \end{matrix}), Δ_{m = 2} = (\begin{matrix} 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \end{matrix}), Δ_{m = 3} = (\begin{matrix} 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 0 & 0 \\ 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Delta }_{m=1}= \left( \begin{array}{llll} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 &{} 1 \end{array}\right) , \quad \varvec{\Delta }_{m=2}=\left( \begin{array}{llll} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \end{array}\right) , \quad \varvec{\Delta }_{m=3}=\left( \begin{array}{llll} 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 \end{array}\right) \end{aligned}$$\end{document}
$Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} cube with $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document}
(B32) $\begin{matrix} Δ_{m = 1} = (\begin{matrix} 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 1 & 0 & 0 & 1 \\ 1 & 1 & 1 & 0 & 1 & 0 & 0 \\ 1 & 1 & 0 & 1 & 0 & 1 & 0 \\ 1 & 0 & 1 & 1 & 0 & 0 & 1 \\ 1 & 1 & 1 & 0 & 1 & 0 & 0 \\ 1 & 1 & 0 & 1 & 0 & 1 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \end{matrix}), Δ_{m = 2} = (\begin{matrix} 1 & 1 & 1 & 0 & 1 & 0 & 0 \\ 1 & 1 & 1 & 0 & 1 & 0 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 1 & 0 & 0 & 1 \\ 1 & 0 & 1 & 1 & 0 & 0 & 1 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 1 & 0 & 1 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \end{matrix}), Δ_{m = 3} = (\begin{matrix} 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 0 & 1 & 0 & 0 & 0 & 0 \\ 1 & 1 & 0 & 1 & 0 & 1 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 1 & 0 & 1 & 0 & 0 \\ 1 & 0 & 1 & 1 & 0 & 0 & 1 \\ 1 & 1 & 0 & 1 & 0 & 1 & 0 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 1 & 0 & 1 & 0 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \\ 1 & 0 & 0 & 1 & 0 & 0 & 0 \\ 1 & 0 & 1 & 1 & 0 & 0 & 1 \\ 1 & 1 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & 1 & 1 & 1 & 1 & 1 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} \varvec{\Delta }_{m=1}= \left( \begin{array}{llllllll} 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 1 &{} 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 &{} 1 &{} 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \end{array}\right) , \varvec{\Delta }_{m=2}= \left( \begin{array}{llllllll} 1 &{} 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 1 &{} 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 1 &{} 1 &{} 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \end{array}\right) , \varvec{\Delta }_{m=3}= \left( \begin{array}{llllllll} 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 1 &{} 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 0 &{} 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 0 &{} 1 &{} 0 &{} 0 &{} 0 \\ 1 &{} 0 &{} 1 &{} 1 &{} 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 &{} 1 \end{array}\right) \end{aligned}$$\end{document}
$Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices with $K = 2$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=2$$\end{document}
(B33) $\begin{matrix} Q_{m = 1} = (\begin{matrix} 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 1 \\ 1 & 1 \\ 1 & 1 \end{matrix}), Q_{m = 2} = (\begin{matrix} 0 & 1 \\ 1 & 0 \\ 1 & 1 \\ 1 & 0 \\ 1 & 0 \\ 1 & 1 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 1 \\ 0 & 1 \\ 1 & 1 \\ 0 & 1 \\ 1 & 0 \\ 1 & 0 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \end{matrix}), Q_{m = 3} = (\begin{matrix} 1 & 0 \\ 0 & 1 \\ 0 & 1 \\ 1 & 0 \\ 1 & 0 \\ 1 & 0 \\ 1 & 0 \\ 0 & 1 \\ 0 & 1 \\ 0 & 1 \\ 1 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 1 \\ 0 & 1 \\ 1 & 0 \\ 0 & 1 \\ 1 & 1 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} {\varvec{Q}}_{m=1}= \left( \begin{array}{ll} 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 1 \\ 1 &{} 1 \\ 1 &{} 1 \end{array}\right) , \quad {\varvec{Q}}_{m=2}=\left( \begin{array}{ll} 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 1 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 1 \\ 0 &{} 1 \\ 1 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \end{array}\right) , \quad {\varvec{Q}}_{m=3}=\left( \begin{array}{ll} 1 &{} 0 \\ 0 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 1 &{} 0 \\ 1 &{} 0 \\ 1 &{} 0 \\ 0 &{} 1 \\ 0 &{} 1 \\ 0 &{} 1 \\ 1 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 1 \\ 0 &{} 1 \\ 1 &{} 0 \\ 0 &{} 1 \\ 1 &{} 1 \end{array}\right) \end{aligned}$$\end{document}
$Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document} matrices with $K = 3$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$K=3$$\end{document}
(B34) $\begin{matrix} Q_{m = 1} = (\begin{matrix} 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 0 & 1 \\ 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 1 & 1 \\ 1 & 1 & 0 \\ 1 & 0 & 1 \\ 0 & 1 & 1 \\ 1 & 1 & 0 \\ 1 & 0 & 1 \\ 1 & 1 & 1 \\ 1 & 1 & 1 \\ 1 & 1 & 1 \end{matrix}), Q_{m = 2} = (\begin{matrix} 1 & 1 & 0 \\ 1 & 1 & 0 \\ 1 & 1 & 1 \\ 0 & 1 & 0 \\ 0 & 0 & 1 \\ 1 & 1 & 1 \\ 0 & 0 & 1 \\ 0 & 1 & 1 \\ 0 & 1 & 1 \\ 1 & 1 & 1 \\ 1 & 0 & 0 \\ 1 & 1 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \\ 1 & 0 & 1 \\ 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \end{matrix}), Q_{m = 3} = (\begin{matrix} 0 & 1 & 0 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \\ 0 & 1 & 0 \\ 1 & 0 & 1 \\ 0 & 0 & 1 \\ 1 & 1 & 0 \\ 0 & 1 & 1 \\ 1 & 0 & 1 \\ 0 & 0 & 1 \\ 1 & 1 & 1 \\ 1 & 0 & 0 \\ 1 & 1 & 0 \\ 1 & 1 & 1 \\ 0 & 0 & 1 \\ 0 & 1 & 1 \\ 1 & 0 & 0 \\ 1 & 1 & 1 \end{matrix}) \end{matrix}$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\begin{aligned} {\varvec{Q}}_{m=1}= \left( \begin{array}{lll} 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 \\ 0 &{} 1 &{} 1 \\ 1 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 \\ 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 \end{array}\right) , \quad {\varvec{Q}}_{m=2}=\left( \begin{array}{lll} 1 &{} 1 &{} 0 \\ 1 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 \\ 0 &{} 1 &{} 0 \\ 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 1 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 1 \\ 0 &{} 1 &{} 1 \\ 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \end{array}\right) , \quad {\varvec{Q}}_{m=3}=\left( \begin{array}{lll} 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 0 \\ 0 &{} 1 &{} 0 \\ 0 &{} 1 &{} 0 \\ 1 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 0 \\ 0 &{} 1 &{} 1 \\ 1 &{} 0 &{} 1 \\ 0 &{} 0 &{} 1 \\ 1 &{} 1 &{} 1 \\ 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 0 \\ 1 &{} 1 &{} 1 \\ 0 &{} 0 &{} 1 \\ 0 &{} 1 &{} 1 \\ 1 &{} 0 &{} 0 \\ 1 &{} 1 &{} 1 \end{array}\right) \end{aligned}$$\end{document}

Simulation results are shown in Table 6.

Table 6 Summary of simulation performance for RLCM with dense $Δ$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} and $Q$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document}

MAD = mean absolute deviation; EAR = element-wise accuracy rate

Footnotes

MAD = mean absolute deviation; EAR = element-wise accuracy rate

Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

References

Allman, E. S., Matias, C., Rhodes, J. A.. (2009). Identifiability of parameters in latent structure models with many observed variables. Annals of Statistics, 37, 3099–3132.CrossRef Google Scholar

Bacci, S., Bartolucci, F., Gnaldi, M.. (2014). A class of multidimensional latent class IRT models for ordinal polytomous item responses. Communications in Statistics-Theory and Methods, 43(4), 787–800.CrossRef Google Scholar

Balamuta, J. J., & Culpepper, S. A. (2022). Exploratory restricted latent class models with monotonicity requirements under Polya–gamma data augmentation. Psychometrika 1–43.CrossRef Google Scholar

Bartolucci, F.. (2007). A class of multidimensional IRT models for testing unidimensionality and clustering items. Psychometrika, 72, 141–157.CrossRef Google Scholar

Bradshaw, L., Templin, J.. (2014). Combining item response theory and diagnostic classification models: A psychometric model for scaling ability and diagnosing misconceptions. Psychometrika, 79(3), 403–425.CrossRef Google Scholar PubMed

Brooks, S. P., Gelman, A.. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7(4), 434–455.CrossRef Google Scholar

Chen, J., de la Torre, J.. (2013). A general cognitive diagnosis model for expert-defined polytomous attributes. Applied Psychological Measurement, 37(6), 419–437.CrossRef Google Scholar

Chen, J., Zhou, H.. (2017). Test designs and modeling under the general nominal diagnosis model framework. PLoS ONE, 12(6.Google Scholar PubMed

Chen, Y., Culpepper, S., Liang, F.. (2020). A sparse latent class model for cognitive diagnosis. Psychometrika, 85, 121–153.CrossRef Google Scholar PubMed

Chen, Y., Liu, J., Xu, G., Ying, Z.. (2015). Statistical analysis of Q-matrix based diagnostic classification models. Journal of the American Statistical Association, 110(510), 850–866.CrossRef Google Scholar

Chen, Y., Liu, Y., Culpepper, S. A., Chen, Y.. (2021). Inferring the number of attributes for the exploratory DINA model. Psychometrika, 86(1), 30–64.CrossRef Google Scholar PubMed

Chiu, C.-Y., Douglas, J., Li, X.. (2009). Cluster analysis for cognitive diagnosis: Theory and applications. Psychometrika, 74, 633–665.CrossRef Google Scholar

Culpepper, S. A.. (2019). An exploratory diagnostic model for ordinal responses with binary attributes: Identifiability and estimation. Psychometrika, 84(4), 921–940.CrossRef Google Scholar PubMed

Culpepper, S. A., & Balamuta, J. J. (2021). Inferring latent structure in polytomous data with a higher-order diagnostic model. Multivariate Behavioral Research 1–19.Google Scholar

Dang, N. V. (2015). Complex powers of analytic functions and meromorphic renormalization in QFT. arXiv preprint arXiv:1503.00995 .Google Scholar

De La Torre, J.. (2009). A cognitive diagnosis model for cognitively based multiple-choice options. Applied Psychological Measurement, 33(3), 163–183.CrossRef Google Scholar

de la Torre, J.. (2011). The generalized DINA model framework. Psychometrika, 76(2), 179–199.CrossRef Google Scholar

DeYoreo, M., Reiter, J. P., Hillygus, D. S.. (2017). Bayesian mixture models with focused clustering for mixed ordinal and nominal data. Bayesian Analysis, 12(3), 679–703.CrossRef Google Scholar

DiBello, L. V., Henson, R. A., Stout, W. F.. (2015). A family of generalized diagnostic classification models for multiple choice option-based scoring. Applied Psychological Measurement, 39(1), 62–79.CrossRef Google Scholar PubMed

Dunson, D. B., Xing, C.. (2009). Nonparametric Bayes modeling of multivariate categorical data. Journal of the American Statistical Association, 104(487), 1042–1051.CrossRef Google Scholar

Fang, G., Liu, J., Ying, Z.. (2019). On the identifiability of diagnostic classification models. Psychometrika, 84(1), 19–40.CrossRef Google Scholar PubMed

George, E. I., McCulloch, R. E.. (1993). Variable selection via Gibbs sampling. Journal of the American Statistical Association, 88(423), 881–889.CrossRef Google Scholar

Gnaldi, M., Bacci, S., Kunze, T., Greiff, S.. (2020). Students’ complex problem solving profiles. Psychometrika, 85, 469–501.CrossRef Google Scholar PubMed

Goodman, L. A.. (1974). Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika, 61(2), 215–231.CrossRef Google Scholar

Gu, Y., & Dunson, D. B. (2021). Bayesian pyramids: Identifiable multilayer discrete latent structure models for discrete data. arXiv preprint arXiv:2101.10373 .Google Scholar

Holmes, C. C., Held, L.. (2006). Bayesian auxiliary variable models for binary and multinomial regression. Bayesian Analysis, 1(1), 145–168.Google Scholar

Huang, G.-H., Bandeen-Roche, K.. (2004). Building an identifiable latent class model with covariate effects on underlying and measured variables. Psychometrika, 69(1), 5–32.CrossRef Google Scholar

Jiang, Z., Templin, J.. (2019). Gibbs samplers for logistic item response models via the Pólya-Gamma distribution: A computationally efficient data-augmentation strategy. Psychometrika, 84(2), 358–374.CrossRef Google Scholar PubMed

Jimenez, A., Balamuta, J. J., & Culpepper, S. A. (2023). A sequential exploratory diagnostic model using a Pólya-gamma data augmentation strategy. British Journal of Mathematical and Statistical Psychology.CrossRef Google Scholar

Kruskal, J.. (1977). Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics. Linear Algebra and its Applications, 18, 95–138.CrossRef Google Scholar

Kruskal, J. B.. (1976). More factors than subjects, tests and treatments: An indeterminacy theorem for canonical decomposition and individual differences scaling. Psychometrika, 41(3), 281–293.CrossRef Google Scholar

Kuo, B.-C., Chen, C.-H., Yang, C.-W., Mok, M. M. C.. (2016). Cognitive diagnostic models for tests with multiple-choice and constructed-response items. Educational Psychology, 36(6), 1115–1133.CrossRef Google Scholar

Ma, W., de la Torre, J.. (2016). A sequential cognitive diagnosis model for polytomous responses. British Journal of Mathematical and Statistical Psychology, 69(3), 253–275.CrossRef Google Scholar PubMed

Ma, W., de la Torre, J.. (2019). Category-level model selection for the sequential G-DINA model. Journal of Educational and Behavioral Statistics, 44(1), 45–77.CrossRef Google Scholar

MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth berkeley symposium on mathematical statistics and probability (Vol. 1, pp. 281–297).Google Scholar

Matsaglia, G., Styan, G. P. H.. (1974). Equalities and inequalities for ranks of matrices. Linear and Multilinear Algebra, 2(3), 269–292.CrossRef Google Scholar

McHugh, R. B.. (1956). Efficient estimation and local identification in latent class analysis. Psychometrika, 21(4), 331–347.CrossRef Google Scholar

Mityagin, B. S.. (2020). The zero set of a real analytic function. Mathematical Notes, 107, 529–530.CrossRef Google Scholar

Murray, J. S., Reiter, J. P.. (2016). Multiple imputation of missing categorical and continuous values via Bayesian mixture models with local dependence. Journal of the American Statistical Association, 111(516), 1466–1479.CrossRef Google Scholar

Polson, N. G., Scott, J. G., Windle, J.. (2013). Bayesian inference for logistic models using Pólya-gamma latent variables. Journal of the American Statistical Association, 108(504), 1339–1349.CrossRef Google Scholar

Royle, J. A., Link, W. A.. (2005). A general class of multinomial mixture models for anuran calling survey data. Ecology, 86(9), 2505–2512.CrossRef Google Scholar

Shear, B. R., & Roussos, L. A. (2017). Validating a distractor-driven geometry test using a generalized diagnostic classification model. In Understanding and investigating response processes in validation research (pp. 277–304). Springer.CrossRef Google Scholar

Si, Y., Reiter, J. P.. (2013). Nonparametric Bayesian multiple imputation for incomplete categorical variables in large-scale assessment surveys. Journal of Educational and Behavioral Statistics, 38(5), 499–521.CrossRef Google Scholar

Templin, J., Henson, R. A., Rupp, E., Jang, A. A., & Ahmed, M. (2008). Cognitive diagnosis models for nominal response data. New York, NY: In Annual Meeting of the National Council on Measurement in Education.Google Scholar

Vermunt, J. K., Van Ginkel, J. R., Van der Ark, L. A., Sijtsma, K.. (2008). Multiple imputation of incomplete categorical data using latent class analysis. Sociological Methodology, 38(1), 369–397.CrossRef Google Scholar

Wagner, R. F., Wells, K. A.. (1985). A refined neurobehavioral inventory of hemispheric preference. Journal of Clinical Psychology, 41(5), 671–676.3.0.CO;2-1>CrossRef Google Scholar PubMed

Xu, G.. (2017). Identifiability of restricted latent class models with binary responses. Annals of Statistics, 45(2), 675–707.CrossRef Google Scholar

Xu, G., Shang, Z.. (2018). Identifying latent structures in restricted latent class models. Journal of the American Statistical Association, 113(523), 1284–1295.CrossRef Google Scholar

Yigit, H. D., Sorrel, M. A., de la Torre, J.. (2019). Computerized adaptive testing for cognitively based multiple-choice data. Applied Psychological Measurement, 43(5), 388–401.CrossRef Google Scholar PubMed

Table 1 Summary of simulation performance for RLCM and ULCM.

Table 2 Summary of mean absolute deviations (MADs) of RLCM and ULCM item response probabilities by item for two selected conditions.

Table 3 Wagner preference inventory items, anchors, and response frequencies.

Figure 1 The maximum PSRF for Wagner Preference Inventory data.

Table 4 Estimated Θ^\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hat{\varvec{\Theta }}$$\end{document} for Wagner Preference Inventory data.

Table 5 Estimated distribution of attributes in Wagner Preference Inventory data.

Table 6 Summary of simulation performance for RLCM with dense Δ\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\Delta }$$\end{document} and Q\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{Q}$$\end{document}

Article contents

Restricted Latent Class Models for Nominal Response Data: Identifiability and Estimation

Abstract

Keywords

1. Introduction

2. Overview of Mixture Models for Nominal Responses

2.1. Unstructured Latent Class Models (ULCMs)

2.2. Restricted Latent Class Models (RLCMs)

Example 1

Example 2

Remark 1

Definition 1

Remark 2

Example 3

Example 4

Remark 3

3. Identifiability Issue

3.1. Model Identifiability

Definition 2

3.2. Generic Identifiability

Remark 4

Definition 3

3.3. Identifiability Conditions

Theorem 1

Remark 5

Theorem 2

Remark 6

4. Bayesian Formulation for the Nominal RLCM

5. Monte Carlo Simulation Study

5.1. Settings

5.2. Results

5.3. Unstructured Latent Class Models (ULCMs)

6. Applications

6.1. Wagner Preference Inventory

7. Discussion

Acknowledgements

Appendix A Proof of Theorems

Preliminary Results

Definition 4

Remark 7

Theorem 3

Definition 5

Example 5

Proposition 1

Proof

Remark 8

Proposition 2

Proof

Proof of Theorem 1

Proof of Theorem 2

Proposition 3

Proof

Lemma 1

Proposition 4

Proof

Appendix B Posterior Inference

Conditional Likelihood and Polya Gamma Data Augmentation

Full Conditional Distributions

Appendix C Starting Values of B \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document}

Footnotes

References

Save article to Kindle

Save article to Dropbox

Save article to Google Drive

Reply to: Submit a response

Your details

You have entered the maximum number of contributors

Conflicting interests

Appendix C Starting Values of $B$ \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{B}$$\end{document}