Grobelny J., Michalski R., Weber G.W. (2020). Modeling Human Thinking about Similarities by Neuromatrices in the Perspective of Fuzzy Logic. Neural Computing and Applications. Cited (JCR): 0, Other Cites: 0 IF:4.774 5yIF:4.627 Pt:100
Abstract
In this work, we propose a new method for modeling human reasoning about objects’ similarities. We assume that similarity depends on perceived intensities of objects’ attributes expressed by natural language expressions such as low, medium, and high. We show how to find the underlying structure of the matrix with intensities of objects’ similarities in the factoranalysislike manner. The demonstrated approach is based on fuzzy logic and settheory principles, and it uses only maximum and minimum operators. Similarly to classic eigenvector decomposition, we aim at representing the initial linguisticordinalscale (LOS) matrix as a maxmin product of other LOS matrix and its transpose. We call this reconstructing matrix a neuromatrix because we assume that such a process takes place at the neural level in our brain. We show and discuss on simple, illustrative examples, how the presented way of modeling grasps natural way of reasoning about similarities. The unique characteristics of our approach is treating smaller attribute intensities as less important in making decisions about similarities. This feature is consistent with how the human brain is functioning at a biological level. A neuron fires and passes information further only if input signals are strong enough. The proposal of the heuristic algorithm for finding the decomposition in practice is also introduced and applied to exemplary data from classic psychological studies on perceived similarities between colors and between nations. Finally, we perform a series of simulation experiments showing the effectiveness of the proposed heuristic.
Keywords:
Similarity perception, fuzzy logic, similarity matrix decomposition, neuromatrices, linguistic ordinal scales (LOS), reconstructing similarity matrix
1. Introduction
In our paper we present a new approach to modeling and analyzing human perception of similarities that derives both from cognitive psychology and neurophysiological studies. Though there have been developed a number of models trying to mimic the brain functioning, there is still a variety of issues that are not covered or clear in this regard. In this research, we focus only on modeling of a specific aspect of the human thinking, that is, processing the object’s similarities. As a result, our proposal could be treated only as a small subproblem to the general human cognitive architectures available in the literature such as, ACTR (e.g., [1], [2]), SOAR (e.g., [3], [4]), or EPIC (e.g., [5], [6]. The review of these approaches can be found, e.g., in [7]–[9] whereas interesting discussion of their importance in general artificial intelligence was presented, e.g., in [10], [11].
We assume that similarity depends on perceived intensities of objects’ attributes expressed by natural language expressions such as low, medium, and high, that may be provided, e.g., by an expert. Ordinal scales are very widely used in psychology, sociology, business or marketing, especially in diverse questionnairebased studies. In general, one is able to arrange scale items in an order, e.g., from the smallest to the biggest, from the most to the least preferred, important, usable etc. However, the distances (intervals) between two consecutive items may not be equal throughout the whole scale and are usually unknown. Probably the most popular scale of this type is the Likert scale [12] and its countless variations (e.g., 1. Strongly disagree, 2. Disagree, 3. Neither agree nor disagree, 4. Agree, and 5. Strongly agree). Exact definitions, properties, and applications of different types of scales, can be found, e.g., in the seminal paper of Stevens [13]. The ordinal scale may be presented in various ways, such as numbers, text, or graphical objects. In this paper, we use scales of ordinal nature with items presented as language expressions and call them linguistic ordinal scales (LOS). They are also sometimes referred to as qualitative ordinal scales (e.g., [14]).
Our main goal is to approximate a matrix containing intensities of objects’ similarities evaluated by pairwise comparisons on LOS. For this purpose, we search for such a set of vectors, expressed also on LOS, that multiplied by their transposes using max and min operators, reconstruct the original matrix as close as possible. The sought set of vectors forms a matrix, which we name the neuromatrix.
Some recent studies involving brain imaging (e.g., [15]) show that tasks differing in cognitive load are related with the existence of brain states that cannot be directly associated with presented stimuli. Thus, modeling and searching for hidden structures of similarities may correspond to the physiology of human brain functioning.
In problem solving approaches, it is more and more common to connect such separate fields as neuroscience and computer science. In this regard, analogies to a physiological human brain functioning are gaining increasing attention. For instance, lately two special issues have been devoted to this subject: Braininspired computing and machine learning [16] and Cognitive computing for intelligent application and service [17]. The researchers, in general, try to mimic the human mental cognition as close as possible. The simple neuron based models are becoming to a greater extent complex and similar to the real biological mechanisms taking place in human brains (cf. [18]).
Our approach fits well into this trend. We presume that, the neuromatrix searched for in our proposal reflects the brain activity occurring at the neural level and represents the objectsfactors relations. The matrix of similarities’ intensities, in turn, is a kind of a resulting demonstration of those hidden brain processes that can be observed and registered at the behavioral level. Our proposed method may be treated as an attempt to relate neural characteristics of thinking about similarities with their behavioral representations measured on LOS.
1.1 Background and related work
There is a number of various methods developed and extended over the last decades in different field of science that deal with the data dimensionality reduction problem and finding the data underlying or latent structure. Probably the most known and popular is the Principal Component Analysis (PCA) that derives directly from the classic linear algebra and involves the eigen value and eigen vector decomposition. This approach and its countless modifications have been used by scientists for a variety of purposes in different applications. Currently, it is still common to come across various versions of this method in scientific papers. For example, Zhu and colleagues [19] combined PCA with linear hashing and manifold learning for similarity search in color images while Das et al. [20] used PCA to remove irrelevant features in their hybrid neurofuzzy reduction model for classification purposes. Other contemporary advancements in regarding PCA may be found, e.g., in [21]–[23]. One of the latest and most comprehensive overviews of the data dimensionality reduction techniques has been provided by Ayesha and colleagues [24].
Another widely utilized technique used for uncovering hidden structure of surveys’ data is Factor Analysis (FA). Though, there is a considerable number of theoretical constraints and practical problems with this approach (e.g., related with applying this method to variables measured on interval scale), it is very popular. The concept of FA is similar to PCA but due to controlling the within subjects errors, it is far more computationally challenging. Scientists have also developed more complex and versatile methods that incorporate ideas and computations from FA. These studies led to a common framework called Structural Equation Modelling, which has become, de facto, a standard in studies involving humans answers to various types of surveys. Recommendations on how to apply them in practice are available, e.g., in [25], whereas some recent methodological developments in this area can be found, e.g., in [26]–[28].
Most of the available methods assume that the processed data are measured in ratio or interval scales. However, in many cases, especially in the fields of psychology, marketing, education or sociology, the investigators have only ordinal data at their disposal. Unfortunately, it is still quite common for psychologists and researchers from other fields to use FA or PCA based methods for the data gathered only on the ordinal scales which is, strictly speaking, not fully appropriate. Stevens [13] pays attention to it yet in the 1950ies, pointing out that an ordinal scale allows only for determination of greater or less. Thus, the researcher obtains only the rank order of data. In such a case, there is no guarantee that successive intervals on the scale are equal in size.
Though these approaches are useful in many situations they do not address all the problems associated with their theoretical assumptions (e.g., regarding the nature of the underlying probability distribution). Therefore, researchers have been trying to elaborate new methodologies. The great abundance of misusing the PCA and FA based methods is not justified in the light of the methodological progress on other than ratio or interval scales. For instance, various equivalents of FA for the ordinalscale variables were developed, by Jöreskog and Moustaki [29]. These methods, however, still require some assumptions and they end up with factor loadings which are interpreted as correlations. Despite that, their ideas were further extended in, e.g., [30], [31], and recently in [32].
Lately, Revuelta and colleagues [33] have shown how to apply exploratory and confirmatory analysis to nominal data in Mplus software. Their approach is similar to multinomial logistic regression with unobserved predictors. A version of FA which operates only on binary data (BFA) is described by Belohlavek and Vychodil [34]. Similar proposals were put forward by Boeck and Rosenberg [35], and Widerjans et al. [36]. They developed HICLAS and SIMCLAS models, respectively. The general idea of these methods consists in reconstructing objectsattributes binary matrix I by two binary matrices of relationships: objectsfactors and factorsattributes. Boeck and Rosenberg [35] developed algorithms for performing the reconstruction based on settheoretical terms, such as association, equivalence, and hierarchical implication. They restrict sets of possible vectors, called as bundles, to those that meet the assumed relationships.
The Ordinal HICLAS proposal by Leenen et al. [37] is an extension of the HICLAS model, where the initial binary matrix (objectsattributes) is recreated by bundles containing ordinalscale variables. They employ specially defined association relationships connecting an AND OR logic to obtain hidden factors and hierarchical relationships between objects and factors.
A similar approach was presented by Ganter and Glodeau [38]. The authors showed the way of searching ordinal factors for an initial binary matrix. This, in turn, is an extension of BFA and aims at a factorization by regular binary factors that are determined individually for each ordinalscale category. The model corresponds fully to the disjunctive version of Ordinal HICLAS proposal [37], though the same result is obtained by a slightly different, more mathematically justified method. Moreover, the authors analyze properties of their approach in the context of a formal concept analysis. In this respect, they are moving in the direction developed by Belohlavek et al. [39], [40] where BFA is combined with a formal concept analysis. The formal concept is defined as a subset of the attributes’ relationships containing these objects that have the same attributes and the attributes are common for objects from this set. Belohlavek provided many properties of this approach. In particular, he demonstrated that having the binary objectsattributes relationship, one can always find the solution in the form of sets of factors that fully reconstruct the initial matrix. In specific cases, it is also possible to find the solution including fewer vectors than the number of vectors in the initial matrix [34]. Formal concepts allow to restrict the solutions’ search space and are generated by contextual knowledge about relationships between objects and attributes. In [41], [42], the binary approach is generalized to fuzzy data and relationships, such that properties and theorems from formal concepts used in BFA apply also if attributes and relations are assessed by the truth value from multimodal logic, i.e., by values from the interval [0, 1]. Recent advances regarding formal concept analysis involving dimensionality reduction may also be found, e.g., in [43] and [44].
Another original approach to factorization of matrices was put forward by Lin et al. [45], where the matrix with ordinalscale measures of the objectsattributes relation is explained by vectors representing orthogonal factors.
Apart from the FA group of methods dealing with ordinalscale data, there are also methods that can be specifically and directly applied for similarities between objects and do not require ratio scale variables. The socalled nonmetric MDS [46]–[50] approach are among them. Generally, the MDS class of methods enable to see the dissimilarities in dimensions which facilitate the identification of possible underling similarity structures. The final analysis and interpretation of the results, however, might be troublesome if there are more than three dimensions and if an other than Euclidean space is presumed. This trend of research is still active, some of the latest research include [51]–[53].
1.2 Contribution
In this research, we put forward to use the fuzzy logic and settheory operators for reconstructing objects’ similarities matrix by the searched for (hidden) objectsattributes relation (the neuromatrix). As an input, we take a square, symmetrical fuzzy matrix of similarities between objects denoted S(objectsobjects, n×n). Based on the structure of these values, we try identify factors that could have possibly shaped the similarity ratings. In technical terms, we want to find the socalled reconstructing vectors V(objectsfactors, n×k) that represent the factors underlying the observed similarities. The idea is similar to classic FA. The number of factors (reconstructing vectors) k is either lower or equal to the number of assessed objects. Usually, we would be interested in finding as few factors as possible to reconstruct the initial similarities as well as possible.
The extensive explanations and discussion about the relations, similarities and differences between existing methods and our approach is presented in Section 2.5. The main contribution of this research can be described under the following three perspectives.
From a theoretical point of view, we put forward a new methodology that, to the best of our knowledge, has not been earlier developed and utilized. The proposed concept models human cognitive functioning in relation to objects’ similarities assessments. The presented approach allows to find hidden objectsattributes’ relations based on linguistic expressions and reduce the dimensionality of similarities’ matrix. Our approach is theoretically well grounded and soundly logically justified (cf. Sections 2.1–2.3).
The technical aspect includes the development of the heuristic algorithm that allows for taking advantage of the theoretical proposal in practical applications. The effectiveness of the putforward procedure has been proved in performed simulation experiments. The unique characteristics of the method is treating smaller attribute intensities as less important in making decisions about similarities. This feature is consistent with the way the human brain is functioning at a biological level. A neuron fires and passes information further only if input signals are strong enough.
From the operational and practical application perspective, our proposal extends the arsenal of methods for data dimensionality reduction and finding patterns of an experimental data structure. Additionally, it may be applied for linguistic based or ordinal data, which is not the case in most other approaches. As it was shown on wellknown practical examples, our methodology provides results that can be logically and reasonably interpreted and may allow for better understanding of the examined results. Our approach has a potentially very wide usage in all research concerned with directly assessing objects’ similarities.
The rest of this paper is organized in the following way. First, we show and discuss on simple, illustrative examples how the presented model grasps a natural way of reasoning about similarities. In the next section, we discuss relations and differences between our approach, and other methods. Then, we provide a description of a heuristic algorithm for finding the underlying structure of the square matrix with intensities of objects’ similarities in the factoranalysislike manner. Next, we apply our proposal to real experimental data on perceived color similarities provided by Ekman [54] and reanalyzed by Shepard [55], [56], and to an example about subjective nations’ similarities described by Kruskal and Wish [57, p. 31]. Section 5 presents experimental simulation results of our algorithm for randomly generated matrices and confront them with a brute force approach. Finally, we sum up the described approach, indicate its possible applications, and broadly discuss possible future studies.
2 Modeling Human Thinking About Similarities
2.1 Fuzzy Set Perspective
The idea of the proposed similarity assessment model for a simple case of a single attribute and two objects can be described in the following way: “the X and Y objects are similar if the intensity rating of this attribute for both objects is high.” In the perspective of fuzzy sets and multimodal logic, the intensity level of the attribute A may be specified as the membership function value of the object in the set of “objects having the attribute A at a high intensity level”. Then µA(X) and µA(Y) denote membership function values of X and Y objects, respectively, belonging to the set of objects having the A attribute at a high level of intensity. The relation of similarity can be a fuzzy relation, which is, generally, defined as R(X, Y) = T(μ(X), μ(Y)), where T is any Tnorm or implication. In the presented approach, the fuzzy relation can be expressed as:
SIMILARITY(X, Y) = µA(X) AND µA(Y), (1)
where X, Y ∈ {O}, and O is the set of objects being compared. In terms of fuzzy logic, the described inference model can also be formulated as a logical expression:
SIMILARITY(X, Y) is HIGH IFF (Truth of (A(X) is HIGH) AND Truth of (A(Y) is HIGH)), (2)
where A(X) is an intensity of attribute A for object X.
In both cases we can define and calculate the similarity degree for any two objects. For (1):
SIMILARITY(X, Y) = min{µA(X), µA(Y)}, (3)
whereas for (2):
SIMILARITY(X, Y) is HIGH = min{Truth of (A(X) is HIGH), Truth of (A(Y) is HIGH)}. (4)
In our approach, we assume that SIMILARITY(X, Y) is determined by a human based on the perceived intensity of attribute A, modeled by membership function values or by the truth of (2). The natural way to define and process attributes’ intensities is to use natural language expressions such as low, medium, high, etc. It is reasonable to assume a restricted number of intensity degrees given the psychophysiological resolution, sensitivity of the senses, and the cognitive abilities of the human brain. The intensity granularity may also depend on the context.
The illustrative examples described in the next sections show possible extensions of this way of thinking for a greater number of attributes and objects. In the first example, we took the binary data perspective which is typical to Boolean Factor Analysis (BFA) [34], whereas in the second one, we extend our considerations to LOS values. In the latter example and the algorithm, we adopted a linguistic model for determining and processing the membership function of the degree of truth for intensity levels of attributes. As membership function values and degrees of truth are usually defined in the range of 0–1, linguistic expressions (low, medium, and high) can be replaced with numerical values from such a range (e.g., 0, 0.5, and 1, respectively). Due to the use of only maxmin operators in our approach, such manipulations are not necessary. For clarity, we assign subsequent natural numbers to consecutive levels of attribute intensity.
Table 1. Sample Binary Data of ObjectsAttributes Relation
2.2 Binary Similarity Data Example
Let us say that an expert specifies the similarities between all pairs of six sticks {a, b, c, d, e, f}. Each stick is characterized by two attributes: its length and diameter. The expert is able to assign each stick to two disjunctive length classes: either long or short, and two disjunctive diameter classes: wide and narrow. Table 1 presents an exemplary result of such a procedure. Let us consider two extreme approaches for assessing sticks similarities given this objectsattributes relation: liberal and conservative.
2.2.1 Liberal pattern of similarity derivation
In the first, liberal logical pattern of similarity generation (L_LPSG), the expert may regard as similar two sticks that are assigned to the same class of one attribute or to the same categories for both attributes, i.e., “both are long” OR “both are short” OR “both are wide” OR “both are narrow”.
Let us find objects’ relations separately for each attribute by computing the Cartesian product of appropriate vectors taken from Table 1 using logical AND. By applying logical OR to these matrices we obtain the objects’ similarities matrix denoted as SL(Bin) (“L” – for ”liberal” and “Bin” – for “binary”), i.e., sij is one when in any of these matrices the (i, j)th element is one. The zero value will appear in sij only if in all matrices the (i, j)th element is equal zero. As a result, we obtain (5):
As it was demonstrated by Belohlavek and Vychodil [34], vectors from Table 1 may be treated as a matrix of specifying factors. Thus, the similarity relation matrix can be obtained by (6):
Table 2. Sample LOS Intensities of ObjectsAttributes Relation
2.2.2 Conservative pattern of similarity derivation
In the second, conservative logical pattern of similarity generation (C_LPSG), two sticks are similar only when they have both attributes assigned to the same categories, i.e., (“both are long” AND “both are wide”) OR (“both are long” AND “both are narrow”) OR (“both are short” AND “both are wide”) OR (“both are short” AND “both are narrow”).
In this pattern of eliciting similarities, the matrix of the objectsattributes relation consists of column vectors representing joint attributes and may take the following form (7):
By applying the same procedure as for the first way of thinking, we obtain the subsequent similarity matrix denoted as SC(Bin) (8), where “C” refers to conservative and “Bin” to “binary”:
It can clearly be observed that matrices SL(Bin) and SC(Bin) differ significantly since they reflect various ways of thinking about similarities.
2.3 Our Approach: LOS Similarity Data Example
In our method we want to factorize matrix S with objects’ similarities by finding the matrix V such as V ◦ VT S. In contrast to the previous example, here, both matrices S and V include LOS values. It seems that this approach is more realistic than the one employing only binary relations. We modified the binary example presented above such as the objectsattributes relations are given on an ordinal scale by means of natural language expressions, that is, low, medium (med), and high represented by numbers 1, 2, and 3, respectively. Table 2 contains possible data under these assumptions.
2.3.1 Liberal Pattern of Similarity Derivation
By applying the schemes of thinking from the binary variables case and using similar logical expressions, one may try to construct similarities matrices for LOS values. Obviously, it is not possible to use the same logical operators as they are only defined for binary variables. The natural extension of the matrix Boolean product is a maxmin operation, where OR corresponds to max and AND to min. Within the sets theory the summation is replaced by the max operator whereas the multiplication by the min one. It can be noticed that the Boolean matrix product is just specific case of the maxmin operation. This type of a construct is used as a method of relations composition especially in the area of fuzzy sets and fuzzy logic (e.g., [58]–[60]).
In Appendix A, we show that the maxmin operation can be used for constructing LOS similarities analogously as in the Boolean data example. The similarities matrix is created by means of a union of objects’ similarities relations with respect to individual attributes (simple or complex). Such a procedure is equivalent to performing maxmin product of V and VT. The neuromatrix V may contain single vectors of objectsattributes relations or vectors being a logical combination of two or more attributes like in the second scheme of eliciting objects’ similarities.
Irrespective of the procedure of determining objects’ similarities, we assume that each object is fully similar to itself, therefore diagonal items have the highest similarity scale value. Additionally, we assume that object i is similar to j with the same extent as object j to i, thus the similarities matrix is symmetric.
Applying the L_LPSG pattern of eliciting similarities and performing the same maxmin operation as in the in the binary example (V ◦ VT) on vectors from Table 2, we get (9):
2.3.2 Conservative Pattern of Similarity Derivation
The second way of eliciting similarities presented in this paper starts with determining combined vectors for objectsattributes relations. For this purpose, instead of binary AND we use the min operator (denoted by ). Thus, a vector representing sticks that are long and wide contains minimal values from columns long and wide from Table 2. Applying this procedure for all combination of attributes, we obtain (10):
Using the second scheme of thinking (C_LPSG) leads to the following similarities matrix (11):
Table 3. Sample LOS Intensities of ObjectsAttributes Relation Showing that Lower Values are Less Important in our Similarity Assessment
2.4 Our approach characteristics
In the binary example, we presented two natural ways of obtaining similarities between objects. It can be observed that in this LOS example, other logical patterns of determining objects’ similarities may be specified. It stems from the fact that attributes are not necessarily disjunctive. For instance, object f in Table 2 was rated by an expert as partly wide and partly narrow at the same time. Thus, one may deem natural to specify similarity based on a combination of three or more attributes instead of only two of them.
The examples described above show how to obtain a matrix of similarities in a natural and logical way both for the binary and LOS variables. There is a number of issues that require discussion and clarifications. First, presented here patterns of determining similarities between objects based on processing their attributes do not represent all possible ways of doing that. Secondly, some may argue that they are not always consistent with various psychological models of assessing similarities. For example, it is easy to see that the application of L_LPSG does not always preserve the transitivity of relations in a similarity matrix, which is often assumed or is desirable in psychological studies. It may happen that according to an expert, object a is similar to b with respect to the length attribute, b is similar to c with respect to the width attribute; but that does not necessarily mean that a should be similar to c because it may have different length and width.
In contrast to L_LPSG, the more conservative C_LPSG approach guarantees similarity matrix transitivity for binary data. It results from the assumption about the attributes’ disjunction and the similarity construction that requires identical attributes for similar objects. The application of the min operation for combining logically attributes may raise doubts and provoke discussions. Referring to the sticks example let us consider the situation where an expert evaluated the intensities of attributes using LOS (low, medium, high) as in Table 3. Determining the similarities matrix according to the rule “sticks are similar if they are long and wide” we obtain (12):
It can be observed that although objects b and c have identical measures of intensities for the long and wide attributes (the first and second column of Table 3), their similarity is specified at the lowest level. On the other hand, objects a and f differ in their attributes’ intensities, but are assessed as more similar than objects b and c, where the attributes’ intensities are the same.
This seemingly paradoxical result may be interpreted in favor of the min operation. It can be treated as a cautious (pessimistic) similarity assessment in a situation when an expert is not fully convinced that the given attribute characterizes the specific object. For instance sticks b and c are rated as being long to the same, smallest extent, and as medium wide. Though both features are measurable, an expert could assign the small length value both to the short sticks as well as to the very short ones. Likewise, the medium width could represent slightly less than medium width sticks or somewhat wider than medium width sticks. When attributes are hardly to measure or even categorical, such an approach could be even more convincing. If we were, e.g., to assess the sticks’ colors, and specify the attribute as blue, then small level of this feature could be attributed both to navy blue and teal blue. In such a case, for a sensitive person, these two colors may not be similar. Generally, in the maxmin approach, higher levels of a specific attribute intensities (or a combination of many attributes) in both compared objects increase their degree of similarity.
The way of constructing similarities matrices based on the C_LPSG pattern is in concordance with the general idea of the feature set model of similarity – the contrast model proposed by Tversky [61]. In this approach, the similarity determination is described as a feature matching process. The model defines the similarity between objects as a linear combination of the measures of their common and distinctive features. In the conservative scheme of constructing objects’ similarities based on attributes/factors (C_LPSG) presented here, only common features are taken into account.
Despite all restrictions, the possibility of explaining objects’ similarities subjectively expressed on LOS by factors represented on the same type of scale is attractive cognitively and practically. Obviously, the presented above examples are simple and assume full knowledge about objects’ attributes. However, our real task being subject to analysis in this paper is the process reverse to that presented in above examples. We try to find unknown neuromatrix V containing factors that reproduce the similarities matrix S which is known and has been, e.g., acquired from an expert or a group of experts in real contexts.
Based on the extensive theoretical considerations presented in this section, we employ the maxmin product of neuromatrix vectors V with their transposed values to produce (reconstruct) the input matrix of similarities. The general idea is presented in Fig. 1 and can also be express as (13):
V(objectsfactors, n×k) ◦ VT(factorsobjects, k×n) = S(objectsobjects, n×n). (13)
Fig. 1. Schematic illustration of our approach to employ the maxmin product of neuromatrix vectors V with their transposed values to produce (reconstruct) the input matrix of similarities (k ≤ n).
Our idea is similar to the PCA concept where orthogonal eigen vectors reconstruct a square symmetric matrix containing either correlations or covariations. Researchers usually take advantage of this approach to reduce the correlation or covariations matrix and represent it by as few eigenvectors as possible, trying to reproduce the original matrix as close as possible. In our approach, the input is also square and symmetric, but all the similarity values are measured solely on a LOS and they can be represented neither by correlations nor covariances. Furthermore, we confine solely to max, min, AND, OR operators. However, our main goal is similar to PCA and we want to represent the complex similarity matrix by a simpler structure consisting of reconstructing vectors that would make the data interpretation easier.
Usually in real contexts attributes’ assessments, such as those given in Tables 1 and 2, are not available. What is more, the experts’ ways of thinking (L_LPSG, C_LPSG or others) are also not known. When in such circumstances, one finds a decomposition that reconstructs the similarities matrix well, the interpretation of the factors may be a kind of art, which often takes place in the classic Factor Analysis (FA) or various types of multidimensional scaling (MDS). It seems to be justified to presume that better decompositions signify that the similarity determination mechanism was closer to the maxmin composition of relations model. In such a case, one may try to interpret the obtained neuromatrix in terms of the attributes’ composition by appropriate LPSG. Likewise in FA, knowledge about the analyzed context facilitates possible factors’ explanations also in our approach. A straightforward mathematical background used in our approach was demonstrated in detail in Appendix A using a very simple example.
2.5 Relation to other methods
The method presented in this paper is inspired by the concepts of FA, MDS, HICLASS, Ordinal HICLASS, Ordinal FA, and BFA, which were reviewed in the introduction section. In particular, the proposal is similar to the approach originated from fuzzy logic [39], since in both cases the input data represent various intensity levels of similarity relations. In Section 2 of our paper, we use ordinal formal contexts for illustrative purposes, but we do not directly refer to the formal concepts analysis. The use of LOS values for describing similarity relationships differentiates our approach form such models as Ordinal HICLASS [37] and Ordinal FA [38]. In the latter proposal, ordinal scales are employed only for defining searched factors whereas the matrix being factorized still contains binary values.
Unlike other models, e.g., [62]–[64], in our proposal the formal contexts represented by objectsattributes relationships are not known. In the theoretical setup that we present, we neither generate nor hypothesize about formal contexts. Since the objectsattributes matrix does not exist in our methodology, any type of formal concept analysis is not feasible.
In our approach we search for unknown factors that explain similarities between objects presented in a square matrix containing pairwise comparisons results. These factors may only, at most, be interpreted as aggregated properties or combinations of objects’ attributes which are not known, whereas in formal contexts, objects’ attributes are explicitly specified and known before any analysis is conducted.
What is unique in our method, is the use of LOS data along with applying only max and min operations in reconstructing the initial matrix. Such a procedure is a generalization of the BFA which is a kind of an extension of the classic FA idea to categorical data. It can also be compared to the association relation in the HICLASS model for ordinalscale variables, or to the similarity relationship analysis in the fuzzy context and fuzzy concept lattices developed by Belohlavek [39] and extended later by Belohlavek and colleagues [40]–[42].
In contrast to the latter approaches, where one analyzes the existing, well specified fuzzy formal context, we try to find the unknown LOS context, a neuromatrix, understood as an objectsfactors relation. Since we take advantage of the simple maxmin relations for reconstructing the similarity matrix, there is no need for using multivalued logic formulas, as it is the case in fuzzy concepts approaches.
In general, we search for one objectsfactors matrix V(objectsfactors, n×k) that reconstructs a square and symmetric matrix S(objectsobjects, n×n) of similarities between objects rated on an ordinal scale. Thus, we want V(objectsfactors, n×k) ◦ VT(factorsobjects, k×n) = S(objectsobjects, n×n). In proposals of Belohlavek and colleagues concerned with Boolean factor analysis and factor analyses involving formal concepts, the input data consist of relationships between objects and attributes. The set of objects, attributes, and their relationships are called a formal context, and can be conveniently presented in a form of a matrix: I(objectsattributes, n×m). Based on this input, two additional, distinct matrices are searched for, i.e.,: A (objectsfactors, n×k), and B (factorsattributes, k×m). The relation between these components is (14):
I(objectsattributes, n×m) = A (objectsfactors, n×k) ◦ B (factorsattributes, k×m), (14)
which is totally different than in our proposal.
We provide only one matrix V(objectsfactors, n×k) as an output. The only similarity is the correspondence between our matrix V(objectsfactors, n×k) and matrix A (objectsfactors, n×k) from formal concepts approaches. Matrices I(objectsattributes, n×m) and B (factorsattributes, k×m) from formal concepts decompositions do not appear in our approach whereas our matrix S(objectsobjects, n×n) is not present in papers regarding decompositions of fuzzy contexts both in their fuzzy and Boolean versions and all of their modifications.
Finding factors that try to explain the ordinalscale similarity matrix is also a main purpose of MDS or nonmetric linear FA concepts [49]. In this trend, all the computations are based on dissimilarities that are represented as distances in a multidimensional space, whereas in our technique we are operating directly on LOS similarity intensities between objects.
3 Algorithm Proposal for Decomposing the LOS Similarity Matrix
To apply the demonstrated idea to practically seek data structure and reduce problems’ dimensionality, it is necessary to develop a procedure of finding the reconstructing vectors. It would be ideal if such a procedure provides a full decomposition of any square and symmetric LOS data matrix, like it is the case in PCA. However, despite many attempts, we were not able to devise any deterministic algorithm for finding the full decomposition of such an array. Therefore, we present a heuristics that does not guarantee finding the vectors that fully reconstruct the initial matrix.
The general idea of our procedure is summarized in Algorithm 1, which takes as input LOS similarities intensities between all pairs of objects and outputs a neuromatrix with reconstructing vectors and ordered reconstructing vectors. Our procedure does not require defining any parameters.
The key point in the presented process of finding the solution is connected with the observation that within the suggested fuzzy settheory framework negative values do not appear. Therefore, if big values are included in the reconstructing vector at the beginning of the procedure, there will be no possibility to decrease the values from the reconstructed matrix by remaining vectors. If one imagines the initial similarity matrix values as cuboids laid down on a plane, where each cuboid consists of the number of unitary cubes corresponding to the degree of similarity between a pair of objects, then the process of reconstructing such a structure is just the superposition (max operation) of quasi rankone matrices created by applying the min operation on consecutive specific vectors.
Algorithm 1: Finding reconstructing vectors for LOS similarity matrix
Given the problem with additive nature of the maxmin operations, the proposed heuristic tries to find such values for reconstructing vectors that, from one hand side, reconstruct as much as possible but on the other hand they do not produce bigger ratings in other places of the predicted matrix than their equivalents in the initial similarity matrix.
In our method, we use integer values, however, one should bear in mind that these values represent LOS variables just like in the Appendix A example. In a computer program that implements this algorithm, the matrix S contains the initial LOS similarity values, the V neuromatrix includes the searched reconstructing vectors. Additionally, we use three other types of matrices. The predicted (reconstructed) matrix which is computed by the maxmin multiplication of the current specific vectors and their transposes P = Vcurrent ◦ VTcurrent. The matrix of residuals calculated as R = S – P. If R contains only zeros then the V ◦ VT fully reconstructs S. The hint matrix H that stores those items from S which are not fully reproduced (the residual does not amount to zero) by the current specific vectors. So, if rij = 0, then hij = 0; else, hij = sij.
Some others procedures could be applied for finetuning the decomposition, e.g., instead of adding or subtracting repeatedly ones, a combination of adding and subtracting may be used. We also propose here only one of the possible ways of ordering the reconstructing vectors which, however, does not guarantee finding the best vector arrangement. One may devise different heuristics or, at the expense of computing time, check all combinations of column arrangements.
To give the user idea to what extent the individual vectors reconstruct the input matrix, the relative importances and cumulative relative importances are used. They are computed for a given vector as a percentage value of: (sum of absolute differences from the matrix reconstructed by the given vector – the sum of absolute differences resulting from reconstructing the initial matrix by all previous vectors) divided by (the maximal possible sum of absolute differences). The consecutive relative importances say by what percentage the initial matrix will be better reconstructed if the given vector is included in the solution, given all preceding reconstructing vectors are also used. The cumulative relative importances can be interpreted as the percent of the input matrix reconstruction. The full reconstruction occurs when the cumulative relative importance is equal to 100%.
Likewise eigenvalues from the classic approach, the relative importances are used for assessing the usefulness of a given specific vector in reconstructing S, but their interpretation is different and they should not be confused. Eigenvalues are always associated with their eigenvectors. Here, the relative importances depend on the reconstruction degree of S produced by preceding vectors from the ordered matrix. The sum of consecutive relative importances show to what extent the initial matrix is reconstructed but we cannot say that the reconstructing vectors here are orthogonal. They cannot be treated as eigenvectors and they do not contribute irrespective of other vectors. Changing the order of column vectors in the neuromatrix V would not change the overall reconstruction quality. Residuals will be the same. It results from the fact that the quasi rankone matrices produced by individual specific vectors are joined by the union operator which provides the same predicted matrix irrespective of the rankone matrices order.
In methods like FA, MDS, and our approach, where the initial data matrix is to be represented by a restricted number of dimensions/vectors, there is a problem with determining the final model, i.e., the number of reconstructing vectors in our case. The final model should reproduce S as well as possible, but the number of reconstructing vectors should be as small as possible to provide clear and reasonable interpretations of the underlying data. There have been already different solutions proposed in various methods to tackle this problem. They range from very a simple approach like the Kaiser’s heuristic [65] which advices retaining vectors in FA with eigenvalues greater than one, to more complex ones put forward by, e.g., Ceulemans and Kiers [66], Preacher et al. [67], Wilderjans et al. [68]. The discussion of strategies that could be applied in such situations were provided in, e.g., [36], [69]–[71].
In our approach, the values in reconstructing vectors should be interpreted as the degree of similarity of a given object with the object’s attribute (factor) represented by a given specific vector. We assume that the LOS range is the same for all specific vectors. In classic FA, the factor loadings are just correlations between an object and the hidden factor. Likewise in classic FA, one needs to specify the threshold at which the similarity intensity is high enough and the value for which it should be considered as not meaningful. In the literature regarding FA, various recommendations may be found in this regard. According to some researchers, 0.3 is treated as the minimal value for a factor loading [72], [73] whereas others classify 0.70 or above as high and 0.5 or lower as low [74]. One of the most popular approaches involve using an absolute value of 0.4 as a cut off, and interpret values of 0.6 as high [72], [75]. Analogically to the recommendations used in FA, we propose to use the similarity scale range median the as a threshold in our approach. For example, for nine items LOS with increasing intensities, values bigger than the fifth value will denote a significant degree of similarity between a given object and the specific attribute represented by the reconstructing vector.
As mentioned above, the final model should be as parsimonious as possible and provide reasonable degree of the initial matrix reconstruction. Thus, again some recommendation regarding the acceptable value would be useful. Peterson [76] compared real FA metadata with randomly generated data, and based on the results advocates searching solutions in which the variance explained by the factors exceeds 50%. In our case, instead of variances we use cumulative relative importances that are significantly different but also provide information on how good the approximation is. Given the exemplary data provided in Section 4 and experiences from simulation studies presented in Section 5, we would rather recommend pursuing solutions with cumulative relative importances higher than 80%. It is also worth noting that our method works for symmetric and asymmetric data. The predicted matrix is always symmetric and the algorithm tries to find such a symmetric approximation of asymmetric data that the absolute sum of residuals is the lowest.
4 Practical Examples
Here we present two different examples showing how the suggested method may be applied and used for drawing conclusions regarding similarities between objects and reconstructing vectors. These examples are well known in the literature regarding MDS and the original raw data are easily available. Both of them deal with similarities expressed by humans during pairwise comparisons on ordinal scales.
4.1 Perceived colors’ similarities
Ekman, in his work [54], asked participants to assess the degree of similarity between 14 colors. Stimuli were displayed in pairs and subjects rated the qualitative similarity on a fivestep scale. He rescaled the results to the [0, 1] interval range and applied FA treating these data as correlations. Ekman presented a fivedimensional solution that decently reconstructed the initial quasicorrelation matrix. The obtained eigenvectors were identified as: violet, blue, green, yellow, and red.
Shepard [55], [56] reanalyzed Ekman’s data using his nonmetric MDS approach which resulted in two dimensions. He also proved that in this case the relationship between similarities and distances are not linear.
Ekman’s and Shepard’s original analyses were performed on rational data. Our methodology, by definition, cannot be applied for other than ordinal data. Thus, to make the comparisons more logical we transformed the rational data into ordinal ones by multiplying them by 10 and rounding to whole values. The transformed data are given in Appendix B. Then, we reproduced Shepard’s result for ordinal data using classic nonmetric MDS with a standard stress value as a goal function, in a Matlab 7.11.0 (R2010b) version. The outcome, illustrated in Fig. 2, was next compared with the solution provided by our methodology (see Table 4).
The application of two versions of our algorithm to these data resulted in finding two different decompositions where one of them was able to fully reconstruct the initial data. The ordering of the obtained vectors (cf. Table 4) shows that the similarity matrix can be reconstructed in 83% by only three vectors, which can be interpreted as red, blue, and green.
Fig. 2. Illustration of Shepard’s solution [55], [56] to Ekman’s colors similarities experiment [54]. Colors were generated by Spectra software, which converts the wave lengths to the RGB color system [77].
Table 4. Ordered Reconstructing Vectors with Relative Importances for the Example with Colors [54].
The obtained results seem to be qualitatively different from both Ekman’s FA which suggested five dimensions and the Shepard’s [55], [56] twodimensional solution. The Ekman’s approach was correctly criticized by Shepard for using rescaled similarity ratings as correlations (scalar products). In our approach, we do not use correlations, but proximity measures and, like Shepard, we do not assume a linear relationship between similarities and distances. Additionally, unlike Shepard, we do not “get something for nothing” which is the case in the Ekman’s and Shepard’s approaches. Ekman obtains precise points in multidimensional Euclidean space from similarities rated on a fivestep scale whereas Shepard provides metric representation based solely on a nonmetric rank order of those proximity measures.
Both previous approaches applied to this experiment assume that people think in terms of dimensions while performing similarity judgments and/or they are aware that such a dimensions exist. This, however, might not be true, all the more that in this specific example the colors were presented only in pairs and subjects could not see the broader picture of the whole experiment. There is another problem with the Shepard’s solution: how to interpret the identified dimensions? Although, the graphical representation (see Fig. 2) resembles to some degree the Newton’s color circle, Shepard did not provide substantive and convincing explanation of these two dimensions. The idea of a color circle is to provide a color hue categorization and summarize the additive (subtractive) mixing properties of so called primary colors: red, green and blue (cyan, magenta, yellow) but there were significant problems with identifying color physical properties in twodimensional Euclidean space. From the perceptual point of view, attempts of representing color hues in a twodimensional Euclidean space resulted in creating the CIE Lab color system [78] where the equal Euclidean distances between color hues correspond approximately to similar differences in their human subjective perceptions. The Shepard’s solution seems to be more similar to this approach than to classic color circles. The CIE Lab space is obtained by linear transformations of human photoreceptors sensitivity to red, green and blue light components. Since the cones sensitivity functions are not straightforward, the system is far from being perfect. In light of the above, it is quite possible that the process of judging color similarities depends more on physical properties of three different types of retina’s cones (red, green, and blue) than the artificially created twodimensional CIE Lab space for the color hue. The process of estimating the colors’ similarities could have been simpler and not based on a dimensional idea. We may try to assign (compare, categorize) a given hue to one of the wellknown primary colors. In this sense, our approach and the solution proposed by Ekman would be more appropriate than the Shepard’s analysis.
Shepard argues also that his twodimensional solution accounts for as much as 84% of the overall variance which is much better than the reconstruction obtained by the first two (unrotated) Ekman’s dimensions (about 64%). However, according to Kruskal’s recommendations [47], only the stress value around 0.05 corresponds to a good quality solution (10% fair, 20% poor). Naturally, adding another dimension improves the solution’s quality but then the problem with interpreting dimensions is becoming even bigger since neither the color saturation, nor lightness (brightness) were controlled in this experiment. Our solution based on three attributes exhibits comparable degree of initial values reconstruction as Shepard’s twodimensional or Ekman’s fivedimensional solutions, and allows for analyzing the experimental data from a different point of view.
4.2 Perceived nations’ similarities
The original data from the Kruskal and Wish example [57, p. 31] were collected from a group of 18 students who rated each pair of 12 countries (Brazil, Congo, Cuba, Egypt, France, India, Israel, Japan, China, former times USSR, USA, and former times Yugoslavia) on a scale from 1 “very different” to 9 “very similar”. The authors proposed the following interpretation of the three obtained dimensions: I – Political alignment (noncommunist – communist), II – Economical development (developing – developed), and III – Geography and culture (East – West). A nonmetric MDS with a standard stress value as a goal function performed for this three dimensional solution in a Matlab 7.11.0 (R2010b) version provided data illustrated in Fig. 3.
Fig. 3. Nonmetric MDS three dimensional solution for a nations’ similarities example of [57, p.31].
For the purposes of our approach the original similarity data were rounded and rescaled such that the minimal value equals one whereas the maximal scale value amounts to seven. They are given in Appendix C. Ordered reconstructing vectors provided by our heuristic algorithm are presented in Table 5.
The results of our analysis provides an alternative solution to the one obtained by nonmetric MDS. The first four reconstructing vectors from Table 5 are able to reconstruct the initial nations’ similarities in 89.2% and they may be interpreted as follows: communist or former communist countries (v3): Cuba, China, Yugoslavia, USSR; countries having nuclear weapons (v10): USSR, France, USA; developing countries (v6): Congo, Egypt, India, Cuba; closely cooperating countries in military and economic areas (v7): USA, Israel, Japan. The military associations seem to be quite justifiable since the study were conducted at the time when the issues regarding the cold war, armament race, or Vietnam War were very popular and constantly present in various media.
Table 5. Ordered Reconstructing Vectors (Neuromatrix) with Relative Importances for the Example with Nations’ Similarities [57, p. 31].
The proposed interpretations of dimensions in the nonmetric MDS solution generally seem to be correct, however if we take closer look on the presented data we would see that the data are sometimes difficult to interpret within the Euclidean space. For instance, China seems to be decidedly more communist than USSR and Cuba; or Japan is significantly less noncommunist than Brazil, which seems to be even more anticommunist than the USA.
The axes rotations do not make the interpretations much easier. It should also be noticed that the standard stress value for this threedimensional MDS solution amounts to 0.1044, only after adding the fourth dimension, the stress reaches 0.049, which is deemed as a good quality solution according to [47].
Given the above, it is not clear whether participants in this experiment judged similarities using the dimensional approach. As it can be seen from our analysis, the underlying nations’ similarities structure could equally come from the way of thinking resembling the maxmin operations performed on the identified attributes.
5 Simulation studies of the proposed algorithm
5.1 Brute force simulations
We applied the brute force simulations to extend our knowledge about the nature of the problem, its sophistication degree and to provide a basis for comparison with our heuristics. We assumed that the number of reconstructing vectors is equal to the number of objects thus the reconstructing matrix has the same dimensions as the initial data array.
The number all of possible solutions (nsol) depend on the number of analyzed objects (nobj) and the number of LOS items employed (nLOS), and can be calculated in the subsequent way.
Table 6 contains the number of variations for a various matrix dimensions and number of LOS items. The conditions in italics presented in Table 6 were analyzed by a brute force algorithm. For those cases we generated 1000 random squared and symmetrical similarity matrices with LOS data and verified all possible variations of maxmin products for each of them. Additionally, we examined the possibility of reconstructing matrices bigger than 5×5 with various nLOS by taking advantage of less number of vectors than the initial matrix dimensions. We confined only to such combinations of nLOS, matrix size and number of reconstructing vectors when the number of variations was lower than 16 million. Other conditions were not analyzed since they required too much computation time. The results of our simulations are put together in Table 7 and show percentages of fully decomposed matrices (PDF) for each combination of a matrix size, nLOS, and the number of reconstructing vectors applied.
Table 6. Number of Variations when the Number of Reconstructing Vectors is the same as the Number of Objects.
For the following matrices: nLOS = 2, nobj = 11–20; nLOS = 3, nobj = 8–13; nLOS = 4, nobj = 7–11; nLOS = 5, nobj = 6–10; nLOS = 6, nobj = 5–9; nLOS = 8, nobj = 5–8, the decomposition by one reconstructing vector was not found. For these matrices, bigger numbers of vectors were not analyzed due to a great number of variations and unacceptable time of simulations.
The presented brute force results shows that the 3×3 matrix size, the full reconstruction were possible for all randomly generated matrices and analyzed nLOS (from 2 up to 10) by 3 or 2 reconstructing vectors. Matrices 4×4 were fully reconstructed at all times by 4 vectors for nLOS = 2 4. It was not possible to check whether this result is also true for larger nLOS since the nsol was too big. The most interesting result was obtained for the matrix 5×5 consisting of values represented on a binary scale (nLOS = 2, cf. Table 7). It occurred that even 5 vectors are not enough to fully reconstruct the initial matrix in all cases.
Table 7. Percentages of Fully Decomposed 1000 Random Similarity Matrices by a Brute Force Algorithm.
5.2 Performance of the proposed heuristic algorithm
The effectiveness of our heuristic procedure was examined by performing a simulation experiment. We applied our approach to randomly generated matrices with various combinations of their dimensions and scales. We examined two factors: the matrix dimension and the rating scale type. Matrix sizes ranged from 3×3 up to 13×13 (11 levels), whereas nLOS varied from 2 up to 10 (9 levels). The applied within subjects design, produced 99 different experimental conditions. For every combination of the matrix size and nLOS, we generated 1000 symmetric matrices. We tried to decompose each of the total 99 000 random matrices by our heuristic procedure. We recorded the highest percentage of the initial matrix reconstruction obtained by applying both versions of the tuningup procedure. Matrices 3×3 and 4×4 with nLOS from 2 to 10, were fully decomposed for all randomly generated matrices. The remaining results of our simulations presenting PDF and mean percentages of initial matrix reconstructions (MPR) are put together in Table 8.
Table 8. Results of the Decompositions Obtained by our Algorithm for 1000 Random Similarity Matrices,
The simulations show that our heuristic procedure was able to decompose all randomly generated small matrices. This result is the same as applying brute force algorithm. For more complex data the percentages of full reconstructions gradually decrease. For matrices bigger than 6×6 and nLOS bigger than 3, the possibility of the full decomposition drops radically far below 50%. If the matrix is bigger than 8×8 and nLOS is bigger than 2, then there is almost no chances of getting the full decomposition by our approach. We additionally performed simulations for 14×14 and 15×15 matrices including data with nLOS = 2. In these cases, none of randomly generated similarities’ matrices was fully decomposed by our algorithm. However, it is not known whether such full decompositions exist at all for those similarity data.
One should notice that the mean percentage of reconstruction is quite high. Even for the most difficult experimental condition, the value is higher than 90%. The mean percentage of reconstruction for 14×14 and 15×15 matrices with nLOS = 2 amounted to 92.6% (2.33) and 92.3% (2.33), respectively.
6 Applications
The presented method may be widely used in these fields of science in which human perception is involved to judge directly about similarities. It could be especially suited and practically applied in situations where humans are judging objects’ similarities in pairwise comparisons, using ordinal scales, such as the Likert’s or linguistic ones. They may be, for instance, concerned with benchmark studies in management and marketing like in the HATCO company comparison with nine competitors [72], psychological studies regarding cognition or memory [79]–[81], or psychological analyses of human perception like in the research on differences between adults and children in recognizing body parts similarities [82].
Our proposal assumes that people apply maxmin approach on attributes. We demonstrated that in some experimental data applying this method may provide different explanations than dimensional approaches based on Euclidean spaces which are used in classic nonmetric MDS or other FAlike methods.
The suggested, nonstatistic and nonmetric approach can be applied to any ordinal variables where consecutive values correspond to the perceived level of similarity intensity. A granularity resolution, i.e., scale range, can be freely chosen as it neither affects the theoretical basis nor the described heuristic algorithm. The number of expressions describing similarity levels may, in practice, refer to experts’ sensitivity to tell similarities between objects in a specific context.
Reconstructing vectors from our proposal might be interpreted as counterparts of the fuzzy formal contexts. One can apply formal concept analysis to these results for further detailed examination of relations between factors and objects. However, even not using formal analysis, our reconstructing vectors allow for retracting knowledge about factors shaping similarity assessments. It seems particularly important to look for such hidden relations in various practical areas. For example, factors affecting the perception and cognition of visual stimuli are a particular focus of marketing and neuromarketing (see [83]–[88]). Specifying reliable objectsattributes relations that underlie similarity perception could facilitate the design of more effective graphic marketing messages used in product packages that will stand out from their competitors or advertisements.
7 Future studies
There are some research questions regarding our proposal that should be answered in future studies. They concern detailed properties, practical usefulness, and methodological correctness.
7.1 Algorithmic extensions
Some prospective studies can enclose simulation research on markedly more complex examples, with numerous attributes contributing to peoples’ perceptions. For such significantly more sophisticated problems with a large number of possible factors, one could try to combine our algorithm with the fuzzy formal concept analysis. From the point of view of the described model per se, investigations regarding the influence of its properties on the generated results are of special interest. For instance, how the granularity of a similarity intensity scale impacts the results quality for various tasks.
Possible future research may also focus on applying other than our approaches for determining reconstructing vectors such as deep learning. Some initial works in this regard have already been performed for the Boolean matrix factorization. Frolov et al. [89] used Hopfieldlike neural networks for this purpose. They further extended their ideas in a series of subsequent publications [90]–[92]. Input and output matrices of these approaches are completely different conceptually than our proposal. Thus, direct comparisons are not possible. However, creating a deep learning algorithm similar to the solutions provided by Frolov and colleagues for similarity matrices containing ordinal scale values, would be very interesting.
Another direction of extending or improving our algorithm could utilize some latest developments in optimization research. Though some analysis emphasize the complexity of problem of similar types (e.g., [93]), one may try, for instance, to take advantage of interesting extensions of classical desirability function optimizations, especially the approach involving max and mintype functions (cf. [94]–[96]).
7.2 Theoretical advancements
From the theoretical perspective, answering the question under what circumstances the initial objects similarity matrix can be fully decomposed is an certainly worth pursuing. A possible conjecture is that such a full decomposition is feasible for matrices where the classic triangle inequality between all similarity ratings is conserved.
A number of future research directions and projects could include the development of a methodology that would deal with multiple similarity matrices. This, probably, shall involve some clustering techniques. For the presented approach, one should try to determine in which situations either liberal, conservative models shall be applied. Moreover, an extension of our proposal may include other types of theoretical logical relations or their combinations that has not been demonstrated in this paper.
There could be a potential tradeoff concerned with the specific feature of our approach that decrease the significance of smaller attribute intensities. This might increase the danger of excluding some factors from the final reconstructing matrix. The problem may constitute a limitation of our approach, and some further studies may focus on determining whether such a phenomenon exists, and if so, what the scale is.
In recent decades, fuzzy sets have been intensively used as a tool for uncertainty modeling. It results, among others, from the nature of phenomena in many areas of interest in science. It is especially the case in mathematical modeling of both social and technical phenomena. The framework presented in this research allows for advanced analytical constructions that take into account uncertainty. For example, linguistic expressions of membership function values or degrees of truth can be represented as fuzzy sets. Then, the analysis of similarity relationships would be based on fuzzy sets of second type. Intensive work on extending classic approaches to develop models involving uncertainty can be also seen in construction of algorithms for solving differential equations. For example, in the works [97]–[100], authors propose algorithms that operate on fuzzy numbers and use the theory of kernel reproduction. Processing and modeling of imprecision involving similar approaches seems to be an interesting approach in analyses related to human behavior. Hence, the cited works suggest a possible direction of more advanced studies in this field
Another possible extension could involve definitions of the acceptation, rejection and uncertainty levels of similarity while considering given factors or decompositions. Such modifications are conceptually interesting, despite the danger of decreasing the precision of the similarity matrix reconstruction (cf. [40]).
7.3 Validation studies
A significant problem concerned with validation of the presented methodology is that it is not clear what true human being’s assessments of similarities are, and how to identify them. The question is what should be the reference? Should this be the results of nonmetric MDS, the structure of neurons activations in the brain? How should these data be aggregated? – Simple average, Choquet integral, etc.
Moreover, in a variety of factor analysis types, one can come up with a number of qualitatively different solutions having similar goodnessoffit parameters. In a classic factor analysis it can be done by simple algebraic rotations of eigenvectors. At the end of the day, it is up to the investigator to select the most logical, theoretically and practically justifiable solution, from among those possible. Nevertheless, even without knowing the real true structure of psychological concepts and relations between them, these approaches are useful. They are employed very intensively as they provide, at least, some insight into psychological constructs.
Despite the abovementioned problems, there are some ways of increasing the belief that the proposal is valid. We showed on two simple, but wellknown examples that the idea works, that there is a theoretical background related to how people may think about similarities. The theory corresponds logically to the problem we are trying to solve.
From the technical point of view, the put forward algorithm for seeking the LOS neuromatrices provided satisfactory solutions both for real experimental examples and in decomposing randomly generated data. This may be considered as a part of an internal validation. The procedure provides reasonable solutions that can be interpreted logically, but qualitatively differently from the case of classic approaches. These outcomes can be treated as a basic external validation.
Naturally, some additional steps may be taken to further validate our proposal. Given the paper length restrictions, other, more detailed and comprehensive attempts can be performed in subsequent studies. In the perspective of neuroscience, future research could be directed to empirical investigations at the biological level focused on checking if the proposed assumptions are reflected in the brain structures’ activities. Finding patterns of brain functioning could verify the suggested approach at a physiological level. These investigations could take advantage of brain imaging methods such as PET or fMRI, that occurred to be very helpful in understanding of various neural based processes (cf., e.g., [101], [102]).
It seems that making decisions about similarities based on hidden factors (neuromatrices) may also influence visual processing strategies. Using considerably technologically improved and significantly less expensive eye tracking techniques to study similarity issue is reasonable. The human visual behavior can be characterized by spatiotemporal oculometric parameters such as saccades and fixations. Their dynamics may be modeled by hidden Markov models (cf. [103]–[109]), their fuzzy equivalents (see [110]–[112]) or even Markov switching models (cf. [113], [114]).
It can be attractive from the cognitive and behavioral point of view to conduct experiments focused on determining relations between visual strategies and mechanisms of making decisions about similarities modeled by neuromatrices introduced in this paper. Analogous studies may also be conducted by other tools used in neuroscience such as electroencephalography [115], [116], magnetoencephalography, facial recognition, etc. Reviews and discussion on the usefulness of various neuroscience methods can be found, e.g., in [117], [118].
Some more classic methods may also be applied for extended validation purposes. They may include studies aimed at finding correlations and relations with psychological constructs with known values of similarities between objects or concepts of various types. One may even conduct simulations where similarities would be generated automatically based on objects’ physical properties, such as calculated stick lengths. Another new idea is to include retrospective thinking in the experimental procedure. In such a case, after assessing similarities, participants explain how they evaluated them, what factors were the most important, and in what way objects’ or concepts’ features influenced subjects’ perception.
8 Conclusion
In this paper, we propose a new approach for modeling human thinking about objects’ similarities by searching the neuromatrix. The neuromatrix consist of vectors that reconstruct the LOS similarity data matrix. We search for internal data structure using fuzzyset theory simple operators. We have shown that given such assumptions, it is possible to represent the initial matrix as the union of quasi rankone matrices.
Conceptually, we presented a model that reflects cognitive processes taking place in the brain. The process is demonstrated in the form of linguistic expressions – provided by a human – about similarities between objects. Uncovering hidden objectsattributes relations in the form of neuromatrices is an attempt of specifying factors shaping decisions about those similarities. From the neuroscientific point of view, we assume that our approach discloses components of the cognitive perception mechanism occurring at the neural level.
Technically, our scientific proposal is very closely related to the idea that underpins PCA, FA, metric and nonmetric MDS and Correspondence Analysis, namely, the eigendecomposition of a matrix of real values. Analogously to classic approaches, we have attempted to represent the initial LOS data matrix as a maxmin product of some other LOS matrix, called a neuromatrix, and its transpose. In our opinion, such an approach is appropriate for linguistic based or ordinal data. In the maxmin multiplication, the product of two values is replaced by the intersection (min) operator, whereas the summation takes the form of union (max values).
Our methodology is theoretically well grounded and soundly logically justified. The idea is very simple and is based solely on maxmin operators. We think that such an approach is closer to real human thinking about similarities than other methods. The maxmin operations are truly natural as they are in the inner core of humans’ negotiations, games, optimization, orientation and gaining of perspective. Moreover, our methodology has a tendency to relatively diminish the significance of smaller attributes’ intensities. This, in turn, fits well to human brain biological functioning where neurons are activated and pass electrical impulse further only if superposition of input signals exceed a specific, minimal level. This property of our methodology seems to be better suited to physiological structures of the neurons than other approaches. Such a way of handling similarities is in concordance with intuition. Usually, weights of factors deciding about similarities are nonlinear – some of them are more important than the others. Those less important ones, probably, have less impact on the overall perception.
Below we present a brief list characterizing our proposal :
 The theoretical foundations are in concordance with the human thinking about similarities and basic neural activity.
 The similarity matrix includes only values measured on an ordinal scale.
 It is possible to decompose the initial objects’ similarities matrices.
 The decomposition uses only max and min operators and provides reconstructing vectors that can be interpreted akin to classic approaches.
 The proposal provides logical results, however, their interpretation might differ from classic approaches, which allows for better understanding of the examined phenomenon.
 Brute force simulation results shows that starting from the 5 × 5 matrices it is not possible to fully decompose random objects' similarity matrices.
 Simulation results proved that the proposed heuristic procedure is able to reconstruct randomly generated similarity matrices to a very high extent, even for the most difficult examined cases.
We hope that our proposal would be interesting to other researchers that could apply it in a variety of contexts and extend in various directions including those that are indicated in this paper.
References
[1] J. R. Anderson, “ACT: A simple theory of complex cognition,” American Psychologist, vol. 51, no. 4, pp. 355–365, 1996.
[2] F. E. Ritter, F. Tehranchi, and J. D. Oury, “ACTR: A cognitive architecture for modeling cognition,” WIREs Cognitive Science, vol. 10, no. 3, p. e1488, 2019.
[3] B. G. Milnes, G. Pelton, R. Doorenbos, M. H. Laird, P. Rosenbloom, and A. Newell, “A Specification of the Soar Cognitive Architecture in Z,” Carnegie Mellon University, USA, Technical Report, 1992.
[4] J. E. Laird, The Soar Cognitive Architecture. MIT Press, 2012.
[5] D. E. Kieras and D. E. Meyer, “An overview of the EPIC architecture for cognition and performance with application to humancomputer interaction,” Hum.Comput. Interact., vol. 12, no. 4, pp. 391–438, Dec. 1997.
[6] D. E. Meyer, J. M. Glass, S. T. Mueller, T. L. Seymour, and D. E. Kieras, “Executiveprocess interactive control: A unified computational theory for answering 20 questions (and more) about cognitive ageing,” European Journal of Cognitive Psychology, vol. 13, no. 1–2, pp. 123–164, Mar. 2001.
[7] P. Langley, J. E. Laird, and S. Rogers, “Cognitive architectures: Research issues and challenges,” Cognitive Systems Research, vol. 10, no. 2, pp. 141–160, Jun. 2009.
[8] K. Thórisson and H. Helgasson, “Cognitive Architectures and Autonomy: A Comparative Review,” Journal of Artificial General Intelligence, vol. 3, no. 2, pp. 1–30, May 2012.
[9] I. Kotseruba and J. K. Tsotsos, “40 years of cognitive architectures: core cognitive abilities and practical applications,” Artif Intell Rev, vol. 53, no. 1, pp. 17–94, Jan. 2020.
[10] J. E. Laird, C. Lebiere, and P. S. Rosenbloom, “A Standard Model of the Mind: Toward a Common Computational Framework across Artificial Intelligence, Cognitive Science, Neuroscience, and Robotics,” AI Magazine, vol. 38, no. 4, Art. no. 4, Dec. 2017.
[11] A. Lieto, M. Bhatt, A. Oltramari, and D. Vernon, “The role of cognitive architectures in general artificial intelligence,” Cognitive Systems Research, vol. 48, pp. 1–3, May 2018.
[12] R. Likert, “A technique for the measurement of attitudes,” Archives of Psychology, vol. 22 140, pp. 55–55, 1932.
[13] S. S. Stevens, “On the Theory of Scales of Measurement,” Science, vol. 103, pp. 677–680, 1946.
[14] P. F. Franceschini, M. Galetto, and M. Varetto, “Qualitative Ordinal Scales: The Concept of Ordinal Range,” Quality Engineering, vol. 16, no. 4, pp. 515–524, Jan. 2004, doi: 10.1081/QEN120038013.
[15] J. Taghia et al., “Uncovering hidden brain state dynamics that regulate performance and decisionmaking during cognition,” Nature Communications, vol. 9, no. 1, p. 2505, Jun. 2018.
[16] L. S. Iliadis, V. Kurkova, and B. Hammer, “Braininspired computing and machine learning,” Neural Comput & Applic, vol. 32, no. 11, pp. 6641–6643, Jun. 2020.
[17] Y. Zhang, H. Abbas, and Y. Li, “Cognitive computing for intelligent application and service,” Neural Comput & Applic, vol. 32, no. 9, pp. 4315–4316, May 2020.
[18] V. A. Filippov, A. N. Bobylev, A. N. Busygin, A. D. Pisarev, and S. Yu. Udovichenko, “A biomorphic neuron model and principles of designing a neural network with memristor synapses for a biomorphic neuroprocessor,” Neural Comput & Applic, vol. 32, no. 7, pp. 2471–2485, Apr. 2020.
[19] X. Zhu, X. Li, S. Zhang, Z. Xu, L. Yu, and C. Wang, “Graph PCA Hashing for Similarity Search,” IEEE Transactions on Multimedia, vol. 19, no. 9, pp. 2033–2044, Sep. 2017.
[20] H. Das, B. Naik, and H. S. Behera, “A Hybrid NeuroFuzzy and Feature Reduction Model for Classification,” Advances in Fuzzy Systems, vol. 2020, pp. 1–15, Mar. 2020.
[21] J. Gou, Y. Xue, H. Ma, Y. Liu, Y. Zhan, and J. Ke, “Double graphsbased discriminant projections for dimensionality reduction,” Neural Comput & Applic, May 2020.
[22] C. Peng, Y. Chen, Z. Kang, C. Chen, and Q. Cheng, “Robust principal component analysis: A factorizationbased approach with linear complexity,” Information Sciences, vol. 513, pp. 581–599, Mar. 2020.
[23] T. K. Sahoo, H. Banka, and A. Negi, “Novel approaches to onedirectional twodimensional principal component analysis in hybrid pattern framework,” Neural Comput & Applic, vol. 32, no. 9, pp. 4897–4918, May 2020.
[24] S. Ayesha, M. K. Hanif, and R. Talib, “Overview and comparative study of dimensionality reduction techniques for high dimensional data,” Information Fusion, vol. 59, pp. 44–58, Jul. 2020.
[25] J. B. Schreiber, A. Nora, F. K. Stage, E. A. Barlow, and J. King, “Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review,” The Journal of Educational Research, vol. 99, no. 6, pp. 323–338, Jul. 2006.
[26] J. Guo, H. W. Marsh, P. D. Parker, T. Dicke, O. Lüdtke, and T. M. O. Diallo, “A Systematic Evaluation and Comparison Between Exploratory Structural Equation Modeling and Bayesian Structural Equation Modeling,” Structural Equation Modeling: A Multidisciplinary Journal, vol. 26, no. 4, pp. 529–556, Jul. 2019.
[27] H. W. Marsh, J. Guo, T. Dicke, P. D. Parker, and R. G. Craven, “Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and SetESEM: Optimal Balance Between Goodness of Fit and Parsimony,” Multivariate Behavioral Research, vol. 55, no. 1, pp. 102–119, Jan. 2020.
[28] X. Liang, Y. Yang, and C. Cao, “The Performance of ESEM and BSEM in Structural Equation Models with Ordinal Indicators,” Structural Equation Modeling: A Multidisciplinary Journal, vol. 0, no. 0, pp. 1–14, Feb. 2020.
[29] K. G. Jöreskog and I. Moustaki, “Factor Analysis of Ordinal Variables: A Comparison of Three Approaches,” Multivariate Behavioral Research, vol. 36, no. 3, pp. 347–387, Jul. 2001.
[30] M. Katsikatsou, I. Moustaki, F. YangWallentin, and K. G. Jöreskog, “Pairwise likelihood estimation for factor analysis models with ordinal data,” Computational Statistics & Data Analysis, vol. 56, no. 12, pp. 4243–4258, Dec. 2012.
[31] M. Katsikatsou and I. Moustaki, “Pairwise Likelihood Ratio Tests and Model Selection Criteria for Structural Equation Models with Ordinal Variables,” Psychometrika, vol. 81, no. 4, pp. 1046–1068, Dec. 2016.
[32] I. Papageorgiou and I. Moustaki, “Sampling of pairs in pairwise likelihood estimation for latent variable models with categorical observed variables,” Stat Comput, vol. 29, no. 2, pp. 351–365, Mar. 2019.
[33] J. Revuelta, A. MaydeuOlivares, and C. Ximénez, “Factor Analysis for Nominal (first Choice) Data,” Structural Equation Modeling: A Multidisciplinary Journal, pp. 1–17, Oct. 2019.
[34] R. Belohlavek and V. Vychodil, “Discovery of optimal factors in binary data via a novel method of matrix decomposition,” Journal of Computer and System Sciences, vol. 76, no. 1, pp. 3–20, Feb. 2010.
[35] P. D. Boeck and S. Rosenberg, “Hierarchical classes: Model and data analysis,” Psychometrika, vol. 53, no. 3, pp. 361–381, Sep. 1988.
[36] T. F. Wilderjans, E. Ceulemans, and I. V. Mechelen, “The SIMCLAS Model: Simultaneous Analysis of Coupled Binary Data Matrices with Noise Heterogeneity Between and Within Data Blocks,” Psychometrika, vol. 77, no. 4, pp. 724–740, May 2012.
[37] I. Leenen, I. V. Mechelen, and P. D. Boeck, “Models for ordinal hierarchical classes analysis,” Psychometrika, vol. 66, no. 3, pp. 389–403, Sep. 2001.
[38] B. Ganter and C. V. Glodeanu, “Ordinal Factor Analysis,” in Formal Concept Analysis, F. Domenach, D. I. Ignatov, and J. Poelmans, Eds. Springer Berlin Heidelberg, 2012, pp. 128–139.
[39] R. Belohlavek, “Similarity relations in concept lattices,” Journal of Logic and Computation, vol. 10, no. 6, pp. 823–845, Dec. 2000.
[40] R. Belohlavek, J. Dvořák, and J. Outrata, “Fast factorization by similarity in formal concept analysis of data with fuzzy attributes,” Journal of Computer and System Sciences, vol. 73, no. 6, pp. 1012–1022, Sep. 2007.
[41] R. Belohlavek and M. Krmelova, “Factor analysis of ordinal data via decomposition of matrices with grades,” Ann Math Artif Intell, vol. 72, no. 1, pp. 23–44, Oct. 2014.
[42] R. Belohlavek and M. Trneckova, “Factorization of matrices with grades via essential entries,” Fuzzy Sets and Systems, vol. 360, pp. 97–116, Apr. 2019.
[43] K. Sumangali and C. A. Kumar, “Knowledge Reduction in Formal Contexts through CUR Matrix Decomposition,” Cybernetics and Systems, vol. 50, no. 5, pp. 465–496, Jul. 2019.
[44] P. K. Singh, “Bipolar δequal complex fuzzy concept lattice with its application,” Neural Comput & Applic, vol. 32, no. 7, pp. 2405–2422, Apr. 2020.
[45] M. M. Lin, B. Dong, and M. T. Chu, “Integer Matrix Factorization and Its Application,” 2005. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.157.7359. [Accessed: 05Jun2020].
[46] R. N. Shepard, “The analysis of proximities: Multidimensional scaling with an unknown distance function. I,” Psychometrika, vol. 27, no. 2, pp. 125–140, Jun. 1962.
[47] J. B. Kruskal, “Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis,” Psychometrika, vol. 29, pp. 1–27, 1964.
[48] J. B. Kruskal, “Nonmetric multidimensional scaling: A numerical method,” Psychometrika, vol. 29, pp. 115–129, 1964.
[49] J. B. Kruskal and R. N. Shepard, “A nonmetric variety of linear factor analysis,” Psychometrika, vol. 39, no. 2, pp. 123–157, Jun. 1974.
[50] L. Guttman, “A general nonmetric technique for finding the smallest coordinate space for a configuration of points,” Psychometrika, vol. 33, no. 4, pp. 469–506, Dec. 1968.
[51] J. F. Vera and P. Mair, “SEMDS: An R Package for Structural Equation Multidimensional Scaling,” Structural Equation Modeling: A Multidisciplinary Journal, vol. 26, no. 5, pp. 803–818, Sep. 2019.
[52] I. Borg, “Data Fit (Stress) vs. Model Fit (Recovery) in Multidimensional Scaling,” Austrian Journal of Statistics, vol. 49, no. 2, pp. 43–52, Feb. 2020.
[53] S.T. Lu, M. Zhang, and Q.N. Li, “Feasibility and a fast algorithm for Euclidean distance matrix optimization with ordinal constraints,” Comput Optim Appl, vol. 76, no. 2, pp. 535–569, Jun. 2020.
[54] G. Ekman, “Dimensions of Color Vision,” The Journal of Psychology, vol. 38, no. 2, pp. 467–474, 1954.
[55] R. N. Shepard, “The analysis of proximities: Multidimensional scaling with an unknown distance function. II,” Psychometrika, vol. 27, no. 3, pp. 219–246, Sep. 1962.
[56] R. N. Shepard, “Multidimensional Scaling, TreeFitting, and Clustering,” Science, vol. 210, no. 4468, pp. 390–398, Oct. 1980.
[57] J. Kruskal and M. Wish, in Multidimensional Scaling, SAGE Publications, Inc., 1978.
[58] H. LeeKwang, Y.S. Song, and K.M. Lee, “Similarity measure between fuzzy sets and between elements,” Fuzzy Sets and Systems, vol. 62, no. 3, pp. 291–293, Mar. 1994.
[59] W.J. Wang, “New similarity measures on fuzzy sets and on elements,” Fuzzy Sets and Systems, vol. 85, no. 3, pp. 305–309, Feb. 1997.
[60] V. Vassilevska, R. Williams, and R. Yuster, “All Pairs Bottleneck Paths and MaxMin Matrix Products in Truly Subcubic Time,” Theory of Computing, vol. 5, pp. 173–189, Sep. 2009.
[61] A. Tversky, “Features of similarity,” Psychol. Rev., vol. 84, no. 4, pp. 327–352, 1977.
[62] P. K. Singh and A. Gani, “Fuzzy concept lattice reduction using Shannon entropy and Huffman coding,” Journal of Applied NonClassical Logics, vol. 25, no. 2, pp. 101–119, Apr. 2015.
[63] P. K. Singh, A. K. Cherukuri, and J. Li, “Concepts reduction in formal concept analysis with fuzzy setting using Shannon entropy,” Int. J. Mach. Learn. & Cyber., vol. 8, no. 1, pp. 179–189, Feb. 2017.
[64] P. K. Singh, “Cloud data processing using granular based weighted concept lattice and Hamming distance,” Computing, vol. 100, no. 10, pp. 1109–1132, Oct. 2018.
[65] H. F. Kaiser, “The Application of Electronic Computers to Factor Analysis,” Educational and Psychological Measurement, vol. 20, no. 1, pp. 141–151, Apr. 1960.
[66] E. Ceulemans and H. A. L. Kiers, “Selecting among threemode principal component models of different types and complexities: A numerical convex hull based method,” British Journal of Mathematical and Statistical Psychology, vol. 59, no. 1, pp. 133–150, May 2006.
[67] K. J. Preacher, G. Zhang, C. Kim, and G. Mels, “Choosing the Optimal Number of Factors in Exploratory Factor Analysis: A Model Selection Perspective,” Multivariate Behavioral Research, vol. 48, no. 1, pp. 28–56, Jan. 2013.
[68] T. F. Wilderjans, E. Ceulemans, and K. Meers, “CHull: A generic convexhullbased model selection method,” Behav Res, vol. 45, no. 1, pp. 1–15, 2013.
[69] R. N. Shepard, “Representation of structure in similarity data: Problems and prospects,” Psychometrika, vol. 39, no. 4, pp. 373–421, Dec. 1974.
[70] T. F. Wilderjans, E. Ceulemans, H. A. L. Kiers, and K. Meers, “The LMPCA program: A graphical user interface for fitting the linkedmode PARAFACPCA model to coupled realvalued data,” Behavior Research Methods, vol. 41, no. 4, pp. 1073–1082, Nov. 2009.
[71] T. Wilderjans, E. Ceulemans, and I. V. Mechelen, “The CHIC Model: A Global Model for Coupled Binary Data,” Psychometrika, vol. 73, no. 4, pp. 729–751, Jul. 2008.
[72] J. F. Hair, R. L. Tatham, R. E. Anderson, and W. Black, Multivariate Data Analysis, Fifth edition. Upper Saddle River, N.J: Prentice Hall, 1998.
[73] B. G. Tabachnick and L. S. Fidell, Using Multivariate Statistics, Fourth edition. Boston, MA: Allyn & Bacon, 2000.
[74] A. S. Kaufman, Intelligent Testing with the WISCIII. New York: John Wiley & Sons, 1994.
[75] J. Stevens, Applied multivariate statistics for the social sciences. Mahwah, New Jersey: Lawrence Erlbaum, 2002.
[76] R. A. Peterson, “A MetaAnalysis of Variance Accounted for and Factor Loadings in Exploratory Factor Analysis,” Marketing Letters, vol. 11, no. 3, pp. 261–275, Aug. 2000.
[77] E. F. Glynn II, Spectra software. Overland Park, KS, USA: EFG Computer Lab, 2001.
[78] A. R. Robertson, “The CIE 1976 ColorDifference Formulae,” Color Research & Application, vol. 2, no. 1, pp. 7–11, Mar. 1977.
[79] T. F. Brady, T. Konkle, G. A. Alvarez, and A. Oliva, “Visual longterm memory has a massive storage capacity for object details,” PNAS, vol. 105, no. 38, pp. 14325–14329, Sep. 2008.
[80] T. Konkle, T. F. Brady, G. A. Alvarez, and A. Oliva, “Conceptual distinctiveness supports detailed visual longterm memory for realworld objects,” J Exp Psychol Gen, vol. 139, no. 3, pp. 558–578, Aug. 2010.
[81] M. C. Hout, S. D. Goldinger, and K. J. Brady, “MMMDS: A Multidimensional Scaling Database with Similarity Ratings for 240 Object Categories from the Massive Memory Picture Database,” PLoS ONE, vol. 9, no. 11, p. e112644, Nov. 2014.
[82] D. Jacobowitz, “Development of semantic structures,” Unpublished Ph.D. dissertation, University of North Carolina, Chapel Hill, 1973.
[83] M. Koenigs and D. Tranel, “Prefrontal cortex damage abolishes brandcued changes in cola preference,” Soc Cogn Affect Neurosci, vol. 3, no. 1, pp. 1–6, Mar. 2008.
[84] L. Astolfi et al., “The Track of Brain Activity during the Observation of TV Commercials with the HighResolution EEG Technology,” Computational Intelligence and Neuroscience, vol. 2009, no. Article ID 652078, 2009.
[85] R. N. Khushaba, L. Greenacre, S. Kodagoda, J. Louviere, S. Burke, and G. Dissanayake, “Choice modeling and the brain: A study on the Electroencephalogram (EEG) of preferences,” Expert Systems with Applications, vol. 39, no. 16, pp. 12378–12388, Nov. 2012.
[86] R. N. Khushaba, C. Wise, S. Kodagoda, J. Louviere, B. E. Kahn, and C. Townsend, “Consumer neuroscience: Assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye tracking,” Expert Systems with Applications, vol. 40, no. 9, pp. 3803–3812, Jul. 2013.
[87] S. Lahmiri, “Neuromarketing Perspective of Consumer Choice,” 2018. [Online]. Available: https://www.igiglobal.com/gateway/chapter/199641. [Accessed: 20Jul2018].
[88] V. Grigaliunaite and L. Pileliene, “Emotional or rational? The determination of the influence of advertising appeal on advertising effectiveness,” Scientific Annals of Economics and Business, vol. 63, no. 3, pp. 391–414, 2016.
[89] A. A. Frolov, A. M. Sirota, D. Húsek, I. P. Muraviev and P.A. Polyakov, “Binary Factorization in HopfieldLike Neural Networks: SingleStep Approximation and Computer Simulations,” Neural Network World, vol. 14, no. 2, pp. 139–152, Apr. 2004.
[90] A. A. Frolov, D. Husek, I. P. Muraviev, and P. Y. Polyakov, “Boolean Factor Analysis by Attractor Neural Network,” IEEE Transactions on Neural Networks, vol. 18, no. 3, pp. 698–707, May 2007.
[91] A. A. Frolov, D. Husek, and P. Y. Polyakov, “RecurrentNeuralNetworkBased Boolean Factor Analysis and Its Application to Word Clustering,” IEEE Transactions on Neural Networks, vol. 20, no. 7, pp. 1073–1086, Jul. 2009.
[92] A. A. Frolov, D. Húsek, and P. Y. Polyakov, “Comparison of Seven Methods for Boolean Factor Analysis and Their Evaluation by Information Gain,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 3, pp. 538–550, Mar. 2016.
[93] Y. Shitov, “Factoring a band matrix over a semiring,” Fuzzy Sets and Systems, vol. 382, pp. 165–171, Mar. 2020.
[94] B. AktekeÖzturk, G. Köksal, and G. W. Weber, “Nonconvex optimization of desirability functions,” Quality Engineering, vol. 30, no. 2, pp. 293–310, Apr. 2018.
[95] B. AktekeÖztürk, G.W. Weber, and G. Köksal, “Optimization of generalized desirability functions under model uncertainty,” Optimization, vol. 66, no. 12, pp. 2157–2169, Dec. 2017.
[96] B. AktekeÖztürk, G.W. Weber, and G. Köksal, “Generalized desirability functions: a structural and topological analysis of desirability functions,” Optimization, vol. 69, no. 1, pp. 115–130, Jan. 2020.
[97] O. A. Arqub, M. ALSmadi, S. Momani, and T. Hayat, “Numerical solutions of fuzzy differential equations using reproducing kernel Hilbert space method,” Soft Comput, vol. 20, no. 8, pp. 3283–3302, Aug. 2016.
[98] O. A. Arqub, “Adaptation of reproducing kernel algorithm for solving fuzzy Fredholm–Volterra integrodifferential equations,” Neural Comput & Applic, vol. 28, no. 7, pp. 1591–1610, Jul. 2017,.
[99] O. A. Arqub, M. AlSmadi, S. Momani, and T. Hayat, “Application of reproducing kernel algorithm for solving secondorder, twopoint fuzzy boundary value problems,” Soft Comput, vol. 21, no. 23, pp. 7191–7206, Dec. 2017.
[100] O. A. Arqub and M. AlSmadi, “Fuzzy conformable fractional differential equations: novel extended approach and new numerical solutions,” Soft Comput, vol. 24, no. 16, pp. 12501–12522, Aug. 2020.
[101] E. Kropat, R. A. TikidjiHamburyan, and G.W. Weber, “Operations research in neuroscience,” Ann Oper Res, vol. 258, no. 1 (Special Issue on Operations Research in Neuroscience), pp. 1–4, Nov. 2017.
[102] A. Çevik, G.W. Weber, B. M. Eyüboğlu, K. K. Oğuz, and T. A. D. N. Initiative, “VoxelMARS: a method for early detection of Alzheimer’s disease by classification of structural brain MRI,” Ann Oper Res, vol. 258, no. 1, pp. 31–57, Nov. 2017.
[103] W. Zucchini, I. L. MacDonald, and R. Langrock, Hidden Markov Models for Time Series: An Introduction Using R, Second Edition. Boca Raton: Chapman and Hall/CRC, 2016.
[104] J. Grobelny and R. Michalski, “Applying Hidden Markov Models to Visual Activity Analysis for Simple Digital Control Panel Operations,” in Advances in Intelligent Systems and Computing, J. Świątek, Z. Wilimowska, L. Borzemski, and A. Grzech, Eds. Springer, 2017, pp. 3–14.
[105] J. Grobelny and R. Michalski, “Zastosowanie modeli Markowa z ukrytymi stanami do analizy aktywności wzrokowej w procesie oceny wirtualnych opakowań techniką porównywania parami,” Zeszyty Naukowe Politechniki Poznańskiej. Organizacja i Zarządzanie, no. 73, pp. 111–125, 2017.
[106] A. Coutrot, J. H. Hsiao, and A. B. Chan, “Scanpath modeling and classification with hidden Markov models,” Behav Res Methods, vol. 50, no. 1, pp. 362–379, 2018.
[107] B. H. Ulutas, N. F. Özkan, and R. Michalski, “Application of hidden Markov models to eye tracking data analysis of visual quality inspection operations,” Cent Eur J Oper Res, vol. 28, no. 2, pp. 761–777, Jun. 2020.
[108] J. Grobelny and R. Michalski, “Investigating Human Visual Behavior by Hidden Markov Models in the Design of Marketing Information,” in Advances in Human Factors and Simulation, D. N. Cassenti, Ed Springer, 2020, pp. 234–245.
[109] J. Grobelny and R. Michalski, “Hidden Markov Models for Visual Processing of Marketing Leaflets,” in Advances in Simulation and Digital Human Modeling, D. N. Cassenti, S. Scataglini, S.L. Rajulu, J.L. Wright, Eds Springer, 2021, pp. 72–79.
[110] M. A. Mohamed and P. Gader, “Generalized hidden Markov models. I. Theoretical frameworks,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 1, pp. 67–81, Feb. 2000.
[111] N. K. Verma and M. Hanmandlu, “Additive and Nonadditive Fuzzy Hidden Markov Models,” IEEE Transactions on Fuzzy Systems, vol. 18, no. 1, pp. 40–56, Feb. 2010.
[112] J. Winkley and P. Jiang, “Adaptive probability scheme for behaviour monitoring of the elderly using a specialised ambient device,” Int. J. Mach. Learn. & Cyber., vol. 5, no. 2, pp. 293–307, Apr. 2014.
[113] B. Z. Temoçin and G.W. Weber, “Optimal control of stochastic hybrid system with jumps: A numerical approximation,” Journal of Computational and Applied Mathematics, vol. 259, pp. 443–451, Mar. 2014.
[114] E. Savku and G.W. Weber, “A Stochastic Maximum Principle for a Markov RegimeSwitching JumpDiffusion Model with Delay and an Application to Finance,” J Optim Theory Appl, vol. 179, pp. 696–721, Nov. 2018.
[115] Y. Choi, J. Park, and D. Shin, “A semisupervised inattention detection method using biological signal,” Ann Oper Res, vol. 258, no. 1, pp. 59–78, Nov. 2017.
[116] V. Rasoulzadeh, E. C. Erkus, T. A. Yogurt, I. Ulusoy, and S. A. Zergeroğlu, “A comparative stationarity analysis of EEG signals,” Ann Oper Res, vol. 258, no. 1, pp. 133–157, Nov. 2017.
[117] J. M. Harris, J. Ciorciari, and J. Gountas, “Consumer neuroscience for marketing researchers,” Journal of Consumer Behaviour, vol. 17, no. 3, pp. 239–252.
[118] Y. Zhao and K. Siau, “Cognitive Neuroscience in Information Systems Research,” Journal of Database Management (JDM), vol. 27, no. 1, pp. 58–73, 2016.
Appendix A
Constructing LOS Similarities by the maxmin Operations
Appendix B
The Similarity S Array for the Example with Colors
The original data from [54] were rounded and rescaled such that the minimal value equals one, whereas the maximal amounts to eleven. Colors in the second column were generated by Spectra software, which converts the wave lengths to the RGB color system [77].
No Color Wave
length [nm] 1. 2. 3 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14.
1. 434 11 10 5 5 3 2 2 1 1 2 2 2 2 3
2. 445 10 11 6 5 3 2 2 2 1 1 2 2 2 2
3. 465 5 6 11 9 6 3 2 2 1 1 1 1 2 1
4. 472 5 5 9 11 6 4 2 2 1 1 1 1 1 1
5. 490 3 3 6 6 11 7 4 4 2 1 1 1 1 1
6. 504 2 2 3 4 7 11 7 6 2 2 1 1 1 1
7. 537 2 2 2 2 4 7 11 8 3 2 2 1 1 1
8. 555 1 2 2 2 4 6 8 11 4 3 1 1 1 1
9. 584 1 1 1 1 2 2 3 4 11 7 5 4 3 3
10. 600 2 1 1 1 1 2 2 3 7 11 8 6 5 4
11. 610 2 2 1 1 1 1 2 1 5 8 11 9 7 7
12. 628 2 2 1 1 1 1 1 1 4 6 9 11 10 8
13. 651 2 2 2 1 1 1 1 1 3 5 7 10 11 9
14. 674 3 2 1 1 1 1 1 1 3 4 7 8 9 11
Appendix C
The Similarity Array S for the Example with Nations
The original data from [57, p. 31] were rounded and rescaled such that the minimal value equals one, while the maximal scale value amounts to seven.
No Nation 1. 2. 3 4. 5. 6. 7. 8. 9. 10. 11. 12.
1. Brazil 7 4 4 2 4 4 3 3 1 2 4 2
2. Congo 4 7 4 4 3 4 2 2 3 2 1 3
3. Cuba 4 4 7 4 3 3 3 2 5 4 2 4
4. Egypt 2 4 4 7 4 5 4 3 3 3 2 3
5. France 4 3 3 4 7 2 3 3 3 4 5 4
6. India 4 4 3 5 2 7 3 4 3 4 3 3
7. Israel 3 2 3 4 3 3 7 4 2 3 5 3
8. Japan 3 2 2 3 3 4 4 7 3 4 5 3
9. China 1 3 5 3 3 3 2 3 7 5 2 4
10. USSR 2 2 4 3 4 4 3 4 5 7 4 6
11. USA 4 1 2 2 5 3 5 5 2 4 7 3
12. Yugoslavia 2 3 4 3 4 3 3 3 4 6 3 7
