On definition and construction of association measures

1Introduction

The association measures are widely used in data analysis. Different association and correlation measures have been introduced in statistics, data mining, fuzzy set theory etc. [1, 7, 12, 13, 17] for different types of data. The Pearson’s correlation coefficient [12]

is the most popular association measure used for analysis of possible relationships between variables. Many association measures similar to the correlation coefficient have been proposed but it is an interesting problem not only to introduce a new association measure for some type of data but to analyze a class of functions similar to the correlation coefficient and to propose the methods of their generation. In [1], it was proposed the measure of correlation between fuzzy membership functions satisfying to the set of properties similar to the properties of the Pearson’s correlation coefficient. In [6], it was considered another set of properties similar to the properties of Pearson’s correlation coefficient and defining the time series shape association measures. In [7], the general methods of construction of such association measures have been proposed and the sample Pearson’s correlation coefficient was obtained as a particular case of the general approach. In [8], the methods proposed in [7] have been extended on the general case of functions A : X × X → [-1, 1] defined on a set X with involutive operation N (called reflection) and satisfying the properties similar to the properties of the Pearson’s correlation coefficient. The methods of construction of such measures [8, 9] use similarity measures and pseudo-difference operations associated with t-conorms [2, 15]. In [9], the problems appeared in the definition of the general class of functions similar to the Pearson’s correlation coefficient have been discussed. These problems have the different reasons. First, the properties of the function (1): corr(x,x) = 1 and corr(x,–x) = –1, are, really, contradictive for the n-tuple x = (0, …  ,0) where it is fulfilled: x = –x. The similar problem appears, generally, for the fixed points of the reflection operation N used in the definition of the association measure A. Second, the function (1) does not defined for the constant n-tuples x = (x ₁, …, x _n ) = (s, …, s) where s is some real value because the denominator of (1) equals to 0. Similarly, it is possible that an association measure cannot be defined on all set X. Such elements of X can be excluded from the domain of the association measure or this function should be additionally defined there. Third, depending on the domain X, additionally to the general properties of the association measures it is possible to consider other properties specific for this domain. See, for example, the definition of time series shape association measure [6, 7].

The current paper tries to avoid these problems by two ways. First, to consider explicitly the association measures defined on some subset V of X where these problems disappear. Second, to define the association measure on the set X and to correct some properties required from the association measure to avoid the possible contradiction between them.

The current paper also gives the proofs of some general results considered in the previous papers of the author without proofs. Some related details can be found also in [10].

The paper has the following structure. Section 2 discusses the definitions and the properties of association measures defined on the sets with involutive operation. For example, the simple association measure on the set of real values is introduced. Section 3 considers the basic definitions and the properties of operations of fuzzy logic used in the following sections. Section 4 considers the general methods of construction of association measures and gives the proofs of the related theoretical results. Section 5 considers an example of association measure constructed by proposed methods. The conclusions are given in the last section.

2Association measures

Let X be a set and |X|>1.

Definition 1. Let N : X → X be a function satisfying for all x ∈ X the property:

N is called a reflection on X if it is not an identical function, i.e. for some x ∈ X it is fulfilled N (x) ≠ x. An element x ∈ X, such that

is called a fixed point of N in X.

The fixed points will be denoted by x _FP , hence:

Denote FP (N, X) the set of all fixed points of N in X. This set can be empty.

Definition 2. Let X be a set with a reflection operation N on X, V be a subset of X, |V|>1, from x ∈ V it follows N (x) ∈ V and the restriction of N on V is a reflection on V. A function A : V × V → [-1, 1] satisfying for all x, y ∈ V the properties:

is called an association measure on V.

Proposition 1. If A is an association measure on V ⊆ X then V ⊆ X ∖ FP (N, X).

Proof. Suppose Proposition 1 does not true, i.e. A is afunction satisfying on V the properties (5)-(7) and Vcontains some fixed point x _FP of the reflection N.Then from Equations (4) and (6) we obtain: A (x _FP , N (x _FP )) = A (x _FP , x _FP ) =1, but from Equations(7) and (6) we have: A (x _FP , N (x _FP )) = - A (x _FP , x _FP ) = -1. The obtained contradiction proves the proposition. ■

Consider the following properties of association measures:

Proposition 2. The association measure A on V satisfies for all x, y ∈ V the properties (8), (9) and the following property:

Proof. (8) and (9) follow from Equations (7) and (5): A (N (x) , N (y)) = - A (N (x) , y) = - A (y, N (x)) = A (y, x) = A (x, y). A (N (x) , y) = A (y, N (x)) = - A (y, x) = - A (x, y) = A (x, N (y)). Equation (10)follows from Equations (7) and (6): A (x, N (x)) = - A (x, x) = -1. ■

Definition 3. Let X be a set with a reflection operation N on X and FP (N, X) be a set of fixed points of N. A function A : X × X → [-1, 1] will be called:

Proposition 3. An association measure A of type 1 on X satisfies for all x, y ∈ X the properties (8), (9) and:

Proof. For the proof of Equations (8), (9) and (11) see the proof of Proposition 2. Let us prove Equation (12). From Equations (4), (7) and (5) for all x ∈ X and all x _FP  ∈ FP (N, X) it follows: A (x, x _FP ) = A (x, N (x _FP )) = - A (x, x _FP ) hence A (x, x _FP ) =0 and A (x _FP , x) =0. ■

Note that from Proposition 3 it follows A (x _FP , x _FP ) =0. Although some papers require the fulfillment of (6) for all x ∈ X, in this paper the association measures of type 2 will be not considered. The property (12) of association measures of type 1 seems more reasonable. See [10].

3Basic properties of operations of fuzzy logic

Consider the basic properties of the operations of fuzzy logic used in the following sections [2–5, 10, 11, 14–16, 18].

Definition 7. t-conorm is a function S : [0, 1] ² → [0, 1] satisfying for all x, y, z ∈ [0, 1] the following properties:

From the definition of t-conorm it follows for all a ∈ [0, 1]:

Definition 8. A t-conorm S is nilpotent if there exist x, y ∈]0, 1 [ such that S (x, y) =1.

Definition 9. An element x ∈]0, 1 [ is a nilpotent element of t-conorm S if there exists y ∈]0, 1 [ such that S (x, y) =1.

It is clear that t-conorm S has no nilpotent elements if and only if for all x, y ∈ [0, 1] it is fulfilled:

Consider the simplest, basic, t-conorms:

Maximum and probabilistic sum have no nilpotent elements but Lukasiewicz t-conorm has.

Definition 10. Let S be a t-conorm.

(i) The S-difference-s is defined for all a, b ∈ [0, 1] as follows:

(ii) The pseudo-difference ⊖s associated to S is defined for all a, b ∈ [0, 1] as follows:

Pseudo-difference ⊖s associated to S has the following properties (see [10, 15] for details):

1) 1⊖sb=1, if b = 0 or

2) For any a, b ∈ [0, 1] it is fulfilled:

3) If t-conorm S is continuous at the point 0 in both arguments then the following is fulfilled for all a, b ∈ [0, 1]:

The following pseudo-differences are associated to the basic t-conorms S _M , S _P and S _L :

Definition 11. An automorphism of the interval[0,1] is a continuous, strictly increasing function φ : [0, 1] → [0, 1] satisfying boundary conditions φ (0) =0, φ (1) =1.

Theorem 1. [3, 18]. A function N : [0, 1] → [0, 1] is a strong negation if and only if there exists an automorphism φ of the unit interval such that

The function φ in Equation (41) is called a generator of N.

Example 1. The standard negation:

has the generator φ (x) = x and the fixed point c = 0.5.

Example 2. Yager negation:

has the generator φ (x) = x ^p and the fixed pointc=0.5p.

Example 3. The negation, introduced by Batyrshin in [10]:

It has the generator:

This simple strong negation connects by line segments the fixed point (c, c) with the points (0,1) and (1,0). It can be used for construction of strong negations with any fixed point c ∈]0, 1 [.

4Constructing association measures

Consider the methods of construction of association measures using a similarity measure and pseudo-difference operation associated with some t-conorm and prove the related results [8, 9].

Definition 12. A function SIM : X × X → [0, 1] is a similarity measure on X if it satisfies for all x, y ∈ X the properties:

Definition 13. A similarity measure SIM on X is strict reflexive if

For strict reflexive similarity measure SIM on X with reflection N it is fulfilled the property of weak similarity of reflections:

Proposition 6. The similarity measure SIM satisfies for all x, y ∈ X the cancellation of reflections property:

if and only if it satisfies the permutation of reflections property:

Proof. Equation (50) follows from Equation (51)and involutivity of N : SIM (N (x) , N (y)) = SIM(N (N (x) , y)) = SIM (x, y). Equation (51) follows from Equation (50) and involutivity of N : SIM (x, N (y)) = SIM (N (x) , N (N (y))) = SIM (N (x) , y). ■

Theorem 2. Suppose X is a set with a reflection N, V  ⊆ X ∖ FP (N, X) , |V|>1, V is closed under N which is a reflection on V, S is a t-conorm and SIM is a similarity measure on X satisfying the permutation of reflections property then the function A _SIM,S  : V × V → [-1, 1] defined for all x, y ∈ V by

is an association measure on V.

Proof. We need to prove only Equations (5) and (7).

Let us prove Equation (5). For y = x Equation (5) is fulfilled trivially.

For y = N (x) from involutivity of N we have x =N (y), and from Equation (53) we obtain: A _SIM,S (x, y) = A _SIM,S (x, N(x))=-1 and A _SIM,S (y, x)=A _SIM,S (y, N(y))=-1, hence A _SIM,S (x, y)=A _SIM,S (y, x).

Suppose y ≠ x, y ≠ N (x) then from the involutivity of N it follows N (y) ≠ x. From Equations (54), symmetry and permutation of reflections properties of SIM we obtain:

Let us prove Equation (7). For y = x Equation (7)follows from Equations (53) and (52): A _SIM,S (x,N (y))   =  A _SIM,S  (x, N (x))   = -1 = - A _SIM,S  (x, x) =-A _SIM,S  (x, y).

For y = N (x) Equation (7) follows from the involutivity of N, Equations (52) and (53): A _SIM,S  (x,  N (y))   =  A _SIM,S  (x,  N (N (x)))   =  A _SIM,S  (x,  x)   =  1  =   -  A _SIM,S  (x,  N(x)) = - A _SIM,S  (x, y).

If y ≠ x, y = N (x) then Equation (7) follows from Equation (54), involutivity of N and Equation (36):

Theorem 3. If in the conditions of the Theorem 2 SIM is a similarity measure on X satisfying the properties of permutation of reflections and weak similarity of reflections then the function A _SIM,S  : V × V → [0, 1] defined for all x, y ∈ X by:

is an association measure on V if one of the following is fulfilled:

Proof. The symmetry of A _{SIM, S} follows from the symmetry and the permutation of reflections properties of SIM:

The reflexivity of A _SIM,S follows from the reflexivity and weak similarity of reflections properties of SIM and from (35) that requires the fulfilment of (56) or (57):

The inverse relationship of A _{S IM, S} follows from the involutivity of N and Equation (55):

5Examples of association measures

The examples of association measures on different domains constructed by the methods discussed in the previous section can be found in [7–10]. The similarity measures satisfying the conditions of Theorems 2 and 3 can be obtained from the distance measures used together with some data transformation [7], from generators of strong negations [3, 5, 9, 10] etc. For example, suppose φ, ψ : [0, 1] → [0, 1] are automorphisms of [0,1] and φ defines by (41) a strong negation N on [0,1]. Then the function

is a similarity measure on [0,1] that can be used for constructing association measure on [0,1] related with strong negations (42)-(44) (see [10] for details). Below is an example of the simplest association measure on [0,1] related with the standard negation(42) [10]:

6Conclusion

The paper gives the definitions of the association measures generalizing the Pearson’s correlation coefficient and proposes the general methods of construction of such measures. The proofs of the main results are provided. The simple association measure on the set of real numbers is introduced. The considered methods of generation of association measures can be used for construction of association measures on different domains.