The state of socio-economic phenomena is usually reflected by a large number of indicators of various importance. In order to quantitatively assess the state of such phenomena, it is necessary to know both the values of the indicators and the weights. When there are many indicators, adequate determination of weights becomes complicated, since experts can no longer mentally weigh the mutual relations of importance of all indicators. The solution of the problem is facilitated by determining the weights in two stages. In the first, the importance ranks of the indicators are obtained, and in the second, based on these ranks, the weights. Both the importance ranks and the weights are determined by experts, therefore it is necessary to check the consistency of their opinions. Today, methods have been developed to determine the consistency of expert assessment of indicator weights, and there is almost no talk about checking the consistency of expert assessment of importance ranks. Methods for determining the consistency of expert assessment of indicator weights are not suitable here, since the expert determines the weights quantitatively, i.e. in numbers, and the importance – qualitatively - indicates which of the two indicators is more important. The proposed methodology, named DeA (definition of agreement), is based on the ratio of the difference in the sums of indicators estimated with identical estimates to the total number of estimates. The compatibility criterion obtained in this way shows the minimum number of identical estimates that must be present in order for the experts' opinions to be consistent.