What do the data say?

1 - does not describe at all

2 - slightly describes

3 - somewhat describes

4 - fairly well describes

5 - describes excellently

Time distance

Absolute difference

Relative difference (ratio)

Graphical presentation

Dear Mr or Mrs,

we have prepared for you a short questionnaire on data presentation formats, when changes in trends are being observed. We kindly ask you to give your opinion on four illustrative examples of data presentation.

It is crucial for us to receive your personal insight on each case presented, thus we kindly ask you not to change your answers to previous questions.

Your cooperation in voluntary and anonimous.

In case you have any questions or comments, please refer to the following e-mail: katja.prevodnikv@fdv.uni-lj.si.

Katja Prevodnik and prof. Vasja Vehovar, PhD

Faculty of Social Sciences, University of Ljubljana

Jezik

In media and in professional public, comparisons between countries, groups, companies, individuals and other units, are often encountered. Here, a simple and illustrative example of trends in the field of social well-being is presented, where changes in trends are observed. The data is hypothetic. We are interested in how you would answer whether the divide between the two units compared for the time interval is increasing, decreasing or remains constant.

Table 1 presents the percentage of people at risk of poverty in Congo and Uganda for the time period from 2010 to 2012.

Table 1: Percentage of people at risk of poverty and absolute difference

The absolute difference of the percentage of people at risk of poverty in 2010 was 8 percentage points (difference: 10 % - 2 %), in 2011 it was 21 percentage points (difference: 31 % - 10 %) and in 2012 it was 27 percentage points (difference: 49 % - 22 %). The absolute difference has thus increased.

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

The same data is presented again, this time with the calculated relative difference (ratio) between the compared units.

Table 2: Percentage of people at risk of poverty and relative difference (ratio)

In 2010, the ratio of percentages of people at risk of poverty in Congo and Uganda was 5:1 (ratio: 10 % / 2 %), which means that in Congo there was a five times higher percentage of people at risk of poverty. The ratio has until 2012 decreased in favour of Uganda. In 2012, it was 2.2:1 (ratio: 49 % / 22 %). This means that the percentage of people at risk of poverty in Congo was only 2.2 times higher from the percentage in Uganda. The relative difference has thus decreased.

Again, in your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

The same data - the percentage of people at risk of poverty in Congo and Uganda - can also be presented graphically.

Figure 1: Percentage of people at risk of poverty in Congo and Uganda

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

The same data can be additionally presented with a third measure of comparison, that is the time distance.

Time distance quantifies the distance (proximity) in time, when the two units (series) compares reach a specified level of a certain indicator (e.g. a certain percentage of people living at risk of poverty) and is expressed in units of time (months, years, etc.). The calculation of time distance is presented in Figure 2.

Figure 2: Percentage of people at risk of poverty in Congo and Uganda, and time distance

Table 3: Percentage of people at risk of poverty in Congo and Uganda, and time distance

Time distance in this case shows that the divide between the compared countries increased. In 2011, the difference between the two countries was 1 year, as the country of Congo achieved 10 % in year 2010. In 2012, the proportion of 22 % represents 1.5 year difference, as Congo reached that level before the year 2011.

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

We present the same data for the last time in a table with the calculations of all three measurements, as well as in a graph.

Table 4: Percentage of people at risk of poverty in Congo and Uganda, absolute difference, relative difference and time distance

Figure 3: Percentage of people at risk of poverty in Congo and Uganda

On a scale of 1 to 5, where 1 means "does not describe at all" and 5 means "describes excellently", evaluate how well an individual measurement describes the comparison between the two countries in this case.

Finally, based on the data and analyses presented, what is the direction of change of the divide between the compared units in the presented case? The divide is:

increasing

remaining constant

decreasing

Do you have any additional comments?

How hard was it for you to answer the question on the direction of change for the example as a whole, based on all data and presentations?

On a scale of 1 to 5, where 1 means "not at all comprehensible" and 5 means "extremely comprehensible", evaluate how comprehensible are the individual measurements in your personal opinion.

In media and professional public, comparisons between countries, groups, companies, individuals, and other units are often encountered. Here, a simple and illustrative example of trends in the field of social well-being is presented where changes in trends are observed. The data is hypothetic. We are interested in how you would answer whether the divide between the two units compared for the time interval is increasing, decreasing or remains constant.

Table 1 presents the percentage of people at risk of poverty in Congo and Uganda for the time period from 2010 to 2012.

Table 1: Percentage of people at risk of poverty and the relative difference (ratio)

In 2010, the ratio of percentages of people at risk of poverty in Congo and Uganda was 5:1 (ratio: 10 % / 2 %), which means that in Congo there was a five times higher percentage of people at risk of poverty. The ratio has until 2012 decreased in favour of Uganda. In 2012, it was 2.2:1 (ratio: 49 % / 22 %). This means that the percentage of people at risk of poverty in Congo was only 2.2 times higher than the percentage in Uganda. The relative difference has thus decreased.

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

We present the same data again, this time with calculated absolute difference between the compared units.

Table 2: Percentage of people at the risk of poverty and the absolute difference

The absolute difference of the percentage of people at risk of poverty in 2010 was 8 percentage points (difference: 10 % - 2 %), in 2011 it was 21 percentage points (difference: 31 % - 10 %) and in 2012 it was 27 percentage points (difference: 49 % - 22 %). The absolute difference has thus increased.

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

The same data - the percentage of people at risk of poverty in Congo and Uganda – can also be presented graphically.

Figure 1: Percentage of people at risk of poverty in Congo and Uganda

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

The same data can be additionally presented with a third measure of comparison, that is the time distance.

Time distance quantifies he distance (proximity) in time, when the two units (series) compares reach a specified level of a certain indicator (e.g. a certain percentage of people living at risk of poverty) and is expressed in units of time (months, years, etc.). The calculation of time distance is presented in Figure 2.

Figure 2: Percentage of people at risk of poverty in Congo and Uganda, and time distance

Table 3: Percentage of people at risk of poverty in Congo and Uganda, and time distance

Time distance in this case shows that the divide between the compared countries increased. In 2011, the difference between the two countries was 1 year, as the country of Congo achieved 10 % in year 2010. In 2012, the proportion of 22 % represents 1.5 year difference, as Congo reached that level before the year 2011.

In your opinion, has the divide in the percentage of people at risk of poverty in Congo and Uganda in this time period increased, decreased or remained constant?

Decreased

Remained constant

Increased

How hard was it for you to answer the previous question?

We present the same data for the last time in a table with the calculations of all three measurements, as well as in a graph.

Table 4: Percentage of people at risk of poverty in Congo and Uganda, absolute difference, relative difference and time distance

Figure 3: Percentage of people at risk of poverty in Congo and Uganda

On a scale of 1 to 5, where 1 means "does not describe at all" and 5 means "describes excellently", evaluate how well an individual measurement describes the comparison between the two countries in this case.

Finally, based on the data and analyses presented, what is the direction of change of the divide between the compared units in the presented case? The divide is:

increasing

remaining constant

decreasing

Do you have any other comments?

How hard was it for you to answer the question on the direction of change for the example as a whole, based on all data and presentations?

Rate on the scale from 1 to 5, where 1 is "not hard at all" and 5 is "extremely hard".

On a scale of 1 to 5, where 1 means "not at all understand" and 5 means "understand", evaluate how well you personally understand individual measurement.

On a scale of 1 to 5 rates, to what extent do you personally agree or disagree with the following statements.

1 means "strongly disagree", 5 means "strongly agree".


	1 - strongly disagree	2 - disagree	3 - neither agree nor disagree	4 - agree	5 - strongly agree
To understand a comparison of a divide in time, the graphical representation is sufficient.
I understood the case well enough.
To understand the comparison only one measurement would suffice.
Time distance is important additional information.
Measures complement each other.
Time distance can serve as an independent measure of a divide.
I understand the example better, when all three measures and the graph are presented.
Graphical presentation is essential to understand a comparison of a divide in time.

In your opinion, a single measurement would therefore suffice for the presentation of a case. Which one would you choose?

Absolute difference

Relative difference (ratio)

Time distance

Drugo:

Please, rate the importance of a proper presentation of statistical data in the areas listed below.


	1 - not at all important	2 - somewhat unimportant	3 - moderately unimportant	4 - somewhat important	5 - very important
In your work
In online media
In other media (printed newspapers, magazines, television, radio)
In politics (for the formulation, preparation and justification of measures and strategies)
In school or in education

The following statements refer to statistics presented in the media (e.g. data in tables, graphs, simple statistical analyses and interpretations etc.).

Please, indicate to what extent do you agree or disagree with each statement.


	1 - strongly disagree	2 - disagree	3 - neither agree nor disagree	4 - agree	5 - strongly agree
Usually, the data is understandably presented.
Authors are often insufficiently competent for reporting statistics.
I always think about the basic data on my own.
The interpretations of the data are often intentionally misleading.
Usually, the data is correctly represented.
I always believe the data presented.

What is your primary field of work?

Natural sciences (mathematics, computer science and informatics, physics, chemistry, soil and environment, biology, other natural sciences)

Engineering and technological sciences (construction, electrical engineering, electronics and information engineering, mechanics, chemical engineering, materials, health engineering, environmental engineering, materials, medical engineering, environmental engineering, environmental biotechnology, industrial biotechnology, nanotechnology, other technical and technological sciences)

Medical and health sciences (medicine, clinical medicine, health sciences, medical biotechnology, other medical sciences)

Agriculture (agriculture, forestry and fisheries, animal and dairy science, veterinary science, agricultural biotechnology, other agricultural sciences)

Social sciences (psychology, economics and business sciences, education, sociology, law, political sciences, economic and social geography, media and communications, other social sciences)

Humanities (History and Archeology, Languages and Literature, Philosophy, Religion and Ethics, Art, Other Humanities)

Interdisciplinary area - please explain:

Please, mark the levels of formal education where you listened to individual contents.

	Statistics (as an individual subject)	Mathematics	Statistics within other subjects
In high school
In undergraduate study
In post-graduate study

Please, mark whether you listened to the listed contents elsewhere.

	Statistics	Mathematics
At work (in a job, company)
On seminars, courses or workshop
Self-education

Overall, is your knowledge of mathematics sufficient for your needs?

Overall, is your knowledge of statistics sufficient for your needs?

The following statements refer to statistics presented in the media (e.g. data in tables, graphs, simple statistical analyses and interpretations etc.). Please, indicate to what extent do you agree or disagree with each statement.

What is you highest level of formal education?

mary school or less

vocational school (2- or 3-year vocational school)

high school

college, university (first degree), a university degree or second degree Bologna (Bologna master's degree)

science master's degree or PhD

Age

up to 30 years old

31 - 40 years old

41 - 50 years old

50 years and over

Gender

Male

Female

Please, indicate to what extent do you personally agree or disagree with following statements.

We have therefore presented you with some examples in which the direction of the movement of the gap, according to various dimensions, is not entirely clear. In fact, there is no consensus on the correct answer to the question posed in the presented cases also in professional circles. We do not know the unequivocal answer to this question, and with the knowledge of the understanding of cases we would like to draw up certain guidelines for the use of individual measures in such cases.

You have greatly contributed to this by participating in the research, for which we sincerely thank you.If you wish to receive a short summary of results after the completed study, please email us at katja.prevodnik@gmail.com.

Thank you!