CHAPTER 3 METHODOLOGY
3.5 Reliability Test and Pilot Study
In quantitative study involving a survey questionnaire, it is important to identify the internal consistency of the questionnaire items that is the degree of similarity of the questions as understood by different test subjects. Hence, before the questionnaire was distributed to the respondents, it is important to determine its reliability. According to Creswell (2012), reliability test indicates the consistency of the instrument’s score and produces same results even when it is repetitively tested. Oppenheim (2003) emphasized that questionnaire even is adapted from previous studies needs to be constructed, revised and refined before the actual data collection can be implemented.
This is in line with Tang et al. (2013) which considered pilot study as a preparation stage to increase the content validity of the questionnaire measurement before conducting the actual or the large-scale study. The study conducted a pilot study for the purpose of determining the reliability of the questionnaire using Cronbach’s coefficient alpha test. The Cronbach’s coefficient alpha value indicates the consistency of the items in the questionnaire. As noted by Pallant (2013), items with high correlation values ranged from 0 to 1 indicate great reliability, while Kuhn and Jackson (1989) emphasize that a score of 0.40 or greater is considered acceptable and reliable.
Hence, the study accepted items with a coefficient alpha value of more than 0.40.
77
There are various suggestions regarding the size number of respondents selected for the pilot study. Malhotra (2008) for instance, recommends an appropriate size for conducting a pilot study to be between 15 and 30. It is also noted that the general guideline for choosing the number of respondents for pilot testing is 10% of the projected sample of the study (Connely, 2008). Additionally, a number between 10 to 30 respondents is also considered suitable by Isaac and Michael (1995) and Hill (1998). As the targeted respondents for the study was 400, a sample of 40 respondents (10%) was selected for the pilot study. Due to the Covid-19 pandemic and the implementation of Movement Control Order (MCO), the questionnaire was distributed to the respondent through online using a Google form link. The questionnaire was posted to the email platform of academic staff of the Universiti Utara Malaysia (UUM). The email also stated that only those who are living in the specific tourism areas such as ecotourism, natural-park, cultural heritage, agrotourism and other areas that are directly affected by climate change to answer the questionnaire. This is very important to make sure that their respond is valid and reliable. The Google link was closed within three weeks, once the number of the returned questionnaire reached 40.
The responses were presented in an Excel format and then were transferred to Statistical Package for Social Sciences (SPSS-PC) version 25 for Windows for further analysis.
Table 3.2 describes the findings of Part 1 regarding the socioeconomic characteristics of respondents. Briefly, majority of the respondents were female (67.5%) and the
78
remaining were male (32.5%). Most respondents were below 25 years old (67.5%) and single (70.0%). Interestingly, all respondents had tertiary level of education. The findings also indicated that majority of the respondents were living within 5 – 10 people (57.5%) and contributed to less than RM1000 income per month (57.5%). The findings revealed significant output to the objectives of the study regarding the types of tourism in their area. Most respondents were living in the area of beach/island tourism (25.0%), followed by ecotourism (20.0%), natural park tourism (17.5%) and cultural heritage tourism (15.0%). Further, majority of the respondents eventually understand the meaning of climate change (80.0%).
Table 3.2
Socioeconomic characteristics of respondents (N=40)
Items Frequency Percent
Gender
Male Female
13 27
32.5 67.5 Age
Below 25 years old 25 – 35 years old 36 – 45 years old 46 – 55 years old Above 55 years old
27 6 2 1 4
67.5 15.0 5.0 2.5 10.0 Marital status
Single Married Divorced Others
28 10 1 1
70.0 25.0 2.5 2.5
79 Level of education
Primary Secondary Tertiary
No formal education
0 0 40 0
0 0 100 0 Household size
Less than 5 people 5 – 10 people
More than 10 people
17 23 0
42.5 57.5 0 Occupation
Government servant Private sector
Own business No occupation
40 0 0 0
100 0 0 0 Income per month
Less than RM1000 RM1000 – RM5000 More than RM5000 No income
23 11 6 0
57.5 27.5 15.0 0 Types of tourism activity in your community
Ecotourism
Adventure tourism Wildlife tourism Natural Park tourism Cultural heritage tourism Beach/island tourism Urban tourism
Mountain tourism
8 1 0 7 6 10 3 0
20.0 2.5 0 17.5 15.0 25.0 7.5 0
80 Agro-tourism
Others
5 0
12.5 0 Number of years living in the community
Less than 5 years 5 – 10 years 11 – 20 years More than 20 years
5 10 1 24
12.5 25.0 2.5 60.0 Do you understand the meaning of climate
change?
Yes No Not sure
32 1 7
80.0 2.5 17.5
Further, the reliability test for the pilot study showed that Part 2 - 4 of the questionnaire derived with strong value of Cronbach’s coefficient alpha (Table 3.3). Part 2 which asked the respondents about their awareness of climate change consisted of 13 items revealed coefficient alpha value of .923. The perceptions about climate change impacts in Part 3 revealed a strong coefficient alpha value of .938 and Part 4 on the perceptions about adaptation strategies indicated a value of .930 coefficient alpha.
However, the findings noted that two items in Part 2 derived with Cronbach’s coefficient alpha value of less than 0.40. The items were identified as, ‘Climate change is a natural phenomenon’ (coefficient alpha = .226) and ‘Climate change cannot be overcome’ (coefficient alpha = .246). Hence, these items were eliminated from the questionnaire. Other items were retained in the questionnaire for further data collection of the actual study.
81 Table 3.3
Reliability test for items in the questionnaire (N=40)
Part Statement Item-total
correlation
Total items
Coefficient Alpha 2 Community Awareness of Climate
Change
13 .923 1 Climate change is one of the most serious
challenges in the world.
.841
2 Climate change is a natural phenomenon. .226 3 Climate change is caused by human
activities.
.710
4 Climate change is all about rainfall. .567 5 Climate change is all about rising
temperature.
.757
6 Climate change affects natural environment. .881 7 Climate change affects human life. .841 8 Community is responsible for climate
change.
.857
9 The government is responsible to solve climate change issues.
.717
10 There is a relationship between climate change and tourism activities.
.804
11 Climate change destroys tourism activities. .682 12 Climate change can be solved by having
adaptation strategies.
.765
13 Climate change cannot be overcome. .246 3 Community’s Perceptions about Climate
Change Impacts on Tourism Activities
18 .938 1 Tourism activities in the community are
affected due to extreme heat conditions.
.493
2 Tourism activities in the community are affected due to frequent droughts.
.574
82
3 Tourism activities in the community are affected due to fires in forest.
.493
4 Tourism activities in the community are affected due to frequent floods during raining seasons.
.518
5 The sea level rise has great impact on tourism activities in the community.
.652
6 Tourism activities in the community are affected due to beach erosion.
.527
7 Natural forest resources for tourism activities in the community have declined due to climate change.
.806
8 Coral reefs in the community are damaged due to climate change.
.820
9 There has been a loss of biodiversity for tourism activities in the community due to climate change.
.677
10 Climate change has caused behavioral change of wildlife in the community.
.618
11 Changes in seasonal pattern have great impact on tourism activities in the community.
.828
12 Unpredictable weather has affected tourism activities in the community.
.689
13 Water sufficiency due to climate change has affected tourism activities in the community.
.621
14 Deceases caused by climate change has affected tourism activities in the community.
.623
15 Climate change has caused difficulty for the community to run daily errands of tourism activities.
.780
16 Infrastructure damage caused by climate change has affected tourism activities in the community.
.818
17 Climate change has led to loss of income for tourism in the community.
.652
83
18 Climate change has led to loss of job for tourism in the community.
.602
4 Community’s Perceptions about Adaptation Strategies for Climate Change
10 .930 1 Develop strong collaborations between
stakeholders in the community.
.576
2 Involve the community in monitoring the impacts of climate change on tourism activities.
.771
3 Communicate and raise awareness among community regarding climate change and tourism through websites and current technology.
.752
4 Educate the community on climate change and tourism.
.855
5 Provide early warning and response capability of climate change to the community.
.831
6 Create emergency response center in the community due to the impacts of climate change on tourism.
.802
7 Invest innovation in measurement systems and resources of climate change pertaining to tourism activities in the community.
.762
8 Offering substitute attractions for the community as tourism activities in the area.
.714
9 Relocate tourism activities in the community that are affected due to climate change.
.632
10 Implement water quality for tourism activities in the community.
.629
84