Escolar Documentos
Profissional Documentos
Cultura Documentos
Using Math Evolve, a Tablet-Based Game, to Develop Numeracy Skills in Elementary School
Research Proposal
Jhodi Leong
80026115
University of British Columbia
ETEC 500 65C
Dr. Sunah Cho
April 5, 2013
Introduction
As a high school mathematics teacher, my colleagues and I have noticed a consistent pattern over
the last few years that students are coming into our classrooms with weaker basic numeracy
skills such as the ability to add, subtract, multiply, and divide integers and fractions. Students are
increasingly becoming reliant on the use of calculators for these skills that are an essential
foundation for success in higher level mathematics. Various literature reports that this is an
increasingly reported observation and is of concern to education systems across the country.
Practice is a key factor in the development of these skills, as well as the students ability for
speed, accuracy, and application of skills in a variety of contexts. Engagement can increase the
level of interest for students and therefore the frequency at which they will want to participate in
learning opportunities. Therefore, finding engaging ways for students to practice basic numeracy
skills is essential in the foundational years when these skills are being developed.
Problem Statement
What effect do tablet-based math games focused on basic numeracy skills have on engagement,
frequency of practice, and accuracy for students in the sixth grade?
This research study will look at how the tablet-based mathematics game, Math Evolve, designed
to use basic numeracy skills in an educational game can impact the engagement level, frequency
of practice, and level of ability of students in grade six. This study will focus on the factors that
contribute to engagement and how engagement can influence the level of interest, frequency of
practice, and accuracy for students.
Cher Lim, Darren Nonis, and John Hedberg (2006) thoroughly explore the effect on
engagement of the use of a 3D virtual environment in science. The use of a seven-level
taxonomy of engagement developed through previous research of observations of sixthgrade students and computer software was significantly informative and used in the
development of the taxonomy for engagement for this study. The qualitative study of
engagement provided substantial insight for effective methods and challenges experienced
in their study such as the inability of students to adequately reflect on engagement
provided insight for improvement of effective questioning for the interview phase of this
study.
Tablet Use for Education. Eugene Geist (2012) completed a research study on the
interactions of two year-olds with tablet technologies. Findings regarding the intuitive
nature, level of engagement, and ease of use were presented in a qualitative study
providing significant evidence for the advantageous use of tablet technologies with young
students.
Andrew Jaciw, Megan Toby, and Boya Ma (2012) study the effectiveness of an algebrabased tablet program as well as the implementation practices that contributed to
effectiveness to conclude that higher levels of engagement were reached when teachers
promoted the use of tablets with excitement and confidence. This research is significant to
this study because it provides significant insight into how a tablet can be used in a
mathematics program as well as the conditions that facilitated its use and learning. The
study did not however examine the student motivations that led to such experiences.
Leslie Couse and Dora Chen (2010) explore the use of tablet computing in early childhood
education in a 41-participant case study. Findings reveal statistically significant results for
positive student engagement and interactivity. Significant work with the Information
Society for Technology in Education (ISTE) and the National Association for the Education
of Young Children (NAEYC) focusing on meeting standards such as creativity and
innovation, communication and collaboration, critical thinking, problem-solving and
decision-making, and technology operations and concepts through the use of tablets in the
education of young children is provided. A mixed-method approach found relationships
between tablet use and high levels of interactivity and engagement. These results provide
significant relevance to the development and support of this study.
Educational Games. Will Richardson (2012) explores the current role of games in
students lives and how these games can be tailored towards education to positively impact
engagement and motivation in his paper. Specific examples and case studies are explored
and analyzed providing real-life examples and analysis. Educational benefits are
thoroughly explored and the use of experts and literature to analyze findings is prevalent.
Further exploration of the difficulties in the use of these educational games in the
classroom would have been useful to provide understanding about specific factors that led
to engagement and frustration.
Don Hernandez (2009) explored the impact of gaming and autonomy on academic
achievement and the characteristics of gaming that were engaging and motivating to
students to report that gaming promoted student autonomy, leadership skills, and initiative.
Emphasis was on mathematics-based games and the conditions under which these games
took place, the affordances allowed to methods of instruction, and changes in behaviour,
social skills, and attitudes toward learning. This research is significant to this area of study
because it provides insight as to how games can impact motivation and engagement in a
positive way and how this has the potential to positively impact frequency of practice and
achievement.
Leicha Bragg (2012) observed grade 5 and 6 students in a series of game-playing and nongame-playing sessions of mathematics to explore the effect of games on on-task
behaviours. Bragg provides significant evidence for her argument that games increase ontask student behaviour during mathematics lessons and provides ample literature in support
of her findings. This research provides support for the effectiveness of Math Evolve to
increase level of interest for students in mathematics. Further exploration as to the
characteristics of the games that the students found engaging would have provided
valuable information to the current study.
Emerging Themes
Consistent findings for increased engagement and tablet use were consistent amongst the
research. Increased motivation was encouraged by the use of tablet-based activities, which
frequently led to more on-task behaviour and student interest. The structure and use in real-life
of gaming has been found to provide students with a familiar activity positively associated with
pleasant experiences. Students have been found to show similar feelings when using educational
games that have been designed in a similar fashion. Support for increased focus and positive
attitudes towards learning have been expressed.
engagement
Literate
learning
Integrating
thinking
new
knowledge
with
personal
experience
materials.
and
6
Critical
knowledge
Self-
engagement
systemic
knowledge-
Self-
building
Developing
regulated
interest
content
expertise in
areas of
interest
Structure-
Developing
dependent
schema for
engagement
10
content
comprehens
completion.
Frustrated
ion
Developing
engagement
schema for
material use
Unsystemati Acquiring
disconnecte
engagement
d facts
about
apparent reason.
material and
1
content
Disengagem None
ent
Level
engagement
Highly
active
engagement
11
Active
engagement
Passive
participating.
Students show or express passive personal engagement through
engagement
Minimal or
no
engagement
Following a required 20 minutes spent on the numeracy activity, students will be given an
option of educational free-time for 10 minutes, which will consist of the option to either
continue the numeracy activity that they are already currently completing, or choose from
an assortment of individual math puzzles/worksheets or math-based reading. Students will
be observed and their choices will be recorded using the following criteria:
Table 3: Continued student engagement
Descriptive indicators
Level
Type of
engagement
Continued
engagement
Discontinued
engagement
on to a new activity.
12
At the end of each day, students will be given the option to sign out learning materials (ie.
worksheets or tablets) for continued use and practice at home. Students using worksheets
will be asked to self-record (or have a parent record) the amount of time spent practicing
using a time log and students using tablets will have their time monitored on their account
set up through Math Evolve. Student data will be recorded using the following criteria:
Table 4: Student frequency of practice
Descriptive indicators
Students show that they have spent 30 minutes or more
Level
2
Time
30 minutes or
more
5-30 minutes
5 minutes or
less
engaging in activity.
Student work will be marked for final answer correctness and given a percent score
ranging from 0%-100%. This data will be recorded individually after each observation and
sorted using the following 10% ranges:
Table 5: Student accuracy
Level
Percent score
9
91%-100%
8
81%-90%
7
71%-80%
6
61%-70%
5
51%-60%
4
41%-50%
3
31%-40%
2
21%-30%
1
11%-20%
0
0%-10%
Part 2: At the conclusion of the observational phase (Part 1 above) of the study, students
will complete a survey to reflect on the personal motivations and material characteristics
13
Technique
Survey
Structure
15-30
questions
using a
Likert-
type scale
of 1
(never) 5
(always)
14
separately. From the larger sample, 30 participants will be randomly selected for analysis
and their data will be separated from the larger group.
The main focus of this study will be on the data collected from the combination of tables 1
and 2 to understand the effect of tablet use on engagement. Results from each of the 10
observations will be combined into a score out of 100. The mean of this data will be used
as a measure of central tendency to calculate the average scores for the control and
treatment groups. The range of scores will be recorded separately for each group and
analysed for variance to investigate the spread of data and comparison between groups.
Standard deviation (using z-scores) will be used to determine levels of high engagement
(one or more standard deviation above the mean), average engagement (within one
standard deviation above or below the mean), and low engagement (one or more standard
deviations below the mean). The use of standard deviations to determine levels of
engagement allows for the two sets of data to be compared more easily for variability.
Analysis of each group for normal distribution/skewing will yield results valuable for
investigation in the qualitative phase of the study. The Pearson r correlation coefficient
will be used as a measure of relationship between the two sets of data. An r-value close to
+1.00 or -1.00 will yield results in support of the original hypothesis and an r-value close
to 0.00 will yield results that do not support the original hypothesis (although does not
prove it wrong either). An r-value of at least 0.5541 would be ideal to ensure statistical
significance for this sample size.
Data from table 5 will be analyzed using similar methods since it will provide a sufficiently
large range of data that can be analyzed using the mean as a measure of central tendency.
Data from table 5 will however be analyzed for differences or similarities between
15
somewhat significant (
) or insubstantial (
),
will be used for comparative purposes with the structured interview to follow in the
qualitative phase of the study. Results will be used to help develop questions for the
structured interview to gain further insights as to why characteristics fell in each category.
4) Collect qualitative data. Results achieved from the quantitative phase will be used to
formulate specifics of this phase of the study. This segment will focus on the personal
motivations of students and reasons for increased/consistent/decreased levels of
engagement. Questions will focus on the specific characteristics of the learning material
16
that students found/did not find engaging, reasons for choosing to continue/discontinue use
of a material when given the option of educational free-time, and reasons for taking/not
taking home the material for extra practice. The development of interview questions will
be informed additionally by areas and questions from the TERF-N and SESQ previously
used in the quantitative phase of the study. Data will be collected through the following
techniques:
Technique
Structured
interview
ended and
closed
questions
(approxim
ately 10
interview.
questions)
Questions asked will be focused on personal rationale for the
areas listed above. Questions will be dependent on the
quantitative findings. For example, if it is found that there is a
correlation between engagement and material use, questions
would focus on the characteristics of the tablet and game or
paper material that students found engaging/not engaging or for
a correlation between tablet/paper use and
increased/constant/decreased frequency of practice, questions
would be developed to explore the reasons behind choosing to
17
The structured interview will be pilot tested with a grade 6 elementary school class not
involved in the current study, with characteristics similar to those currently participating
prior to being used to ensure that questions make sense to this demographic and elicit
informative responses.
5) Qualitative data analysis. Each interview will consist of one participant and two
researchers. Researchers will independently record and analyse the data and compare
results to ensure consistency. Data will be analysed for common themes and
characteristics amongst the responses. Comparison will be performed with results from the
quantitative data to gain further insight into the motivations behind potential factors that
contributed to engagement and frequency of practice.
Step 1: Researchers will thoroughly read through the data and write memos for an initial
sense.
Step 2: Researchers will add to/review comprehensive descriptions of the participants,
setting, and phenomenon. This could include contextual information, potential different
perspectives of students, observed situations, or social interactions.
Step 3: Researchers will classify the data into smaller categories of engagement,
motivation, and outcomes. Data within each category will be studied for specific
characteristics and themes. These characteristics and themes will then be analyzed
alongside the interviews and all data will be coded for comparison.
18
Maxwells Criteria for Validity will be considered during the analysis of the qualitative
data. Descriptive validity will be ensured by having researchers record key notes verbatim
and recording entire interviews for reflection of accuracy. Interpretive validity will be
confirmed through training prior to the start of the study as well as the use of two
researchers for each interview to interpret the responses independently before comparing.
Theoretical validity will be safeguarded first by the development of the qualitative
questions based on the results from the quantitative data helping to develop meaningful
connections between data, and secondly, by focusing on student motivations and personal
rationale for decisions and outcomes. Although researchers will go through training prior
to the start of this study so that all researchers and observers look for and evaluate the
findings in a similar fashion, having two researchers observe and record the data
independently for each interview and compare findings will help guarantee evaluative
validity. Should the findings of the two researchers vary significantly, a third observer will
be included to review the recorded interview and make an independent analysis for
comparison.
Having used various techniques of quantitative and qualitative methods to collect data,
triangulation of data will be sufficient to cross-check findings. The use of the TERF-N and
SESQ to help develop questions and categorize findings in both the quantitative and
qualitative phases helps to ensure reliability as it is a previously used test proven to have
high reliability (Hart et al., 2011).
6) Interpretation. All data analysis will be performed by researchers with a universityaccredited degree in elementary education and a minimum of 5 years of teaching
experience at an elementary level. Researchers will complete training to provide a clear
19
method of interpretation and conduct to help ensure that all observations and data analysis
are consistent and well-informed.
Quantitative data interpretation is provided through quantitative data analysis component.
Correlational findings (or lack thereof) will be interpreted by determining the degree of
correlation and relationships amongst variables.
Qualitative data interpretation will attempt to answer the following four questions: 1) What
is important in the data? 2) Why is it important? 3) What can be learned from it? and 4)
So what? Researchers will use their personal experience to make valuable, relevant
interpretations/connections amongst the data. Personal understandings of student
engagement and learning/knowledge attained through training and experience will help
guide researchers to make sense of the data. Colleagues with educational experience will
provide critical insight into possible interpretations and meanings. Literature used in study
development as well as additional literature to further explore findings will be used as
support for understanding this area/topic of study. Learning theories will be consulted to
further make sense of the reasons behind findings and understand such factors as
cognitive/emotional development.
Quantitative data and qualitative data findings will be analyzed in conjunction to make
possible connections between empirical evidence of findings for engagement, motivation,
and outcomes and personal motivations and rationale for these findings. Given that the
qualitative phase will depend on the quantitative findings, there will be a significant
relationship between data.
Participants
20
21
22
Roles. Classroom teachers will be responsible for transition in and out of activity
completion. Teachers will be required to be familiar with material use and provide
students with instructions and monitor time allotments. Non-participant observers will
remain passive during observations and active during interviews.
Rationale
A mixed-methods design focusing on quantitative data will allow for the collection of
quantitative data, which can be analysed for correlation between tablet use, engagement,
frequency of practice, and accuracy. This provides empirical evidence as to whether tablet
computers can effectively aid and promote learning. After the analysis of quantitative data,
participants will provide useful insight regarding personal motivations and reasons for the
quantitative results. This justifies relevance of this study to the field of education and improving
instructional methods and materials. Collectively, insight regarding tablet computers ability to
effectively promote learning while increasing student engagement will be gained.
Average-income communities have been selected as a sample representation of the larger
population to represent the larger majority. Criterion for selection and exclusion ensures the
most homogeneous population possible, minimizing other potential factors of influence. Cluster
sampling accommodates the large potential sample population and need to narrow this
population into a representative sample for effective observation. Maintaining a consistent
classroom environment to the norm for students is crucial to minimize any external factors that
may result from a change of routine or other new knowledge. This is further aided by the use of
the regular classroom teacher as the instructor for activities. Analysis and interpretation
strategies have been chosen and developed to ensure credibility and limit researcher bias.
23
Discussion
Significance and possible implications. This study has the potential to provide
significant relationships between student engagement, motivations, and academic
achievement through the use of the educational mathematics game Math Evolve and the
use of a tablet with young students. Given that tablets are a relatively new technology, this
area of study is not well-researched and requires more data for further insights into the
realm of education.
Relationship to literature. This study has the potential to provide further support for
previous research done in this area of study as well as help address some of the areas for
future research indicated by the researched literature in the development of this study.
There is not a significant amount of literature focusing on the use of tablet computing to
promote engagement at the elementary level of schooling in the field of numeracy skills in
mathematics. Furthermore, the research completed in this field of study needs further
insight into the motivations and reasons behind the outcomes, which this study has the
potential to provide.
24
References
Bragg, L. A. (2012). The Effect of Mathematical Games on On-Task Behaviours in the Primary
Classroom. Mathematics Education Research Journal, 24(4), 385-401.
Couse, L. J., & Chen, D. W. (2010). A Tablet Computer for Young Children? Exploring Its
Viability for Early Childhood Education. Journal Of Research On Technology In
Education, 43(1), 75-98.
Gay, L.R., Mills, G.E., & Airasian, P.W. (2012). Educational research: Competencies for
analysis and application (10th ed.). Upper Saddle River, NJ: Merrill Prentice Hall.
Geist, E. A. (2012). A Qualitative Examination of Two Year-Olds Interaction with Tablet Based
Interactive Technology. Journal Of Instructional Psychology, 39(1), 26-35.
Hart, S. R., Stewart, K., & Jimerson, S. R. (2011). The Student Engagement in Schools
Questionnaire (SESQ) and the Teacher Engagement Report Form-New (TERF-N):
Examining the Preliminary Evidence. Contemporary School Psychology, 1567-79.
Hernandez, D. (2009). Gaming + Autonomy=Academic Achievement. Principal Leadership,
10(4), 44-47.
Jaciw, A. P., Toby, M., Ma, B., & Society for Research on Educational Effectiveness, (. (2012).
Conditions for the Effectiveness of a Tablet-Based Algebra Program. Society For Research
On Educational Effectiveness,
25
Lim, C. P., Nonis, D., & Hedberg, J. (2006). Gaming in a 3D Multiuser Virtual Environment:
Engaging Students in Science Lessons. British Journal Of Educational Technology, 37(2),
211-231.
McCoy, L. P., & Wake Forest University, D. (2009). Studies in Teaching: 2009 Research Digest.
Research Projects Presented at Annual Research Forum (15th, Winston-Salem, North
Carolina, December 2009). Online Submission.
Richardson, W. (2012). Gaming Gains Respect. District Administration, 48(6), 44-47,.