<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">PYTH</journal-id>
<journal-title-group>
<journal-title>Pythagoras - Journal of the Association for Mathematics Education of South Africa</journal-title>
</journal-title-group>
<issn pub-type="ppub">1012-2346</issn>
<issn pub-type="epub">2223-7895</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">PYTH-43-677</article-id>
<article-id pub-id-type="doi">10.4102/pythagoras.v43i1.677</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Investigating the cognitive demand levels in probability and counting principles learning tasks from an online mathematics textbook</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-5398-4301</contrib-id>
<name>
<surname>Ekol</surname>
<given-names>George</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-5746-8478</contrib-id>
<name>
<surname>Mlotshwa</surname>
<given-names>Simphiwe</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<aff id="AF0001"><label>1</label>Mathematics Education Division, School of Education, Faculty of Humanities, University of the Witwatersrand, Johannesburg, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> George Ekol, <email xlink:href="george.ekol@wits.ac.za">george.ekol@wits.ac.za</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>16</day><month>09</month><year>2022</year></pub-date>
<pub-date pub-type="collection"><year>2022</year></pub-date>
<volume>43</volume>
<issue>1</issue>
<elocation-id>677</elocation-id>
<history>
<date date-type="received"><day>22</day><month>01</month><year>2022</year></date>
<date date-type="accepted"><day>05</day><month>07</month><year>2022</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2022. The Authors</copyright-statement>
<copyright-year>2022</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<p>This case study carried out during the 2020 coronavirus disease of 2019 (COVID-19) lockdown used online data collection means to investigate the distribution of cognitive demand levels of probability and counting principles (PCP) learning tasks in a popular online Grade 12 mathematics textbook, based on the PCP teachers&#x2019; rating. The teachers&#x2019; cognitive demand ratings were categorised following Stein&#x2019;s mathematical task framework. Five mathematics teachers from four secondary schools in two provinces in South Africa participated in the study by filling in an online questionnaire. We developed a rating framework named the mean cognitive demand rating (MCDR) to help us interpret the teachers&#x2019; perception of the tasks in terms of cognitive demand to the learners. Data from the teachers&#x2019; ratings revealed nearly 65&#x0025; of the PCP learning tasks in the online textbook were rated as high. Analysis of secondary data from Department of Basic Education diagnostic reports from 2014 to 2020, however, suggests no association between teachers&#x2019; rating of learning tasks and learner performance.</p>
<sec id="st1">
<title>Contribution</title>
<p>This study draws attention to a long-standing underperformance in the topic of probability and suggests classroom-based study that focuses on the learners&#x2019; rating of the learning tasks themselves to understand clearly how best to support them.</p>
</sec>
</abstract>
<kwd-group>
<kwd>probability and counting principles</kwd>
<kwd>mean cognitive demand rating</kwd>
<kwd>mathematical competencies</kwd>
<kwd>mathematical task framework</kwd>
<kwd>descriptive statistical analysis</kwd>
<kwd>digital textbook</kwd>
<kwd>multiple representations</kwd>
<kwd>Grade 12</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Introduction</title>
<p>The worldwide spread of the coronavirus disease of 2019 (COVID-19) in the year 2020 brought changes to the way societies live, work and study. The institutions affected by COVID-19 responded by moving from physical, human-to-human interaction to virtual and online platforms. During 2020, South African schools were shut down for two and a half months before Grade 7 and Grade 12 pupils were permitted to return to school. During the shutdown, learning continued virtually and online for some schools, particularly the relatively well-resourced schools (Mohohlwane, Taylor, &#x0026; Shepherd, <xref ref-type="bibr" rid="CIT0020">2020</xref>). In response to the closure of schools, and in a bid to ensure that learning was taking place especially for the candidate classes, the Department of Basic Education (DBE) issued guidelines with recommendations for children to take advantage of online learning resources to continue with schooling from home. To facilitate learning from home, some websites were zero-rated in partnership with mobile phone companies (DBE, 2020b).</p>
<p>Online learning resources include resources such as online video lessons on YouTube, digital textbooks (DT), and study guides. These resources can be accessed by learners working from home on a computer or on a smartphone connected to the internet. In this study, we focus on only one online resource, namely the DT used by Grade 12 mathematics learners and teachers in South Africa.</p>
<p>Due to the closure of schools in 2020 due the prevalence of COVID-19, we did not conduct classroom-based study involving the Grade 12 learners. We noticed that this online textbook was being heavily used by both Grade 12 teachers and learners and decided to investigate the teachers&#x2019; rating of learning tasks in the probability and counting chapter of the book. We were able to carry out an online survey with the Grade 12 mathematics teachers who are involved in teaching probability and counting principles (PCP).</p>
<sec id="s20002">
<title>Digital textbook</title>
<p>The DT approved by the DBE is freely downloadable on any mobile device such as tablets and mobile phones. The DT comprises 9 mathematics topics (sequences and series, functions, finance, trigonometry, polynomials, analytical geometry, Euclidean geometry, statistics, and probability) that are taught at Grade 12. The 9 topics are each written following the same format; thus, each topic begins with the revision of related concepts, followed by the content notes, a couple of worked out examples, and exercises at the end. The exercises have answers to enable learners to cross-check their solutions. In this article, we only discuss the topic of PCP.</p>
</sec>
<sec id="s20003">
<title>Probability and counting principles</title>
<p>Probability theory is a mathematical modelling (Blum et al., <xref ref-type="bibr" rid="CIT0005">2007</xref>, p. 4) of the phenomenon of chance or randomness. Randomness has a specific meaning in probability and statistics (Batanero et al., <xref ref-type="bibr" rid="CIT0002">1997</xref>; Batanero &#x0026; Sanchez, <xref ref-type="bibr" rid="CIT0003">2013</xref>). Suppose <italic>T</italic> is a finite probability space. We assume that the physical characteristics of an experiment in <italic>T</italic> are such that the various outcomes of the experiment have equal chance of occurring. Such a probability space, where each point is assigned the same chance of outcome, is called a finite equiprobable space (Moore, Notz, &#x0026; Fligner, <xref ref-type="bibr" rid="CIT0021">2013</xref>, p. 262; Spiegel, Schiller, &#x0026; Srinivasan, <xref ref-type="bibr" rid="CIT0025">2013</xref>). However, events in <italic>T</italic> are far from being random. For example, a coin does not generate random numbers because a tossed coin obeys the laws of physics depending on the force used, angle of toss, and surface of the coin. So, why then do the results of tossing a coin look random? It is because the outcomes are extremely sensitive to the inputs, so that very small changes in the forces one applies when tossing a coin do change the outcomes, say from heads to tails and back again (Moore et al., <xref ref-type="bibr" rid="CIT0021">2013</xref>, p. 262).</p>
<p>Regarding counting principles, these are techniques for determining without direct enumeration, the number of possible outcomes of a particular experiment (May, Masson, &#x0026; Hunter, <xref ref-type="bibr" rid="CIT0019">1990</xref>, p. 189). For example, if <italic>T</italic> defined as above, has <italic>k</italic> elements, then each point in <italic>T</italic> is assigned the probability <inline-formula id="ID1"><alternatives><mml:math display="inline" id="I1"><mml:mrow><mml:mfrac><mml:mn>1</mml:mn><mml:mi>k</mml:mi></mml:mfrac></mml:mrow></mml:math><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PYTH-43-677-i001.tif"/></alternatives></inline-formula>, and each event B &#x2208; <italic>T</italic> containing <italic>h</italic> points is assigned the probability <inline-formula id="ID2"><alternatives><mml:math display="inline" id="I2"><mml:mrow><mml:mfrac><mml:mi>h</mml:mi><mml:mi>k</mml:mi></mml:mfrac></mml:mrow></mml:math><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PYTH-43-677-i002.tif"/></alternatives></inline-formula>. In other words, <inline-formula id="ID3"><alternatives><mml:math display="inline" id="I3"><mml:mrow><mml:mi>P</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mtext>B</mml:mtext><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mtext>n</mml:mtext><mml:mo stretchy="false">(</mml:mo><mml:mtext>B</mml:mtext><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:mtext>n</mml:mtext><mml:mo stretchy="false">(</mml:mo><mml:mi>T</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mtext>number of ways that the event B can occur</mml:mtext></mml:mrow><mml:mrow><mml:mtext>number of ways that the sample&#x2009;</mml:mtext><mml:mi>T</mml:mi><mml:mtext>&#x2009;can occur</mml:mtext></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mi>h</mml:mi><mml:mi>k</mml:mi></mml:mfrac></mml:mrow></mml:math><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PYTH-43-677-i003.tif"/></alternatives></inline-formula>. We note that the formula for <italic>P</italic>(B) only applies to an equiprobable space <italic>T</italic> and not to a general space.</p>
</sec>
<sec id="s20004">
<title>Multiple representations</title>
<p>By multiple representations, we mean techniques of teaching PCP that include various objects such as graphs, diagrams, texts, and 3D visualisations to facilitate learners&#x2019; grasping of the underlying meaning of the concepts.</p>
</sec>
<sec id="s20005">
<title>Context</title>
<p>Probability and fundamental counting principles are relatively new topics in the South African mathematics syllabus (Zondo, Zewot &#x0026; North, <xref ref-type="bibr" rid="CIT0030">2020</xref>), having been introduced for the first time in Grade 10 in 2012, and in Grade 11 in the following year. The topic was first examined in Grade 12 in 2014. Since their inclusion as compulsory topics in the South African mathematics syllabus, these principles have remained a challenge to many learners, with performance remaining generally poor over the years (DBE, <xref ref-type="bibr" rid="CIT0008">2015</xref>, <xref ref-type="bibr" rid="CIT0009">2016</xref>, <xref ref-type="bibr" rid="CIT0010">2017</xref>, <xref ref-type="bibr" rid="CIT0011">2018</xref>, <xref ref-type="bibr" rid="CIT0012">2019</xref>, <xref ref-type="bibr" rid="CIT0013">2020</xref>, <xref ref-type="bibr" rid="CIT0014">2021</xref>). For example, in 2013, the average score in the national examination was 30&#x0025; (DBE, <xref ref-type="bibr" rid="CIT0007">2014</xref>). Although every year diagnostic reports are published stating specific concepts in PCP that learners show weakness in so that educators in schools can support them in overcoming such identified weaknesses, from 2014 to 2019, diagnostic reports strongly suggest that the same challenges faced by learners keep coming up in subsequent years.</p>
<p>There is also a lack of research to inform the teaching and learning of PCP at the school level. For example, a database search by the first author of articles in <italic>Pythagoras</italic> from 2016 to 2020 with probability as the keyword turned up only two outcomes, which were also not linked to the information on probability we were looking for. One article (Murray, <xref ref-type="bibr" rid="CIT0022">2017</xref>) sought to understand how the grades obtained at school for English and Mathematics affect the &#x2018;probability&#x2019; of graduation at a university. Clearly, the context of said study was different from the current one. The second article (Prince &#x0026; Frith, <xref ref-type="bibr" rid="CIT0024">2017</xref>) discussed quantitative literacy of South African school leavers who qualify for higher education. Again, this study is not related to PCP. These examples clearly confirm our assertion of little research in the topic of PCP at the secondary level. This study contributes to understanding mathematics teachers&#x2019; rating of the PCP learning tasks at Grade 12 in terms of the tasks&#x2019; cognitive demand levels. It may be that the underperformance in PCP at the national certificate is contributed to by the learning tasks that learners are prepared for on for the national examinations.</p>
<p>One of the proposals from the education authorities to try and reverse the poor performance at Grade 12 is the suggestion that the teaching and learning of PCP should incorporate multiple representations of tasks. Based on the mathematical task theoretical framework (Stein &#x0026; Smith, <xref ref-type="bibr" rid="CIT0027">1998</xref>), we associate tasks with high cognitive demands with better prospects to enable learners to master PCP concepts, whereas tasks with low cognitive demand are associated with less chance of offering learners the opportunity to master PCP concepts. The objective is to understand the distribution of the cognitive demand levels of PCP learning tasks that are in the DT introduced earlier in the previous section of this study.</p>
<p>The Curriculum Assessment Policy Statements (CAPS) diagnostic reports (DBE, <xref ref-type="bibr" rid="CIT0011">2018</xref>, <xref ref-type="bibr" rid="CIT0013">2020</xref>) also recommend multiple representations of concepts as a strategy for teaching PCP at Grade 12. The effective learning of PCP at Grade 12 requires many resources. Teachers certainly play a vital role in supporting learners (Fennema &#x0026; Franke, <xref ref-type="bibr" rid="CIT0016">1992</xref>).</p>
</sec>
<sec id="s20006">
<title>Focus</title>
<p>This case study investigated the Grade 12 mathematics teachers&#x2019; rating of learning tasks in a PCP chapter in a popular Grade 12 mathematics online textbook. Teacher ratings were interpreted following Stein and Smith&#x2019;s (<xref ref-type="bibr" rid="CIT0027">1998</xref>) cognitive demand levels of learning tasks. Two research questions guided the study: (1) What is Grade 12 mathematics teachers&#x2019; rating of the PCP learning tasks in one popular Grade 12 mathematics online textbook? (2) From the teachers&#x2019; rating of learning tasks, and from the secondary data available on Grade 12 learners&#x2019; performance in PCP over the years, what can be said about the two pieces of data &#x2013; might there be a link between the achievement in probability at the national level by Grade 12 learners, and mean cognitive demand level of the learning tasks that the learners popularly use to prepare for the national examinations?</p>
</sec>
<sec id="s20007">
<title>Probability knowledge for teaching</title>
<p>The idea of probability is empirical. That is, probability describes what happens in very many trials, and we must observe many trials to pin down a probability. In this article, we use the definition based on the notion of proportion or relative frequency. Relative frequency of a score is obtained by dividing the frequency of that score by the total number of scores. Similarly, the probability of an experiment yielding a particular result (e.g. a coin toss yielding heads) can be defined as the number of equally likely and mutually exclusive outcomes, divided by the total number of possible, equally likely, and mutually exclusive outcomes. By equally likely, we mean that in the long run each of the possible outcomes will occur with approximately equal frequency (May et al., <xref ref-type="bibr" rid="CIT0019">1990</xref>, p. 179; Moore et al., <xref ref-type="bibr" rid="CIT0021">2013</xref>, p. 260).</p>
<p>Probability knowledge for teaching (PKT) includes content knowledge of probability, and various ways of presenting this content to the learners so that learning takes place (Batanero, Chernoff, Engel, Lee, &#x0026; Sanchez, <xref ref-type="bibr" rid="CIT0001">2016</xref>). Like mathematical knowledge for teaching, PKT can be divided into probability content knowledge (PCK) and probability pedagogical content knowledge (PPCK). Probability content knowledge requires teachers to have specialised training in probability beyond the content covered in the high school.</p>
<p>Probability pedagogical content knowledge is knowledge about presenting the concepts to the learners so that learners easily understand them (Kazima &#x0026; Adler, <xref ref-type="bibr" rid="CIT0018">2006</xref>; Hill et al., <xref ref-type="bibr" rid="CIT0017">2008</xref>). For instance, how does a teacher present to the learners concepts such as variation and randomness, aware that many learners come into a probability class with deterministic (concrete) understanding of the world around them? Take, for example, a probability experiment such as tossing a coin. In such an experiment, the outcome is not predictable every time the coin is tossed. It is, thus, not a straightforward case to generalise the probability of events arising from the experiment unless the experiment is repeated very many times. Nevertheless, although an individual trial has an unpredictable outcome, there is a predictable pattern of outcomes that will be obtained over a long series of trials (Moore et al., <xref ref-type="bibr" rid="CIT0021">2013</xref>, p. 260). Hence, for a teacher who may be unaware of the foundation principles of probability, moving their learners from theoretical probability to the concrete results can result in misunderstanding by the learners.</p>
</sec>
<sec id="s20008">
<title>Mathematical tasks</title>
<p>In the mathematical task framework (MTF), a task is defined as a segment of classroom activity that is devoted to the development of a particular mathematical idea (Stein &#x0026; Smith, <xref ref-type="bibr" rid="CIT0027">1998</xref>). A task can involve several related problems in each topic in mathematics, in this case PCP. Mathematical tasks used in the classroom, or used by learners in their homework, are the foundation for their learning (Doyle, <xref ref-type="bibr" rid="CIT0015">1988</xref>; Stein &#x0026; Smith, <xref ref-type="bibr" rid="CIT0027">1998</xref>). Stein and Smith (<xref ref-type="bibr" rid="CIT0027">1998</xref>) distinguish three phases through which tasks pass: the first phase includes tasks that are found in the instructional materials such as study guides, printed textbooks, and DTs. The second phase includes tasks that are prepared by the teacher, and the third phase involves tasks that the students engage with in the classroom or at home, as reflected in <xref ref-type="fig" rid="F0001">Figure 1</xref>.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>The mathematics tasks framework.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PYTH-43-677-g001.tif"/>
</fig>
<p>This article will limit the discussion to phase 1 of Stein and Smith (<xref ref-type="bibr" rid="CIT0027">1998</xref>) with a focus on PCP learning tasks in a DT. Learning tasks for PCP were chosen for two reasons. First, as noted earlier, PCP is a topic that learners show poor grades in at the matric level (see DBE, <xref ref-type="bibr" rid="CIT0012">2019</xref>, <xref ref-type="bibr" rid="CIT0013">2020</xref>). Second, through interaction with some Grade 12 mathematics teachers, we learned that the DT is widely used by learners and teachers. So, we wanted to understand the cognitive demand level of PCP tasks in the DT. This study contributes to providing research-based information on PCP at the matric level.</p>
</sec>
<sec id="s20009">
<title>Mathematical task framework</title>
<p>As shown in <xref ref-type="fig" rid="F0001">Figure 1</xref>, the three phases of mathematical tasks are: (1) curriculum tasks found in the learning materials such as textbooks, and other CAPS-compliant learning materials, (2) tasks that teachers select and use in their classroom teaching, and (3) tasks that students implement in their day-to-day learning (Stein, Smith, Henningsen, &#x0026; Silver, <xref ref-type="bibr" rid="CIT0028">2000</xref>). The three phases are interrelated.</p>
<p>Stein et al. (<xref ref-type="bibr" rid="CIT0027">1998</xref>) use the MTF to classify tasks into four levels of cognitive demand, namely: (1) memorisation, (2) procedures without connections, (3) procedures with connections, and (4) doing mathematics (see <xref ref-type="table" rid="T0001">Table 1</xref>). According to the authors, tasks that promote memorisation and procedures without connections do not present any challenge to the learners since they do not require deep reflection to solve. Tasks that involve procedures but require other information that is not obvious in the tasks are classified as procedures with connections. Finally, doing mathematics is a level at which tasks are highly cognitively demanding (Stein, Grover, &#x0026; Henningsen, <xref ref-type="bibr" rid="CIT0026">1996</xref>). Based on Stein et al.&#x2019;s (<xref ref-type="bibr" rid="CIT0026">1996</xref>) classification, we associate high cognitive demand tasks with tasks that require multiple representations to solve. By &#x2018;doing mathematics&#x2019;, we mean engaging students with PCP tasks that give them the opportunity to develop their thinking and reasoning skills thus leading them to meaningful mathematical understanding (Stein &#x0026; Smith, <xref ref-type="bibr" rid="CIT0027">1998</xref>, p. 13).</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Cognitive demand levels used in mathematical task framework.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Levels of demands of tasks</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left"><bold>Memorisation</bold>
<list list-type="bullet">
<list-item><p>Involves reproducing previously learned facts, rules, formulas, or definitions.</p></list-item>
<list-item><p>Cannot be solved because a procedure does not exist.</p></list-item>
<list-item><p>Involves the exact reproduction of previously seen material, and what is to be reproduced is clearly and directly stated.</p></list-item>
<list-item><p>Tasks have no connection to the concepts that underlie them.</p></list-item></list></td>
</tr>
<tr>
<td align="left"><bold>Procedures with no connections</bold>
<list list-type="bullet">
<list-item><p>Algorithmic. Use of the procedure either is specifically called for or is evident from prior instruction.</p></list-item>
<list-item><p>Require limited cognitive demand for successful completion.</p></list-item>
<list-item><p>Have no connection to the concepts or meaning that underlie the procedure being used.</p></list-item>
<list-item><p>Are focused on producing correct answers rather than developing mathematical understanding.</p></list-item>
<list-item><p>Require no explanations or, if any, explanations that focus solely on describing the procedure that was used.</p></list-item></list></td>
</tr>
<tr>
<td align="left"><bold>Procedures with connections</bold>
<list list-type="bullet">
<list-item><p>Focus learners&#x2019; attention on the use of procedures for the purpose of developing deeper levels of understanding of mathematical concepts and ideas.</p></list-item>
<list-item><p>Suggest explicitly or implicitly pathways that are broad and have connections to the underlying conceptual ideas.</p></list-item>
<list-item><p>Can be represented in multiple ways, such as visual diagrams, symbols, and graphs that help develop meaning.</p></list-item>
<list-item><p>General procedures may be applied, but the procedure cannot be fused mindlessly. Learners need to engage with conceptual ideas that underlie the procedures to complete the tasks.</p></list-item></list></td>
</tr>
<tr>
<td align="left"><bold>Doing mathematics</bold>
<list list-type="bullet">
<list-item><p>Require complex and non-algorithmic thinking.</p></list-item>
<list-item><p>Pathways to solutions are not explicitly suggested by the task, or by the task instructions.</p></list-item>
<list-item><p>Require learners to explore and understand the nature of mathematical concepts, processes, or relationships.</p></list-item>
<list-item><p>Demand self-monitoring or self-regulation (Tanner &#x0026; Jones, 2005) of one&#x2019;s own cognitive processes.</p></list-item>
<list-item><p>Require learners to access relevant knowledge and experiences and make appropriate use of them in working through the task.</p></list-item>
<list-item><p>Require learners to analyse the task and actively examine task constraints that may limit possible solution strategies and solutions.</p></list-item>
<list-item><p>Require considerable cognitive effort and may involve some level of anxiety for the learner because of the unpredictable nature of the solution process required.</p></list-item></list></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>Source</italic>: Stein, M.K., Smith, M.P., Henningsen, M., &#x0026; Silver, E. (2000). <italic>Implementing standards-based mathematics instruction: A casebook for professional development</italic>. New York, NY: Teachers College Press.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s20010">
<title>Cognitive demands of tasks</title>
<p>The MTF is used to classify PCP tasks found in a DT in terms of either high or low cognitive demand levels. Tasks that are set at a high cognitive demand level require multiple strategies to solve (Stein et al., <xref ref-type="bibr" rid="CIT0026">1996</xref>). Low cognitive demand tasks occupy learners with reproducing known facts. Tasks promoting memorisation (level 1) and procedures without connections (level 2) require less reflection to solve and are categorised as low cognitive demand level (Stein et al., <xref ref-type="bibr" rid="CIT0026">1996</xref>). For example:</p>
<disp-quote>
<p>The probability that Jabu likes tea is 0.6 and the probability that Jabu likes coffee is 0.3. If the probability that Jabu likes tea, coffee or both is 0.7, determine the probability that Jabu likes tea and coffee.</p>
</disp-quote>
<p>This task does not demand much more than using a formula and substituting in the respective values, then solving for the unknown. Let T represent tea, and C represent coffee, <italic>P</italic>(T) is the probability that Jabu likes tea and P(C) is the probability that Jabu likes coffee. Then, P(T&#x222A;C) = P(T) + P(C) &#x2013; P(T&#x2229;C).</p>
<p>Tasks of high cognitive demand level require some thinking and reasoning to solve (Stein et al., <xref ref-type="bibr" rid="CIT0026">1996</xref>). Take an example adapted from Moore et al. (<xref ref-type="bibr" rid="CIT0021">2013</xref>):</p>
<disp-quote>
<p>Government data in Country Z show that 10&#x0025; of adults are full-time students and that 35&#x0025; of the adults are age 50 years or older. Explain why we cannot conclude that because (0.10) (0.35) = 0.035, therefore about 3.5&#x0025; of adults are college students aged 50 years or older.</p>
</disp-quote>
<p>One reason is that the two events are not necessarily independent, because not all 10&#x0025; of adult full-time students are above 50 years of age. Moreover, it is reasonable to expect that younger adults are more likely than older adults to be college students. Hence, P(college student|over 50 years) &#x003C; 0.10. This example fits in level 3 or level 4 of Stein et al.&#x2019;s (<xref ref-type="bibr" rid="CIT0026">1996</xref>) categorisation of learning tasks, namely procedures with connection, or doing mathematics.</p>
</sec>
<sec id="s20011">
<title>Probability and counting tasks used in the study</title>
<p>The PCP tasks used in this article are obtained from a digital Grade 12 mathematics textbook. The textbook is endorsed by the DBE in South Africa. The book is freely available to South African users. Users are free to download and read the book on their mobile devices or print and read offline. The only restriction is for users to keep the book&#x2019;s cover, title, contents, and short-codes unchanged.</p>
<p>We chose the digital book from among other books for three reasons. First, the book is used by many Grade 12 mathematics teachers and learners in South Africa, so it is a popular learning resource. Second, the book is freely available. Third, the book covers all mathematics topics taught in Grade 12 in South Africa. In this article, we focus only on the topic of PCP.</p>
<p>The PCP section is divided into eight sub-topics. For the purposes of this article, we limited our discussion to only four sub-topics, namely: the fundamental counting principles, factorial notation, tasks involving the application of counting principles, and tasks involving application of probability. We picked a total of 48 different learning tasks and asked five senior mathematics teachers at Grade 12 to rate the tasks according to the four levels of cognitive demand developed by Stein et al. (<xref ref-type="bibr" rid="CIT0026">1996</xref>). Details of the study design are contained in the methodology section.</p>
</sec>
</sec>
<sec id="s0012">
<title>Methodology</title>
<sec id="s20013">
<title>Design</title>
<p>This study is a case study taking a descriptive statistical approach. This approach enables us to transform qualitative data into quantifiable form and use it to make sense of the cognitive demand levels of learning tasks in PCP.</p>
</sec>
<sec id="s20014">
<title>Participants</title>
<p>Participants in the study are five secondary mathematics and probability teachers, pseudo-named A, B, C, D, and E to ensure anonymity. Initially, seven secondary mathematics teachers (six male and one female) were contacted by email to take part in the study. A questionnaire with clear instructions was emailed to all the seven teachers to complete. However, only five teachers, all male, from four secondary schools in two provinces in South Africa (Gauteng and KwaZulu-Natal) returned the questionnaire. The five questionnaires were entered into a spreadsheet (<xref ref-type="table" rid="T0002">Table 2</xref>) for analysis.</p>
<table-wrap id="T0002">
<label>TABLE 2</label>
<caption><p>Cognitive demand rating of 48 probability and counting principles tasks in the digital textbook by five senior mathematics teachers.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left" rowspan="2">SN</th>
<th valign="top" align="center" rowspan="2">Exercise (Task #)</th>
<th valign="top" align="center" colspan="5">Task cognitive demand rating by teacher<hr/></th>
<th valign="top" align="center" rowspan="2">Mean rating</th>
<th valign="top" align="center" rowspan="2">Mean rating (to the nearest digit)</th>
</tr>
<tr>
<th valign="top" align="center">A</th>
<th valign="top" align="center">B</th>
<th valign="top" align="center">C</th>
<th valign="top" align="center">D</th>
<th valign="top" align="center">E</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1</td>
<td align="center">10.4 (1)</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">1.4</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left">2</td>
<td align="center">10.4 (2)</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">1.6</td>
<td align="center">2</td>
</tr>
<tr>
<td align="left">3</td>
<td align="center">10.4 (3)</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">1.8</td>
<td align="center">2</td>
</tr>
<tr>
<td align="left">4</td>
<td align="center">10.4 (4)</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">5</td>
<td align="center">10.4 (5)</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">6</td>
<td align="center">10.4 (6)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.2</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">7</td>
<td align="center">10.4 (7)</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">8</td>
<td align="center">10.5 (1)</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1.2</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left">9</td>
<td align="center">10.5 (2)</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1.4</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left">10</td>
<td align="center">10.5 (3)</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">2.2</td>
<td align="center">2</td>
</tr>
<tr>
<td align="left">11</td>
<td align="center">10.6 (1)</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1.2</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left">12</td>
<td align="center">10.6 (2)</td>
<td align="center">2</td>
<td align="center">1</td>
<td align="center">3</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">1.6</td>
<td align="center">2</td>
</tr>
<tr>
<td align="left">13</td>
<td align="center">10.6 (3)</td>
<td align="center">1</td>
<td align="center">1</td>
<td align="center">3</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">1.6</td>
<td align="center">2</td>
</tr>
<tr>
<td align="left">14</td>
<td align="center">10.6 (4)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">2.4</td>
<td align="center">2</td>
</tr>
<tr>
<td align="left">15</td>
<td align="center">10.6 (5)</td>
<td align="center">3</td>
<td align="center">1</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.6</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">16</td>
<td align="center">10.6 (6)</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.6</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">17</td>
<td align="center">10.6 (7)</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.8</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">18</td>
<td align="center">10.6 (8)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">19</td>
<td align="center">10.6 (9)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">20</td>
<td align="center">10.6 (10)</td>
<td align="center">4</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">21</td>
<td align="center">10.6 (11)</td>
<td align="center">4</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">22</td>
<td align="center">10.7 (1)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">2.6</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">23</td>
<td align="center">10.7 (2)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">2.8</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">24</td>
<td align="center">10.7 (3)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">25</td>
<td align="center">10.7 (4)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.8</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">26</td>
<td align="center">10.7 (5)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">27</td>
<td align="center">10.7 (6)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">28</td>
<td align="center">10.8 (1)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">29</td>
<td align="center">10.8 (2)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">2.6</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">30</td>
<td align="center">10.8 (3)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.8</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">31</td>
<td align="center">10.8 (4)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">32</td>
<td align="center">10.8 (5)</td>
<td align="center">4</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">33</td>
<td align="center">10.8 (6)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.6</td>
<td align="center">4</td>
</tr>
<tr>
<td align="left">34</td>
<td align="center">10.8 (7)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.6</td>
<td align="center">4</td>
</tr>
<tr>
<td align="left">35</td>
<td align="center">10.8 (8)</td>
<td align="center">4</td>
<td align="center">4</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.8</td>
<td align="center">4</td>
</tr>
<tr>
<td align="left">36</td>
<td align="center">10.9 (1)</td>
<td align="center">4</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">37</td>
<td align="center">10.9 (2)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.2</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">38</td>
<td align="center">10.9 (3)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.0</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">39</td>
<td align="center">10.9 (4)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.8</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">40</td>
<td align="center">10.9 (5)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3.2</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">41</td>
<td align="center">10.9 (6)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">2.8</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">42</td>
<td align="center">10.9 (7)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">4.0</td>
<td align="center">4</td>
</tr>
<tr>
<td align="left">43</td>
<td align="center">10.9 (8)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">44</td>
<td align="center">10.9 (9)</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">45</td>
<td align="center">10.9 (10)</td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">4.0</td>
<td align="center">4</td>
</tr>
<tr>
<td align="left">46</td>
<td align="center">10.9 (11)</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.6</td>
<td align="center">4</td>
</tr>
<tr>
<td align="left">47</td>
<td align="center">10.9 (12)</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.4</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">48</td>
<td align="center">10.9 (13)</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">4</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">3.6</td>
<td align="center">4</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>1, Memorisation; 2, Procedure with no connection; 3, Procedure with connection; 4, Doing mathematics.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s20015">
<title>Data gathering process</title>
<p><xref ref-type="table" rid="T0002">Table 2</xref> has 48 rows and 8 columns. Each row represents one task taken from the DT. The first column provides the serial number of the task for identification during analysis. The second column gives the location of the task in the DT. An &#x2018;exercise&#x2019; is a collection of tasks. For example, 10.4 (1) represents task 1 found under exercise 10.4 in the DT. It can also be observed from <xref ref-type="table" rid="T0002">Table 2</xref> that exercise 10.4 has a total of seven different tasks. The remaining 47 tasks are presented in a similar format. For instance, exercise 10.5 has a total of three PCP tasks. The next five columns after column 2 are the five participant teachers who independently rated the 48 PCP tasks according to the four cognitive demand levels on a scale from 1 to 4 for each task. The last column shows the mean rating for each task.</p>
</sec>
<sec id="s20016">
<title>Consistency of measurements</title>
<p>The mean cognitive demand ratings (MCDR) by five senior PCP teachers from four schools in two provinces in South Africa were received by email by both authors of this article. Each teacher rated the 48 tasks independently of the other teachers. The first author entered the original data received from all teachers in <xref ref-type="table" rid="T0002">Table 2</xref> and the second author corroborated the entries with the original submissions. <xref ref-type="table" rid="T0002">Table 2</xref> was again cross-checked by the first author to ensure accuracy and consistency of measurements. In reporting the findings, we have rounded off the cognitive demand ratings of PCP tasks to the nearest digits.</p>
</sec>
<sec id="s20017">
<title>Data analysis</title>
<sec id="s30018">
<title>Mean cognitive demand rating</title>
<p>In this article, we have categorised MCDR 1 and 2 as low, and MCDR 3 and 4 as high (Stein et al., <xref ref-type="bibr" rid="CIT0026">1996</xref>). An MCDR is a value (corrected to the nearest whole number) obtained from the five independent ratings of a learning task, divided by the total number of ratings. For instance, the MCDR for task number 48 in <xref ref-type="table" rid="T0002">Table 2</xref>, is <inline-formula id="ID4"><alternatives><mml:math display="inline" id="I4"><mml:mrow><mml:mfrac><mml:mrow><mml:mstyle displaystyle="true"><mml:msubsup><mml:mo>&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mn>5</mml:mn></mml:msubsup><mml:mrow><mml:msub><mml:mi>x</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:mstyle></mml:mrow><mml:mi>n</mml:mi></mml:mfrac><mml:mo>&#x2248;</mml:mo><mml:mn>4</mml:mn></mml:mrow></mml:math><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PYTH-43-677-i004.tif"/></alternatives></inline-formula> (corrected to the nearest unit), where <italic>x<sub>i</sub></italic> is a rating of teacher <italic>i</italic>. <xref ref-type="table" rid="T0003">Table 3</xref> provides the frequency distribution of the MCDR scores obtained from <xref ref-type="table" rid="T0002">Table 2</xref> and <xref ref-type="fig" rid="F0002">Figure 2</xref> is the corresponding chart.</p>
<table-wrap id="T0003">
<label>TABLE 3</label>
<caption><p>Frequency table of the mean cognitive demand ratings of probability and counting principles learning tasks.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Level</th>
<th valign="top" align="center">Frequency</th>
<th valign="top" align="center">Percentage</th>
<th valign="top" align="center">Cumulative percentage</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1 = Memorisation</td>
<td align="center">4</td>
<td align="center">8.3</td>
<td align="center">8.3</td>
</tr>
<tr>
<td align="left">2 = Procedures without connections</td>
<td align="center">6</td>
<td align="center">12.5</td>
<td align="center">20.8</td>
</tr>
<tr>
<td align="left">3 = Procedures with connections</td>
<td align="center">31</td>
<td align="center">64.6</td>
<td align="center">85.4</td>
</tr>
<tr>
<td align="left">4 = Doing mathematics</td>
<td align="center">7</td>
<td align="center">14.6</td>
<td align="center">100</td>
</tr>
<tr>
<td align="left" colspan="4"><hr/></td>
</tr>
<tr>
<td align="left"><bold>Total</bold></td>
<td align="center"><bold>48</bold></td>
<td align="center"><bold>100</bold></td>
<td align="center"><bold>-</bold></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="F0002">
<label>FIGURE 2</label>
<caption><p>Bar graph of the mean cognitive demand rating of probability and counting learning tasks in the digital textbook by probability and counting principles teachers.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PYTH-43-677-g002.tif"/>
</fig>
</sec>
</sec>
</sec>
<sec id="s0019">
<title>Findings</title>
<p>From <xref ref-type="table" rid="T0003">Table 3</xref> and <xref ref-type="fig" rid="F0002">Figure 2</xref>, teachers&#x2019; rating of the PCP tasks in the popular online textbook tasks reveal that 8.3&#x0025; (<italic>n</italic> = 4) of the total learning tasks sampled in this study comprise facts that only require memory to solve; 12.5&#x0025; (<italic>n</italic> = 6) of the tasks are procedures without connection; 64.5&#x0025; (<italic>n</italic> = 31) are procedures with some connections; whereas 14.6&#x0025; (<italic>n</italic> = 7) are learning tasks rated under doing mathematics, meaning, for example, tasks whose solutions are require learners to explore and understand the nature of mathematical concepts, processes, or relationships. Such tasks, according to Stein and Smith (<xref ref-type="bibr" rid="CIT0027">1998</xref>) also demand self-monitoring or self-regulation of one&#x2019;s own cognitive processes.</p>
<p>From <xref ref-type="table" rid="T0003">Table 3</xref>, tasks requiring memorisation and procedures without connection together account for approximately 21&#x0025; of the total number of PCP tasks sampled in this study. According to Stein et al.&#x2019;s (<xref ref-type="bibr" rid="CIT0026">1996</xref>) MTF, the above tasks are grouped under low cognitive demand level tasks which occupy learners with reproducing known facts. One hopes that these are not the kinds of task that take much of learners&#x2019; time when they prepare for PCP assessments at different school levels. However, until classroom-based studies are conducted, this remains an open question.</p>
<p>From <xref ref-type="table" rid="T0003">Table 3</xref>, tasks that only need memorisation or procedures without connection are 6&#x0025; more than tasks rated as doing mathematics. &#x2018;Doing mathematics&#x2019; is conceptualised as engaging students in the learning tasks (Blumenfeld et al., <xref ref-type="bibr" rid="CIT0004">1991</xref>) that give them the opportunity to develop their thinking and reasoning skills (Stein &#x0026; Smith, <xref ref-type="bibr" rid="CIT0027">1998</xref>, p. 13). An example of such tasks is:</p>
<disp-quote>
<p>The code to a safe consists of 10 digits chosen from the digits 0 to 9. Assuming that none of the digits is repeated, determine the probability of having a code with the first digit even and none of the first three digits is 0.</p>
</disp-quote>
<p>Such a task includes procedures with connection, but it also requires some reasoning skills from the learner to solve. <xref ref-type="table" rid="T0003">Table 3</xref> and <xref ref-type="fig" rid="F0002">Figure 2</xref> clearly show that the majority (64.6&#x0025;, <italic>n</italic> = 31) of the PCP learning tasks in the DT comprise procedures with connections. Only about 13&#x0025; of the learning tasks are rated at the highest cognitive demand level of doing mathematics. Nevertheless, if tasks under procedures with connection, and tasks under doing mathematics are combined, it can be concluded that, overall, 79&#x0025; of the PCP learning tasks in the DT are high-level cognitive demand tasks, and 21&#x0025; are low-level cognitive demand tasks.</p>
</sec>
<sec id="s0020">
<title>Discussion</title>
<p>This case study focused on and investigated Grade 12 senior mathematics teachers&#x2019; rating of learning tasks in a PCP chapter of a popular Grade 12 online textbook. Teacher ratings of tasks were interpreted following Stein and Smith&#x2019;s (<xref ref-type="bibr" rid="CIT0027">1998</xref>) cognitive demand framework. Two research questions guided the study: (1) What is Grade 12 mathematics teachers&#x2019; rating of the PCP learning tasks in one popular Grade 12 mathematics online textbook? (2) From the teachers&#x2019; rating, might there be a link between the achievement in probability at the national level by Grade 12 learners, and mean cognitive demand level of the learning tasks that the learners popularly use to prepare for the national examinations?</p>
<p>On the first question, 65&#x0025; of the learning tasks in the chapter on PCP were rated by the teachers in this sample as procedures, but with some connections to other concepts and representations, which supported learning. Characteristics of such tasks include use of procedures, but after obtaining the numerical solutions, learners are expected to interpret the solutions. Other examples include interpreting the concepts of probability that have been represented in a diagram such as a tree diagram. We argue concepts such as the ones in our example engage learners beyond the procedures and can help them to understand underlying concepts in the tasks (Stein et al., <xref ref-type="bibr" rid="CIT0028">2000</xref>).</p>
<p>However, findings in this study also revealed that teachers in this study rated 79&#x0025; of the learning tasks in the DT as having high cognitive demand. Only 21&#x0025; of tasks in the DT the teachers rated as having low cognitive demand. If the teachers&#x2019; seemingly favourable rating of the learning tasks is true, the question that remains unanswered is: what explains learners&#x2019; general underperformance in the PCP topic in the Grade 12 national examination?</p>
<p>Under the new CAPS syllabus (DBE, <xref ref-type="bibr" rid="CIT0006">2011</xref>), probability has been examined in Paper 1 at Grade 12 since 2014 and contributes about 18&#x0025; of the total marks in Paper 1 (Mutara &#x0026; Makonye, <xref ref-type="bibr" rid="CIT0023">2014</xref>). However, since 2014, learners have performed poorly in this topic in matric examinations (see DBE, <xref ref-type="bibr" rid="CIT0013">2020</xref>). In fact, the mean percentage pass in probability is 34.7&#x0025; for a period of seven years, from 2014 to 2020, respectively. In 2020 the percentage pass was 18&#x0025; (see <xref ref-type="table" rid="T0004">Table 4</xref>), the lowest since 2014 when the topic was first examined, and the pattern does not show signs of improvement.</p>
<table-wrap id="T0004">
<label>TABLE 4</label>
<caption><p>Grade 12 learners&#x2019; mean pass rate in probability (2014&#x2013;2020).</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Year</th>
<th valign="top" align="center">2014</th>
<th valign="top" align="center">2015</th>
<th valign="top" align="center">2016</th>
<th valign="top" align="center">2017</th>
<th valign="top" align="center">2018</th>
<th valign="top" align="center">2019</th>
<th valign="top" align="center">2020</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Probability</td>
<td align="center">39</td>
<td align="center">28</td>
<td align="center">65</td>
<td align="center">41</td>
<td align="center">31</td>
<td align="center">21</td>
<td align="center">18</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>Source</italic>: Department of Basic Education (DBE). (2015). <italic>National Senior Certificate: Diagnostic report 2014</italic>. Pretoria: Department of Basic Education; Department of Basic Education (DBE). (2016). <italic>National Senior Certificate: Diagnostic report 2015</italic>. Pretoria: Department of Basic Education; Department of Basic Education (DBE). (2017). <italic>National Senior Certificate: Diagnostic report 2016</italic>. Pretoria: Department of Basic Education; Department of Basic Education (DBE). (2018). <italic>National Senior Certificate: Diagnostic report 2017</italic>. Pretoria: Department of Basic Education; Department of Basic Education (DBE). (2019). <italic>National Senior Certificate: Diagnostic report 2018</italic>. Pretoria: Department of Basic Education; Department of Basic Education (DBE). (2020). <italic>National Senior Certificate: Diagnostic report 2019</italic>. Pretoria: Department of Basic Education; Department of Basic Education (DBE). (2021). <italic>National Senior Certificate: Diagnostic report 2020</italic>. Pretoria: Department of Basic Education</p></fn>
</table-wrap-foot>
</table-wrap>
<p>This leads us to the second research question, which is: What are the implications of the teacher rating of the learning tasks in the online mathematics textbook on improved performance in PCP? Drawing on the secondary data from the CAPS document, and from our data from the teachers&#x2019; ratings of tasks, we can only offer two reflections on this question. First, the exceptionally low performance in probability in 2020 by Grade 12 learners partly speaks to the learning difficulty that learners could have faced during the COVID-19 closure of schools, but this observation has no direct link to our current data on teacher rating. The apparently favourable teacher rating of the online tasks is probably an indication of the confidence that teachers had (or still have) in the tasks. However, the learner performance as shown in <xref ref-type="table" rid="T0004">Table 4</xref> clearly shows that there is no link between the teacher ratings of tasks and learner performance. Looking at the teacher ratings and learner performance in PCP topic over the years, our study draws attention to the fact that there is a bigger problem in PCP that needs concerted effort to solve. The question of underperformance in PCP, our data have shown, cannot be fully explained by the hardships imposed on teaching during the COVID-19 lockdown. The issue must be about how probability is taught, how much time is allocated to it, who teaches the topic and at what time of the curriculum calendar year it is taught as well as the resources available to both teachers and learners. All these questions remain to be followed up in future research studies.</p>
<sec id="s20021">
<title>Limitations to the study</title>
<p>The study was carried out during the restrictions due to COVID-19, where physical contacts were restricted as recommended by the health authorities to keep individuals and the public safe from contracting the disease. Communication during the data gathering process depended mainly on email with an attached questionnaire for the teachers, and follow-up phone calls. We contacted seven PCP teachers, but in the end only five teachers returned the questionnaire. Although only five teachers responded, percentage wise, it still represented a reasonable percentage considering that our initial target was seven senior teachers of probability at Grade 12. We were not able to observe the teaching of PCP in the classrooms for the same reason explained above. Finally, this study focused only on the learning tasks that are available to learners in the online textbook, so we missed the teaching tasks and the nuances that the teachers incorporate in their actual lessons. Obviously, we also missed observing the tasks that learners implement in their learning in the classrooms (Stein et al., <xref ref-type="bibr" rid="CIT0026">1996</xref>). Future empirical studies should consider these uncovered areas with respect to PCP.</p>
</sec>
</sec>
<sec id="s0022">
<title>Conclusion and recommendations</title>
<p>The study opened our eyes to the challenges in the teaching of probability that we only have been hearing about but have not investigated for ourselves. This study suggests that teachers&#x2019; rating of tasks does not count until reflected in learner output in terms of learners&#x2019; performance in the tasks. It can also be argued that learners&#x2019; rating of learning tasks should precede the teachers&#x2019; rating. In other words, teachers should rely on, and respond to, the learners&#x2019; rating of learning tasks. One direct indicator is the learner scores in the tasks that are assigned to them. We recommend empirical classroom-based studies that support teachers with different ways of teaching PCP. One possibility is writing PCP teaching support materials that complement the online materials and the CAPS-recommended materials, focusing on the understanding of meanings in PCP, and their applications.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>G.E. would like to thank Wits University, Faculty of Humanities, for the small research grant for this report.</p>
<sec id="s20023" sec-type="COI-statement">
<title>Competing interests</title>
<p>The authors have declared that no competing interests exist.</p>
</sec>
<sec id="s20024">
<title>Authors&#x2019; contributions</title>
<p>S.M. compiled the data and wrote the first draft. G.E. added more research information on the draft, wrote and edited the final manuscript.</p>
</sec>
<sec id="s20025">
<title>Ethical considerations</title>
<p>This article followed all ethical standards for research without direct contact with human or animal subjects.</p>
</sec>
<sec id="s20026">
<title>Funding information</title>
<p>G.E. received project fund number GEKL020 from the Faculty of Humanities Research Grant.</p>
</sec>
<sec id="s20027">
<title>Data availability</title>
<p>Data sharing is not applicable as no new data were created.</p>
</sec>
<sec id="s20028">
<title>Disclaimer</title>
<p>The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Batanero</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Chernoff</surname>, <given-names>E.J</given-names></string-name>., <string-name><surname>Engel</surname>, <given-names>J</given-names></string-name>., <string-name><surname>Lee</surname>, <given-names>H.S</given-names></string-name>., &#x0026; <string-name><surname>Sanchez</surname>, <given-names>E</given-names></string-name></person-group>. (<year>2016</year>). <source><italic>Research on teaching and learning probability</italic></source>. <publisher-loc>Cham</publisher-loc>: <publisher-name>Springer Nature</publisher-name>.</mixed-citation></ref>
<ref id="CIT0002"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Batanero</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Godino</surname>, <given-names>J.D</given-names></string-name>., &#x0026; <string-name><surname>Navarro-Pelayo</surname>, <given-names>V</given-names></string-name></person-group>. (<year>1997</year>). <article-title>Effect of the implicit combinatorial model on combinatorial reasoning in secondary school pupils</article-title>. <source><italic>Educational Studies in Mathematics</italic></source>, <volume>32</volume>(<issue>2</issue>), <fpage>181</fpage>&#x2013;<lpage>199</lpage>.</mixed-citation></ref>
<ref id="CIT0003"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Batanero</surname>, <given-names>C</given-names></string-name>., &#x0026; <string-name><surname>Sanchez</surname>, <given-names>E</given-names></string-name></person-group>. (<year>2013</year>). <chapter-title>What is the nature of high school students&#x2019; conception and misconception about probability?</chapter-title> In <person-group person-group-type="editor"><string-name><given-names>G.A</given-names>. <surname>Jones</surname></string-name> (Ed.)</person-group>, <source><italic>Exploring probability in school: Challenges for teaching and learning</italic></source> (pp. <fpage>260</fpage>&#x2013;<lpage>289</lpage>). <publisher-loc>Alphen aan den Rijn</publisher-loc>: <publisher-name>Kluwer Academic Publishers</publisher-name>.</mixed-citation></ref>
<ref id="CIT0004"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Blumenfeld</surname>, <given-names>P.C</given-names></string-name>., <string-name><surname>Soloway</surname>, <given-names>E</given-names></string-name>., <string-name><surname>Marx</surname>, <given-names>R.W</given-names></string-name>., <string-name><surname>Krajcik</surname>, <given-names>J.S</given-names></string-name>., <string-name><surname>Guzdial</surname>, <given-names>M</given-names></string-name>., &#x0026; <string-name><surname>Palincsar</surname>, <given-names>A</given-names></string-name></person-group>. (<year>1991</year>). <article-title>Motivating project-based learning: Sustaining the doing, supporting the learning</article-title>. <source><italic>Educational Psychologist</italic></source>, <volume>26</volume>(<issue>3&#x2013;4</issue>), <fpage>369</fpage>&#x2013;<lpage>398</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/00461520.1991.9653139">https://doi.org/10.1080/00461520.1991.9653139</ext-link></comment></mixed-citation></ref>
<ref id="CIT0005"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Blum</surname>, <given-names>W</given-names></string-name>., <string-name><surname>Galbraith</surname>, <given-names>P.L</given-names></string-name>., <string-name><surname>Henn</surname>, <given-names>H.W</given-names></string-name>., &#x0026; <string-name><surname>Niss</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2007</year>). <source><italic>Modelling and applications in mathematics education</italic></source> (pp. <fpage>3</fpage>&#x2013;<lpage>32</lpage>). <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>.</mixed-citation></ref>
<ref id="CIT0006"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2011</year>). <source><italic>Mathematics: Curriculum and assessment policy statement Grade 4 to 6</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Government Printing Works</publisher-name>.</mixed-citation></ref>
<ref id="CIT0007"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2014</year>). <source><italic>National Senior Certificate: Diagnostic report 2013</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0008"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2015</year>). <source><italic>National Senior Certificate: Diagnostic report 2014</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0009"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2016</year>). <source><italic>National Senior Certificate: Diagnostic report 2015</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0010"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2017</year>). <source><italic>National Senior Certificate: Diagnostic report 2016</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0011"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2018</year>). <source><italic>National Senior Certificate: Diagnostic report 2017</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0012"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2019</year>). <source><italic>National Senior Certificate: Diagnostic report 2018</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0013"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2020</year>). <source><italic>National Senior Certificate: Diagnostic report 2019</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0014"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Basic Education (DBE)</collab></person-group>. (<year>2021</year>). <source><italic>National Senior Certificate: Diagnostic report 2020</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0015"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Doyle</surname>, <given-names>W</given-names></string-name></person-group>. (<year>1988</year>). <article-title>Work in mathematics classes: The context of students&#x2019; thinking during instruction</article-title>. <source><italic>Educational Psychologist</italic></source>, <volume>23</volume>(<issue>2</issue>), <fpage>167</fpage>&#x2013;<lpage>180</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1207/s15326985ep2302_6">https://doi.org/10.1207/s15326985ep2302_6</ext-link></comment></mixed-citation></ref>
<ref id="CIT0016"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Fennema</surname>, <given-names>E</given-names></string-name>., &#x0026; <string-name><surname>Franke</surname>, <given-names>M.L</given-names></string-name></person-group>. (<year>1992</year>). <chapter-title>Teachers&#x2019; knowledge and its impact</chapter-title>. In <person-group person-group-type="editor"><string-name><given-names>D.A</given-names>. <surname>Grouws</surname></string-name> (Ed.)</person-group>, <source><italic>Handbook of research on mathematics teaching and learning: A project of the National Council of Teachers of Mathematics</italic></source> (pp. <fpage>147</fpage>&#x2013;<lpage>164</lpage>). <publisher-loc>Stuttgart</publisher-loc>: <publisher-name>Macmillan Publishing Co., Inc</publisher-name>.</mixed-citation></ref>
<ref id="CIT0017"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hill</surname>, <given-names>H.C</given-names></string-name>., <string-name><surname>Blunk</surname>, <given-names>M.L</given-names></string-name>., <string-name><surname>Charalambous</surname>, <given-names>C.Y</given-names></string-name>., <string-name><surname>Lewis</surname>, <given-names>J.M</given-names></string-name>., <string-name><surname>Phelps</surname>, <given-names>G.C</given-names></string-name>., &#x0026; <string-name><surname>Sleep</surname>, <given-names>L</given-names></string-name></person-group>. (<year>2008</year>). <article-title>Mathematical knowledge for teaching and the mathematical quality of instruction: An exploratory study</article-title>. <source><italic>Cognition and Instruction</italic></source>, <volume>26</volume>, <fpage>430</fpage>&#x2013;<lpage>511</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/07370000802177235">https://doi.org/10.1080/07370000802177235</ext-link></comment></mixed-citation></ref>
<ref id="CIT0018"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kazima</surname>, <given-names>M</given-names></string-name>., &#x0026; <string-name><surname>Adler</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2006</year>). <article-title>Mathematical knowledge for teaching: Adding to the description through a study of probability in practice</article-title>. <source><italic>Pythagoras</italic></source>, (<issue>63</issue>), <fpage>a108</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/pythagoras.v0i63.108">https://doi.org/10.4102/pythagoras.v0i63.108</ext-link></comment></mixed-citation></ref>
<ref id="CIT0019"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>May</surname>, <given-names>R.B</given-names></string-name>., <string-name><surname>Masson</surname>, <given-names>M.E.J</given-names></string-name>., &#x0026; <string-name><surname>Hunter</surname>, <given-names>M.A</given-names></string-name></person-group>. (<year>1990</year>). <source><italic>Applications of statistics in behavioural research</italic></source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Harper &#x0026; Row Publishers</publisher-name>.</mixed-citation></ref>
<ref id="CIT0020"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Mohohlwane</surname>, <given-names>N</given-names></string-name>., <string-name><surname>Taylor</surname>, <given-names>S</given-names></string-name>., &#x0026; <string-name><surname>Shepherd</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2020</year>). <source><italic>Covid-19 and basic education: Evaluating the initial impact of the return to schooling</italic></source>. <comment>Synthesis Report NIDS-CRAM Wave 2</comment>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Department of Basic Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0021"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Moore</surname>, <given-names>D.S</given-names></string-name>., <string-name><surname>Notz</surname>, <given-names>W</given-names></string-name>., &#x0026; <string-name><surname>Fligner</surname>, <given-names>M.A</given-names></string-name></person-group>. (<year>2013</year>). <source><italic>The basic practice of statistics</italic></source> (Vol. <volume>32</volume>, p. <fpage>745</fpage>). <publisher-loc>New York, NY</publisher-loc>: <publisher-name>WH Freeman</publisher-name>.</mixed-citation></ref>
<ref id="CIT0022"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Murray</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2017</year>). <article-title>How does the grade obtained at school for English and Mathematics affect the probability of graduation at a university?</article-title> <source><italic>Pythagoras</italic></source>, <volume>38</volume>(<issue>1</issue>), <fpage>1</fpage>&#x2013;<lpage>7</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/pythagoras.v38i1.335">https://doi.org/10.4102/pythagoras.v38i1.335</ext-link></comment></mixed-citation></ref>
<ref id="CIT0023"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Mutara</surname>, <given-names>L</given-names></string-name>., &#x0026; <string-name><surname>Makonye</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2014</year>). <source><italic>Learners&#x2019; use of probability models in answering probability tasks in South Africa</italic></source>. <publisher-loc>Johannesburg</publisher-loc>: <publisher-name>University of the Witwatersrand</publisher-name>.</mixed-citation></ref>
<ref id="CIT0024"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Prince</surname>, <given-names>R</given-names></string-name>., &#x0026; <string-name><surname>Frith</surname>, <given-names>V</given-names></string-name></person-group>. (<year>2017</year>). <article-title>The quantitative literacy of South African school-leavers who qualify for higher education</article-title>. <source><italic>Pythagoras</italic></source>, <volume>38</volume>(<issue>1</issue>), <fpage>1</fpage>&#x2013;<lpage>14</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/pythagoras.v38i1.355">https://doi.org/10.4102/pythagoras.v38i1.355</ext-link></comment></mixed-citation></ref>
<ref id="CIT0025"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Spiegel</surname>, <given-names>M.R</given-names></string-name>., <string-name><surname>Schiller</surname>, <given-names>J.J</given-names></string-name>., &#x0026; <string-name><surname>Srinivasan</surname>, <given-names>R</given-names></string-name></person-group>. (<year>2013</year>). <source><italic>Schaum&#x2019;s outline of probability and statistics</italic></source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>McGraw-Hill Education</publisher-name>.</mixed-citation></ref>
<ref id="CIT0026"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stein</surname>, <given-names>M.K</given-names></string-name>., <string-name><surname>Grover</surname>, <given-names>B.W</given-names></string-name>., &#x0026; <string-name><surname>Henningsen</surname>, <given-names>M.A</given-names></string-name></person-group>. (<year>1996</year>). <article-title>Building student capacity for mathematical thinking and reasoning: An analysis of mathematical tasks used in the reform classrooms</article-title>. <source><italic>American Educational Research Journal</italic></source>, <volume>33</volume>(<issue>2</issue>), <fpage>455</fpage>&#x2013;<lpage>488</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3102/00028312033002455">https://doi.org/10.3102/00028312033002455</ext-link></comment></mixed-citation></ref>
<ref id="CIT0027"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stein</surname>, <given-names>M.K</given-names></string-name>., &#x0026; <string-name><surname>Smith</surname>, <given-names>M.S</given-names></string-name></person-group>. (<year>1998</year>). <article-title>Mathematical tasks as a framework for reflection: From research to practice</article-title>. <source><italic>Mathematics Council of Teachers and Mathematics</italic></source>, <volume>3</volume>(<issue>4</issue>), <fpage>268</fpage>&#x2013;<lpage>275</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5951/MTMS.3.4.0268">https://doi.org/10.5951/MTMS.3.4.0268</ext-link></comment></mixed-citation></ref>
<ref id="CIT0028"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Stein</surname>, <given-names>M.K</given-names></string-name>., <string-name><surname>Smith</surname>, <given-names>M.P</given-names></string-name>., <string-name><surname>Henningsen</surname>, <given-names>M</given-names></string-name>., &#x0026; <string-name><surname>Silver</surname>, <given-names>E</given-names></string-name></person-group>. (<year>2000</year>). <source><italic>Implementing standards-based mathematics instruction: A casebook for professional development</italic></source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Teachers College Press</publisher-name>.</mixed-citation></ref>
<ref id="CIT0029"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tanner</surname>, <given-names>H</given-names></string-name>., &#x0026; <string-name><surname>Jones</surname>, <given-names>S</given-names></string-name></person-group>. (<year>2003</year>). <article-title>Self-efficacy in mathematics and students&#x2019; use of self-regulated learning strategies during assessment events</article-title>. <source><italic>International Group for the Psychology of Mathematics Education</italic></source>, <volume>4</volume>, <fpage>275</fpage>&#x2013;<lpage>282</lpage>.</mixed-citation></ref>
<ref id="CIT0030"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zondo</surname>, <given-names>N</given-names></string-name>., <string-name><surname>Zewotir</surname>, <given-names>T</given-names></string-name>., &#x0026; <string-name><surname>North</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2020</year>). <article-title>Learner performance in the 2009 to 2014 final Grade 12 mathematics examination: A quantile regression approach</article-title>. <source><italic>Pythagoras</italic></source>, <volume>41</volume>(<issue>1</issue>), <fpage>a545</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/pythagoras.v41i1.545">https://doi.org/10.4102/pythagoras.v41i1.545</ext-link></comment></mixed-citation></ref>
</ref-list>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Ekol, G., &#x0026; Mlotshwa, S. (2022). Investigating the cognitive demand levels in probability and counting principles learning tasks from an online mathematics textbook. <italic>Pythagoras, 43</italic>(1), a677. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/pythagoras.v43i1.677">https://doi.org/10.4102/pythagoras.v43i1.677</ext-link></p></fn>
</fn-group>
</back>
</article>