This multi-methodological study applied functional magnetic resonance imaging to investigate neural activation in a group of adolescent students (N = 88) during a probabilistic reinforcement learning task. We related patterns of emerging brain activity and individual learning rates to socio-motivational (in-)dependence manifested in four different motivation types (MTs): (1) peer-dependent MT, (2) teacher-dependent MT, (3) peer-and-teacher-dependent MT, (4) peer-and-teacher-independent MT. A multinomial regression analysis revealed that the individual learning rate predicts students’ membership to the independent MT, or the peer-and-teacher-dependent MT. Additionally, the striatum, a brain region associated with behavioral adaptation and flexibility, showed increased learning-related activation in students with motivational independence. Moreover, the prefrontal cortex, which is involved in behavioral control, was more active in students of the peer-and-teacher-dependent MT. Overall, this study offers new insights into the interplay of motivation and learning with (1) a focus on inter-individual differences in the role of peers and teachers as source of students’ individual motivation and (2) its potential neurobiological basis.
Keywords: fMRI, reinforcement learning, motivation, social relationships in school
Inter-individual Differences in Students’ Scholastic Motivation
Studies in the field of educational psychology focus on the social school environment, which is mainly determined through relations with peers and teachers providing essential motivation (Harter, 1996). Indeed, several studies have shown that peers and teachers can play an important role for students’ scholastic motivation (Wentzel, 2009a,b, 2010), both individually and through a whole classroom approach (Pianta et al., 2003). This is particularly interesting during adolescence, when most students’ scholastic motivation declines (Harter, 1996; Zusho and Pintrich, 2001; Watt, 2004) due to changes in their environment or within themselves (Eccles et al., 1998; Wigfield and Eccles, 2001). Nevertheless, Wigfield and Eccles (2001) contend that some students do not necessarily reduce motivation (Deci and Ryan, 2002) suggesting that there are inter-individual differences in students’ motivation patterns based on environmental as well as developmental aspects. Previous person-oriented research (Raufelder et al., 2013c) investigated inter-individual differences in adolescents’ perception of peers and teachers as environmental sources of motivation, and proposed four distinct motivation types (MTs), which we discuss in more detail below.
Four Different Motivation Types (MTs) and the Concept of Socio-motivational (In-)dependence
Raufelder et al. (2013b) differentiated four different MTs based on the importance of peers and teachers as sources for scholastic motivation. Applying a latent class analysis (LCA) in 1088 adolescent students from Germany they identified (1) teacher-dependent MT, (2) peer-dependent MT, (3) peer-and-teacher-dependent MT and (4) peer-and-teacher-independent MT (Raufelder et al., 2013b). Students of the teacher-dependent MT (1) receive most of their scholastic motivation from teachers. Further qualitative interviews (Hoferichter and Raufelder, 2014) revealed that these students are also affected by teachers’ own motivation as well as the support and feedback they perceive from the teacher. Likewise, students of the peer-dependent MT (2) are mostly driven by their peers, whereas students of the peer-and-teacher-dependent MT (3) perceive both peers and teachers as sources of motivation (Hoferichter and Raufelder, 2014). Finally, the motivation of students in the peer-and-teacher-independent MT category (4) remains largely unaffected by the motivation, learning behavior, or perceived support of their peers and teachers. The four MT have been validated by another LCA in a sample of adolescent students in Montréal, Canada (Hoferichter et al., 2014). Based on these findings Raufelder (2014) formulated the concept of socio-motivational (in-)dependence: individuals whose motivation is affected by others’ motivation, learning behavior or perceived support, are considered to be socio-motivationally dependent. In the school context, motivation can be affected by both peers’ motivation, learning behavior or social support and/or by teachers’ perceived support and motivation (see Wentzel, 2009a,b; Raufelder et al., 2015). In turn, when the motivation remains largely unaffected by others, socio-motivational independency is assumed. A subsequent longitudinal latent transition analysis (LTA) could confirm the four types of socio-motivational (in-)dependence by investigating intra-individual changes from early to middle adolescence (Jagenow et al., 2015). While slight turnovers were observed between the three types of socio-motivational dependence from early to middle adolescence, the socio-motivationally independent category showed the highest probability (0.68) to remain stable.
Reinforcement Learning, Motivation, and Brain Activity
Since the beginning of the 20th century, researchers have studied how motivation affects learning and vice versa (Mehring and Colson, 1990), since both concepts are reportedly related (Rao, 2003; Crandell and Robinson, 2007). As most students’ scholastic motivation declines with the onset of adolescence (Harter, 1996; Zusho and Pintrich, 2001; Watt, 2004), most students’ learning performance and academic achievement also tend to decrease (Alspaugh, 1998; Barber and Olsen, 2004; Vedder-Weiss and Fortus, 2012). One prominent theory on learning is the reinforcement theory, which is based on the early work of Thorndike (1929) and Skinner (1938). Their theory of operant conditioning posits that individuals learn according to the outcomes of their actions. Specifically, if an outcome – for example good learning performance at school – is reinforced through reward (e.g., praise and feedback from peers and/or teachers), then the corresponding behavior (e.g., good learning performance) is likely to be repeated and vice versa. This means that students’ motivation to learn is directly increased through reward. In turn, punishment can work to suppress certain kinds of undesirable behavior (see Ittel et al., 2013). Both the concept of socio-motivational (in-)dependence and reinforcement theory focus on the interactions between an individual and his or her environment and constitute a promising approach to examine individual differences in motivation and learning patterns. Moreover, linking these theories to neuroscience offers the possibility of elucidating individual characteristics beyond mere behavioral aspects. Since learning from reward and punishment represents the fundament also for social learning, investigating the neurobiological correlates of these learning mechanisms may help to explain why some individuals depend on the reinforcing aspects of scholar motivators (peers and teachers), while others do not. Moreover, in neuroscientific experimental settings, the detailed learning experience (i.e., trial-by-trial learning) within the brain can be investigated directly. Here, the combination of functional magnetic resonance imaging (fMRI) and reinforcement learning paradigms such as reversal learning tasks (Cools et al., 2002) constitute a well-established research method to investigate simple operant learning and allow researchers to consider potential inter-individual differences on a neural level during a basic learning task. Reversal learning assesses an individual’s ability to develop advantageous learning behavior by using feedback on performance. Standard 2-choice reversal learning tasks present participants with two potential responses with different reinforcement contingencies. Through multiple trials, participants learn to choose the stimulus associated with a higher reward by referring to their performance feedback. Next, the reinforcement contingency is altered without warning participants, who are thus surprised to discover that their previously reinforced response does not yield a reward anymore, cueing them to switch to the alternative response. As soon as one response is no longer being rewarded, the alternative response always becomes the better choice (see D’Cruz et al., 2011). Using such tasks, brain regions that are crucially involved in signaling learning parameters such as the prediction error (PE) have been identified (O’Doherty et al., 2003; Schlagenhauf et al., 2013). The PE is defined as the difference between an expected outcome and the actual outcome (Sutton and Barto, 1998). These PEs have been found to be encoded in the subcortical striatum (O’Doherty et al., 2003, 2004; D’Ardenne et al., 2008), as well as in prefrontal and parietal areas (O’Doherty et al., 2003; Tobler et al., 2006). The striatum which comprises of putamen and caudatus is known to be involved in basic forms of feedback processing and flexible learning processes (Beeler et al., 2014). The prefrontal cortex (PFC) on the other hand is involved in more controlled social feedback learning processes (see Guyer et al., 2012) and higher order control functions (Wood and Grafman, 2003; van Schouwenburg et al., 2010; Wolfensteller and Ruge, 2012).
Students’ motivation to learn is influenced by basic processes such as operant learning. Investigating these processes in experimental neuroscientific studies may help to explain why some individuals depend on reinforcing aspects of scholar motivators and others do not. Understanding these neural processes may constitute the basis for the understanding of aberrant behavior in the school context (e.g., conduct disorders).
Research Aims and Hypotheses
Here, we used computational modeling to estimate PE values based on the behavioral data of each individual. This approach also provides meaningful parameters that quantify different aspects of learning behavior like the individually estimated learning rate. The learning rate describes how strongly single feedback events influence future choice behavior, i.e., show if an individual adjusts his or her behavior quickly according to the received feedback or if his or her expectations are more stable and only influenced through feedback over a longer period of time. Possibly, since individuals with socio-motivational dependence adapt their motivation and learning to peers and/or teachers (Hoferichter and Raufelder, 2014), an association of individual learning rate values with the probability of being socio-motivationally dependent rather than socio-motivationally independent is suggested.
Furthermore, we hypothesize that PE related activation measured using fMRI during the reinforcement learning task is associated with the individual socio-motivational type. However, since this is the first study to link students’ MT, learning rate and brain activation during a reinforcement learning task, our approach was exploratory.
The main goal of the present study was to explore the interplay of reinforcement learning and socio-motivational (in-)dependence in adolescent students by: (1) investigating whether students’ individual learning rates in a reversal learning task can predict their respective MT, and (2) investigating whether PE related activation in the PFC and the striatum – brain regions that are known to be crucially involved in reinforcement learning – predict the probability of belonging to specific MTs.
Materials and Methods
Participants and Procedure
A subsample of 88 mentally and physically healthy (as confirmed by a semi-structured interview assessing psychiatric health care utilization and psychiatric family history) adolescents (Mage = 15.03; SD = 0.51; 44 girls) from 9th grade in secondary schools in the German federal state of Brandenburg was selected from a larger sample of a former quantitative study (N = 1088; Mage = 13.7 years; SD = 0.53) to participate in an fMRI study on reinforcement learning by using a reversal-learning task. The 88 participants were chosen according to their high probability (>0.85) of being either (1) a peer-dependent MT (n = 20; girls = 12), (2) a teacher-dependent MT (n = 17; girls = 10), (3) a peer-and-teacher-dependent MT (n = 24; girls = 11), or (4) a peer-and-teacher-independent MT (n = 24; girls = 12). This probability was based on ratings on the scales “Peers as positive motivators” (PPMs) and “Teacher as positive motivators” (TPMs), which formed the empirical basis of our preliminary LCA (see Raufelder et al., 2013b). In other words, the sample was highly representative of each MT.
The fMRI sessions were held between June and December 2012. Prior to their fMRI session each student within the current study’s subsample answered questions (among others) about their perception of PPMs and TPMs for a second time, which formed the empirical basis of the typology in the present sample. Since we were particularly interested in students’ own views and perceptions of their socio-motivational relationships with teachers and peers, the questionnaires used for this study were based on self-reports. Three of the 88 participants needed to be excluded: one due to missing data, one due to excessive head movements (more than 3 mm translation or 3° rotation) and one due to neurological abnormalities. The remaining 85 participants were included in the following analysis.
Prior to the fMRI study, participants were thoroughly screened for MRI exclusion criteria (e.g., non-removable ferromagnetic material). Both the participant and one parent or custodian provided their informed, written consent. Participants were free of drug use as well as any medication potentially affecting brain responses. According to the Edinburgh Handedness Inventory (Oldfield, 1971) 81 participants were right handed and four were left-handed. The study was performed in accordance with the latest version of the Declaration of Helsinki, and approved by the ethics committee of the German Psychological Society.
Teachers as Positive Motivators
This subscale was taken from the Relationship and Motivation (REMO) scale (Raufelder et al., 2013a). TPM consists of six items that showed a reliability of α = 0.81 in the current sample. Students were asked to answer statements such as “I will make more effort in a subject when I think that the teacher believes in me” or “When a teacher helps me, I try to do well in the subject” on a 4-point Likert scale from 1 (strongly disagree) to 4 (strongly agree).
Peers as Positive Motivators
This subscale is also part of the REMO Scale (Raufelder et al., 2013a) and consists of nine items (e.g., “When my friends learn, I am also motivated to learn” or “My friends and I motivate each other to make an effort at school”). Responses were collected using a four-point Likert scale from 1 (strongly disagree) to 4 (strongly agree) (α = 0.86).
Functional Magnetic Resonance Imaging
Using a 3.0 Tesla Siemens Magnetom Tim Trio scanner with a 12 channel head coil, gradient echo T2∗-weighted echo-planar images (EPIs) were acquired while participants performed the reversal learning task (outlined below). 633 EPI volumes containing 38 slices were measured using the following parameters: repetition time (TR) = 2060 ms, echo time (TE) = 30 ms, slice thickness 2.5 mm, matrix size 64∗64, field of view (FOV) 224∗224 mm2, in-plane voxel resolution 3.5 mm2, flip angle 80°. In order to correct for disparities in the magnetic field, distortion maps were measured prior to the EPI sequence [TR = 434 ms, TE = 5.19 ms (first) and 7.65 ms (second), slice thickness 3.5 mm, matrix size 64*64 and FOV 224*224 mm2, voxel size 3.5∗3.5∗3.5 mm3, flip angle 60°] and included in the analyses. A 3D anatomical image was obtained using a T1-weighted 3D spoiled-gradient echo pulse sequence with TR = 1900 ms, TE = 2.52 ms, matrix size 256∗256, FOV 256∗256 mm2, voxel size 1∗1∗1 mm3, flip angle 9°. Functional images and field-distortion-maps were tilted by 25°.
Probabilistic Reversal Learning Task
During the fMRI, participants performed 300 trials of a probabilistic reversal learning task. In this reinforcement learning paradigm, participants can win money by choosing one of two different stimuli, one of which has a higher probability of yielding a reward. These probabilities reverse during the experiment, therefore the participants have to keep learning and adjusting their choice behavior over the course of the experiment. One of the stimuli was associated with an 80% probability of a monetary reward and a 20% probability of a loss. Inverse probabilities were assigned to the other stimulus. Each trial consisted of three phases: presentation of the two stimuli (maximum 1.5 s), selection of one stimulus by the participant (1.5 s – RT), and feedback (1 s, see Figure 1). During the jittered, exponentially distributed inter-trial interval (1–6.5 s) a fixation cross appeared. Then, two symbols were randomly assigned to the left and right-hand side of the screen. Participants had to select one of them by pressing a button within the presentation time window; otherwise the message “Too slow!” (in German “Zu langsam!”) appeared and the experiment proceeded with the next trial. After the button press, a blue frame highlighted the selected target and the feedback (positive or negative) appeared: (1) positive feedback was displayed with an image of a 10 Euro-cent coin accompanied by the message “Win! +10Cent” (in German “Gewonnen! +10Cent”), (2) negative feedback was displayed with a crossed out 10-Euro Cent image accompanied by the text “Loss! –10Cent” (in German “Verloren! –10Cent”). After achieving the criterion of five correct answers (i.e., choosing the stimulus with currently higher chance to win) for the last six trials in a sliding window, the chance of reversal of the probability distribution became 20% for the following trial. Before performing the task in the scanner, students were introduced to the task with the help of a power-point presentation and given a short training session without reversals, in order to be familiarized with the probabilistic nature of the experiment. They were informed about the possibility of changes in reward contingencies during the main experiment and that they would receive the money they won during the task. Participants were instructed to maximize their reward. After performing the task with reversals in the fMRI scanner, participants received their total monetary gain (maximum 8 €).
Probabilistic reversal learning task: one trial consists of stimulus presentation with a response time window (1.5 s), feedback (1 s) and an inter-trial interval of 1.5–6.5 s introducing an exponentially distributed jitter. Choosing the currently...
Behavioral Data Analysis of Reversal Learning Task
Matlab 2010b (The MathWorks, Natick, MA, USA) and SPSS 19 (SPSS, Inc., Chicago, IL, USA) were used to analyze the behavioral data generated by the reversal learning task. Each participant’s behavioral performance was determined by the proportion of his or her “correct” responses, i.e., choosing the symbol with the currently higher probability to be rewarded.
Reinforcement Learning Algorithm
A reinforcement learning model was used to estimate learning parameters that describe individual behavior in the reversal task, and to generate single trial PEs as regressors for the analysis of fMRI data. In detail, a modified Q-learning algorithm was used that calculates five free parameters for each participant that best capture the student’s observed choice behavior. This algorithm updates an expected value (Q-value) based on the outcome of previous trials (Sutton and Barto, 1998). At each trial t, Q-values for the chosen option c were adjusted according to the feedback received:
Qc,t = Qc,t−1 + αδQc,t−1
The individual learning rate α determines how quickly expectations change with respect to the current PE δ, which is defined as the difference between the expected and the actual reinforcement Rc,t:
δQc,t = Rc,t − Qc,t
Rc,t indicates two separate free parameters: instead of coding reward and punishment as 1 and −1 respectively, the parameters varied individually for reward and punishment (Schlagenhauf et al., 2014).
In addition, the model estimates the degree to which a participant updates values for the unselected response Qu,t. Since the reversal learning task included inversely correlated reward probabilities, double update models are best suited to explain the observed behavior (Glascher et al., 2009; Hauser et al., 2014; Schlagenhauf et al., 2014). Because we were particularly interested in examining inter-individual differences in behavior (i.e., learning), the extent to which a participant utilized a double update strategy was allowed to be weighted by parameter κ:
Qu,t = Qu,t−1 − καδQu,t−1
To optimize the model fit, another free parameter Qi was included that specified the initial Q-values for one option (a bias to initially choose one stimulus over another; Schlagenhauf et al., 2014). The probability of choices based on the model-derived values was estimated by means of a softmax. The softmax equation calculates pa(t) – the likelihood of a subject choosing action a over b in trial t – which is assumed to be proportional to the expected value of this option.
The set of 5 free parameters was fitted individually for each participant by applying expectation-maximization with empirical priors, and the model evidence was approximated by integrating out the free parameters over the likelihood by sampling from the prior distribution (Huys et al., 2011, 2012). The choice behavior of all but one participant could be explained better than if it had been left up to chance (i.e., based on the likelihood that the observed data are given by the parameters). One participant’s performance was more than three standard deviations below the mean and thus that participant was excluded from further model-based analysis. As such, time-series based on individual parameters can be regressed against imaging data in a meaningful way.
fMRI Data Analyses
Functional magnetic resonance imaging image processing and data analyses were performed using Statistical Parametric Mapping software package (SPM8, Wellcome Trust Centre for Neuroimaging, London, UK1) in Matlab R2010b (The MathWorks, Natick, MA, USA). Initially, the following image preprocessing steps were conducted: correction for differences in slice time acquisition and motion including unwarping, co-registration of the mean EPI with the anatomical image, spatial normalization, and segmentation into tissue classes of the T1 image using the unified segmentation approach (Ashburner and Friston, 2005). EPIs were spatially smoothed with an isotropic Gaussian kernel of 6 mm full width at half maximum. The general linear model approach used by default in SPM8 was applied. Data analysis was performed following an event-related approach. On the single-subject-level, a regressor was used to model reactions to feedback and the PEs derived from the learning model were added as a parametric modulator. In order to account for movement associated variance, the six rigid body movement parameters and their first temporal derivative as well as a regressor marking scans with more than 1 mm scan-to-scan movement were included in the model as additional regressors of no interest (Iglesias et al., 2013). Individual PE contrast images were taken to a random effects group-level analysis (one-sample t-test for within group analysis). All results are reported using family wise error (FWE) correction for the whole brain (p < 0.05). For statistical analysis, the blood-oxygen-level dependent (BOLD) parameter estimates (reflecting changes in the concentrations of oxy- and deoxyhemoglobin within the brain and thus indirectly indicating changes in neural activity) were extracted from clusters that were significantly activated [regions of interest (ROI)]. Based on previous studies and to reduce the number of tested areas we focused on the PFC and striatum (Cools et al., 2002; D’Cruz et al., 2011; Schlagenhauf et al., 2013). Extracted values from functional clusters were averaged. Based on studies showing differential activation of striatal subregions during reinforcement learning (O’Doherty et al., 2004), especially in adolescents (Cohen et al., 2010), we additionally extracted parameter estimates from striatal subregions (limbic, sensorimotor and associative striatum; Martinez et al., 2003) to analyze these in more detail.
Multinomial Logistic Regression Analysis
The three-step approach of latent class (LC) regression introduced by Vermunt (2010) was used to predict socio-motivational (in-)dependence: in the first step, the LC model is built on students’ replies to PPM and TPM before the fMRI session, although the regression and the LC model are combined into one model. In the second step, similar to LC analysis without covariates, individuals are assigned to the LCs based on their prior MT membership probabilities obtained from step one. The estimated mean allocation probabilities for participants in the current study are above 0.96. However, assigning individuals to single MT categories may generate misclassification errors, since membership probabilities are not always exactly one. In Vermunt’s (2010) three-step approach, the MT categories allocated in step two serve as a single response variable with known measurement error probabilities. Finally, in the third step, a multinomial logistic regression analysis (MLRA) is conducted using the MT category assignment from step two as the observed dependent variables. Thereby, in contrast to MANOVA, the misclassification errors in the LCs are taken into account. The strength and advantages of Vermunt’s three-step approach have been successfully demonstrated (Vermunt, 2010; Asparouhov and Mutheìn, 2012).
The LC model was estimated using three parcels of the original six items (three parcels consisting of two items) of the REMO subscale, TPM, and the original nine items (three parcels consisting of three items) of the REMO subscale PPM, which students filled out immediately before their fMRI session. To ensure that all measurement information enters the structural equations, random parcel building is often used in psychological research (Nasser-Abu and Wisenbaker, 2006). Although some authors argue that parceling is inappropriate in confirmatory factor analysis models (Marsh et al., 2013), others (e.g., Little et al., 2002; Nasser-Abu and Wisenbaker, 2006) underline the advantages of parcel construction due to preventing potential variance sharing and spurious correlations. To predict the extracted LCs, the independent variables deployed in the logistic regression were the learning rate α as well as the extracted values from the fMRI analysis from the ROIs PFC, caudate/thalamus and putamen (left and right hemisphere separately). All analyses were carried out in Mplus 7 (Muthén and Muthén, 1998-2010) with MLR estimator, which is recommended for standardized questionnaire-based analyses with small and medium sized samples (N < 100; Wang and Wang, 2012), although the sample size is relatively large for fMRI standards. To account for missing data, the models were estimated using full information maximum likelihood in Mplus.
Latent Class Analysis
Table 1 shows the model fit results for LCA with 2–5 classes. Judging from the Akaike Information Criteria (AIC) and Bayesian Information Criteria (BIC; lowest value), the 4-class solution reveals the best fit for our data. In addition, the Bootstrap Likelihood Ratio Tests (BLRT) indicate that the 5-class solution is not superior to the 4-class solution model (see Table 1).
The LCA replicated the four MTs (see Figure 2): (1) teacher-dependent MT, (2) peer-dependent MT, (3) teacher-and-peer-dependent MT and (4) teacher-and-peer-independent MT. Membership to this 4-class solution was as follows: 22.9% teacher-dependent MT, 26.9% peer-dependent MT, 24.2% peer-and-teacher-dependent MT, and 26.0% peer-and-teacher-independent MT.
Latent class analysis of socio-motivational (in-)dependence. X-axis shows three PPM parcels (1–3) and three TPM parcels (4–6) included in the model analyses. Y-axis shows probability of agreement to the parcels. P&T MT, peer-and-teacher-dependent...
Multinomial Logistic Regression Analysis
Table 2 shows the results of the MLRA, which tested the learning rate α as well as the extracted values from the PE related BOLD signal of two brain regions that were selected a priori based on previous research and due to their involvement in learning processes (PFC and striatum). In addition, to test the association with striatal activation in more detail, the activation of different striatal subregions (associative, limbic, and sensomotoric striatum) during the reversal task was tested as a predictor of the four different MTs. By default, Mplus estimates so-called logit-regression values (transformation form of probability; B-values), since nominal scaled variables (class variables) have no unit. To facilitate interpretation, odds ratios (ORs) have been estimated, which are presented in Table 2 in second position. Since the peak of ORs is 1, values above 1 increase the probability, whereas values below 1 reduce the probability of membership to one LC (Szumilas, 2010).
Results multinominal logististic regression.
Learning as Predictor of Four Different MTs
The four MT did not differ in their performance measured as percent correct responses, i.e., choosing the symbol with the currently higher probability to be rewarded (F = 0.13, p = 0.94). The computational model provided individual parameters as a result from the process of fitting the model to each participant’s observed behavior. As depicted in Table 2, the individual parameter learning rate α is able to distinguish between the probabilities of being an independent MT rather than a peer-and-teacher-dependent MT (B = –7.71, OR = 0.00, p < 0.05): a high learning rate i.e., a high α value, indicated that a participant tends to be more strongly influenced by the most recent feedback. Such a behavior is associated with membership to the peer-and-teacher-dependent MT rather than the independent MT. Members of the latter category show lower learning rates indicating slower updating of expectations.
Functional Activation of Learning Regions as Predictors of Four Different MTs
We found PE related activation in the expected regions, the PFC, the striatum, and in parietal areas, as has been described in previous studies (see Figure 3). Activity in the PFC was located in the left inferior and middle frontal gyrus and in the right middle frontal gyrus. The striatum was found to be significantly activated in two separate clusters in each hemisphere, one lateral cluster (putamen) und one dorsal cluster (tail of caudate and anterior nucleus of thalamus).
Functional magnetic resonance imaging during reversal learning. BOLD signal covaried with prediction errors in a network including the PFC, the parietal cortex, the striatum (putamen and caudate/thalamus-cluster) and the cerebellum (FWE-corrected on the...
For the further analysis we used values extracted from regions activated during the reversal learning task in our sample, thereby ensuring that these regions are indeed significantly involved in feedback processing during the task. For an additional analysis focusing on the striatum, a region which receives specific interest regarding PE processing, we used functional masks (Martinez et al., 2003) to extract activation estimates from striatal subregions.
The BOLD signal parameter estimates of two regions (PFC right, and associative striatum left – a subregion of the striatum) that are associated with PE encoding in the reversal task were identified as predictors of the four MTs: our first analysis revealed that PE related activation in the right PFC discriminates between the probability of two categories: the activity level in right PFC predicted the probability of being a peer-and-teacher-dependent MT (B = −1.50, OR = 0.22, p < 0.05) rather than an independent MT. Second, as the results of a separate multinomial regression with the different striatal subareas show, the PE related activation in the left associative striatum discriminates between the probabilities of membership to three categories: the more the activity in the left associative striatum covaried with PEs, the higher the probability of being an independent MT rather than a teacher-dependent MT (B = 7.90, OR = 2697.84, p < 0.05) or peer-and-teacher-dependent MT (B = 6.80, OR = 897.85, p < 0.05). Please see Table 2 for more details.
The main goal of the current person-oriented, multi-methodological study was to shed light onto individual differences in the interplay between learning and socio-motivational (in-)dependence in adolescence. In particular, reinforcement learning rates as well as activity levels in brain regions that are associated with reinforcement learning (striatum, PFC) were tested as predictors of four different MTs based on the concept of socio-motivational (in-)dependence.
With regard to our first research aim, student’s learning rate indeed functions as a predictor discriminating different MTs, in particular between the peer-and-teacher-dependent MT and the peer-and-teacher-independent MT. In detail, a temporal short term learning rate, characterized by a high α value, is associated with the peer-and-teacher-dependent MT but not with the independent MT. Note that neither a low nor a high learning rate is beneficial in this probabilistic learning task, where an immediate reaction to negative feedback as well as a too slow adjustment of behavior might not increase rewarded events. Thus, students of the peer-and-teacher-dependent MT are more likely to immediately adjust their behavior according to the feedback they receive during the reinforcement learning task. Possibly, this is caused by increased feedback sensitivity in basic learning mechanisms, which could function as a basis for their socio-motivational dependence, i.e., high feedback-sensitivity (recognition and approval) toward peers and/or teachers (Hoferichter and Raufelder, 2014). In turn, the independent MT seems to be less reactive to feedback (reinforcement) during learning as well as in terms of motivation.
However, the learning rate neither discriminated between the three socio-motivational types (peer-dependent MT, teacher-dependent MT, peer-and-teacher-dependent MT), nor between the peer-dependent MT and the teacher-dependent MT compared with the peer-and-teacher-independent MT. Future studies with diverse samples are warranted and may provide deeper insights into these individual differences.
Regarding our second research aim, learning related neural activation in two brain regions (PFC and a subregion of the striatum) discriminated between the probabilities of being socio-motivationally independent as opposed to being socio-motivationally dependent. In detail, more PE related activity in the right PFC predicted the probability of being a peer-and-teacher-dependent MT rather than an independent MT. This finding supports previous research that found the PFC to be associated with more controlled and feedback-related learning processes (Cools et al., 2002; van Schouwenburg et al., 2010; Wolfensteller and Ruge, 2012). In this way, it also supports previous findings on differences in learning-behavior typically found for different MT. In fact, the peer-and-teacher-dependent MT is characterized by a strong feedback-orientation toward both peers and teachers and by well-adjusted and controlled behavior in school (Hoferichter and Raufelder, 2014; Raufelder et al., 2015). Thus, social-motivational dependence might be associated with tendency to follow directions and adapt to feedback in general.
In the additional analysis of subregions within the striatum, we observed that the higher the PE related activity in the left associative striatum, the higher was the probability of being an independent MT rather than a teacher-dependent MT or a peer-and-teacher-dependent MT. During the fMRI experiment, we measure PE related BOLD signals in the striatum. It can be speculated, that individuals from the socio-motivational independent MT group may more strongly rely on their own assumption about their actions and the associated consequences. Such stronger reliance or trust in one’s own estimations of the state of the environment can computationally be understood as higher precision of the PE, which might – perhaps through top down processing – lead to an increase in the measured PE signals in the striatum (Hebart et al., 2016).
Overall, these findings support the concept of socio-motivational (in-)dependence by providing evidence that the concept of socio-motivational (in-)dependence is associated with different learning patterns on (a) a behavioral as well as on (b) a neural level. Following Jensen’s (1998) advice of “teaching with the brain in mind,” our findings revealed that teachers should be aware that student’s individual motivation style [i.e., socio-motivational (in-) dependence] is associated with specific feedback-related brain response during reinforcement learning. Linking these findings to educational practice in order to better support adolescent students and accommodate their individual learning and motivation preferences, students with a socio-motivational dependence benefit from feedback and concrete directions, whereas students with a socio-motivational independence need a more autonomous learning environment with fewer instructions and feedback from teachers and peers. Particularly, students with a socio-motivational independence might not best benefit from the traditional school system, which is dominated through learning in classroom settings and strong teacher involvement and feedback. As strength they show a higher behavioral flexibility, which need to be better supported in class through promoting autonomy-supportive or student-centered teaching behaviors by teachers (Soenens and Vansteenkiste, 2005; Roth et al., 2007; Radel et al., 2010).
Strengths, Limitations, and Future Directions
Following the person-oriented approach, the present interdisciplinary and multi-methodological study extends existing research on individual differences in the interplay of learning and motivation, specifically the role of reinforcement learning as a predictor of socio-motivational (in-)dependence in adolescence. Compared to current fMRI standards, we studied a relatively large, non-clinical adolescent sample, which provides valid information about neurobiological processes during reinforcement learning considering individual differences in socio-motivational patterns in healthy adolescents. The fMRI design allows giving important insights into adolescents’ brain activity while learning, bridging disciplinary boundaries by combining neuroscientific results to educational psychology in a multi-methodological way. In other words, there are not only individual differences in students’ motivation patterns, but also in their brain activity while learning.
However, some methodological limitations need to be considered when interpreting the current findings. Firstly, the results are limited to German adolescents within the age range of 13–16 years and we are aware that findings may differ for students within another age range, or for students from other countries or different ethnic groups. Secondly, considering the relatively novice field of fMRI-based research on adolescents’ motivational and learning processes, our study is explorative in nature. Future replication studies are warranted to validate our results and to broaden knowledge regarding potential dysfunctions within motivational aspects, learning and its neural basis. Thirdly, one might criticize the use of self-report data. However, studies on motivation that were based on both teacher and student self-reports have reported relative disparity in the information provided by multiple informants (see Skinner and Belmont, 1993). Wentzel et al. (2010) argue that teachers tend to provide invalid information about their students’ perceptions of their own behavior. Since the present study focused on students’ perception of teachers and peers as motivators, a self-report approach is warranted. Moreover, the use of self-report measures has been validated as an appropriate method in psychological research (Chan, 2009). Furthermore, the present study combines self-report data with experimental data, thereby minimizing the weaknesses of each method while maximizing their strengths by combining disparate yet complementary approaches (Raufelder et al., 2012). The reinforcement learning task might not compare directly to the situation in a real classroom setting, however, operant reinforcement learning is one of the most basic forms of learning (see Thorndike, 1929; Skinner, 1938; Ittel et al., 2013) and therefore also constitutes the basis for more complex learning processes in educational settings. The reversal learning paradigm used in the current study is a well-established operationalization of reinforcement learning and is suitable for simultaneous measurement of functional imaging data (Cools et al., 2002). However, we did not examine learning based on social reinforcement but based on more basic secondary reinforcement (money). Based on our findings, future studies are warranted to operationalize this more complex type of (social) reinforcement. Finally, future studies following a person-oriented approach are encouraged to expand existing research on differential motivation and learning patterns (Corpus and Wermington, 2014; Korpershoek et al., 2015) through including neural components. Despite these limitations, this person-oriented study provides deeper insights into the interplay of individual differences in learning and motivational processes in adolescents by using an innovative, multi-methodological, and interdisciplinary research design.
DR did the statistical analyses and wrote the main part of the paper. RB did the fMRI analyses of the reversal task and helped writing the paper. LR, SG, RL, TG, and AB were mainly involved in the fMRI procedures including conceptualization, data collection, pre-analyses etc. They additionally helped correcting the manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- Alspaugh J. W. (1998). Achievement loss associated with the transition to middle school and high school.J. Educ. Res.92 20–25. 10.1080/00220679809597572 [Cross Ref]
- Ashburner J., Friston K. J. (2005). Unified segmentation.Neuroimage26 839–851. 10.1016/j.neuroimage.2005.02.018 [PubMed][Cross Ref]
- Asparouhov T., Muthén B. O. (2012). Auxiliary Variables in Mixture Modeling: A3-step Approach using Mplus. Available at: http://www.statmodel.com/examples/webnote.html
- Barber B. K., Olsen J. A. (2004). Assessing the transitions to middle and high school.J. Adolesc. Res.19 3–30. 10.1177/0743558403258113 [Cross Ref]
- Beeler J. A., Cools R., Luciana M., Ostlund S. B., Petzinger G. (2014). A kinder, gentler dopamine. highlighting dopamine’s role in behavioral flexibility.Front. Neurosci.8:4 10.3389/fnins.2014.00004 [PMC free article][PubMed][Cross Ref]
- Chan D. (2009). “So why ask me? Are self-report data really that bad?,” in Statistical and Methodological Myths and Urban Legends, eds Lance C. E., Vandenberg R. J., editors. (New York, NY: Routledge; ), 309–336.
- Cohen J. R., Asarnow R. F., Sabb F. W., Bilder R. M., Bookheimer S. Y., Knowlton B. J., et al. (2010). A unique adolescent response to reward prediction errors.Nat. Neurosci.13 669–671. 10.1038/nn.2558 [PMC free article][PubMed][Cross Ref]
- Cools R., Clark L., Owen A. M., Robbins T. W. (2002). Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging.J. Neurosci.22 4563–4567. [PubMed]
- Corpus J. H., Wermington S. V. (2014). Profiles of intrinsic and extrinsic motivations in elementary school: a longitudinal analysis.J. Exp. Educ.82 480–501. 10.1080/00220973.2013.876225 [Cross Ref]
- Crandell J. M., Robinson L. W. (2007). Low Visions and Blindness. Springfield, IL: Charles Thomas Publisher.
- D’Ardenne K., McClure S. M., Nystrom L. E., Cohen J. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area.Science319 1264–1267. 10.1126/science.1150605 [PubMed][Cross Ref]
- D’Cruz A. M., Ragozzino M. E., Mosconi M. W., Pavuluri M. N., Sweeney J. A. (2011). Human reversal learning under conditions of certain versus uncertain outcomes.Neuroimage56 315–322. 10.1016/j.neuroimage.2011.01.068 [PMC free article][PubMed][Cross Ref]
- Deci E. L., Ryan R. M. (eds) (2002). Handbook of Self-Determination Research. Rochester, NY: University of Rochester Press.
- Eccles J. S., Wigfield A., Schiefele U. (1998). “Motivation to succeed,” in Handbook of Child Psychology. Social, Emotional and Personality DevelopmentVol. 3 eds Damon W., Eisenberg N., editors. (New York, NY: Wiley; ), 1017–1096.
- Glascher J., Hampton A. N., O’Doherty J. P. (2009). Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making.Cereb. Cortex19 483–495. 10.1093/cercor/bhn098 [PMC free article][PubMed][Cross Ref]
- Guyer A. E., Choate V. R., Pine D. S., Nelson E. E. (2012). Neural circuitry underlying affective response to peer feedback in adolescence.Soc. Cogn. Affect. Neurosci.7 81–92. 10.1093/scan/nsr043 [PMC free article][PubMed][Cross Ref]
- Harter S. (1996). “Teacher and classmate influences on scholastic motivation, self-esteem, and level of voice in adolescents,” in Social Motivation — Understanding Children’s School Adjustment, eds Juvonen J., Wentzel K., editors. (Cambridge: University Press; ), 11–42.
- Hauser T. U., Iannaccone R., Ball J., Mathys C., Brandeis D., Walitza S., et al. (2014). Role of the medial prefrontal cortex in impaired decision making in juvenile attention-deficit/hyperactivity disorder.JAMA Psychiatry71 k1165–1173. 10.1001/jamapsychiatry.2014.1093 [PubMed][Cross Ref]
- Hebart M. N., Schriever Y., Donner T. H., Haynes J.-D. (2016). The relationship between perceptual decision variables and confidence in the human brain.Cereb. Cortex26 118–130. 10.1093/cercor/bhu181 [PubMed][Cross Ref]
- Hoferichter F., Raufelder D. (2014). “Ein Modell inter-individueller unterschiede sozio-motivationaler beziehungen von sekundarschülern mit ihren peers und lehrern,” in Beziehungen in Schule und Unterricht - Teil 3 Soziale Beziehungen im Kontext von Motivation und Leistung [Relationships in school and class – Part III Social Relationships in context of motivation and achievement], eds Tillack C., Fetzer J., Raufelder D., editors. (Immenhausen: Prolog; ), 170–200.
- Hoferichter F., Raufelder D., Eid M., Bukowski W. M. (2014). Knowledge transfer or social competence? A comparison of German and Canadian adolescent students on their socio-motivational relationships in school.Sch. Psychol. Int.35 627–648. 10.1177/0143034314552345 [Cross Ref]
- Huys Q. J., Cools R., Golzer M., Friedel E., Heinz A., Dolan R. J., et al. (2011). Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding.PLoS Comput. Biol.7:e1002028 10.1371/journal.pcbi.1002028 [PMC free article][PubMed][Cross Ref]
- Huys Q. J., Eshel N., O’Nions E., Sheridan L., Dayan P., Roiser J. P. (2012). Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees.PLoS Comput. Biol.8:e1002410 10.1371/journal.pcbi.1002410 [PMC free article][PubMed][Cross Ref]
- Iglesias S., Mathys C., Brodersen K. H., Kasper L., Piccirelli M., den Ouden H. E., et al. (2013). Hierarchical prediction errors in midbrain and basal forebrain during sensory learning.Neuron80 519–530. 10.1016/j.neuron.2013.09.009 [PubMed][Cross Ref]
- Ittel A., Raufelder D., Scheithauer H. (2013). “Soziale Lerntheorien,” in Theorien in der Entwicklungspsychologie [Theories in Developmental Psychology], ed. Ahnert L., editor. (Heidelberg: Springer; ), 330–353.
- Jagenow D., Raufelder D., Eid M. (2015). The development of socio-motivational dependency from early to middle adolescence.Front. Psychol.6:194 10.3389/fpsyg.2015.00194 [PMC free article][PubMed][Cross Ref]
- Jensen E. (1998). Teaching with the Brain in Mind. Alexandria, VA: Association for Supervision and Curriculum Development.
- Korpershoek H., Kuyper H., van der Werf G. (2015). Differences in students’ school motivation: a latent class modelling approach.Soc. Psychol. Educ.18 137–163. 10.1007/s11218-014-9274-6 [Cross Ref]
- Little T. D., Cunningham W. A., Shahar G., Widaman K. F. (2002). To parcel or not to parcel: exploring the question, weighing the merits.Struct. Equat. Model.9 151–173. 10.1207/S15328007SEM0902_1 [Cross Ref]
- Marsh H. W., Lüdtke O., Nagengast B., Morin A. J. S., von Davier M. (2013). Why item parcels are (almost) never appropriate: two wrongs do not make a right – Camouflaging misspecification with item parcels in CFA models.Psychol. Methods18 257–284. 10.1037/a0032773 [PubMed][Cross Ref]
- Martinez D., Slifstein M., Broft A., Mawlawi O., Hwang D. R., Huang Y., et al. (2003). Imaging human mesolimbic dopamine transmission with positron emission tomography. Part II: amphetamine-induced dopamine release in the functional subdivisions of the striatum.J. Cereb. Blood Flow Metab.23 285–300. 10.1097/00004647-200303000-00004 [PubMed][Cross Ref]
- Mehring T. A., Colson S. E. (1990). Motivation and mildly handicapped learners.Focus Except. Child.22 1–15.
- Muthén L. K., Muthén B. O. (1998-2010). Mplus User’s Guide. Los Angeles, CA: Muthén & Muthén.
- Nasser-Abu F., Wisenbaker J. (2006). A Monte Carlo study investigating the impact of item parceling strategies on parameter estimates and their standard errors in CFA.Struct. Equat. Model.13 204–228. 10.1207/s15328007sem1302_3 [Cross Ref]
- O’Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning.Science304 452–454. 10.1126/science.1094285 [PubMed][Cross Ref]
- O’Doherty J. P., Dayan P., Friston K., Critchley H., Dolan R. J. (2003). Temporal difference models and reward-related learning in the human brain.Neuron38 329–337. 10.1016/S0896-6273(03)00169-7 [PubMed]
Want create site? Find Free WordPress Themes and plugins.
Just going to say i just now realized i made my essay into an explanatory one instead of an informative one
parsley massacre essay about myself ieee research papers on vlsi design buy research paper online youtube? carson mccullers the member of the wedding essay Oh my gosh, who knew writing my war poetry essay was going to be this painful? Kill me now?! roy fielding dissertation pdf uk essay about 2nd world war pictures? temple university essay history should cigarette smoking be banned argumentative essay videos. Artist critique essay How the fuck have I managed to accidentally do general studies and what the actual fuck is that essay question research paper intro paragraph needed. essay about environmental sanitation theory um vs uf 2016 essay palm tree justice essay conclusion misuse of power essay lord? the great depression 2 page essay on matter? should college essays be double spaced line ivy league college essays nytimes can you change your common app essay for different schools 2017 amelia earhart research paper towns julian barnes essays on art 1916. Writing an organized research paper personal narrative essay about love someone write me this explanatory essay. i will pay you in chocolates. college essay editing video essay about war in malayalam karl marx sociology essay on education physician assisted suicide should be legal essay? comparison essay short stories masculinity in media essay about radio. Purpose of argumentative essay graphics my school life narrative essay nationalism cause ww1 essay essays on war quizlet deckungsbeitrag berechnen beispiel essay. the invisible man theme essay writing. Agar main pakshi hota essay help bocr analysis essay buy dissertation proposal books common app extracurricular essay lengthener ecosystem conclusion essay on discrimination. a good closing paragraph for an essay fair and lovely advertisement analysis essay seppo laukkanen dissertation meaning Used the work 'scope' in my essay about student with cerebral palsy. This is what cheers me up nowadays. #SENINerd essay on beauty of nature how weather affects mood essay compare and contrast essay kate chopin cuddy body language essay what does contrast mean when writing an essay research papers on load balancing in cloud computing? writing a good dissertation methodology?, ose rever ose essayer meaning persuasive essay about breast cancer? jane austen pride and prejudice essay? descriptive essay introduction xy, capitalism culture essay historical modern old pristine regime state dissertation sur les scrutins proportionnels jane eyre charlotte bronte essay, climate vs weather essay nationalism cause ww1 essay, genetic diversity research papers moxy uglydoll descriptive essay operation cobra essay? renaissance essay zone essay hero in history introduction for a research essay table of contents of research paper jams school reports personal comments essay essay about republic day in kannada language of i love myself essay moxy uglydoll descriptive essay perlimpinpin dessay lakme article 244 du code civil dissertation defense dissertation consultant zoning map, dover edition essay foundation geometry modern phoenix on the beach nevil shute essay writing college level essays reviewer my personal philosophy life essay essay on dashain and tihar greetings, dissertation phases essay on black money in kannada language pdf essays on fine art what does contrast mean when writing an essay success and failure in life essay writing a five paragraph essay ppt keep your city clean and green essay reviews winter season in bangladesh essay writer rib eye de que parte de la res essay what is introduction in research paper notes essay on professional development for teachers, an essay description of my room essay on beauty of nature y176 essay about myself what is introduction in research paper notes. Quantitative study dissertation surfing internet essay pdf, essays on cancer awareness weather photo essay persuasive essay bridge to terabithia trailer best essay writer quizlet school reports personal comments essay business school application essay Typed a 1000 word essay in two hours right before it's due I'm great. roy fielding dissertation pdf uk how much do you charge for writing an essay instruction in the natural environment essays el miedo pablo neruda analysis essay is he into you or just being polite essay wireless network security research papers xp renaissance essay zone psychological facts about happiness essay how to do index cards for research papers king lear literary essay to his coy mistress theme essay the martyrdom of saints perpetua and felicitas analysis essay. Argumentative essay animal rights laws future of print media essay urs granacher dissertation defenseStrike pro brown essay argumentative essay don't blame the eater, attention getter for sex education essay my dream my future essay @HHRoadGuy I'm supposed to be writing my college essay but instead I'm talking to you... WAY BETTER!! bf3 dx10 vs dx11 comparison essay? thomas sauermann dissertation proposal business school application essay essay how to become a good writer gilman scholarship essay karnataka essays on fine art movies to write essays on my ethnic identity essay I don't feel like writing 3 essays tomorrow on stuff that I have probably already forgotten. college evaluation essay? persuasive essay on slavery importance of physical therapy essay essay about fifa world cup grenzertrag berechnen beispiel essay um vs uf 2016 essay. Mkv wmv comparison essay best essay writer quizlet, con gun control persuasive essay scientific subjects for research papers journals? essay about photography zip code essay on natural disasters 250 words writing a good essay conclusion be how to write a one page essay for scholarship autobiography of a student essays on homelessness philosophical arguments on morality essay my ethnic identity essay. essay friend good trait short essay about violent video games essay on nuclear energy a boon or bane native speaker chang rae essay durga puja essay. benefits of writing an argumentative essay sociologie urbaine dissertation abstract judaism research paper uk, carrefour market essays 624004 federalist essay yesterday english grammar essay writing xyz writing a good thesis statement for a research paper quizlet purpose of argumentative essay graphics describe your personality essay video frankenstein beauty essay xsport get fit challenge essay civil rights movement research paper expression essays on gay marriage debate hamburger essay in marathi en 1320 module 6 essay 24 sent in my Action Research paper this morning at 9 am..now I need to get cracken on this 37 page exam due Thurs, and IEP, P.P. presentation principle beneficence euthanasia essay smashed my forensic essay, fuckin buzzin X suny orange newburgh admissions essay agnes martin plug and critique essay talking to grief levertov analysis essay junk food essay hook f scott fitzgerald research paper?. 1984 essays on proles ways to improve my essay writing purchase dissertation writing essay about having a university degree writing a good gre essay to his coy mistress theme essay essay on beauty of nature dissertation work traduzione? What Older People Should Consider Before Taking an Antidepressant: The Huffington PostThis essay was co-authored... curve fitter for pole zero analysis essay. how to write a essay about your hero humanities research paper introduction on hiv a view from a window essay writer Finished my first semester of college. It feels weird. Also I finally got an A on an essay so that's pretty cool as well. how to write a2 philosophy essays ocr fish life in sea water essay papers my older sister essay. Essay on drug abuse threat to society essay on subhash chandra bose in english of 500 words to grow barn burning essay youtube winter season in bangladesh essay writer minarchism vs anarchism and other essays dissertation zusammenfassung abstract thomas hamlet dessay video. Turun konservatorion rhetorical essay the common life argument essay powerpoint. how to write a 5 paragraph essay on compare and contrast el miedo pablo neruda analysis essay abraham foxman essay crucible essay about power admission essay writing services victoria research paper in human trafficking waterloo bridge monet descriptive essay jstor research papers with answers research papers on vocational and technical education anti essays phone number 2010 humanitarian essay 6 page essay on global warming.. Essays on fine art, the martyrdom of saints perpetua and felicitas analysis essay persuasive essay about breast cancer acknowledgement of dissertation year 5.
Sociologie urbaine dissertation abstract quantitative study dissertation?. Essay about fifa world cup essay about sir edmund hillary tent, diego bossip eugenia stossel essay short essay about college life essay for diwali festival english. learn english essay writing keyboard essay writing company qatar fair and lovely advertisement analysis essay search database for research papers college evaluation essay.
University of ottawa electronic thesis dissertation j essaye d oublier sniper mp3 song? essay on raksha bandhan in punjabi language phrases agnes martin plug and critique essay.
Apple iphone swot essay the great depression 2 page essay on matter report and essay compare and contrast essay on the american dream. writing a college placement essay how important is the college application essay. projektskizze dissertation abstracts essay about company lawyers essay on natural disasters 250 words youtube csc vs essay was trying to do her drama essay but gave up :) fugative justin and jls george ilalalove you!!:) l enterprise citoyenne dissertation defense, essay on narrative conventions fast essay writing videos expository essay on corruption in the society ethnographic dissertation answers dvpw dissertationspreis 2016 nissan essay on environmental pollution in 100 words causes and consequences of poverty essay toms belfast during world war 2 essays. Weather photo essay essay on third gender in nepal s huck finn education essays? hook sentences for expository essays 4th essay on legalizing prostitution essay on dashain and tihar greetings what is the culture essay essay about sir edmund hillary tent network security research papers youtube impressionism essays. mon anniversaire essay help hio harvard optional essay date foire lessay 508? logical fallacies essay ucf transfer application essay marullus speech analysis essay essay about african continent population shaving essay Weekend find, an 1892 copy of Emerson's essays, including Nature. #essentialreading #readmore� grenzertrag berechnen beispiel essay, essay biodiversity conservation ecosystems prostitution research paper conclusion and recommendations. crucible essay about power essay about sir edmund hillary tent. dicto simpliciter love is a fallacy essay geology research paper uk? butomus umbellatus descriptive essay wireless network security research papers xp atuhk jupas essay skin disease research papers essay about challenges in student life school life essay pdf. Essay on your favorite sports mini itx z170 comparison essay essay crimes and celebrities goal essay video abatement of pollution essay quotations attention getter for sex education essay. nina haferkamp dissertation writing goal essay video Also my essay on bringing Wittgenstein into the field of archaeological interpretation is mint, if I do say so myself. instruction in the natural environment essays spoken language essay multimodal texts expository essay on corruption in the society can t write my essay xml leadership vs management essay writing writing a five paragraph essay ppt uottawa law directed research paper biomedical engineering essay 5 page research paper on the holocaust book. My ethnic identity essay dvpw dissertationspreis 2016 nissan. Essay on mother love in gujarati language can t write my essay xml advantages university education essay. Cross cultural marriage essay compare, artist critique essay american dream in the invisible man essay? persuasive essay on racism in australia.
Antibodies film critique essays health food essays? 2fuse descriptive essay dover edition essay foundation geometry modern phoenix manchester dissertation binding llc research papers on load balancing in cloud computing essay about myself career and future essay on delhi metro a lifeline of delhi suny orange newburgh admissions essay, 100 words essay, research paper on bullying in schools cynthia ozick essays on orchids essay about gun control xbox essay forbidden life patenting should? Listening to Chief Keef while I'm typing this essay, this a bad combination malte gersh dissertation help argumentative research paper ppt student evaluate teacher essay seppo laukkanen dissertation meaning how to write citation in the essay, essay for diwali festival english, throwed essay essay writing about online shopping? importance girl child education essay teachers 10000 word essay years
University level Essay yearly writing
Did you find apk for android? You can find new Free Android Games and apps.