First, teachers self-score their portfolios using our portfolio scoring rubric guides. You can see a sample guide by going to http://team-tn.org/wp-content/uploads/2016/07/2017-18-K-ELA-Portfolio-Scoring-Resource-Guide_Final_8.2.17.pdf
Then, once teachers’ portfolios are submitted, all portfolios are carefully scored based on the scoring guide by certified peer reviewers using a consensus protocol. This means that the teacher’s score and the peer reviewer’s score must align within one performance level. If the difference between these two growth scores is more than one performance level, an expert reviewer scores the collection/submission, providing an additional level of review. If an expert reviewer scores a collection/submission, those scores are considered final.
All collections in portfolios have been scored. At the score report level in Educopia, teachers can view all of their scores.
If there was a mismatch between standards (see more below), the individual collection received an automatic score of 1. When teachers access Educopia to view work artifacts at the student sample level, the score of 1 is not displayed because the score was assigned to the entire collection rather than the artifact. Therefore, teachers may conclude that no score was assigned at all.
Portfolio collections could have received a score of 1 for a number of reasons.
Portfolios are designed to demonstrate student growth across time and for standards which teachers select and are assessed through student work. In cases where evidence of student growth is significantly below expectations, these collections would receive a score of 1.
Collections could also receive a score of 1 because of a mismatch either between samples of students or between the standards that were chosen at Point A and the standards that were chosen at Point B. When the standards are mismatched in either of these ways, those portfolio collections/submissions were both flagged by a peer reviewer and automatically scored as a 1.
It’s important to note that, for teachers who used all standards consistently from Point A to Point B for all three samples of students, no automatic score was generated, and the collection was scored by a peer reviewer and an expert reviewer if needed. If the difference between these two scores is more than one performance level, an expert reviewer scores the collection/submission, providing an additional level of review. If an expert reviewer scores a collection/submission, those scores are considered final. This mismatch could have happened in a number of ways:
For other reasons on why portfolio submissions may receive a score of 1, you may review the information on the second page of your score report.
In the event a teacher elects to grieve this early grades portfolio evaluation composite, please note that the local grievance process must be started no later than 15 days from the issuance of scores, which is August 8. For more information on the grievance process, please visit the State Board of Education’s website at https://www.tn.gov/content/dam/tn/stateboardofeducation/documents/pendingrulespolicies/april-20%2c-2018/5.201%20Teacher%20%26%20Administrator%20Evaluation%20Policy%204-20-18.pdf
If a local grievance is upheld, more information about vacating a score can be found on the TEAM website at http://team-tn.org/wp-content/uploads/2016/07/Portfolio-Vacate-Guidelines-2017-18.pdf
For more information, please contact Rene’ Diamond at Rene.Diamond@tn.gov
Based on teacher feedback, we have made improvements to the portfolio platform. For example, in the upcoming school year, uploading of context forms will no longer be required, and portfolio collections will be identified by selecting from a list of pre-populated options available for each model. We have also improved guardrails, so when standards are selected at Point A, those same standards are retained at Point B. You can read more about the improvements at http://team-tn.org/wp-content/uploads/2016/07/TEAM-Portfolio-Implementation-Action-Brief.pdf
We will also continue to provide training to TEAM and district leads to strengthen teachers’ understanding of the portfolio process, and we will continuously improve that training to address areas where there may be particular confusion.
For the sake of consistency across the different domains and options for ELA, the codes used for tagging the ELA standards for Pre-Kindergarten and Kindergarten have a common format that indicates the domain, option, and sequence of the standard as it appears in the scoring guide. This format breaks down as follows:
ELA student work samples found on the TEAM website utilize blank, white paper to demonstrate the application of integrated foundational, reading, and writing standards. While students must produce a written artifact that may include a combination of drawing, emergent writing, and teacher dictation, student writing is not required to be submitted on blank white paper. For more about student work samples, see p. 17 of the Pre-K or the Kindergarten Student Growth Portfolio Model Scoring Resource Guides.
Purposeful sampling is the process by which teachers select the student work artifacts to include in the portfolio formally submitted as part of the evaluation process. There may be circumstances in which one student is represented in more than one collection, especially in classes that are small, or in circumstances in which the teacher feels that the student’s work in more than one assignment strongly represents student growth in more than one area. See p. 6 of the Pre-K or the Kindergarten Student Growth Portfolio Model Scoring Resource Guides.
As in previous years, peer reviewers do not see teacher self-score “tags,” but a teacher can use the contextual/narrative form to share important information with the peer reviewer. After the review process is complete and scores have been released, teachers will be able to see the peer reviewer's tags in TeachForward, which can lead to reflection for the teacher when comparing them with self-scores. See p. 9 of the Pre-K or the Kindergarten Student Growth Portfolio Model Scoring Resource Guides.
For more information, see the Portfolio Resources page on the TEAM website.
Because the portfolio model documents student growth through student work artifacts, it is crucial that teachers submit the evidence that best captures student learning in whichever format is most appropriate for a particular standard.
When collecting student work artifacts for math collections, teachers should consider what the standard is asking the student to say, do, or think, and whether video is the best format with which to capture this.
When collecting student writing for the ELA collection, teachers are encouraged to begin with a student work sample that includes dictation (i.e., students say or read their drawing or writing aloud while the teacher writes down what is said). If a teacher feels that video or audio would enhance the demonstration of the reading comprehension component within the integrated writing artifact, a video or audio clip may also be submitted. For more, see p. 4 of the Pre-K and the Kindergarten Student Growth Portfolio Model Scoring Resource Guides and the virtual training called Pre-K/K Student Growth Portfolio Scoring Rubric Guidance.
To provide more details on the scoring, an individual sample report is now generated that enables teachers to view the actual scores (or Results) they entered and to view tags they tagged as Evidence. This prevents teachers from having to open Rate each time to see their tags and entered scores. To view the report, click on the three bar, vertical icon. This will open up the report and initially display the scores entered by the teacher (under the Results toggle). To view tags, click on the Evidence toggle. This will display the first product uploaded (the Context form) and a right panel. In the right panel, click Go to First Tag to go to the first tag. To go to the next tag, click Next Tag in the right panel or to go back click Prev Tag.
When uploading student work samples, teachers may add additional work products (files) by clicking Add More Work. This will put a new field called Additional Work Product and a number. To view the new field, you may have to scroll by placing your mouse over the actual fields and then scroll. If your mouse is not over the fields themselves, you will not be able to scroll.
When clicking Enter Scores, if you need to score a standard that is further down the screen, you will need to place your mouse over the standards (Select circles) and then scroll. If your mouse is not over the standards themselves, you will not be able to scroll.
Once teachers start uploading work for a given assessment (Point A or Point B), the status of the assessment changes from Not Started to In Progress.
After uploading work for a given differentiated sample (Emerging, Proficient, Advanced), teachers move to the next step to Rate their work. In Rate, teachers tag evidence that generates a recommended score based on the preponderance of evidence. Teachers then select Enter Scores to enter the actual scores for that sample and standard and click Save. Once teachers have finished tagging and scoring, they must click Finish at the top (next to the X). Upon clicking Finish, the Report column will show a three bar, vertical icon indicating that a report has been generating for that sample.
After all three samples are finished (i.e. tagged and scored and the teacher selected Finish) for a given assessment (Point A or Point B), the blue Submit half circle button becomes available on the What I Need to Submit. Once the teacher is ready to submit the three samples, the teacher must select Submit. This will change the status of the assessment from In Progress to Complete.
The blue Submit half circle will change to an orange Recall half circle. This enables teachers to recall an assessment if they need to make a change to a sample. This is particularly important if there is mobility and a student who took the Point A is not there for the Point B, so the teacher needs to swap out the sample with a different student sample. The Recall will be available until the 4/15/2018 deadline.
For Pre-K, Kindergarten, and Grade 1 ELA, teachers do not enter a specific GLE or CLE (the row of the rubric). Instead, teachers enter the option they have selected for the assessment they are submitting (Option A, B, or C for Informational/Explanatory collections or Option 1, 2, or 3 for Literature/Narrative collections).
Portfolios have been implemented in Tennessee since the 2011-12 school year when the fine arts portfolio was first piloted. In the past three years, the use of student growth portfolios has notably increased (see the chart below). In the 2017-18 school year, the following portfolio options will be available: fine arts, physical education, pre-kindergarten, kindergarten, and first grade.
Research conducted on the Tennessee portfolio model found that portfolio scores are well aligned to observation scores. In fact, teachers implementing portfolios had slightly higher observation scores than similar teachers not implementing portfolios, particularly in the areas of Activities and Materials, Thinking, and Problem Solving. Roughly 50 percent of teachers who implemented portfolios received higher growth scores than they would have without the portfolio and about 20 percent received the same score. Additionally, teachers on the whole reported that portfolios were more appropriate and understandable as part of the evaluation process than any other measure, aside from classroom observations. For more details, read the department’s report, The Rise of Student Growth Portfolio Models in Tennessee. Additionally, based on the 2016 Tennessee Educator Survey, 83 percent of educators who expected the portfolio to be a part of their evaluation understood what they were being evaluated on. Of that same group of teachers, 75 percent agreed that the portfolio model is appropriate for use in their overall evaluation, and 71 percent reported taking at least some professional development action as a result of the feedback from their portfolio.
Approved voluntary pre-K programs (VPKs) have been awarded funds for the 2017-18 school year because the district has met quality benchmark standards in its VPK application. For more information regarding the application process or high-quality programs, reach out to Candace.Cook@tn.gov.
The growth portfolio model allows teachers to demonstrate students’ progress towards mastery of student learning standards based on four domains of learning. Teachers collect student work artifacts at two points in time (Point A and Point B) and select artifacts from differentiated groups of students to submit for review via the TeachForward system by April 15, 2018. Then, certified peer reviewers score student work based on a comprehensive scoring guide. Implementation of a student growth portfolio model produces an individual growth score, which is used for the 35 percent student growth component of the teacher’s level of overall effectiveness (LOE); as a result, teachers implementing student growth portfolio models have an evaluation composite similar to that of “tested” teachers.
Various types of evidence can be collected to indicate student performance on a standard(s). This evidence, also referred to as “student work artifacts,” can include but is not limited to video segments that demonstrate student action or talk, audio recordings of student conversation or think aloud, photographs of student work, recorded think alouds, videos of students performing a task, conceptual maps, writing samples, and art projects.
The time necessary for portfolio implementation outside of the normal expectations for classroom instruction is minimal. Teachers should gather student work artifacts for the portfolio during the course of regularly planned classroom instruction and assignments—this should not be an extra or different assignment. Teachers submit four portfolio collections (with the exception of CTE - Work Based Learning, which only has one). Each collection includes a Point A (or Early Assessment) and Point B (or Late Assessment) student work artifact from each of the three differentiated groups of student performance: emerging, proficient, and advanced. The additional time required for portfolio implementation is primarily related to the purposeful sampling process. Purposeful sampling refers to the time when teachers select student artifacts that illustrate growth over time for each differentiated group of student performance (emerging, proficient, advanced) for each portfolio collection. For content-specific requirements, please download the relevant Portfolio Resource Guide in the Resources section of this web site.
Strong, standards-aligned planning and instruction are the best preparation for portfolio implementation. Additionally, there are suggested ways that administrators can prepare teachers in the District Support section of this web site. Other suggested ideas include:
In previous years, teachers were asked to upload samples of student work for a Point A and Point B assessment for each of the evidence collections. This part is still the same. Teachers and Peer Reviewers used to download and score student work on paper and then use those scores to calculate the growth for each student to determine the level of growth for each evidence collection and ultimately for the Teacher Effectiveness rating. To simplify this process and reduce teacher burden on this work, teachers and Peer Reviewers will only score the student work for each assessment using the standards-based learning rubrics in the guidebook. Once teachers have entered their scores for each student and assessment, the TeachForward system will automatically calculate the growth between the Point A and Point B assessments per student and then average the growth scores to determine the level of growth as defined by the Student Growth cut point ranges.
Yes. Classroom observations constitute the 50 percent qualitative component for a portfolio teacher’s LOE, while the portfolio serves as the 35 percent student growth component. The portfolio process is strongly aligned with the instruction, planning, and environment domains of the TEAM rubric that can lead to rich conversations in pre- and post-conferences.
Student achievement measures are the basis for setting achievement targets that all students are expected to meet on summative assessments of grade-level or content standards. Because portfolio models provide a growth measure based on a subset of students for a subset of standards, they cannot be used as an achievement measure. However, it should be noted that the 3/4/5 override, outlined in state board policy 5.201, allows student growth data to be used in place of a teacher’s achievement measure if it is a level 3, 4, or 5 and is greater than the achievement score.
The portfolio score can be used to activate the 4/5 Trump Rule in districts that have opted into that flexibility. The 4/5 Trump Rule allows teachers who score a level 4 or 5 on individual growth to use their individual growth score for the entirety of their overall LOE.
Portfolios are carefully scored based on the scoring guide by certified peer reviewers using a consensus protocol. In the event that a peer reviewer does not have consensus with a teacher’s self-score within one performance level for a given evidence collection, an expert reviewer will be utilized. The expert reviewer's scores will be final for determining the growth score for the discrepant collection.
Teacher self-scoring is one of many reflective components of the portfolio. Teachers score Point A and Point B student work artifacts using the scoring guide and task-based expectations. It is this scoring process which will inform the purposeful sampling, which is the selection of students from each of the three differentiated groupings (emerging, proficient, and advanced). Other reflective components of the portfolio include evidence tagging, completion of the context form, and completion of the narrative.
No. Portfolios are specifically intended to be a teacher-level measure of student growth rather than a school or district-level measure. TVAAS, in contrast, can be calculated separately at the teacher, school, and district levels and thus provides measures that are incorporated in school and district accountability that go beyond a roll-up of teacher-level data.
As part of regular instructional planning, a teacher should select two points during the school year (Point A and Point B) that would best reflect student growth according to the state standards for the grade level and subjects being assessed. Teachers should then collect the student work artifacts from these two points in time that are the most appropriate for documenting learning. We encourage teachers to be thoughtful in determining what evidence provides the clearest picture of their impact on student learning for differentiated groups of student performance (emerging, proficient, and advanced).
From each differentiated group of student work artifacts, teachers choose the student work artifacts to include in their portfolio collections through a process called purposeful sampling. Teachers examine the growth of each sample in the differentiated group using the Point A and Point B student work artifacts and select the student whose work most accurately represents the growth of students in that differentiated group. This process is repeated for each differentiated group to complete the four required portfolio collections, which are then submitted into the TeachForward system.
Teachers who team teach or co-teach cannot submit the same student work artifacts for their portfolio collections. Student work artifacts that most closely represent the individual teacher’s impact should be chosen for each collection and can contain similar evidence in terms of formatting and types of student work artifacts.
Examples of task-specific expectations for PreK/Kinder will be released in the Portfolio Resource Guide for ELA. When available, portfolio resources for all subjects and grade levels will be posted on the Team TN web site.
Portfolios were designed to be implemented without an additional investment in technology. For portfolios that include video collections to demonstrate student growth, teachers have used a variety of district-owned devices (e.g., tablets or video cameras) and low- or no-cost downloadable software. Some districts have found tripods to be helpful. Teachers and Peer Reviewers may use their laptops with a web browser (Firefox, Chrome, or Safari) to access the TeachForward system to upload student work products and score the assessments. The department will provide the TeachForward system for portfolio submissions at no cost to districts. A document on the Technical Requirements is in the Resources section of this web site.
Teachers should complete all four evidence collections via the TeachForward system by April 15, 2018.
Teachers will be able to securely utilize the TeachForward system beginning in October to upload student work artifacts for the differentiated sample collected throughout the year for each assessment and evidence collection. Then, when teachers have finished uploading work for a given student and assessment, the TeachForward system will allow teachers to self-score the work and submit each assessment as they go. Peer Reviewers will not be able to access any evidence collections until after the April 15 deadline. From the beginning of the school year until the TeachForward launch date in October 2017, teachers can also store student work artifacts using any district-approved storage resource (e.g., free, cloud-based storage service, external hard drive, classroom files or folders, etc.). Teachers who are using Google Drive may also access and upload their samples directly from Google Drive into TeachForward.
There are no plans to develop and implement a student growth portfolio model for special educators for the 2017-18 school year. The department will facilitate the development of a special education student growth portfolio model for inclusive special educators during the 2017-18 school year.
All student work submitted within a collection must represent one grade level (either pre-K or kindergarten). However, a teacher may submit all pre-K collections, all kindergarten collections, or a combination of pre-K/K collections. A minimum of three students must be rostered within a grade level in order to submit a complete collection. When registering and enrolling for the TeachForward system, transitional teachers will be asked to select which grade level (pre-K or Kinder) they will focus on for each evidence collection.
Per the Pre-K Quality Act, districts that receive VPK program approval must utilize the pre-K and kindergarten student growth portfolio models approved by the State Board of Education in the evaluation of pre-K and kindergarten teachers. Teachers who do not submit portfolios put districts out of compliance with state law, and districts may dismiss or suspend the teacher for neglect of duty as per T.C.A. § 49-5-511. When available, more information regarding the process for exemptions will be included in the Administrative Guidelines for Portfolios in the Resource section of this web site.
There will be monitoring reports that identify the status of each teacher’s platform activity throughout the year.
You may use Windows Movie Maker or iMovie to create your video, but you must export the video from Windows Movie Maker in one of the supported formats to upload the exported file.
There is a 5 GB limit per video or audio. There is a 200 MB limit for documents and presentations. There is a 5 MB limit on images.
While tagging evidence, the GLE/CLEs will be provided in a tag panel that will enable you to select the appropriate GLE/CLE. In the Context Form, teachers are given a box for them to write in the domain and GLE/CLE that is being assessed in that sample. For the ELA collections in the early grades, the Literature or Informational integrated option standards will be listed. For the Math collections in the early grades, the standards will be listed within a certain domain.
Videos, audios, documents, presentations, and images can all be tagged. PowerPoint presentations can be tagged in similar ways as documents and images. All uploaded files are transformed for the web, so that you do not need to open the presentation in a new window.
You will be asked to log into Google Drive and give permission to have your selected file uploaded when you click on the Google Drive icon. So it is secured to your account. The district’s domain should not limit access.
No there is no limit on how many work samples you upload for a given student. You may add work products beyond the required Context Form and one Student Work Sample.
Users can select the Forgot Password link on the Sign In page, which will send them a Reset Password email for them to create a new password that they can remember
All technical questions can be sent to firstname.lastname@example.org
No. You can always upload directly from your laptop. Google Drive is web-based storage that allows you to store your files in the cloud without having to have a local version of Google Drive on your machine. However, if you do download Google Drive to your machine, the advantage is that you can start uploading large files and continue work on other things while it continues to upload. This is entirely your choice as to whether you wish to download Google Drive.
Emails will be sent to teachers on October 9. We recommend that teachers at least register (i.e. set their password) upon receiving their activation email. They may wait until later to log into the system to complete their profile and select which portfolio they would like to submit for the 2017-18 school year.
When completing the profile for the teacher account, tech leads should select Teacher and Other as their roles.
Each district will provide one peer reviewer per ten portfolio users, per content area. In previous years it has taken approximately 1.5 hours to score an entire portfolio (four evidence collections) and slightly longer than that for the review of PE portfolios. We expect the time to shorten since peer reviewers are just scoring student work this year. If each peer reviewer scores a minimum of 10 portfolios, then it can be expected that each peer reviewer will spend approximately 18 hours in peer review. Portfolio users have the opportunity to show interest in being a peer reviewer by clicking the “Apply to Be a Peer Reviewer” button on the TN Student Growth website, however, this is only showing interest. A formal application process will be shared by the state through the TEAM website and through communication with district portfolio leads.
Each student must be uploaded independently so that the growth can be calculated from Point A to Point B. However, all work for an individual student for each assessment (i.e. Point A or Point B) can be submitted as a single PDF.
Point A and Point B will continue to be uploaded separately for each student sample. Point A and Point B should not be uploaded as a single file.
The deadline for all evidence collections is April 15, 2018.
Contact email@example.com for assistance in making the change.
Teachers should change the context form and reupload it. Teachers have until the April 15th deadline to recall and resubmit any work that is incorrect. We highly recommend that you preview your work after uploading it to ensure the proper information is provided.
Teachers can recall and start over with any evidence collection as long as it is before the 4/15/2018 deadline.
Yes, there is a big blue Submit button that is only selectable once all three samples are done. So, you cannot click on it until you are ready to submit the entire assessment. You may recall the samples up until the April 15th deadline if you need to make a change.
Most of the work for a portfolio is actually done offline as part of discussions in grade level or subject matter teams or PLCs and in collecting and scoring the work for your students to determine your purposeful sample. The time to actually complete the upload and scoring of all samples in TeachForward takes on average, 6 minutes per Point A or Point B assessment depending on the number and length of work products submitted by the teacher.
You may upload the same Context Form for all of your samples if in fact there is no specific information you wish to share about the sample itself. However, the Narrative portion of the context form provides an opportunity for teachers to share specific information about the student and therefore, may be individualized for each student sample. The approach to how to use the context/narrative form is a district or school based decision.
Discrepancy between a teacher’s self score and the peer reviewer score is defined as more than one level on the scoring guide.
Teachers will continue to self-score as they have always done. Once peer review begins, Peer Reviewers will also score the student work as in the past. If there is a discrepancy between the teacher's self-score and Peer Reviewer, then the evidence collection is sent to an Expert Reviewer for a third scoring. Discrepancy is defined as more than one level difference between the teacher’s self score and the peer reviewer’s score.
As in previous years, the student growth scores are based on the average growth of the differentiated samples.
For the early grades (Pre-K, Kinder, and Grade 1), teachers do score all three standards in the Option selected per sample.
The webinar demonstration of the TeachForward shared that tagging was optional, because the demonstration was about the system, not the process of best practices of the portfolio. The online platform will allow teachers to submit without tagging, but the expectation is to tag because it annotates the portion of the student work that is most effective in demonstrating a performance level. Tagging is a mandatory part of peer review and will inform the feedback that teachers receive. In addition, teachers can reflect upon their own tags and the tags of the peer reviewers after the process is complete.
Reviewers will not see teacher tags while scoring to reduce bias and have them focus on their assessment of the student samples; however, when teachers receive the scores back, they will see the peer reviewer tags to facilitate their own reflection and analysis
Often, Point A student work artifacts demonstrate limited variance in performance levels across the cohort of students. For example, all student work artifacts might score at performance level 2 (emerging) for the writing standard. In these instances, the task-specific expectations should be utilized for categorizing student work artifacts as emerging, proficient, and advanced within a performance level. More information about task specific expectations can be found in the Pre-K, K, and First Grade Scoring Resource Guides.
Once TN Student Growth Scores are available, there will be an announcement made in TEAM Update. Thank you for your patience as peer review comes to a close.