Equipped for the Future Logo

Equipped for the Future

Speak, Listen, Read, Write

Performance Continua

Note: This document has been excerpted or adapted from its original format for
functional and consistency purposes within the warehouse. To obtain the full
document and supplementary materials, please visit the EFF website at:
http://eff.cls.utk.edu/


Equipped for the Future

 

Speak, Listen, Read, Write Performance Continua

 

Table of Contents

Speak So Others Can Understand Performance Continuum..……..…..……1

Listen Actively Performance Continuum……………………………………….…………7

 

Mapping the Listen Actively and Speak So Others Can Understand

Performance Levels to NRS ESL Educational Functioning Levels…………………..…….14

 

How to read the EFF Performance Continua for Listen Actively and Speak

 So Others Can Understand…………………………………………………………………….15

 

What are the Guides to Using the EFF Performance Continua?................ 20

 

Introduction to the Performance Continua for Listen Actively and

Speak So Others Can Understand…………..…………………………………………….21

 

References for Listen Actively and Speak So Others Can Understand……………………………………………………..…………………..…………….….24

 

Read With Understanding Performance Continuum….…………..………….…26

 

Performance Levels for the EFF Content Standard Read With Understanding

mapped to NRS Educational Functioning Levels……………………………………………..…35

 

How to read the EFF Read With Understanding Performance Continuum………………………………………………………………………………….………...36

 

What are the Guides to Using the EFF Performance Continua?.....................38

 

Notes on the Research Base for the Read With Understanding

Continuum and Performance Levels………………………………………………………………….39

 

References for Read With Understanding…………………………………………….47

Convey Ideas in Writing Performance Continuum………………………..…….50


Mapping of EFF Levels to NRS Educational Functioning Levels……………………..….…58

How to read the EFF Convey Ideas in Writing Performance Continuum……………………………………………………………………………………………59

 

What are the Guides to Using the EFF Performance Continua?.............. 61

 

Notes on the Research Base for the Convey Ideas in Writing

Performance Continuum and Performance Levels…………………………………………..62

 

References for Convey Ideas in Writing………………………………………………69

 

 

Equipped for the Future Logo

Equipped for the Future
Performance Continuum
for Speak so Others
can Understand

Common Activities


In order to fulfill responsibilities

as parents/family members,
citizens/community members,

and workers, adults must be able to:

·   Gather, Analyze, and Use Information

·   Manage Resources

·   Work Within the Big Picture

·   Work Together

·   Provide Leadership

·   Guide and Support Others

·   Seek Guidance and Support From Others

·   Develop and Express Sense of Self

·   Respect Others and Value Diversity

·   Exercise Rights and Responsibilities

·   Create and Pursue Vision and Goals

·   Use Technology and Other Tools to Accomplish Goals

·   Keep Pace With Change

Speak so Others can Understand Chart

 

Equipped for the Future

Speak So Others Can Understand Performance Continuum

PERFORMANCE LEVEL 1

 

Speak So Others Can Understand

 

How adults at Level 1 Speak So Others Can Understand:

 

Level 1 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 1 can:

·         Recall and use a limited set of learned words and phrases related to basic personal information, basic objects, and a limited number of activities and immediate needs in familiar, predictable, and straightforward communication tasks

·         Use simple strategies (such as stock phrases and questions; responding to simple, direct questions; and, combining or re-combining learned or heard words and phrases) to select and relay information

·         Apply simple strategies (such as gestures, eye contact, and simple, repeated requests for feedback from listener) to monitor effectiveness of the communication and to meet the speaking purpose

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 1 can sometimes speak learned and rehearsed words and phrases fluently and accurately but other times speak with hesitation and inaccuracy in a familiar setting with a familiar audience (usually face-to-face with one person). A high level of support is provided (in the form of written, visual, or verbal prompts). Pronunciation may be inaccurate or nonstandard and speech may, at times, be difficult to understand even by a skilled, supportive listener.

 

Level 1 Examples of Proficient Performance

 

Adults performing at Level 1 can Speak So Others Can Understand to accomplish a variety of goals, such as:

 

Equipped for the Future

Speak So Others Can Understand Performance Continuum

PERFORMANCE LEVEL 2

 

Speak So Others Can Understand

 

How adults at Level 2 Speak So Others Can Understand:

 

Level 2 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 2 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 2 can speak mostly short utterances (sometimes inaccurate, incomplete sentences and sometimes fluent and accurate sentences that may be expansions of learned materials and stock phrases) in familiar settings with a familiar audience (usually face-to-face with one person) when provided with a high level of support (in the form of written, visual, or verbal prompts).  Pronunciation may be inaccurate or non-standard and speech may be difficult to understand even by a skilled, supportive listener.

 

Level 2 Examples of Proficient Performance

 

Adults performing at Level 2 can Speak So Others Can Understand to accomplish a variety of goals, such as:

 

 

 

Equipped for the Future

Speak So Others Can Understand Performance Continuum

PERFORMANCE LEVEL 3

 

Speak So Others Can Understand

 

How adults at Level 3 Speak So Others Can Understand:

 

Level 3 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 3 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 3 can speak fluently and accurately in familiar settings with one or more familiar listeners (either face-to-face or in a brief telephone conversation) when a moderately high level of support is provided (in the form of written, visual, or verbal prompts).  There may be some errors in pronunciation, but with repetition, speech can usually be understood by a skilled, supportive listener.

 

Level 3 Examples of Proficient Performance

 

Adults performing at Level 3 can Speak So Others Can Understand to accomplish a variety of goals, such as:

 

 

 

 

 

 

 

Equipped for the Future

Speak So Others Can Understand Performance Continuum

PERFORMANCE LEVEL 4

 

Speak So Others Can Understand

 

How adults at Level 4 Speak So Others Can Understand:

 

Level 4 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 4 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 4 can speak fluently and accurately in settings and with audiences that may not be entirely familiar when provided with some support (in the form of guided practice, listening to a model, or advance organizers).  There may be occasional pronunciation, word choice, or structural errors that hinder understanding, but speech is generally understandable (with repetition) by a skilled, supportive listener. 

 

Level 4 Examples of Proficient Performance

 

Adults performing at Level 4 can Speak So Others Can Understand to accomplish a variety of goals, such as:

 

Equipped for the Future

Speak So Others Can Understand Performance Continuum

PERFORMANCE LEVEL 5

 

Speak So Others Can Understand

 

How adults at Level 5 Speak So Others Can Understand:

 

Level 5 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 5 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 5 can speak fluently and accurately in most settings with familiar and unfamiliar audiences when provided with minimal support (in the form of opportunities for role plays/ practice, learner-generated practice scripts, etc.).  Pronunciation does not impede understanding and speech can generally be understood by an unsupportive, unskilled listener. 

 

Level 5 Examples of Proficient Performance

 

Adults performing at Level 5 can Speak So Others Can Understand to accomplish a variety of goals, such as:

 

 

Equipped for the future logo


Equipped for the Future
Performance Continuum
for Listen Actively

Common Activities


In order to fulfill responsibilities

as parents/family members,
citizens/community members,

and workers, adults must be able to:

·   Gather, Analyze, and Use Information

·   Manage Resources

·   Work Within the Big Picture

·   Work Together

·   Provide Leadership

·   Guide and Support Others

·   Seek Guidance and Support From Others

·   Develop and Express Sense of Self

·   Respect Others and Value Diversity

·   Exercise Rights and Responsibilities

·   Create and Pursue Vision and Goals

·   Use Technology and Other Tools to Accomplish Goals

·   Keep Pace With Change

 

Listen Actively chart


Equipped for the Future

Listen Actively Performance Continuum

PERFORMANCE LEVEL 1

 

Listen Actively

 

How adults at Level 1 Listen Actively:

·         Attend to oral information

·         Clarify purpose for listening and use listening strategies appropriate to that purpose

·         Monitor comprehension, adjusting strategies to overcome barriers to comprehension

·         Integrate information from listening with prior knowledge to address the listening purpose

 

Level 1 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 1 can:

·         Understand and respond to learned words and phrases in simple questions, statements, and high frequency commands as part of short conversations, explanations, instructions, and narratives where the linguistic complexity is considerably simplified.

·         Use a few simple formulas to convey understanding, and ask for repetition or clarification and one or two simple strategies for gathering missing information and/or repairing problems in communication.

·         Use non-verbal and visual clues, as well as socio-cultural, linguistic, and other background knowledge to understand the basic intent of the speaker and to meet the purpose of the communication.

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 1 can comprehend the gist of simple conversations and explanations on familiar topics in face-to-face situations when tasks are highly structured and include supports, such as visual cues, pre-learning of new vocabulary and phrases, or collaborative listening. Text is considerably adjusted for listeners who usually require a slower rate of speech with frequent opportunities for repetition or rephrasing.  For English language learners, level of ease and confidence in using English may be low, even in familiar contexts.

 

Level 1 Examples of Proficient Performance

 

Adults performing at Level 1 can Listen Actively to accomplish a variety of goals, such as:

·         Listening and responding appropriately to a familiar speaker describing likes and dislikes or opinions related to familiar topics (such a co-worker describing a day off or a child describing a new teacher).

·         Listening and responding to a short explanation of a task (such as a health worker explaining how to give a child medicine or a postal worker explaining how to fill out a form).

·         Listening to a class discussion of a short article about a current event (with visuals and other written supports), following the main points and making a contribution.

·         Following instructions with a few basic steps and sequence markers (such as instructions for using a home appliance or simple piece of work-related equipment) and asking appropriate questions to signal understanding or get clarification.

·         Understanding the main points covered in a brief narrative (such as a weather forecast).

 

Equipped for the Future

Listen Actively Performance Continuum

PERFORMANCE LEVEL 2

 

Listen Actively

 

How adults at Level 2 Listen Actively:

·         Attend to oral information

·         Clarify purpose for listening and use listening strategies appropriate to that purpose

·         Monitor comprehension, adjusting strategies to overcome barriers to comprehension

·         Integrate information from listening with prior knowledge to address the listening purpose

 

Level 2 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 2 can:

·         Understand and respond to explanations, conversations, instructions, and narratives made up of sentence length utterances and some connected discourse on familiar topics related to personal background and needs, social conventions, and everyday tasks.

·         Use several strategies, including formulas for asking for repetition and clarification, and strategies for indicating understanding, for giving feedback, for gathering missing information and/or for repairing problems in comprehension, such as by rephrasing, substituting a different word, or drawing a picture.

·         Apply linguistic, socio-cultural, and other background knowledge and strategies (such as expressing an opinion or collecting relevant information) to understand the intent of the speaker and what is required to respond appropriately and to meet the listening purpose.

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 2 can listen for structured and well-defined purposes related to maintaining personal conversations, acquiring information, or completing basic transactions, either face-to-face or in a brief telephone conversation when language is somewhat simplified and frequent opportunities for repetition, rewording and clarification are provided. For English language learners, level of ease using English may be growing but varies depending on the level of familiarity with the audience and purpose and the stressfulness of the context.

 

Level 2 Examples of Proficient Performance

 

Adults performing at Level 2 can Listen Actively to accomplish a variety of goals, such as:

·         Listening for and identifying relevant information to pass along in a face-to-face conversation (such as a safety problem and to whom it should be reported).

·         Participating in a conversation where a speaker gives background information about his/her experiences and the listener appropriately shares one or two experiences about the same topic.

·         Listening to a recorded telephone message adjusted for English language learners (such as weather-related school closings or simple driving directions) and pass on details to another person.

·         Follow a series of multi-step instructions (such as a demonstration of a more complex piece of equipment or appliance) and use several strategies to confirm and clarify understanding.

·         Listening for and following the main idea in different kinds of small group presentations (such as about a school field trip or community clean-up day).

Equipped for the Future

Listen Actively Performance Continuum

PERFORMANCE LEVEL 3

 

Listen Actively

 

How adults at Level 3 Listen Actively:

·         Attend to oral information

·         Clarify purpose for listening and use listening strategies appropriate to that purpose

·         Monitor comprehension, adjusting strategies to overcome barriers to comprehension

·         Integrate information from listening with prior knowledge to address the listening purpose

 

Level 3 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 3 can:

·         Understand and respond to conversations, explanations, instructions and short narratives of a somewhat complex nature but related to familiar tasks and situations. Tasks may include short routine telephone conversations and some simple information conveyed through electronic media, such as television or radio.

·         Know when to use a range of strategies to repair gaps in understanding, comprehend information, and give feedback even when opportunities to seek clarification or repetition are somewhat limited and the context is somewhat unfamiliar.

·         Apply linguistic, socio-cultural, and other background knowledge and strategies (such as by taking notes and summarizing main points to share with others, evaluating what was heard, and sharing responses of a more complex nature) to understand the main intent and details communicated by the speaker, to respond appropriately, and to meet the listening purpose.

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 3 can listen and respond to most basic content related to personal background information, everyday transactions, and simple routine tasks but understanding the full range of details on less familiar topics may still be uneven. Only limited adjustments in the text may be made.  English language learners display growing comfort using English in simple interactions and social situations but may be less at ease in more complex and/or stressful contexts.

 

Level 3 Examples of Proficient Performance

 

Adults performing at Level 3 can Listen Actively to accomplish a variety of goals, such as:

·         Listening and making relevant contributions in a small-group planning meeting (such as planning for a parent’s meeting or class trip).

·         Listening to a simple, authentic television news report, summarizing the issues addressed and expressing an opinion on the topic.

·         Listening to a presentation to identify key information relevant to one’s own situation (such as information related to enrolling in a vocational program).

·         Listening and providing appropriate feedback and response as a familiar, non-threatening speaker describes a personal problem (such as a classmate describing a problem getting to class or finding the funds to buy a new car).

·         Take part in a simulated job interview, responding appropriately to open-ended questions related to one’s own experience and skills.

Equipped for the Future

Listen Actively Performance Continuum

PERFORMANCE LEVEL 4

 

Listen Actively

 

How adults at Level 4 Listen Actively:

·         Attend to oral information

·         Clarify purpose for listening and use listening strategies appropriate to that purpose

·         Monitor comprehension, adjusting strategies to overcome barriers to comprehension

·         Integrate information from listening with prior knowledge to address the listening purpose

 

Level 4 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 4 can:

·         Understand and respond appropriately to extended explanations and narratives, detailed instructions, and complex conversations requiring adapting one’s response to varied speakers and contexts when language is not adjusted for English language learners.

·         Effectively use a wide range of strategies to repair gaps in understanding and give feedback, tailoring the response to the purpose of the communication, the audience, the level of formality of the situation and other socio-cultural factors.

·         Apply linguistic, socio-cultural, and other background knowledge and strategies (such as comparing, integrating, and categorizing information for others) to understand fully the literal and implied intent of the speaker, to respond appropriately, and to meet the listening purpose.

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 4 can comprehend relatively unstructured conversations and presentations of moderate length and in somewhat complex and unfamiliar situations when language is not adjusted for non-native speakers; however they may be unable to fully follow all main ideas, details, cultural nuances and implied meanings. May have some difficulty following conversations between native speakers but displays growing ease in communicating with native speakers.

 

Level 4 Examples of Proficient Performance

 

Adults performing at Level 4 can Listen Actively to accomplish a variety of goals, such as:

·         Listening to a presentation of moderate length and complexity, asking appropriate questions related to unfamiliar content or vocabulary and taking notes of key points to share with others. 

·         Listening and responding appropriately in a simulated conversation where a speaker is critical or displeased with the listener (such as a traffic cop, landlord or neighbor).

·         Following and carrying out detailed instructions (such as multiple tasks required to prepare for an upcoming class, work-related or community event).

·         Listening and contributing in a small group meeting where a difficult decision must be made.

·        Listening and responding successfully to job interview questions that require adapting responses to the speaker and context, such as questions related to why one left one’s previous job or how one might contribute to the organization

.

 

 

Equipped for the Future

Listen Actively Performance Continuum

PERFORMANCE LEVEL 5

 

Listen Actively

 

How adults at Level 5 Listen Actively:

·         Attend to oral information

·         Clarify purpose for listening and use listening strategies appropriate to that purpose

·         Monitor comprehension, adjusting strategies to overcome barriers to comprehension

·         Integrate information from listening with prior knowledge to address the listening purpose

 

Level 5 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 5 can:

·         Understand main ideas and most details in conversations, short lectures, news reports, extended explanations and other connected discourse on a range of topics, including topics beyond everyday contexts and immediate experiences in a variety of work, personal, and basic academic contexts.

·         Effectively use advanced strategies to repair gaps in understanding, to ask questions to deepen understanding and to give feedback appropriate to the situation, the audience and the purpose of the communication. Growing ability to use strategies appropriate to the socio-cultural context.

·         Apply linguistic, socio-cultural, and other background knowledge and strategies (such as integrating information from more than one source; evaluating the relevance, validity, and adequacy of information; or adapting responses to the age, gender, status, and emotional state of the speaker) to understand fully the literal and implied intent of the speaker, to respond appropriately, and to meet the listening purpose.

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 5 can function independently in most social and work situations and comprehend relatively complex and unstructured conversations or presentations requiring the integration and summary of several data sources or media with limited need for guidance and repetition and with few errors. Adults at this level may have some difficulty following the coherence or thematic organization of longer connected discourse or may have difficulty understanding when time frames and tense markers are complex. They can understand most English language communication at normal speed and often can function successfully (with some support) in adult education classrooms (such as GED classes) with native English speakers, although they may still lack full comfort and ease conversing with native speakers. 

 

Level 5 Examples of Proficient Performance

 

Adults performing at Level 5 can Listen Actively to accomplish a variety of goals, such as:

·         With classmates, listening to the director of a food pantry describe his needs, watching a video on homelessness and discussing priorities for a community service activity.

·         Listening for, identifying and evaluating the viewpoints and truthfulness of various types of marketing in recorded radio commercials.

·         Listening to a simulated community college/GED lecture on a literary topic, taking notes to prepare a brief summary of what was heard, and discussing one’s own ability to listen to college lectures.

·         Listening and providing appropriate feedback and advice in a simulated discussion with a teenager who wants to drop out of school.

·         Listening to several short poems and identifying the underlying themes and implied meanings.

 

 

 

EFF Listen Actively Performance Levels

Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

Mapping the Listen Actively and Speak So Others Can Understand Performance Levels to NRS ESL Educational Functioning Levels

There is very little specific information on the nature of the listening knowledge, skills, and abilities associated with each of the six NRS ESL Educational Functioning Levels. Therefore, in mapping the EFF Listen Actively and Speak So Others Can Understand Performance Levels to NRS ESL Levels, we have also considered the correspondence of the EFF levels to more detailed descriptions of adult performance levels in listening and speaking contained in the ACTFL Proficiency Guidelines – Listening (1986), ACTFL Proficiency Guidelines – Speaking (1999), and the MELT Student Performance Levels (SPL’s).

 

 

EFF Performance Levels

NRS ESL [and ASE]

Educational Functioning Levels

ACTFL

SPL

Listen

Performance Level 1

Low Intermediate ESL

Novice High

4-5

Listen

Performance Level 2

High Intermediate ESL

Intermediate

Low

5-6

Listen

Performance Level 3

Low Advanced ESL

Intermediate

Mid

6-7

Listen

Performance Level 4

High Advanced ESL

[Low Adult Secondary]

Intermediate

High

7-8

Listen

Performance Level 5

[High Adult Secondary]

Advanced

8-9

 

 

EFF Speak So Others Can Understand Performance Levels


EFF Performance Levels

NRS ESL [and ASE]

Educational Functioning Levels

ACTFL

SPL

Speak

Performance Level 1

Low Intermediate ESL

Novice High

4-5

Speak

Performance Level 2

High Intermediate ESL

Intermediate

Low

5-6

Speak

Performance Level 3

Low Advanced ESL

Intermediate

Mid

6-7

Speak

Performance Level 4

High Advanced ESL

[Low Adult Secondary]

Intermediate

High

7-8

Speak

Performance Level 5

[High Adult Secondary]

Advanced

8-9

 

 

 

 


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

How to Read the EFF Performance Continua for Listen Actively and Speak So Others Can Understand

Each performance level of the EFF Performance Continuum for each EFF Standard is divided into four sections:

 

Section 1: The Definition of the Standard

 

Section 1 is the definition of the Standard. The definition of the standard in the components of performance is a useful tool for communicating to adult learners and their teachers the essential features of the construct for each standard. By “unmasking the construct” in this way (making it clear how the skills of listening and speaking are defined, see Gitomer & Bennett, 2002), adult learners are better able to articulate their own learning goals for improving proficiency and teachers are better able to focus learning and instructional activities that build toward the goal of increasing ability to Listen Actively and to Speak So Others Can Understand to accomplish everyday activities.

 

The definition of the EFF Standards Listen Actively and Speak So Others Can Understand are repeated in the same form at each level of the continuum. This repetition serves as a reminder that the integrated skill process defined by the components of performance for each of these standards is constant across all levels, from novice to expert levels of performance. Thus, the standard does not change from level to level. It remains a consistent focal point for learning and instruction. What changes from level to level is the growth and complexity of the underlying knowledge base and the resulting increases in fluency and independence in using the standard to accomplish an increasing range and variety of communication tasks. These changes are reflected in the descriptions of key knowledge, skills, and strategies at each level (Section 2); descriptions of fluent and independent performance in a range of settings at each level (Section 3); and the examples of real-world activities that can be accomplished at each level (Section 4).

Section 2: Key Knowledge, Skills, and Strategies

 

Section 2 of the performance continua for Listen Actively and Speak So Others Can Understand contains descriptions of some of the key knowledge, skills, and strategies that form the basis for proficient performance on the standards at each level. This listing of key knowledge, skills, and strategies is specific to each level and is the foundation for designing assessments to measure performance at that level. Beyond serving as guide for assessment development, the key knowledge, skills, and strategies described at each performance level can also be used to identify instructional objectives or can be included in the criteria used for placement of learners in instructional levels.

 

Linguistic and Textual Knowledge

 

The first bullet under Key Knowledge, Skills and Strategies addresses the level of linguistic knowledge (such as grammar rules and vocabulary at the sentence level), textual knowledge (such as rules for longer texts and connected discourse), and degree of familiarity with the topic


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

and context. In terms of linguistic and textual knowledge, at Level 1 students are expected to respond to or to produce only words and phrases that have been learned in advance. By Level 2, students are responding to or producing some sentence length utterances and some short connected discourse. As students move through Levels 3, 4, and 5, they are able to participate in listening and speaking tasks with increasingly more complex grammar and vocabulary and involving longer and more detailed discourse. As their linguistic knowledge grows, students are increasingly able to use semantic cues, surrounding text, and other cues to understand and produce new vocabulary and idiomatic expressions and in so doing improve their ability to Listen Actively and Speak So Others Can Understand. One of the key differences between Levels 4 and 5 is the mastery of textual knowledge such as the connectedness between phrases and utterances, the thematic and organizational patterns in different kinds of texts, and discourse markers that help listeners understand and speakers convey sequence (e.g., first, next, to conclude, for instance) and tense changes (e.g., shifts from past to past perfect or future tenses). Another key difference between Levels 4 and 5 is the mastery of a wide range of vocabulary, grammatical structures, and registers and the resulting abilities to understand and use a variety of speaking styles.

 

While growth in the linguistic knowledge base is essential to the development of listening and speaking proficiency, the EFF performance level descriptions are not driven by a sequence of grammatical structures but by the ability to understand and convey meaning in purposeful activities. This does not imply that grammar should not be an explicit focus of teaching and learning in the EFF classroom. However, given the purposeful and communicative nature of the EFF Standards, it would be best when teaching to the standards to subsume systematic teaching and learning of grammatical structures within lessons focused on helping learners achieve their goals for communicating in English.

Strategic Knowledge for Clarifying Meaning, Conveying Understanding, and Repairing Problems in Communication

 

The second bulleted category under Knowledge, Skills, and Strategies has to do with the strategic knowledge required to integrate and apply listening and speaking skills. By strategies we mean any behavior, thought, or action that allows an adult to apply their knowledge and skills more effectively and appropriately to accomplish a communication task. At Level 1, the communication-related strategies students are able to access are primarily formulaic in nature, consisting of learned phrases they can use to relay basic information, accomplish simple speaking tasks (such as greetings or asking about the cost of an item at the store), or improve listening and speaking performance (such as: “Say that again please.” or “I don’t understand.” “Do you know what I mean?”). By Level 2, students have gained more flexibility in combining and recombining learned statements and questions appropriate to the context. Their increasing linguistic knowledge may allow them to use a larger variety of strategies beyond simply relying on learned phrases such as rephrasing--saying “the place where you go to work” for “office” or substituting a different word—“job” for “employment” or selectively identifying key information to convey or listen for. By Level 3 and above, as a student’s repertoire of strategies for repairing problems in communication grows they are able make more decisions about when and under what conditions to use certain strategies. Such decisions may take into account the purpose of


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

the communication, the audience, the level of formality of the situation, and a variety of other socio-cultural factors such as the age and gender of the speaker or listener.

 

Although students at Levels 1, 2 and 3 are often able to give appropriate feedback in conversations, by Level 4 and above students are increasingly able to tailor their feedback. For example, a Level 4 Listen Actively sample task requires students to listen and respond in a small group meeting where a difficult decision must be made. In this case, a student might possess the linguistic ability to acknowledge the speakers’ concerns before responding such as by saying, “I know what you mean about this problem but we need to…” By Level 5, students in most communication situations should be able to craft questions and responses that can be understood and are considered appropriate by native English speakers.

 

Strategies supporting listening and speaking proficiency may also be non-linguistic. Adults may use gestures, eye contact, and body language to understand or convey meaning. They may also engage in self-talk or silent “rehearsals” of what they will say in order to overcome anxiety. They may use social strategies to ask for assistance from a teacher or friend, or pool information with peers. They may also use writing to aid listening comprehension or prepare to speak by taking notes, creating graphic organizers, drawing pictures, or creating bilingual vocabulary lists to aid comprehension and production. Non-linguistic strategies such as these and others can be found in the performance level descriptors for Listen Actively and Speak So Others Can Understand.

 

Meeting the Purpose for Communication

 

The knowledge and strategies required to understand the basic intent of the speaker, to relay information effectively in speaking, and to do what is required to meet the purpose of the communication are addressed under the third bullet. The ability to draw upon background knowledge and to apply it to aid communication is included here. Although all the various functions of communication (such as informing, persuading, establishing social interaction, or solving a problem, etc.) may be present at any level, at higher levels students are expected to be able to accomplish increasingly challenging and complex communications. For example, at Listen Actively Level 1 a student might only be expected to ask simple clarification questions in response to a very short persuasive narrative while at Listen Actively Level 3, a student might also be expected to have sufficient and detailed comprehension to take notes and to be ready to summarize the main points so that they can be shared with others. Similarly, at Speak Levels 1 and 2, a student might be expected to provide very basic, and short response to an interview question, while at Speak Level 4, students are expected to be able to provide a more elaborate and longer response to even a simple interview question.


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

Section 3: Fluency, Independence and Ability to Perform in a Range of Settings

 

Section 3 is the description of fluency, independence, and ability to perform in a range of settings expected for proficient performance on the standard at each level. Like the descriptions of key knowledge, skills, and strategies in Section 2, the descriptions in Section 3 are specific to each level and are intended to serve as a basis for guiding assessment, learning, and instruction that is appropriate to that level.

 

For Listen Actively, a key feature of this section is description of how much the listening text has been adjusted to make understanding simpler and to increase opportunities for repetition and clarification. At Level 1, the linguistic and textual complexity, the vocabulary and the rate of speech of the texts is considerably simplified and slowed down. It is assumed that the speaker may need to pause often to repeat or rephrase language to aid comprehension. In Levels 2 and 3, text is still simplified with frequent opportunities for clarification and repairing communication are provided, but the level of complexity of text and speed of delivery gradually increases. At the lower levels, more scaffolding in the form of visual aids, pre-listening exercises, written materials and other supports are also provided.

 

At Listen Actively Levels 4 and 5, the content and speed of delivery of text is not adjusted. Depending on their level of confidence, many non-native English speakers at these levels can function successfully in classes with a mixed ABE and ESL students. One of the key differences between Levels 4 and 5 is the degree of misunderstanding and number of opportunities to repair communication that can be expected to be required. Students at Level 4 may listen to similar kinds of texts as those provided in Level 5, however Level 5 students will be expected to understand more main ideas, details and nuances conveyed by the listening text with fewer opportunities to repair understanding.

 

For Speak So Others Can Understand, a key feature of this section is description of the degree to which the speaker is able to be creative and flexible in their use of vocabulary, sentence structure, style, and register. At Levels 1 and 2, speech production consists almost entirely of learned words and formulaic language (standard greetings, simple questions, politeness formulas, etc.). By Level 5, the speaker is expected to be able to be able to shift speaking styles and be effective in communication in previously unknown and/or unpredictable contexts and situations.

 

For both Listening and Speaking the level of comfort and familiarity associated with the communication context, participants, and situation decreases moving up the performance levels. At the lower levels, fluency and independence are expected only in relatively comfortable and familiar situations. At the higher levels, the degree of risk and ability to communicate in stressful situations increases. At levels 4 and 5, fluency and independence are expected even in situations that may be uncomfortable (such as receiving and responding to a poor performance review from a supervisor) or threatening (such as talking your way out of fight).


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

Section 4: Examples of Applications of the Standards

 

Section 4 of the performance level descriptions provides a short list of examples of the purposeful applications of the standard (activities) that can be accomplished by an adult who is proficient at each level. This list of examples is illustrative and not exhaustive. Like Sections 2 and 3, the descriptions of activities in Section 4 are specific to each performance level. These examples of things that adults can accomplish in the real world at each level of performance on the continuum are useful to adult learners and to their teachers as ways of making concrete the purpose and need for attaining increasing proficiency in performance on the standard. By making it clear what can be accomplished at each level, the descriptions of activities in Section 3 also provide motivation for higher levels of learning. The listing of real-world accomplishments also provides guidance for selecting and designing the content for instructional materials and assessments.

 

At Levels 1 to 3 students are expected to listen and speak in the context of mostly routine tasks that are encountered in everyday life. Level 1 tasks include many supports, such as listening to a local weather forecast with visuals and following instructions for the use of a piece of equipment where the steps are demonstrated as well as described. By Level 3, while the general topics may be familiar, students are expected to be able to understand and respond to some unfamiliar vocabulary and concepts such as, for example, when they listen to a presentation about a vocational education program. At Levels 4 and 5, students are expected to be able to respond to increasingly less familiar listening tasks such as short lectures that simulate simple examples of those they might encounter at the community college, authentic new reports, and conversations where the topic discussed is somewhat unfamiliar. Most listening and speaking at the lower levels consists of face-to-face interactions although at Level 2 students are able to manage short, predictable phone conversations and by Level 3 they are also able to listen and comprehend or convey simple authentic texts conveyed in situations where there are no visual cues, such as by telephone and radio.

 

Across each level many of the genres for listening and speaking are the same. At all levels students are asked to understand and respond to face-to-face conversations, instructions, explanations, narratives, and small group discussions. However the degree of complexity and familiarity with the rules of each of these listening/speaking-related genres increases as students move along the continuum. Within one-to-one conversations, for example, as students move from one level to another they are expected to participate in increasingly complex and potentially difficult situations, such as, by Level 5, communicating with an angry teenager who wants to drop out of school. The length and complexity of text/discourse also increases as we move along the continuum. By Levels 4 and 5, students are expected to be able to effectively participate in communications that may involve, for example, lecture-length, multi-part narratives. Some genres of listening or speaking (such as expressive genres: listening to fiction/ story-telling, reciting/listening to poetry, or singing/listening to music lyrics) may not appear in the examples at every level, but students at all levels can be expected to be able to communicate within these genres and other examples at other levels can be added.


 

Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

What are the Guides to Using the EFF Performance Continua?

The EFF Assessment Resource Collection contains guides to ten of the EFF performance continua (http://eff.cls.utk.edu/assessment/guides.htm). The purpose of each guide is to introduce you to one of the EFF performance continua and show you how to use it to plan for instruction and for classroom-based assessment. Since accountability assessments on the standard will be based on the same performance continuum, the guide may also help you to better understand what to expect once a performance assessment process based on the standard is in place.

The EFF Continua of Performance are multidimensional, developmental descriptions of performance on the EFF Content Standards. They allow for descriptions of performance ranging from the novice level to the expert level. Currently the descriptions of performance describe from three to six levels each beginning with a novice level and extending to levels that correlate with exit points for adult basic education. Each continuum is built around the four EFF Dimensions of Performance, and performance levels are defined by identifying key features of performance at various points along the continuum. The performance continua make up one part of the EFF Assessment Framework.

How Can I Use the Guides?

Currently guides are available for 10 of the 16 EFF standards. Each guide contains a description of the standard and a two-page chart showing the performance continuum itself. The guide also includes: 1) information to help you understand how to read the continuum; 2) tools for lesson planning and assessment; 3) a scenario describing how one teacher used these tools; 4) information on the research basis for the standard; and 5) tips for where to go for more information. Some of the tools are available as Word documents to allow you to adapt them to your needs. You can get to each guide by clicking on the following link: http://eff.cls.utk.edu/assessment/guides.htm

Where Can I Find Examples of Completed Planning Guides?

The guides for each of the standards also contain scenarios describing how a teacher used the performance continuum for the standard along with lesson planning and assessment tools to prepare lesson plans. Embedded within each of the guides are excerpts from completed 1 page planning guides based on the scenarios. You will find the full 1 page versions of the completed planning guides for 10 standards here: http://eff.cls.utk.edu/assessment/planguides.htm.


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

Introduction to the Performance Continua for Listen Actively and Speak So Others Can Understand

Listening and speaking are interactive, communication skills. For all practical purposes, it is not possible to completely separate them. For example, responding to what is heard and asking for clarification are integral to real world, purposeful applications of both the Listen Actively and the Speak So Others Can Understand standards. For this reason, while the EFF Standard Listen Actively and the Standard Speak So Others Can Understand each have their own set of five performance levels, this introduction will provide background information on both continua, considered together. The separate descriptions of levels of performance are useful for the purposes of guiding assessment, teaching, and learning. As you read the performance continuum for each standard, however, you also see that the performance levels descriptors make frequent reference to the other.

 

Background to the EFF Listen and Speak Performance Continua

 

The empirical basis for the performance level descriptions for the Listen Actively and Speak So Others Can Understand Performance Continua was data on adult learner performance collected by EFF field researchers who developed and piloted activities and performance tasks based on these EFF standards in their ABE, GED, and ESL classes. Initial performance level descriptions for these EFF standards were reviewed and amended by two panels of content experts (one for Listen Actively and one for Speak So Others Can Understand). In addition, we conducted a review of research and considered the correspondence of the EFF Listen and Speak performance levels to other descriptions of adult performance levels in listening and speaking. Of particular importance was the review of guidelines developed by the American Council of Foreign Language Teachers (ACTFL) (http://actfl.org) and the Student Performance levels (SPL’s) developed by the Mainstream English Language Training (MELT) project and used in the BEST and BEST Plus language assessments (http://www.cal.org). We also reviewed and took guidance from the Canadian Language Benchmarks 2000 (http://www.language.ca) and the Adult Literacy Core Curriculum and the Adult ESOL Core Curriculum developed by the Adult Literacy and Basic Skills Unit in the United Kingdom (http://www.basic-skills.co.uk). In all of these background resources, the development of listening and speaking proficiency is demonstrated through progressively more effective, accurate, fluent, and independent language use in increasingly demanding communicative contexts. It may be helpful to consult these resources for more detailed proficiency level descriptions, sample tasks, and curriculum guidelines.

 

The EFF approach to defining performance levels for Listen Actively and Speak So Others Can Understand is also informed by a communicative approach to second language teaching and testing. This communicative approach has it roots in theoretical work in philosophy, linguistics, and sociolinguistics that have focused on the functional and interactive aspects of language use – speech act theory (Austin, 1962; Searle, 1969), ethnomethodological and ethnographic approaches to conversational and discourse analysis (Sacks, 1995; Gumperz, 1982); and functional linguistics (Halliday & Hasan, 1985). As elaborated in models of communicative


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

competence (Hymes, 1972; Canale & Swain, 1980; Bachman & Palmer, 1996), the abilities underlying communication activities (accomplishment of listening and speaking tasks) are understood to include: linguistic competence, textual competence, functional competence, socio­cultural competence, and strategic competence. Graznya Pawlikowska-Smith (2002) provides a good, succinct explanation of these forms of competence in language use in her description of the concept of communicative proficiency that guided development of the Canadian Language Benchmarks 2000:

1. Linguistic competence is the knowledge of grammar and vocabulary at a sentence level. It enables the building and recognition of well-formed, grammatically accurate utterances, according to the rules of syntax, semantics, morphology, and phonology/graphology.

2. Textual competence is the knowledge and application of cohesion and coherence rules and devices in building larger texts/discourses. It enables the connection of utterances and sentences into cohesive, logical, and functionally coherent texts and/or discourse.

3. Functional competence is competence to convey and interpret communicative intent (or function) behind a sentence, utterance, or text. It encompasses macro-functions of language use (e.g., transmission of information, social interaction and getting things done/ persuading others, learning and thinking, creation and enjoyment) and micro­functions, or speech acts (e.g., requests, threats, warnings, pleas, etc.) and the conventions of use.

4. Socio-cultural competence focuses on appropriateness in understanding and producing utterances. These include rules of politeness; sensitivity to register, dialect, or variety; norms of stylistic appropriateness; sensitivity to “naturalness”; knowledge of idioms and figurative language; knowledge of culture, customs, and institutions; knowledge of cultural references; and uses of language through interactional skills to establish and maintain social relationships.

5. Strategic competence manages the integration and application of all of language competence components to the specific context and situation of language use. It involves planning and assessing communication; avoiding potential or repairing actual difficulties in communication, coping with communication breakdown, and using affective devices. Most of all, it functions to ensure effectiveness of communications “transactions.”

 

-- Graznya Pawlikowska-Smith (2002), Canadian Language Benchmarks 2000: Theoretical framework, p. 7.

The EFF Listen and Speak standards reflect the performance of both native and non-native speakers of English along the same continuum of performance. Of the performance levels currently described for these standards (Levels 1-5), we expect that the first three will apply primarily (though not exclusively) to English language learners, beginning with learners who might be described as at a “low intermediate” level. Higher performance level descriptions (Levels 4 and 5) may be equally applicable with native as well as non-native speakers. While these higher performance level descriptions take into the account the language development needs of English language learners, students at these levels of performance are not just “learning to listen and speak” but are also “listening and


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

speaking to learn.” Our current data does not support definitions of performance levels below or above the five levels we have described. In the future, research to support the description of higher performance levels or of “pre-Level 1” performance levels for more beginning level English language learners may be developed. In the interim, guidance on features of listening and speaking proficiency (and guidance for assessment, teaching, and learning) at levels below EFF Performance Level 1 and above EFF Performance Level 5 may be found in the ACTFL, MELT/SPL, Canadian Benchmarks, and English Core Curricula cited in the above paragraph.

 

A mapping of the five EFF Listen and Speak Performance Levels to National Reporting System Educational Functioning Levels and to ACTFL and SPL levels can found on page 14.


Equipped for the Future

Listen Actively and Speak So Others Can Understand Performance Continua

 

References

Adult Literacy and Basic Skills Unit (2001). Adult Literacy Core Curriculum. London: The Basic Skills Agency. (http://www.basic-skills.co.uk).

 

Adult Literacy and Basic Skills Unit (2001). Adult ESOL Core Curriculum. London: The Basic Skills Agency. (http://www.basic-skills.co.uk).

 

American Council for the Teaching of Foreign Languages. (1986). ACTFL Proficiency Guidelines – Listening. Hastings-on-Hudson, NY: ACTFL Materials Center. (http://actfl.org)

 

Austin, J. L. (1962). How to do things with words. New York, NY: Oxford University Press.

 

Bachman, L. & Palmer, A. (1996). Language testing in practice. New York, NY: Oxford University Press.

 

Breiner-Sanders, K. E., Lowe, P., Miles, J., & Swender, E. (2000). ACTFL Proficiency Guidelines – Speaking (Revised 1999). Foreign Language Annals 33 (1), 13-18.

 

Brown, G., Anderson, A., Shilcock, R., & Yule, G. (1984). Teaching talk: Strategies for production and assessment. Cambridge, UK: Cambridge University Press.

 

Butler, F. A., Eignor, D., Jones, S., McNamara, T., & Soumi, B. K. (2002). TOEFL 2000 Speaking Framework: A Working Paper. Princeton, NJ: Educational Testing Service.

 

Canale, M. & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1, 1-47.

 

Centre for Canadian Language Benchmarks. (2000). English as a Second Language for Adults. Canadian Language Benchmarks 2000. Ottowa, Ontario. (http://www.language.ca)

 

Devine, T. (1978). Listening: What do we know after fifty years of research and theorizing? Journal of Reading, 21, 296-304.

 

Douglas, D. (1997). Testing speaking ability in academic contexts: Theoretical considerations (TOEFL Monograph Series Report No. 8). Princeton, NJ: Educational Testing Service.

 

Dunkel, P. (1991). Listening in the native and second/foreign language: Toward an integration of research and practice. TESOL Quarterly, 25, 431-457.

 

Gitomer, D. H. & Bennett, R. E. (2002). Unmasking constructs through new technology, measurement theory, and cognitive sciences. In National Academy of Sciences (Ed.),


Technology and Assessment Thinking Ahead: Proceedings from a Workshop, pp. 1-11. Washington, DC: National Academy Press.

(http://www.nap.edu/openbook/0309083206/html/1.html)

 

Grognet, A.G. (1997). Performance-based curricula and outcomes: The Mainstream English Language Project (MELT) updated for the 1990’s and beyond. Denver, CO: The Spring Institute. (http://www.cal.org)

 

Gumperz, J. J. (1982). Discourse strategies. Cambridge, UK: Cambridge University Press.

 

Halliday, M.A.K. & Hasan, R. (1985). Language, context, and text: aspects of language in a social-semiotic perspective. New York, NY: Oxford University Press.

 

Hymes, D. (1972). Models of interaction of language and social life. In J. Gumperz and D. Hymes (Eds.), Directions in Sociolinguistics: The Ethnography of Communication. New York, NY: Holt, Rinehart, & Winston.

 

Joos, M. (1967). The five clocks. New York, NY: Harcourt Brace Jovanovich.

 

Lynch, T. (1998) Theoretical perspectives on listening. Annual Review of Applied Linguistics, 18, 3-19.

 

Mendelsohn, D. & Rubin, J. (Eds.). A guide for the teaching of second language listening. Carlsbad, CA: Dominie Press.

 

Pawlikowska-Smith, G. (2002). Canadian Language Benchmark 2000: Theoretical Framework. Centre for Canadian Language Benchmarks. Ottowa, Ontario. (http://www.language.ca)

 

Sacks, H. (1995). Lectures on conversation. Oxford, UK: Blackwell.

 

Searle, J. R. (1969). Speech acts: a lecture in the philosophy of language. Cambridge, UK: Cambridge University Press.

 

 

 

Equipped for the future logo

Equipped for the Future
Performance Continuum
for Read With Understanding

Common Activities


In order to fulfill responsibilities

as parents/family members,
citizens/community members,

and workers, adults must be able to:

·   Gather, Analyze, and Use Information

·   Manage Resources

·   Work Within the Big Picture

·   Work Together

·   Provide Leadership

·   Guide and Support Others

·   Seek Guidance and Support From Others

·   Develop and Express Sense of Self

·   Respect Others and Value Diversity

·   Exercise Rights and Responsibilities

·   Create and Pursue Vision and Goals

·   Use Technology and Other Tools to Accomplish Goals

·   Keep Pace With Change

 

Read With Understanding chart

 

 

 



Equipped for the Future

Read With Understanding Performance Continuum

PERFORMANCE LEVEL 1

Read With Understanding

 

How adults at Level 1 Read With Understanding:

 

Level 1 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 1 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 1 can read and comprehend words in short, simple texts slowly and with some effort but with few errors, to independently accomplish simple, well defined, and structured reading activities in a few comfortable and familiar settings.

 

Level 1 Examples of Proficient Performance

 

Adults performing at Level 1 can Read With Understanding to accomplish a variety of goals, such as:

 

Equipped for the Future

Read With Understanding Performance Continuum

PERFORMANCE LEVEL 2

Read With Understanding

 

How adults at Level 2 Read With Understanding:

 

LevelLevel 2 Indicators 2 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing Level 2 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 2 can read and comprehend words in small blocks of simple text slowly but easily and with few errors, to independently accomplish simple, well-defined, and structured reading activities in a range of comfortable and familiar settings.

 

LeLevel 2 Examples of Proficient Performance vel 2 Examples of Proficient Performance

 

Adults performing at Level 2 can Read With Understanding to accomplish a variety of goals, such as:

 

 

 

Equipped for the Future

Read With Understanding Performance Continuum

PERFORMANCE LEVEL 3

Read With Understanding

 

How adults at Level 3  Read With Understanding:

 

LevLevel 3 Indicators el 3 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 3 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 3 can quickly and accurately read and comprehend words and word groups in multiple pages of simple text, to independently accomplish simple, well-defined, and structured reading activities in a range of comfortable and familiar settings.

 

LLevel 3 Examples of Proficient Performance vel 3 Examples of Proficient Performance

 

Adults performing at Level 3 can Read With Understanding to accomplish a variety of goals, such as:

 

 

 

 

 

Equipped for the Future

Read With Understanding Performance Continuum

PERFORMANCE LEVEL 4

Read With Understanding

 

How adults at Level 4 Read With Understanding:

 

LLevel 4 Indicators vel 4 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 4 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 4 can read and comprehend a variety of texts at an appropriate pace and with good comprehension, to independently accomplish structured reading activities in a variety of familiar settings.

 

LeLevel 4 Examples of Proficient Performance vel 4 Examples of Proficient Performance

 

Adults performing at Level 4 can Read With Understanding to accomplish a variety of goals, such as:

 

 

 

Equipped for the Future

Read With Understanding Performance Continuum

PERFORMANCE LEVEL 5

Read With Understanding

 

How adults at Level 5 Read With Understanding:

 

LLevel 5 Indicators evel 5 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 5 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 5 can read and comprehend dense or multipart texts at an appropriate pace and with good comprehension to independently accomplish structured, complex reading activities in a variety of familiar and some novel settings.

 

LLevel 5 Examples of Proficient Performance evel 5 Examples of Proficient Performance

 

Adults performing at Level 5 can Read With Understanding to accomplish a variety of goals, such as:

 

 

 

 

 

Equipped for the Future

Read With Understanding Performance Continuum

PERFORMANCE LEVEL 6

Read With Understanding

 

How adults at Level 6  Read With Understanding:

 

LLevel 6 Indicators evel 6 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 6 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 6 can read and comprehend long, complex texts at an appropriate pace and with good comprehension, to independently accomplish structured or unstructured, complex reading activities in a variety of familiar and novel settings.

 

LLevel 6 Examples of Proficient Performance evel 6 Examples of Proficient Performance

 

Adults performing at Level 6 can Read With Understanding to accomplish a variety of goals, such as:

 

 

 

Equipped for the Future

Read With Understanding Performance Continuum

Performance levels for the EFF Content Standard Read With Understanding mapped to
the NRS Educational Functioning Levels

EFF Read With

Understanding Performance

Levels

Can be used to define an exit

point for the NRS ABE

Educational Functioning

Level . . .

Can be used to define an exit

point for the NRS ESL

Educational Functioning

Level . . .

Read With Understanding

Performance Level 1

Beginning ABE Literacy

Beginning ESL

Read With Understanding

Performance Level 2

Beginning Basic Education

Low Intermediate ESL

Read With Understanding

Performance Level 3

Low Intermediate Basic

Education

High Intermediate ESL

Read With Understanding

Performance Level 4

High Intermediate Basic

Education

Low Advanced ESL

Read With Understanding

Performance Level 5

Low Adult Secondary

Education

High Advanced ESL

Read With Understanding

Performance Level 6

High Adult Secondary

Education

 

 


Equipped for the Future

Read With Understanding Performance Continuum

 

 

How to read the EFF Read With Understanding Performance Continuum

The EFF Performance Continuum for Read With Understanding is a developmental description of performance on the Read With Understanding Standard. The continuum portrays development along four dimensions: the structure and depth of knowledge, and the fluency, independence and range of performance. The six EFF Levels described here are points along the continuum that serve as benchmarks for key stages in development and increasing ability to accomplish important activities in daily life that require adults to Read With Understanding.

 

The six levels of performance described in this document cover only a portion of the performance levels possible for Read With Understanding. There are aspects of reading development and performance that fall below the performance described in Level 1 and there are many levels of proficiency leading toward higher levels of expertise beyond the knowledge, skills, strategies, and performance descriptions at Level 6 on the Read With Understanding Performance Continuum.

 

The descriptions of performance at each level of the Read With Understanding Performance Continuum are anchored in analysis of data on adult learner performance. They were developed by analyzing data on use of the Read With Understanding Standard by adult learners in ABE programs (including adult literacy, adult English Speakers of Other Languages, family literacy, and adult secondary education). This empirical evidence of performance on the Read With Understanding Standard went through extensive analysis by research staff and was reviewed and amended by a panel of content experts. At each step in this process, cognitive science and reading theory and research was used to guide and refine the definition of performance criteria. The number of levels defined for the EFF Performance Continuum for Read With Understanding (six) was determined through analysis and review of data. Each level describes a qualitatively distinct stage in the development of proficiency on the standard. Each level builds on the previous levels. Thus, an adult who is able to perform at Level 3 also has mastered the performance on the Standard described at Levels 1 and 2.

 

Each performance level on the Read With Understanding Performance Continuum is described on a single page in this document. Each page is divided into four sections:

 

Section 1 is the definition of the Standard. The performance-level description starts with the components of performance of the standard. These components define the content standard and they remain the same at each level of performance. This repetition serves as a reminder that the integrated skill process defined by the components of performance for each standard is constant across all levels, from novice to expert levels of performance. What changes from level to level is the growth and complexity of the underlying knowledge base and the resulting increases in fluency and independence in using the standard to accomplish an increasing range and variety of tasks.


Equipped for the Future

Read With Understanding Performance Continuum

This definition of the standard is a useful tool for communicating to adults and their teachers the essential features of the construct, or set of targeted abilities, for each standard. By making it clear how the skill process is defined (or “unmasking the construct,” as described by Gitomer & Bennett, 2002), adult learners are better able to articulate their own learning goals for improving proficiency and teachers are better able to focus learning and instructional activities that build toward the goal of increasing ability to use the standard to accomplish everyday activities. Here is how the standard is defined for all performance levels in Read With Understanding:

·        Determine the reading purpose,

·        Select reading strategies appropriate to the purpose,

·        Monitor comprehension and adjust reading strategies,

·        Analyze information and reflect on its underlying meaning, and

·        Integrate new information with prior knowledge to address the reading purpose.

 

Section 2 is a list of key knowledge, skills and strategies that can be observed in proficient performance at that level. These are the primary indicators (or benchmarks) of the growth and organization of the knowledge base needed for proficient performance on the standard at each level. This list is thus of central importance for designing assessments to measure performance on the standard. Because the performance levels are designed primarily as guides for assessment and not as a curriculum framework, the list does not specify details of knowledge, skills, and strategies that might be studied and taught. Nonetheless, the list can serve as a way of identifying instructional objectives for each level and provides a guide for developing criteria for placement of learners in instructional levels.

 

Because this list of key knowledge, skills, and strategies focuses only on those features of performance that indicate qualitative changes in what a learner knows and can do, it can be used by curriculum developers and instructors to set instructional objectives for each level and to develop more detailed curricula or learning plans that will prepare learners to develop these abilities, meet the criteria, and move on to the next level in their development of expertise.

 

Section 3 defines the fluency, independence and ability to perform in a range of settings expected for proficient performance on the standard at each level. Together with the descriptions of key knowledge, skills, and strategies, these descriptions serve as the primary behavioral indicators (benchmarks) of proficient performance at each level. As such, section 3 descriptions also provide a basis for designing learning, instruction and assessment that is appropriate to that level.

 

Section 4 a short list of examples of the purposeful applications (activities) that an adult who is proficient at that level can accomplish. This list of examples is illustrative and not exhaustive. It is based primarily on actual reports from teachers of what students could use the standard to accomplish. These real-world examples are useful to adults and their teachers in making concrete the purpose and need for attaining increasing proficiency in performance on the standard. The

list of real-world accomplishments also provides guidance for selecting and designing content for instructional materials and assessments.


Equipped for the Future

Read With Understanding Performance Continuum

 

What are the Guides to Using the EFF Performance Continua?

 

The EFF Assessment Resource Collection contains guides to ten of the EFF performance continua (http://eff.cls.utk.edu/assessment/guides.htm). The purpose of each guide is to introduce you to one of the EFF performance continua and show you how to use it to plan for instruction and for classroom-based assessment. Since accountability assessments on the standard will be based on the same performance continuum, the guide may also help you to better understand what to expect once a performance assessment process based on the standard is in place.

 

The EFF Continua of Performance are multidimensional, developmental descriptions of performance on the EFF Content Standards. They allow for descriptions of performance ranging from the novice level to the expert level. Currently the descriptions of performance describe from three to six levels each beginning with a novice level and extending to levels that correlate with exit points for adult basic education. Each continuum is built around the four EFF Dimensions of Performance, and performance levels are defined by identifying key features of performance at various points along the continuum. The performance continua make up one part of the EFF Assessment Framework.

How Can I Use the Guides?

 

Currently guides are available for 10 of the 16 EFF standards. Each guide contains a description of the standard and a two-page chart showing the performance continuum itself. The guide also includes: 1) information to help you understand how to read the continuum; 2) tools for lesson planning and assessment; 3) a scenario describing how one teacher used these tools; 4) information on the research basis for the standard; and 5) tips for where to go for more information. Some of the tools are available as Word documents to allow you to adapt them to your needs. You can get to each guide by clicking on the following link: http://eff.cls.utk.edu/assessment/guides.htm

Where Can I Find Examples of Completed Planning Guides?

 

The guides for each of the standards also contain scenarios describing how a teacher used the performance continuum for the standard along with lesson planning and assessment tools to prepare lesson plans. Embedded within each of the guides are excerpts from completed 1 page planning guides based on the scenarios. You will find the full 1 page versions of the completed planning guides for 10 standards here: http://eff.cls.utk.edu/assessment/planguides.htm.


Equipped for the Future

Read With Understanding Performance Continuum

Notes on the Research Base for the Read With Understanding Continuum and Performance Levels

 

Research on the preparation of teachers to deliver comprehension instruction was an important topic in the National Reading Panel’s review of scientific studies of reading comprehension. The key challenge in this area identified by the NRP is that teachers must have a clear understanding not only of the comprehension strategies they are teaching, but also of the instructional strategies that they can employ. This most often means being able to respond to students’ needs for constructive feedback as they read (NRP, 2000b, p. 4-119).

 

For teachers of adult basic education, the challenge of understanding the differences between teaching skills alone and integrated teaching of skills and strategies in ways that build reading proficiency is especially daunting. Marking out a clear and detailed developmental pathway (that includes all the key elements of reading proficiency discussed below) for adult readers (and their teachers) to follow is an essential first step in meeting this challenge. The Read With Understanding Performance Continuum provides such a pathway, with key developmental benchmarks of knowledge, skills, and strategies clearly described.

 

The Read With Understanding Performance Continuum provides a multidimensional view of adult reading proficiency that incorporates important elements of reading skills development in the areas of alphabetics, fluency, and comprehension. As adults move from level to level along the continuum, their increasing capabilities enable them to interact with increasingly complex forms of text to accomplish increasingly demanding reading activities (in an increasingly wide range of contexts). The descriptions of:

·        Key Knowledge, Skills, and Strategies;

·        Fluency, Independence, and Ability to Perform in a Range of Settings; and

·        Variety of Reading Purposes

that can be accomplished at each of the six performance levels on the Read With Understanding continuum are intended to serve as guides for learning and instruction for adults who are striving to improve their proficiency in reading from “novice” to “expert” levels of performance.

 

At each level of the continuum, the core definition of the standard applies. That is to say, at each level the skill process that is being described is one that begins with determining the reading purpose and ends with integrating new information with prior knowledge in order to address the reading purpose. At each successive level of performance on the continuum, the addition of new skills and knowledge and higher levels of ability to apply comprehension strategies lead to more fluent and independent reading proficiency and the ability to perform successfully a greater range of increasingly demanding reading activities.

 

These core elements of the EFF Performance Continuum — developmental descriptions of the capabilities of readers interacting with increasingly complex texts to accomplish increasingly demanding reading activities — align very well with evidence-based definitions of reading comprehension as put forward in recent research syntheses including the National Reading Panel (2000) and the RAND Reading Study Group (RRSG) (Snow, 2002).


Equipped for the Future

Read With Understanding Performance Continuum

 

The RRSG had this to say about reading proficiency:

 

“The RRSG sees achieving reading proficiency as a long-term developmental process; what constitutes “reading well” is different at different points in the reader’s development. The end point — proficient adult reading — encompasses the capacity to read, with ease and interest, a wide variety of different kinds of materials for varying purposes and to read with comprehension even when the material is neither easy to understand nor intrinsically interesting. Adult reading involves reading for pleasure, learning, and analysis, and it represents a prerequisite to many forms of employment, to informed participation in the democratic process, to optimal participation in the education of one’s children, and to gaining access to cultural capital.” (Snow, 2002, p. 9).

 

This conceptualization of reading proficiency has strong parallels in EFF’s conceptualization of purposeful, functional reading — reading to accomplish things in the world. This is the sort of reading proficiency that adult learners, ABE instructors, and others concerned with the quality of ABE desire.

 

The RAND Reading Study Group developed a formal definition of reading comprehension that also closely parallels the construct of applied reading proficiency underlying the EFF Standard Read With Understanding, as follows:

 

“We define reading comprehension as the process of simultaneously extracting and constructing meaning through interaction and involvement with written language. We use the words extracting and constructing to emphasize both the importance and the insufficiency of the text as the determinant of reading comprehension. Comprehension entails three elements:

·        The reader who is doing the comprehending

·        The text that is to be comprehended

·        The activity in which comprehension is a part.

 

In considering the reader, we include all the capacities, abilities, knowledge, and experiences that a person brings to the act of reading. Text is broadly construed to include any printed text or electronic text. In considering activity, we include the purposes, processes, and consequences associated with the act of reading.

 

These three dimensions define a phenomenon that occurs within a larger sociocultural context that shapes and is shaped by the reader and that interacts with each of the three elements.” (Snow, 2002, p. 11)

 

As will be shown below, the characteristics of and interactions among readers, texts, and activities that research has shown to be critical to proficient adult reading (and the learning and instruction that leads to proficient adult reading) are reflected in numerous ways in the descriptions of each level of performance on the Read With Understanding Performance Continuum.


Equipped for the Future

Read With Understanding Performance Continuum

Support for the Continuum and Performance Levels in Reading Theory and Research

The current state of research-based knowledge of reading development, reading proficiency, and reading instruction has been summarized in several recent reports (Snow, Burns, & Griffin, 1998; National Reading Panel, 2000). These reports summarize findings from a large body of experimental research on early reading development and instruction for children in school. As these research syntheses make clear, the bulk of evidence-based knowledge (findings from experimental or quasi-experimental research studies) is related to early stages of reading development (from oral language development to the ability to decode and recognize words and word groups) for very young children (preschool through early elementary school). The number of experimental and quasi-experimental studies of reading development and reading instruction on higher levels of reading development (in the important areas of fluency and comprehension) involving adolescents and adults as research subjects is much smaller.

 

Nonetheless, much of the early reading development research is relevant to adult reading development and instruction and, as other recent research syntheses have shown, there is a growing body of quality research on topics related to reading fluency and comprehension (see Pressley, 2000; Snow, 2002) as well as studies that involve adolescents and adults (see Kruidenier, 2002) and, very critically, studies that include adolescents and adult learning to read in a second language (see Burt, Peyton, & Adams, 2003). All of these recent research summaries (Snow, Burns, & Griffin, 1998; National Reading Panel, 2000; Pressley, 2000; Snow, 2002; Kruidenier, 2002; Burt, Peyton, & Adams, 2003) portray the key elements of reading development in the same way. All of these reports describe reading as a hierarchy of skills, from processing of letter shapes and sounds to word recognition to text processing. These key elements of reading proficiency include alphabetics (phonemic awareness, phonics, and word analysis), fluency (fast and accurate decoding; and prosody), and comprehension (vocabulary, world knowledge, and comprehension strategies). Each of these elements is incorporated in the developmental descriptions of emerging adult reading proficiency on the Read With Understanding Performance Continuum.

 

Cognitive process models of reading

The cognitive process (activity in the brain) of proficient adult reading requires mastery of alphabetics, fluency, and comprehension knowledge, skills, and strategies. Current evidence­based understandings of the cognitive process of skilled reading are built on the foundation of Gough’s (1972) information-processing model. Gough saw a parallel between the way computers process information and the way the brain processes information and developed a model that describes the cognitive process of reading as a linear, letter-by-letter, word-by-word, additive process. Following Gough, LaBerge and Samuels (1974) assumed that word recognition is fundamental to the reading process and developed a model of the cognitive process of reading that involves three memory systems:

·        visual signals are processed by a Visual Memory System that holds representations of

features, letters, spelling groups, words, and word clusters;

·        next information flows to a Phonological Memory Processing System that enables

processing of the sounds of spelling groups, words, and word groups; and,

·         finally, a Semantic Memory System processes the meaning of words, word groups, and sentences.


Equipped for the Future

Read With Understanding Performance Continuum

 

LaBerge and Samuels introduced the notion of “automaticity” to explain the speed and relative ease of skilled reading by hypothesizing that rapid reading comprehension is possible only when the cognitive processes involved in decoding letters and words no longer require conscious attention. When letter and word recognition becomes “automatic,” the brain is capable of focusing on comprehension.

 

More recently, interactive models of reading processes that hypothesize simultaneous cognitive processing of information at different levels (Rumelhart, 1994) have refined the strictly “bottom­up” cognitive models (moving from features to letters, to spelling patterns, to visual word representations, to phonological word representations, to word meanings, to word group meanings) originated by Gough and by LaBerge and Samuels. Marilyn Adams (1990, 1994) has been the leading proponent of this parallel-distributed processing model of reading. Adams describes interactions among four cognitive “processors” (orthographic processor, phonological processor, meaning processor, and context processor) as follows:

 

“… even as the letters of a word in fixation are recognized, they activate the spelling patterns, pronunciation, and meanings with which they are compatible. At the same time, using its larger knowledge of the text, the context processor swings its own bias among the rival candidates so as to maintain the coherence of the message. And as each processor hones in on the word’s identity, it relays its hypothesis back to all the others such that, wherever hypotheses agree among processors, their resolution is speeded and strengthened. In this way, as initiated by print on the page and facilitated through feedback and feedforward both within and between processors, skillful readers come to recognize the spelling, sound, meaning, and contextual role of a familiar word almost automatically and simultaneously, leaving their active attention free for critical and reflective thought.”(Adams, 1994: 9).

 

Adam’s description of the brain activity that underlies skillful reading applies to adults as well as to children. For adults, as for children and youth, developing proficient reading ability involves progressive mastery and integration of the complete hierarchy of fundamental reading knowledge, skills, and strategies, including phonemic awareness, phonics, word analysis, fluency, vocabulary development, world knowledge, and comprehension strategies.

 

Alphabetics (phonemic awareness, phonics, and word analysis)

Alphabetics refers to knowledge of how the letters of the alphabet are used to represent the sounds of the English language. Phonemes are the smallest units (sounds) of spoken language and phonemic awareness is the ability to recognize and manipulate (isolate, segment, blend, delete) phonemes in spoken words. Phonics and word analysis refer to knowledge of connection between written letters and sounds. A large body of evidence-based research has shown that learning and instruction in phonemic awareness and word analysis skills are fundamental to early reading development (Byrne & Fielding-Barnsley, 1993; Felton, 1993; Foorman, et al., 1996, and summary of research in NRP, 2000b). Experimental results from one study with adult literacy learners showed that adult beginning readers had lower phonemic awareness abilities (on phoneme deletion and segmentation tests) and


Equipped for the Future

Read With Understanding Performance Continuum

word analysis skills than children whose reading comprehension was tested at the same level (Greenberg, Ehri, & Perin, 1997). This suggests that adults, like children, may benefit from learning and instruction focused on improving phonemic awareness and word analysis. Although there is some evidence from experimental research with adult English language learners that some aspects of alphabetics knowledge may transfer from the first language to English reading (Koda, 1999), research has also shown that even advanced English learners whose first language is written alphabetically may need instruction to be able to match letters and sounds in English (Burt, Peyton, & Adams, 2003).

 

The importance of phonemic awareness and word analysis are highlighted in the first three levels of the Read With Understanding Performance Continuum. For example, note the italicized descriptors at Level 1 in section 2 of the performance continuum, “Key Knowledge, Skills, and Strategies.”

 

 

Excerpt from Read With Understanding Performance Continuum — Level 1

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 1 can:

•    Recognize words or word groups in simple non-continuous text by decoding letter/sound correspondence, isolating and saying first/last sounds, naming pictures to isolate and say initial sounds, sounding out words by segmenting words into separate sounds and syllables, combining or blending sounds, recognizing simple rhyming word patterns, or recalling oral vocabulary and sight words;

·         Demonstrate familiarity with concepts of print, letter shapes, letter names and sounds (individual consonants and vowels, digraphs and blends) and common vocabulary;

·         Monitor accuracy of decoding and word recognition (using various strategies such as rereading or making word lists);

·         Recall prior knowledge to assist in understanding information in the text.



Fluency

The National Reading Panel described fluency as a critical component of skilled reading but one that is often neglected in instruction. According to the NRP (2000b, p. 3-1), a fluent reader “can read text with speed, accuracy, and proper expression.” The NRP report quotes the following passages from the earlier National Research Council report, Preventing Reading Difficulties in Young Children (Snow, Burns, & Griffin, 1998): “Adequate progress in learning to read English (or, any other alphabetic language) beyond the initial level depends on sufficient practice in reading to achieve fluency with different texts.” (p. 223, quoted in NRP, 2000b, p. 3-1) And “because the ability to obtain meaning from print depends on word recognition accuracy and reading fluency, both the latter should be regularly assessed in the classroom, permitting timely and effective instructional response when difficulty or delay is apparent.” (p. 7, quoted in NRP, 2000b, p. 3-1).

 

Fluency is a key dimension of performance for all of the EFF Standards. The Read With Understanding Performance Continuum describes developmental changes in reading rate and accuracy and emerging ability to read with expression across all six levels of the continuum. Note the changes from level to level in the excerpts from section 3 of the performance level descriptions: “Show Fluency, Independence, and Ability to Perform in a Range of Settings. Also, note that fluency  in word recognition — or automaticity — is achieved at Level 4 on the continuum.

Evidence-based research has shown that training children to recognize words in text more quickly improves reading comprehension (Tan & Nicholson, 1997 and see research synthesis in NRP, 2000b). There is also some experimental research showing that teaching fluency to ABE students may lead to increases in reading achievement (McKane & Greene, 1996; Meyer, 1982).

 

 

 

Excerpts from Read With Understanding Performance Continuum — Levels 1 to 6

 

Adults performing at Level 1 can read and comprehend words in short, simple texts slowly and with some effort but with few errors …

 

Adults performing at Level 2 can read and comprehend words in small blocks of simple text slowly but easily and with few errors …

 

Adults performing at Level 3 can quickly and accurately read and comprehend words and word groups in multiple pages of simple text …

 

Adults performing at Level 4 can read and comprehend a variety of texts at an appropriate pace and with good comprehension …

 

Adults performing at Level 5 can read and comprehend dense or multipart texts at an appropriate pace and with good comprehension …

 

Adults performing at Level 6 can read and comprehend long, complex texts at an appropriate pace and with good comprehension …

 



Vocabulary development

It has long been established that a good vocabulary is strongly associated with good reading comprehension (Anderson & Freebody, 1981). The National Reading Panel (2000b) identifies vocabulary development as one of the three important components of reading comprehension. According to the NRP (2000b, p. 4-1), “reading comprehension is a cognitive process that integrates complex skills and cannot be understood without examining the critical role of vocabulary learning and instruction and its development.”

 

Evidence-based research has shown that vocabulary development and various methods of vocabulary instruction are effective means of improving reading fluency and comprehension for children (Beck, Perfetti, & McKeown, 1982; Beck & McKeown, 1991; and see research synthesis in NRP, 2000b).

 

One conclusion of the NRP in their overview of evidence-based research was that various vocabulary instructional methods can have differential impacts on students of different ages and ability levels (NRP, 2000b: 4-18). For adults, some evidence-based research shows that participation in adult basic education can have a positive impact on vocabulary development (Gold & Horn, 1982; Philliber, Spillman, & King, 1996). Vocabulary development has also long been recognized as a critical component for second language reading development (McLeod & McLaughlin, 1986; Tan et al., 1994).

 

Vocabulary development is an important component of the Read With Understanding Performance Continuum at all six levels of the descriptions of “Key Knowledge, Skill, and Strategies.”

 

Excerpts from the Read With Understanding Performance Continuum — Levels 1 to 6

 

Level 1

Demonstrate familiarity with concepts of print, letter shapes, letter names and sounds (individual consonants and vowels, digraphs and blends) and common vocabulary

 

Level 2

Demonstrate familiarity with simple, everyday content knowledge and vocabulary

 

Level 3

Demonstrate familiarity with common high-interest content knowledge and related vocabulary

 

Level 4

Demonstrate familiarity with everyday and some specialized content knowledge and vocabulary

 

Level 5

Demonstrate familiarity with everyday and some specialized content knowledge and vocabulary

 

Level 6

Demonstrate familiarity with extensive specialized content knowledge and vocabulary

 


Comprehension strategies

Instruction in comprehension strategies was the second important component of reading comprehension identified by the National Reading Panel. The NRP (2000b, p. 4-29), citing Pressley and Afflerbach (1995), notes that the bulk of research on text comprehension in the past three decades has been guided by a cognitive conceptualization of reading as a purposeful and active process. In this view, meaning is influenced by the text and by the reader’s intentionality, problem solving, and use of prior knowledge (Anderson & Pearson, 1984). The NRP (2000b, p. 4-41) quotes Baumann, Seifert-Kessell, & Jones (1992, p. 162), who state that “there is ample extant research supporting the efficacy of cognitive strategy training during reading as a means to enhance students’ comprehension.”

 

There is a large body of evidence-based research to show that text comprehension strategies (including learning to become aware of and monitor one’s own cognitive processes, teacher modeling of actions a reader can take to enhance comprehension, and practicing text comprehension strategies) can be taught effectively and can have positive effects on reading comprehension (Pressley et al., 1989; Rosenshine & Meister, 1994; Rosenshine, Meister, & Chapman, 1996; Brown et al., 1996). There is also experimental evidence that suggests that whereas adults in ABE can improve reading comprehension (see for example, Alessi et al., 1982;

Perin & Greenberg, 1993) adult learners in ABE may be less aware of their own comprehension strategies than skilled college readers are (Gambrel & Heathington, 1981).

The Read With Understanding Performance Continuum calls attention to developing strategies for monitoring and enhancing comprehension and to actively recalling and using prior

knowledge to assist understanding of new information in texts across all six performance levels.

 

 

 

 Excerpts from the Read With Understanding Performance Continuum — Levels 1 to 6

 

Level 1

Monitor accuracy of decoding and word recognition (using various strategies such as rereading or making word lists).

Recall prior knowledge to assist in understanding information in the text.

 

Level 2

Monitor and enhance comprehension (using various strategies such as rereading, restating, copying and rephrasing text; making a list of new words, or using a simplified dictionary). Recall prior knowledge to assist in selecting texts and in understanding the information they contain.

 

Level 3

Monitor and enhance comprehension by use of a range of simple strategies such as recalling, restating, rephrasing, explaining the content of the text or using simple examples. Actively apply prior knowledge to assist in understanding information in texts.

 

Level 4

Monitor and enhance comprehension using a wide range of strategies (such as posing and answering questions, trial and error, adjusting reading pace).

Organize information using some strategies (such as recall, restatement, simple sequencing, simple categorization).

Actively apply prior knowledge to assist in understanding information in texts.

 

Level 5

Monitor and enhance comprehension using a wide range of strategies.

Organize and analyze information (such as identifying the main idea) and reflect upon its meaning using a range of strategies (such as classification, categorization, comparison/contrast). Evaluate prior knowledge against new information in texts to enhance understanding of the information.

 

Level 6

Monitor and enhance comprehension using a wide range of strategies (such as brainstorming and question formulation techniques).

Analyze information and reflect upon its meaning using a wide range of strategies (such as applying relevant information to multiple scenarios, summarizing, drawing “big picture” conclusions and generalizations from detailed reading).

Integrate prior knowledge with new information in texts to develop deep understanding of the information.


Equipped for the Future

Read With Understanding Performance Continuum

 

 

References cited in this section

Adams, M. J. (1990). Beginning to read: Thinking and learning about print. Cambridge, MA: MIT Press.

 

Adams, M. J. (1994). Phonics and beginning reading instruction. In F. Lehr and J. Osborn (Eds.), Reading, language, and literacy: Instruction for the Twenty-First Century (pp. 3-24). Hillsdale, NJ: Lawrence Erlbaum Associates.

 

Alessi, S. M., Siegel, M., Silver, D., & Barnes, H. (1982-83). Effectiveness of a computer-based reading comprehension program for adults. Journal of Educational Technology Systems, 11, 43-57.

 

Anderson, R.C., & Freebody, P. (1981). Vocabulary knowledge. In J.T. Guthrie (Ed.), Comprehension and teaching: Research reviews (pp. 77-117). Newark, DE: International Reading Association.

 

Anderson, R.C., & Pearson, P.D. (1984). A schema-theoretic view of basic processes in reading. In P.D. Pearson, R. Barr, M.L. Kamil, & P. Mosenthal (Eds.), Handbook of reading research. White Plains, NY: Longman.

 

Anderson, V. (1992). A teacher development project in transactional strategy instruction for teachers of severely reading-disabled adolescents. Teaching & Teacher Education, 8, 391-403.

 

Baumann, J. F., Seifert-Kessell, N., & Jones, L. A. (1992). Effect of think-aloud instruction on elementary students’ comprehension monitoring abilities. Journal of Reading Behavior, 24, 143-172.

 

Beck, I.L., & McKeown, M. (1991). Conditions of vocabulary acquisition. In R. Barr, M.L. Kamil, P. Mosenthal, & P.D. Pearson (Eds.), Handbook of reading research: Volume II (pp. 789-814). White Plains , NY: Longman.

 

Beck, I.L., Perfetti, C.A., & McKeown, M.G. (1982). Effects of long term vocabulary instruction on lexical access and reading comprehension. Journal of Educational Psychology, 74, 506-521.

 

Brown, R., Pressley, M., Van Meter, P., & Schuder, T. (1996). A quasi-experimental validation of transactional strategies instruction with low-achieving second grade readers. Journal of Educational Psychology, 88, 18-37.

 

Byrne, B. & Fielding-Barnsley, R. (1993). Evaluation of a program to teach phonemic awareness to young children: A 1-year follow-up. Journal of Educational Psychology, 85, 104-111.

 

Felton, R. H. (1993). Effects of instruction on the decoding skills of children with phonological­processing problems. Journal of Learning Disabilities, 26, 583-589.

 

Foorman, B. R., Francis, D. J., Fletcher, J. M., & Lynn, A. (1996). Relation of phonological and orthographic processing to early reading: Comparing two approaches to regression-based, reading-level­matched designs. Journal of Educational Psychology, 88, 639-652.

 

Gambrel, L. B., & Heathington, B. S. (1981). Adult disabled readers’ metacognitive awareness about reading tasks and strategies. Journal of Reading Behavior, 13, 215-221.


Gold, P. C. & Horn, P. L. (1982). Achievement in reading, verbal language, listening comprehension and locus of control of adult illiterates in a volunteer tutorial project. Perceptual and Motor Skills, 54, 1243­1250.

 

Gough, P. B. (1972). One second of reading. In J. F. Kavenaugh & I. G. Mattingly (Eds.), Language by ear and by eye. Cambridge, MA: MIT Press.

 

Greenberg, D., Ehri, L. C., & Perin, D. (1997). Are word-reading processes the same or different in adult literacy students and third-fifth graders matched for reading level? Journal of Educational Psychology, 89, 262-75.

 

Koda, K. (1999). Development of L2 intraword orthographic sensitivity and decoding skills. Modern Language Journal, 83, 51-64.

 

LaBerge, D., & Samuels, S.J. (1974). Toward a theory of automatic information processing in reading. Cognitive Psychology, 6, 293-323.

 

McKane, P. F. & Greene, B. A. (1996). The use of theory-based computer-assisted instruction in correctional centers to enhance the reading skills of reading-disadvantaged adults. Journal of Educational Computing Research, 15, 331-344.

 

Meyer, V. (1982). Prime-O-Tec: A successful strategy for adult disabled readers. Journal of Reading, 25, 512-515.

 

National Reading Panel (NRP). (2000a). Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. Summary Report. Washington, DC: National Institute of Child Health and Human Development.

 

National Reading Panel (NRP). (2000b). Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. Reports of the Subgroups. Washington, DC: National Institute of Child Health and Human Development.

 

 

Philliber, W. W., Spillman, R. E., & King, R. E. (1996). Consequences of family literacy for adults and children: Some preliminary findings. Journal of Adolescent and Adult Literacy, 39, 558-565.

 

Perin, D., & Greenberg, D. (1993). Relationship between literacy gains and length of stay in a basic education program for health care workers. Adult Education Quarterly, 3, 171-186.

 

Pressley, M. (2000). What should comprehension instruction be the instruction of? In M.L. Kamil, P.B. Mosenthal, P.D. Pearson, & R. Barr (Eds.), Handbook of reading research: Volume III (pp. 545-561). Mahwah, NJ: Erlbaum.

 

Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale, NJ: Erlbaum.

 

Pressley, M., & El-Dinary, P.B. (1997). What we know about translating comprehension strategies instruction research into practice. Journal of Learning Disabilities, 30, 486-488.


Pressley, M., Johnson, C. J., Symons, S., McGoldrick, J. A., & Kurita, J. A. (1989). Strategies that improve children’s memory and comprehension of text. Elementary School Journal, 90, 3-32.

 

Rosenshine, B., & Meister, C. (1994). Reciprocal teacher: A review of the research. Review of Educational Research, 64, 479-530.

 

Rosenshine, B., Meister, C., & Chapman, S. (1996). Teaching students to generate questions: A review of the intervention studies. Review of Educational Research, 66, 181-221.

 

Rumelhart, D. E. (1994). Toward an interactive model of reading. In R. B. Ruddell, M. R. Ruddell, & H. Singer (Eds.), Theoretical models and processes of reading, 4th edition. Newark, DE: International Reading Association.

 

Snow, C. E. (2002). Reading for understanding: Toward an R&D program in reading comprehension. Santa Monica, CA: RAND.

 

Snow, C. E., Burns, S. M., & Griffin, P. (Eds.). (1998). Preventing reading difficulties in young children. Washington, DC: National Academy Press.

 

Tan, A., & Nicholson, T. (1997). Flashcards revisited: Training poor readers to read words faster improves their comprehension of text. Journal of Educational Psychology, 89, 276-288.

 

Tan, A., Moore, D. W., Dixon, R. S., & Nicholson, T. (1994). Effects of training in rapid decoding on the reading comprehension of adult ESL learners. Journal of Behavioral Education, 4, 177-189.

 

 

Equipped for the Future Logo

Equipped for the Future
Performance Continuum
for Convey Ideas in Writing

Common Activities


In order to fulfill responsibilities

as parents/family members,
citizens/community members,

and workers, adults must be able to:

·   Gather, Analyze, and Use Information

·   Manage Resources

·   Work Within the Big Picture

·   Work Together

·   Provide Leadership

·   Guide and Support Others

·   Seek Guidance and Support From Others

·   Develop and Express Sense of Self

·   Respect Others and Value Diversity

·   Exercise Rights and Responsibilities

·   Create and Pursue Vision and Goals

·   Use Technology and Other Tools to Accomplish Goals

·   Keep Pace With Change

Convey Ideas In Writing Chart


Equipped for the Future

Convey Ideas in Writing Performance Continuum

PERFORMANCE LEVEL 1

Convey Ideas in Writing

 

How adults at Level 1  Convey Ideas in Writing:

 

Level 1 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 1 can:

·         Determine the purpose and audience for communicating in writing;

·         Follow a highly structured, externally developed plan (or text model) to organize information about self and/or related to immediate needs in very simple structures such as lists or responses to prompts for everyday information;

·         Write all letters of the alphabet and numbers and appropriately use simple, everyday, highly familiar words (personal names, signatures, addresses), numbers (dates, phone #s, addresses, prices, etc) and simple phrases to convey information with minimal attention to audience;

·         Make a few simple content changes based on review and feedback from others and make a few simple edits of handwriting, spelling, punctuation and capitalization.

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 1 can write individual words, simple phrases and a few very simple sentences slowly and with some effort and some errors. They can independently accomplish simple, well defined, and highly structured writing activities in a few comfortable and familiar settings.

 

Level 1 Examples of Proficient Performance

 

Adults performing at Level 1 can Convey Ideas in Writing to accomplish a variety of goals, such as:

 

 

 

 

 

 

Equipped for the Future

Convey Ideas in Writing Performance Continuum

PERFORMANCE LEVEL 2

Convey Ideas in Writing

 

How adults at Level 2 Convey Ideas in Writing:

 

Level 2 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 2 can:

·         Appropriately use mostly everyday, familiar vocabulary (such as words with personal significance and commonly-used adjectives, pronouns and prepositions) and simple sentence structures (such as simple and compound sentences and questions) in short paragraph form, lists, and responses to prompts with minimal use of detail or attention to audience; 

 

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 2 can write simple and a few compound sentences, sometimes in short paragraphs with some effort but with few errors to independently accomplish simple, well defined, and structured writing activities in a few comfortable and familiar settings.

 

Level 2 Examples of Proficient Performance

 

Adults performing at Level 2 can Convey Ideas in Writing to accomplish a variety of goals, such as:

 

 

 

 

 

Equipped for the Future

Convey Ideas in Writing Performance Continuum

PERFORMANCE LEVEL 3

Convey Ideas in Writing

 

How adults at Level 3 Convey Ideas in Writing:

 

Level 3 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 3 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 3 can write simple narrative, informative, or expressive texts of a few short paragraphs and steps/instructions/commands with some effort but with few errors. They can independently accomplish well-defined and structured writing activities for varied audiences (self, family, workplace, teacher) in a range of comfortable and familiar settings.

 

Level 3 Examples of Proficient Performance

 

Adults performing at Level 3 can Convey Ideas in Writing to accomplish a variety of goals, such as:

·         Writing an easy-to-read information booklet for young children

 

 

 

Equipped for the Future

Convey Ideas in Writing Performance Continuum

PERFORMANCE LEVEL 4

Convey Ideas in Writing

 

How adults at Level 4 Convey Ideas in Writing:

 

Level 4 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 4 can:

 

Show Fluency, Independenc e, and Ability to Perform in a Range of Settings

Adults performing at Level 4 can write coherent steps or a few well-constructed paragraphs easily and with few errors to independently accomplish well defined and structured writing activities for varied purposes (such for personal expression, to inform, to persuade or to complete a task) and audiences in a range of comfortable and familiar settings.

 

Level 4 Examples of Proficient Performance

 

Adults performing at Level 4 can Convey Ideas in Writing to accomplish a variety of goals, such as:

·         Writing a letter of appreciation or congratulations to a friend or relative

·         Writing comprehensive directions for a favorite recipe

·         Writing a response to a newspaper advice column to stimulate thinking about personal issues

·         Writing a brief story about a personal event for the company

·         Writing a short incident/accident report at work

·         Writing an agenda for an upcoming 3-hour meeting

 

 

 

Equipped for the Future

Convey Ideas in Writing Performance Continuum

PERFORMANCE LEVEL 5

Convey Ideas in Writing

 

How adults at Level 5 Convey Ideas in Writing:

 

Level 5 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 5 can:

·         Determine the purpose and audience for communicating in writing;

·         Select from and use a good store of tools and strategies for overall planning and organization; outline, restate, summarize and categorize ideas and produce a legible and comprehensible draft;

·         Appropriately use both everyday and specialized vocabulary including abstract nouns and idioms, and a variety of sentence structures, in medium-length, coherently-linked, and detailed text with appropriate tone, language, and level of formality and in modes of organization suitable for a variety of audiences;

·         Use a variety of strategies to analyze and make simple revisions (such as for clarity, organization, and descriptiveness) and to solve a few more global problems posed by the writing text (such as changes in voice or tone to take into account the needs of the audience or re-sequencing of larger pieces of text based on feedback from others);

·         Undertake multiple re-readings of text in order to edit for grammar, spelling, sentence structure, language usage, and text structure and use appropriate tools such as dictionaries and grammar guides.  

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 5 can write a variety of  texts that include more complex sentence structures and multiple paragraphs easily and with few errors for a wide variety of purposes (such as different kinds of expressive, persuasive and informative purposes). They can independently accomplish structured and fairly complex writing in a variety of familiar and some novel settings.

 

Level 5 Examples of Proficient Performance

 

Adults performing at Level 5 can Convey Ideas in Writing to accomplish a variety of goals, such as:

·         Writing a summary of information about the pros and cons of joining a labor unions to help someone make a decision about joining

·         Writing a detailed narrative accident/incident report for work

·         Writing a memo to employees about a guest speaker presentation on safety in the workplace

·         Writing a proposal/plan for a community group trip

·         Writing a short story for a child depicting what life was like when you were growing up

 

 

 

Equipped for the Future

Convey Ideas in Writing Performance Continuum

PERFORMANCE LEVEL 6

Convey Ideas in Writing

 

How adults at Level 6 Convey Ideas in Writing:

 

Level 6 Indicators

 

Use Key Knowledge, Skills, and Strategies

Adults performing at Level 6 can:

 

Show Fluency, Independence, and Ability to Perform in a Range of Settings

Adults performing at Level 6 can write a variety of sentences in medium-length, detailed text and in a variety of rhetorical forms, easily and with few errors, to independently accomplish structured or unstructured complex writing activities in a variety of familiar and novel settings.

 

 

Level 6 Examples of Proficient Performance

 

Adults performing at Level 6 can Convey Ideas in Writing to accomplish a variety of goals, such as:

·         Writing newspaper editorials that synthesize opposite stands on the same issue and develop a novel personal position on the issue

 


Equipped for the Future

Convey Ideas in Writing Performance Continuum

The table below shows the results of our mapping of performance levels for the EFF Content Standard Convey Ideas in Writing to the NRS Educational Functioning Levels:

EFF Convey Ideas in

Writing Performance Levels

Can be used to define an exit

point for the NRS ABE

Educational Functioning

Level . . .

Can be used to define an exit

point for the NRS ESL

Educational Functioning

Level . . .

Convey Ideas in Writing

Performance Level 1

Beginning ABE Literacy

Beginning ESL

Convey Ideas in Writing

Performance Level 2

Convey Ideas in Writing

Performance Level 3

Beginning Basic Education

Low Intermediate Basic

Education

Low Intermediate ESL

High Intermediate ESL

Convey Ideas in Writing

Performance Level 4

High Intermediate Basic

Education

Low Advanced ESL

Convey Ideas in Writing

Performance Level 5

Low Adult Secondary

Education

High Advanced ESL

Convey Ideas in Writing

Performance Level 6

High Adult Secondary

Education

 


Equipped for the Future

Convey Ideas in Writing Performance Continuum

How to read the EFF Convey Ideas in Writing Performance Continuum

The EFF Performance Continuum for Convey Ideas in Writing is a developmental description of performance on the Convey Ideas in Writing Standard. The continuum portrays development along four dimensions: the structure and depth of knowledge, and the fluency, independence and range of performance. The six EFF Levels described here are points along the continuum that serve as benchmarks for key stages in development and increasing ability to accomplish important activities in daily life that require adults to Convey Ideas in Writing.

 

The six levels of performance described in this document cover only a portion of the performance levels possible for Convey Ideas in Writing. There are aspects of writing development and performance that fall below the performance described in Level 1 and there are many levels of proficiency leading toward higher levels of expertise beyond the knowledge, skills, strategies, and performance descriptions at Level 6 on the Convey Ideas in Writing Performance Continuum.

 

The descriptions of performance at each level of the Convey Ideas in Writing Performance Continuum are anchored in analysis of data on adult learner performance. They were developed by analyzing data on use of the Convey Ideas in Writing Standard by adult learners in ABE programs (including adult literacy, adult English Speakers of Other Languages, family literacy, and adult secondary education). This empirical evidence of performance on the Convey Ideas in Writing Standard went through extensive analysis by research staff and was reviewed and amended by a panel of content experts. At each step in this process, cognitive science and writing theory and research were used to guide and refine the definition of performance criteria. The number of levels defined for the EFF Performance Continuum for Convey Ideas in Writing (six) was determined through analysis and review of data. Each level describes a qualitatively distinct stage in the development of proficiency on the standard. Each level builds on the previous levels. Thus, an adult who is able to perform at Level 3 also has mastered the performance on the standard described at Levels 1 and 2.

 

Each performance level on the Convey Ideas in Writing Performance Continuum is described on a single page in this document. Each page is divided into four sections:

 

Section 1 is the definition of the Standard. The performance-level description starts with the components of performance of the standard. These components define the content standard and they remain the same at each level of performance. This repetition serves as a reminder that the integrated skill process defined by the components of performance for each standard is constant across all levels, from novice to expert levels of performance. What changes from level to level is the growth and complexity of the underlying knowledge base and the resulting increases in fluency and independence in using the standard to accomplish an increasing range and variety of tasks.

 

This definition of the standard is a useful tool for communicating to adults and their teachers the essential features of the construct, or set of targeted abilities, for each standard. By making it

 


clear how the skill process is defined (or “unmasking the construct,” as described by Gitomer & Bennett, 2002), adult learners are better able to articulate their own learning goals for improving proficiency and teachers are better able to focus learning and instructional activities that build toward the goal of increasing ability to use the standard to accomplish everyday activities. Here is how the standard is defined for all performance levels of Convey Ideas in Writing:

·  Determine the purpose for communicating.

·  Organize and present information to serve the purpose.

·  Pay attention to conventions of English language usage, including grammar, spelling, and sentence structure, to minimize barriers to reader’s comprehension.

·  Seek feedback and revise to enhance the effectiveness of the communication.

 

Section 2 is a list of key knowledge, skills and strategies that can be observed in proficient performance at that level. These are the primary indicators (or benchmarks) of the growth and organization of the knowledge base needed for proficient performance on the standard at each level. This list is thus of central importance for designing assessments to measure performance on the standard. Because the performance levels are designed primarily as guides for assessment and not as a curriculum framework, the list does not specify details of knowledge, skills, and strategies that might be studied and taught. Nonetheless, the list can serve as a way of identifying instructional objectives for each level and provides a guide for developing criteria for placement of learners in instructional levels.

 

Because this list of key knowledge, skills, and strategies focuses only on those features of performance that indicate qualitative changes in what a learner knows and can do, it can be used by curriculum developers and instructors to set instructional objectives for each level and to develop more detailed curricula or learning plans that will prepare learners to develop these abilities, meet the criteria, and move on to the next level in their development of expertise.

 

Section 3 defines the fluency, independence and ability to perform in a range of settings expected for proficient performance on the standard at each level. Together with the descriptions of key knowledge, skills, and strategies, these descriptions serve as the primary behavioral indicators (benchmarks) of proficient performance at each level. As such, section 3 descriptions also provide a basis for designing learning, instruction and assessment that is appropriate to that level.

 

Section 4 of the performance level descriptions provides a short list of examples of the writing purpose (writing activities) that can be accomplished by an adult who is performing at each level. Like Sections 2 and 3, the descriptions of writing activities in Section 4 are specific to each performance level. These examples of things that adults can accomplish in the real world at each level of performance are useful to adult learners and to their teachers as ways of making concrete the purpose and need for attaining increasing proficiency in writing. By making it clear what can be accomplished at each level, the descriptions of writing activities in Section 3 also provide motivation for higher levels of learning. The listing of real-world accomplishments also provides guidance for selecting and designing the content for instructional materials and assessments.


Equipped for the Future

Convey Ideas in Writing Performance Continuum

What are the Guides to Using the EFF Performance Continua?

The EFF Assessment Resource Collection contains guides to ten of the EFF performance continua (http://eff.cls.utk.edu/assessment/guides.htm). The purpose of each guide is to introduce you to one of the EFF performance continua and show you how to use it to plan for instruction and for classroom-based assessment. Since accountability assessments on the standard will be based on the same performance continuum, the guide may also help you to better understand what to expect once a performance assessment process based on the standard is in place.

The EFF Continua of Performance are multidimensional, developmental descriptions of performance on the EFF Content Standards. They allow for descriptions of performance ranging from the novice level to the expert level. Currently the descriptions of performance describe from three to six levels each beginning with a novice level and extending to levels that correlate with exit points for adult basic education. Each continuum is built around the four EFF Dimensions of Performance, and performance levels are defined by identifying key features of performance at various points along the continuum. The performance continua make up one part of the EFF Assessment Framework.

How Can I Use the Guides?

Currently guides are available for 10 of the 16 EFF standards. Each guide contains a description of the standard and a two-page chart showing the performance continuum itself. The guide also includes: 1) information to help you understand how to read the continuum; 2) tools for lesson planning and assessment; 3) a scenario describing how one teacher used these tools; 4) information on the research basis for the standard; and 5) tips for where to go for more information. Some of the tools are available as Word documents to allow you to adapt them to your needs. You can get to each guide by clicking on the following link: http://eff.cls.utk.edu/assessment/guides.htm

Where Can I Find Examples of Completed Planning Guides?

The guides for each of the standards also contain scenarios describing how a teacher used the performance continuum for the standard along with lesson planning and assessment tools to prepare lesson plans. Embedded within each of the guides are excerpts from completed 1 page planning guides based on the scenarios. You will find the full 1 page versions of the completed planning guides for 10 standards here: http://eff.cls.utk.edu/assessment/planguides.htm.


Equipped for the Future

Convey Ideas in Writing Performance Continuum

Notes on the Research Base for the Convey Ideas in Writing Performance Continuum and Performance Levels

Writing is sometimes referred to as the “neglected ‘R’” because the emphasis on developing reading and math skills has often caused writing instruction to be overlooked. Yet, the National Commission on Writing in America’s Schools and Colleges has observed “writing today is not a frill for the few, but an essential skill for the many” (National College Board, April 2003). They point out the importance of preparing students in writing for success in the workplace, for retention in postsecondary education, and for full access to the benefits of information technology. Teaching writing helps learners develop awareness of audience and of effective communicative style and technique. Writing is a thinking process and as such it is a vital tool in helping learners in developing skills such as reading, math, speaking and listening. Although there is little research on the teaching of writing to adult basic education learners, there is a strong and solid research base for the teaching of writing in general, including the teaching of writing to adult remedial postsecondary students, a population not entirely unlike adult basic education learners. There is also a growing body of research on the teaching of writing to ESL learners. We offer this review of the research basis for the EFF standard Convey Ideas in Writing with the recommendation that serious consideration be given to including writing as one of the key standards for adult learning supported by the U.S. Department of Education.

 

Teachers of adult basic education often have not had access to training that might allow them to understand the differences between the teaching of writing skills (often referred to as language arts) alone and the teaching of writing as a cognitive problem solving and meaning making process that includes the teaching of skills within a broader framework. The Convey Ideas in Writing standard describes a developmental pathway that includes key aspects of the writing process shown by research to be important, including three cognitive writing processes: planning (deciding what to say and how to say it), text generation (turning plans into written text), and revision (improving existing text) (Hayes, 1996).

 

Each level of the standard describes key developmental benchmarks related to knowledge of the writing process and the development of writing skills and strategies. As adults move from being novice writers along the continuum toward becoming expert writers, their increasing capabilities enable them to interact with increasingly complex genres of writing to accomplish increasingly demanding writing activities (in an increasingly wide range of contexts). The descriptions of

·        Key Knowledge, Skills, and Strategies;

·        Fluency, Independence, and Ability to Perform in a Range of Settings; and

·        Variety of Writing Purposes

that can be accomplished at each of the six performance levels on the Convey Ideas in Writing continuum are guides for learning and instruction for adults who are striving to improve their proficiency in writing.

 

As with the other standards, the core definition of the standard applies to each level of the continuum. At each level, the skill process that is being described is one that begins with determining the writing purpose and ends with seeking feedback and revising to enhance the effectiveness of the communication. New skills and knowledge and higher levels of ability to


63

Equipped for the Future

Convey Ideas in Writing Performance Continuum

apply planning and revision strategies are added as students move along the continuum and become more fluent and independent writers. These core elements of the EFF Performance Continuum — developmental descriptions of the capabilities of writers interacting with increasingly complex texts to accomplish increasingly demanding writing activities — align very well with evidence-based definitions of writing.

 

Support for the Continuum and Performance Levels in Research on the Writing Process

Compared to reading research, research on how people develop as writers is still in its infancy. Until as late as thirty years ago, many researchers and educators assumed that there was essentially one process of writing that served all writers for all their various purposes. Writers decided on what to write in advance and primarily worked alone. The attention of most research and education was directed toward how to evaluate the final products of writing. Starting in the 1970’s, however, research on the cognitive process of writing and later on the sociocultural dimensions of writing has begun to create a foundation of research-based understanding of how individuals develop as writers (Indrisano & Squire, 2000). In 1980, Flower and Hayes first proposed a “working model” of the writing process based on a synthesis of the findings from existing empirical studies of composing practices.


 


 


Equipped for the Future

Convey Ideas in Writing Performance Continuum

As shown in the writing process model above, Flower and Hayes (1980) suggest three cognitive writing processes: planning (deciding what to say and how to say it), text generation (turning plans into written text), and revision (improving existing text). The flow of the skill process depicted in this model parallels the description of the integrated skill process defined in the components of performance of the EFF Standard Convey Ideas in Writing:

Determine the purpose for communicating.

Organize and present information to serve the purpose, context, and audience.

Pay attention to conventions of English language usage, including grammar, spelling, and

sentence structure, to minimize barriers to reader’s comprehension.

Seek feedback and revise to enhance the effectiveness of the communication.

 

Like the EFF Standard, the Hayes-Flower writing process model starts with definition of the writing purpose (with the “Writing Assignments” defined in terms of topic, audience, and motivating cues (reason for the communication) and continues through an iterative cycle of organizing and presenting information (planning and text generation in the Hayes-Flower model), drawing on prior knowledge of language structure and use (long-term memory in the Hayes-Flower model) and revision to enhance the effectiveness of the communication.

 

A key premise of the Hayes-Flower model is that writing is hierarchically organized and that it is, above all, a goal-directed, problem-solving process (Flower & Hayes, 1980). Whenever a person writes, he or she poses a problem to be solved on multiple levels. To solve the problem, the writer must set up sub-goals and solve sub-problems. For example, a woman writing a letter to her child’s school must determine her goal for writing the letter and her sub-goals for making sure she has covered all the issues she wants to address. She also has to solve sub-problems related to how to form the letters on the page and how to spell unfamiliar words. She may do a little planning, begin to write, stop and plan a bit more, interrupt her planning to consult a dictionary, spend some time worrying about her handwriting, pause to talk to a friend about her child’s problem, re-read and revise what she has written, and so forth. As writers gain experience, many of the lower-level processes (such as forming letters and spelling) become automatic and unconscious. Other processes require planning and skill no matter how experienced the writer is (Flower and Hayes, 1980; Dyson & Freedman, 1991 as cited in Gillespie, 2001)

 

As the writing process model developed by Hayes and Flower has evolved, it has become considerably more complex. More recent research has shown that the planning, text generation, and revision processes identified in the Hayes-Flower model (and reflected in the Convey Ideas in Writing components of performance) do not occur in any fixed order but proceed in an organized way that is largely determined by the individual writer’s goals (Dyson & Freedman, 1991). At one moment writers can be observed to be writing, moving their ideas and their discourse forward; at the next they can be seen to be backtracking, re-reading, and digesting what has been written. Dyson and Freedman’s description of these processes as recursive, with sub-processes such as planning and editing often interrupting each other, represented an important shift in the understanding of the writing process. Also, new detailed research on memory has led Hayes to extend and expand the role of working memory in his most recent revision of the writing process model (1996).


Equipped for the Future

Convey Ideas in Writing Performance Continuum

We now understand that our short-term memory storage capacity is limited (Torrance & Jeffery, 1999) and, as result, any cognitive process that is not automated must be retrieved from our long-term memory by our working memory before it can be used to solve problems or make decisions.

 

An adaptation of the Hayes-Flower model of composing has made its way into the classroom as the “writing process approach.” This writing process approach, teaching writing as a thinking and problem-solving process, is easily aligned with the integrated skill process defined by the EFF Standard Convey Ideas in Writing.

 

Support for the Continuum and Performance Levels in Research Contrasting Novice and Expert Writers

During the 1980’s, researcher added to our understanding of the writing process through research on the differences between novice and expert writers. Bereiter and Scardamalia (1987), for example, found through their research that less skilled writers produce much less elaborate and more abstract sets of prewriting notes. Novice writers concern themselves with generating content during composing and spend much less time considering goals, plans, and problems posed by the writing. Bereiter and Scardamalia (1987) found that less-experienced writers, when beginning to compose texts, needed to keep the task relatively uncomplicated in order to direct their working memory to the basic task of converting oral language experiences into written form. Until these lower-level processes of putting text on the page become automatic, writers are less able to focus on the kinds of higher-level processes needed for making global revisions. For beginners, the primary goal is to tell someone what they have retrieved and to translate this into letters, words, and sentences. These strategies work especially well, for example, when recounting a personal story where coherence can easily be created by following a basic chronology.

 

Processes for planning, generating language at the sentence and text levels, and reviewing and revising written text are considered higher-level processes (Berninger & Swanson, 1994). For beginners, “the goal is to automatize the lower-level processes so that working memory resources are freed for the higher-level constructive aspects of composing” (Berninger et al., 1998, p. 652). Increasingly, researchers are seeking to better understand how these lower-level processes can best be acquired within the context of composing.

 

As writers become more expert, more of their attention is directed to problem analysis and goal setting. The resulting goals, and the problems anticipated, lead to plans for how to resolve them, whether they are problems of content or problems concerning the best way to organize the narrative in light of previously presented information and the audience to be addressed (rhetorical problems). As one problem is solved, others are created, and in this way new content is generated or new ideas about how to organize the ideas are developed. As solutions to problems are formed, they feed into the knowledge-telling component of the process and are written down. Bereiter and Scardamalia (1987) argued that the writer’s effort to resolve content and rhetorical problems by moving between these “problem spaces” invokes a dialectical process that allows for more reflection.


Equipped for the Future

Convey Ideas in Writing Performance Continuum

Of particular interest to adult literacy educators has been a body of research that began to focus on remedial writing at the postsecondary level. In Errors and Expectations (1977), Mina Shaughnessy detected predictable patterns in the kinds of the errors made by “basic writing” students. She showed that under-prepared students write the way they do “not because they are slow or non-verbal, indifferent to or incapable of academic excellence, but because they are beginners and must, like all beginners, learn by making mistakes” (1977, p. 3).

 

Sondra Perl (1979) found that adult remedial students she studied might begin to follow a train of thought as they wrote but then lost it when they had to interrupt their thoughts to attend to more mechanical concerns, such as letter formation, punctuation, and spelling. Mike Rose (1980) investigated more closely the experiences of basic writers with writer’s block. He found that writers were blocked because they followed a set of rigid rules, applying them to situations where they did not apply. Nancy Sommers (1980) found that basic writers typically solved problems simply by rewriting, without analyzing the problems with their text. Flower (1979) found that while writing, expert writers thought about their reader more than did novice writers. This helped them to plan their essays and generate text. Beginning writers, on the other hand, wrote what she called “writer-based prose.” They did not think about their reader while writing but were concerned primarily with the text. Taken together, these studies showed that to move from the status of a basic to a more expert writer, students had to learn to revise what they wrote, to consider the reader in their planning, and to attend to more global problems, such as re­sequencing and rewriting units of text.

 

Reflections of Writing Research in Convey Ideas in Writing Key Knowledge, Skills, and Strategies

 

The findings of the research summarized above are reflected in the “Key Knowledge, Skills, and Strategies” sections of the Convey Ideas in Writing Standard. In Level 1, for example, students are provided with considerable scaffolding to help them with the planning process. They are expected to convey information with only minimal attention to the audience since it is understood that their “working memory” will be devoted to text production. The requirements for revision and editing are minimal and focus primarily on text level features.

 

 

 

Excerpt from Convey Ideas in Writing Performance Continuum—Level 1

· Follow a highly structured, externally developed plan (or text model) to organize information about self and/or related to immediate needs in very simple structures such as lists or responses to prompts for everyday information;

· Write all letters of the alphabet and numbers and appropriately use simple, everyday, highly familiar words (personal names, signatures, addresses), numbers (dates, phone #s, addresses, prices, etc) and simple phrases to convey information with minimal attention to audience;

· Make a few simple content changes based on review and feedback from others and make a few simple edits of handwriting, spelling, punctuation and capitalization.

 

 

By Level 3 students can be expected to have learned how to use simple planning processes and to have begun to develop their rereading and revision skills.

 

Excerpt from Convey Ideas in Writing Performance Continuum—Level 3

· Use simple planning strategies to identify and organize a limited number of ideas to support a single purpose (to convey personal experience, meet a specific need or respond to recent learning), and produce a legible and comprehensible draft

· Appropriately use mostly familiar vocabulary based on personal experience and learning, and basic text structure of simple steps/instructions/commands or a few short, well- linked paragraphs to convey ideas, with several supporting details/examples reflecting some attention to audience

· Use simple revision strategies to monitor effectiveness by rereading and revising during the writing process and making revisions to a first and final draft based on review and feedback from others. Demonstrate beginning attention to clarity, descriptiveness, personal voice and appropriateness of text for the intended audience.

· Make several simple edits of grammar (such as simple tense agreement), spelling and punctuation (such as periods, capital letters, and some commas), sentence structure (such as