ࡱ> ~ =bjbjqq .ee5+?????SSS8TS625555555$C795?5??5??5514<)֠Sl2|55062g:pLg:44g:?4t55(6g: : ASSESSMENT REPORTENGLISH MAJOR Academic Year 2010-2011 (Submitted November 2011) Brief Summary of Assessment Plan The assessment plan for the English major includes the following Goals and Outcomes: Goal #1: Knowledge of Literary Works Outcomes: Students should be able to Identify major authors and literary works within the Anglo-American tradition Identify major authors and literary works within other literary traditions Position literary works within cultural and intellectual history Compare and contrast literary works within cultural and intellectual contexts Goal #2: Literary Analysis Outcomes: Students should be able to Classify literary works by genre Identify the elements of literature 3. Read critically and creatively 4. Interpret literary works from an individual perspective Goal #3: Major theories of language/literature studies Outcomes: Students should be able to Explain major theories of language and literature Differentiate among major theories Apply critical theory to literary works Goal #4: Communication Outcomes: Students should be able to Write in genres typical of the field Exhibit accuracy in writing conventions Contribute to oral discussions Use appropriate technologies Goal #5: Research Methods Outcomes: Students should be able to Locate appropriate resources Evaluate the usefulness/credibility of resources Synthesize information from various sources Integrate research with literary analysis The English faculty chose items from all five of the goals above to assess for 2010-2011: Goal #1 (Outcomes 1-4), Goal #2 (Outcomes 1-4), Goal #3 (Outcomes 1-3), Goal #4 (Outcomes 1-2), and Goal #5 (Outcomes 1-4). The Outcomes under Goal #3 are being assessed for the first time this year. The other goals and outcomes have been assessed in previous years. Please note that the Outcomes assessed in Goal #5 apply to the location and appropriateness of resources, the application of literary knowledge and interpretation to writing, and the use of resources in students papers. Assessment Methods The Goals mentioned above were assessed in the following manner: Goal #1 (Outcomes 1-4) The English faculty chose to administer the ETS Major Field Examination: Literature in English to English majors nearing graduation. Four seniors took the online version of the examination under controlled circumstances in the Testing Center in April 2011. The course ENG-L495 Senior Seminar, a required capstone seminar for seniors, served as the starting point for identifying students, informing them about the examination, and scheduling test times. Students took the examination in a two-hour period using the ETS guidelines and were proctored by Testing Center and faculty personnel. Students were scheduled where possible in groups, but those students who could not attend the scheduled times were allowed to schedule individually as per the guidelines of the ETS examination online. Students received their total score and subscores immediately upon completion of the exam. They also received information on national percentiles for individual scores. The statistical reports included in a later section of this report contain information for the one cohort that was completed in 2011 (four students). Note that the cohort was sufficiently small that ETS was unable to provide statistics on the eight institutional assessment indicators. The ETS Major Field Examination: Literature in English contains 150 multiple-choice questions covering major works of poetry, prose, and drama in British and American literature. Some questions require the student to read a passage or a complete short work and answer questions on genre, elements of literature, literary history, and interpretation. A small portion of the examination covers works of literature from outside the Anglo-American tradition. The examination provides subscores in the following four areas: Literature 1900 and Earlier, Literature 1901 and Later, Literary Analysis, and Literary History and Identification. This examination is a nationally prepared examination which provides comparisons to students and departments across the United States. It is intended to assess student knowledge at the undergraduate level, and, unlike the Graduate Record Examination, is not meant as an entry examination for graduate school. The CTLA at Indiana University Kokomo subsidized the examination. The Coordinator of English ordered, scheduled, and administered the examination and analyzed the results. Our benchmark for our majors is to meet or exceed the individual national mean and median for all departments using the examination and for the department as a whole to meet or exceed the national institutional means and medians for the total score and the four subscores. Goal #3 (Outcomes 1-3) Goal #3 assesses students understanding of language theory and literary theory and their ability to apply critical theory to literary works. This year is the first year that we have assessed this goal. These outcomes were assessed by looking at examinations and papers created in ENG-L371 Critical Practices. All English majors take L371 as a required course in the major, usually in the spring of their junior or senior years. Assessment is done by the faculty member teaching the course in the form of individual grades on the papers and examinations and the overall course grade. This year eleven English majors enrolled in ENG-L371. Their course grades included two As, two A-s, one B+, two Bs, two B-s, one C, and one C-. Based on the assessment of the course instructor, all of the students showed the ability to understand critical theory and to apply it to literary analysis. Goal #4 (Outcomes 1-2) Goal #5 (Outcomes 1-4) To assess both Goal # 4 and Goal #5 listed above, the department continued to use its previous assessment tool of requiring all English majors in ENG-L495 Senior Seminar to provide a portfolio of three papers from their previous English courses: a literary interpretation, a research paper incorporating sources and using the MLA documentation system, and a third paper from ENG-L371 Critical Practices. These papers provide evidence of students ability to write in genres typical of the field, exhibit accuracy in writing conventions, locate appropriate sources, evaluate the credibility and usefulness of sources, synthesize information, and integrate research with literary analysis. These papers also provide information about applying critical theory to literary works. This final goal is also assessed through Goal #3 (see above). The English faculty developed a rubric by which to assess the six areas expressed in the outcomes above. All six resident English faculty members read all of the portfolios and assigned each area a score of Good, Fair, and Inadequate (a score of 1-3 with 3 being the highest). Each portfolios scores were averaged to arrive at a total score for the portfolio. Goal #2 (Outcomes 1-4) These outcomes were assessed by looking at examinations and papers created in ENG-L202 Literary Interpretation. All English majors take L202 as a required introduction to the major, preferably in their freshman or sophomore years. Assessment is done by the faculty member teaching the course in the form of individual grades on the papers and examinations and the overall course grade. One sample paper from the course is collected for each English major. This year eight English majors enrolled in ENG-L202. Their course grades included one A, one A-, three B+s, two Bs, and one FN. Papers were collected from all of the students. Based on the assessment of the course instructor, all of the collected papers showed good ability to write short (2-3 pp.) papers of literary interpretation. The student receiving the FN completed a satisfactory paper in the course, but stopped attending and did not complete the course. Description of Assessment Results Results for the ETS Major Field Test: Literature in English Official scores for the four students who took the exam and who are within the closed cohort are attached. These scores occur within a range of 120-200 and were based on seniors taking the exam nationally from August 2005 to June 2011. Table 1 below shows the percentile results for our four students (all seniors) based on the national data: Table 1. Individual scores and percentiles 16468%15855%15141%14732% Tables 2 and 3 below show the mean and median scores for individual student scores (aggregated): Table 2. Individual scoresmeans and medians IU Kokomo meanNational meanIU Kokomo medianNational median155154.4154.5155 These individual scores represent an increase of 4 points in the IU Kokomo mean and 6.5 points in the IUK median over AY 2009-2010. These scores place IU Kokomo in the 48th percentile nationally in terms of individual student mean scores, an increase from last years score in the 40th percentile. This years scores meet the departmental goal of having a departmental mean score that equals or exceeds the national average. These individual scores do not meet our benchmark for Goal #1 that 60% of our students score at or above the national average (50% of our students scored above the national average). This is, however, an increase over last years 20% of students who met the benchmark. The department has met its benchmark in three of the last five years. In addition to comparisons of individual student scores to national individual student scores, the following tables provide information about the overall institutional scores nationally for the total scores and the four subscores. Table 3. Institutional mean score (total score) IU Kokomo meanNational Institutional Percentile15548% Table 4. Institutional scores (four subscores) IU Kokomo meansNational Institutional PercentileSubscore 1: 5654%Subscore 2: 5231%Subscore 3: 5963% Subscore 4: 4518% Please see the previous discussion for the identification of the four subscore areas. These scores represent increases in three of the four subscores. Subscore 1 increased from 54 to 56 and from 45th percentile to 54th. Subscore 2 increased from 46 to 52 and from 30th percentile to 31st. Subscore 3 increased from 51 to 59 and from 51st percentile to 59th. Subscore 4 decreased from 48 to 45 and from the 30th percentile to the 18th. As has been true in previous years, subscore 4 (Literary History and Identification) was our lowest-scoring area as a whole this year. Results for the Portfolio Evaluations: Results from the four student portfolios from our assessment are listed below: Table 7. Portfolio Evaluation Results (from highest to lowest on a 3-point scale) StudentPortfolio AverageStudent #12.95Student #22.90Student #32.76Student #42.70 This years portfolios clearly showed papers that more intentionally worked with literary theory, probably as a result of students completing the requirement of ENG-L371 Critical Practices, which only became a requirement in fall 2006. The portfolio results showed that all of the students were performing in the Good range (see rubric below), higher than last year. The mean score for all portfolios was 2.83, higher than the previous years mean of 2.57. English Major Assessment Rubric (Goals 4 and 5) Circle the evaluation that best describes the overall portfolio. Goal 4.1 Write in genres typical of the fieldGoal 4.2 Exhibit accuracy in writing conventionsGoal 5.1 Locate appropriate resourcesGoal 5.2 Evaluate the usefulness/credibility of resourcesGoal 5.3 Synthesize information from various sourcesGoal 5.4 Integrate research with literary analysisGoodGoodGoodGoodGoodGood FairFairFairFairFairFair InadequateInadequateInadequateInadequateInadequateInadequate  Using Assessment for Program Improvement As indicated in the ETS results (both total scores and subscores), this years smaller cohort of students performed at a higher level on the ETS examination than last years students. This years cohort also represented an increase in the scores on the portfolio assessment. Students have posted strong scores in four of the last five assessment cycles. The exam also provides valuable individual information to students because they receive their scores immediately after completing the test, along with information about national norms for individual scores. The faculty will also be able to use this information to focus more on literary history. Our results from the portfolio evaluation indicate that, while faculty are providing students with a wide range of experiences with resources, we might benefit from targeting the integration and documentation of resources that are central to the field and making certain that particular courses within the curriculum include explicit instruction and exercises pertaining to these abilities. Next years goals include adding Goal #4.4 for assessment and establishing a benchmark for the portfolios. April 2012 will also require a new three-year assessment plan to continue for 2012-2014. Dissemination of Results This report has been distributed to resident English faculty, the Chair of Humanities, the Dean of Arts and Sciences, and the Assessment Committee. The complete assessment report is posted on the Arts and Sciences website, and a summary paragraph with a link to the complete report is posted on the CTLA website. Students receive scores on the ETS examination immediately after completing the test. Students may also access the assessment report at the SOAS website.      PAGE \* MERGEFORMAT 6  79KPQRt` d  +E]u79,0lmoexȺhrih# h h$ChHzhBO5hHzh\hhQh_ h hC- h hBO h hQvh h\5 hh5 h_ 5 hnfhQv5B*CJ,aJ,ph hC5h hQv58 RSt j D E ` o : ; s ^gdQv & FgdQv^gdQv & FgdQvgdQvgdC-   5 B `   / L } ,mogdC- & F gdQv & FgdQv^gdQvgdQv & FgdQvohivwsuT#U#l#k% ' '-'.'gdC-gd_ gd$CgdQvx>LM~GQqegh/1 $+,DUpOP|2h_ h_ B*phh hCh$ChC h_ h;nh' h h$Chri h h;nh\hhQ{H h hSw=hHzh#h_ Cvw &*qtuv!9N 6 8 1!))))y)z)))))))||||||pppp $$Ifa$gd&Bgd-_}kd$$Ifl04 T t0644 latyt ))))))^RRRR $$Ifa$gd kdt$$Ifl\:," t0644 layt ))),,-----.^YYYYYYYYYgd-_kd $$Ifl\:," t0644 layt ++(+?+}+++++++++%,',(,,,H,e,o,q,u,{,~,,,,,,------------....%.&.G.H.I.J.K.L.M.O.P.Q.þheihGhb5 hbhbhb hh5 h{R5 hb5h h{R5 h{5 h~5h9]lh{B*phhCh=ch{hZHh!H;h\hgJh9]lhbhgJhgJH*8..&.H.I.M.Q.s{kd$$Ifl0,"LL t0644 laytG $$Ifa$gdGgd-_Q.R.S.T.....ss $$Ifa$gdGgd-_{kd#$$Ifl0,"LL t0644 laytGQ.R.T.]...................//&/'/(/)/*/,///0////////0 0;0=0N0P0Q0000000000000 1 1a1k1l1m1n1صصصذذصجصԬԥ hChxh h"H*h!h!H*hCh! hbhbhbhTheih"hv\%hbh{R hb5 hv\%5 hb5hGhb5@....xl $$Ifa$gdG $$Ifa$gd"{kd$$Ifl0,"LL t0644 laytG....xl $$Ifa$gdG $$Ifa$gdb{kd-$$Ifl0,"LL t0644 laytG.../xl $$Ifa$gdG $$Ifa$gdb{kd$$Ifl0,"LL t0644 laytG//*/./{o $$Ifa$gdG $Ifgdb{kd7$$Ifl0,"LL t0644 laytG.///0/m1p11111;2<2D2V2wkk $$Ifa$gdG$a$gdxgd-_{kd$$Ifl0,"LL t0644 laytG n1o1p1t111111111292<2C2D2U2W2`2a2b2d2f2g2h2q2r2s2u2w2x2y222222222222222233333333 4 4464D4d4f4୸୸୸୸ʹh>) hb5 hdhxhdhGhx5hGhd5 hd5hb h hxhxh!h" h h-_ hx5hxh-_5hhh>V2W2b2g2uu $$Ifa$gdG}kdA$$Ifl0,"LL t0644 laytGg2h2s2x2ui $$Ifa$gdR $$Ifa$gdG}kd$$Ifl0,"LL t0644 laytGx2y222uu $$Ifa$gdG}kdU$$Ifl0,"LL t0644 laytG2222uu $$Ifa$gdG}kd$$Ifl0,"LL t0644 laytG222g4h4i4j4k4l4m44444||wrrrrrrrrrgdbgdQvgd-_}kdi $$Ifl0,"LL t0644 laytG f4g4h4m44466'6(6G6H6666666666777O7n7q7r778:9C9D9H9r99:::::::9;Q;X;;;;;<ȽȵȒȆȞ~h' hVhyzahMhdhhhCh~h"h h hL*h hb 5h hQv5hP8hbOJQJhbh;AhbOJQJhbOJQJh?Chb5OJQJh\5OJQJ hQv5 h hb 1445?5H5e5n55556 $IfgdI7 66 6665,,, $IfgdI7kd $$Iflֈ 7","F<F<F<F<F<F< t0644 lBaytI766!6&6'6 $IfgdI7'6(6-626765,,, $IfgdI7kd $$Iflֈ 7","F<F<F<F<F<< t0644 lBaytI776<6A6F6G6 $IfgdI7G6H6S6^6i65,,, $IfgdI7kd $$Iflֈ 7","F<F<F<F<F<< t0644 lBaytI7i6t6666 $IfgdI766666500+gdC-gdbkdx $$Iflֈ 7","F<F<F<F<F<< t0644 lBaytI766G9H9;;;;===============$a$gd gd;AgdwXgdQvgdC-gdb < <(<=<A<===================hVmHnHujh' UhjhUhb5OJQJhzshbhwXh' h hb ,1h/ =!"#$% $$Ift!vh5 5T#v #vT:V l t065 5Tatyt $$Ift!vh5 5T#v #vT:V l t065 5Tatyt $$Ift!vh5 5T#v #vT:V l t065 5Tatyt $$Ift!vh5 5T#v #vT:V l t065 5Tatyt $$If!vh5555#v:V l t065yt $$If!vh5555#v:V l t065yt $$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5L5L#vL:V l t065LytG$$If!vh5 5j5/55R5 #v #vj#v/#v#vR#v :V l t065</ BytI7$$If!vh5 5j5/55R5 #v #vj#v/#v#vR#v :V l t065</ BytI7$$If!vh5 5j5/55R5 #v #vj#v/#v#vR#v :V l t065</ BytI7$$If!vh5 5j5/55R5 #v #vj#v/#v#vR#v :V l t065</ BytI7^ 002 0@P`p2( 0@P`p 0@P`p 0@P`p 0@P`p 0@P`p 0@P`p8XV~_HmH nH sH tH @`@ NormalCJ_HaJmH sH tH DA D Default Paragraph FontRi@R  Table Normal4 l4a (k (No List jj zs Table Grid7:V06U6 zs Hyperlink >*B*ph44  0Header  H$6!6  0 Header CharCJaJ4 @24  0Footer  H$6A6  0 Footer CharCJaJPK![Content_Types].xmlj0Eжr(΢Iw},-j4 wP-t#bΙ{UTU^hd}㨫)*1P' ^W0)T9<l#$yi};~@(Hu* Dנz/0ǰ $ X3aZ,D0j~3߶b~i>3\`?/[G\!-Rk.sԻ..a濭?PK!֧6 _rels/.relsj0 }Q%v/C/}(h"O = C?hv=Ʌ%[xp{۵_Pѣ<1H0ORBdJE4b$q_6LR7`0̞O,En7Lib/SeеPK!kytheme/theme/themeManager.xml M @}w7c(EbˮCAǠҟ7՛K Y, e.|,H,lxɴIsQ}#Ր ֵ+!,^$j=GW)E+& 8PK!Ptheme/theme/theme1.xmlYOo6w toc'vuر-MniP@I}úama[إ4:lЯGRX^6؊>$ !)O^rC$y@/yH*񄴽)޵߻UDb`}"qۋJחX^)I`nEp)liV[]1M<OP6r=zgbIguSebORD۫qu gZo~ٺlAplxpT0+[}`jzAV2Fi@qv֬5\|ʜ̭NleXdsjcs7f W+Ն7`g ȘJj|h(KD- dXiJ؇(x$( :;˹! I_TS 1?E??ZBΪmU/?~xY'y5g&΋/ɋ>GMGeD3Vq%'#q$8K)fw9:ĵ x}rxwr:\TZaG*y8IjbRc|XŻǿI u3KGnD1NIBs RuK>V.EL+M2#'fi ~V vl{u8zH *:(W☕ ~JTe\O*tHGHY}KNP*ݾ˦TѼ9/#A7qZ$*c?qUnwN%Oi4 =3ڗP 1Pm \\9Mؓ2aD];Yt\[x]}Wr|]g- eW )6-rCSj id DЇAΜIqbJ#x꺃 6k#ASh&ʌt(Q%p%m&]caSl=X\P1Mh9MVdDAaVB[݈fJíP|8 քAV^f Hn- "d>znNJ ة>b&2vKyϼD:,AGm\nziÙ.uχYC6OMf3or$5NHT[XF64T,ќM0E)`#5XY`פ;%1U٥m;R>QD DcpU'&LE/pm%]8firS4d 7y\`JnίI R3U~7+׸#m qBiDi*L69mY&iHE=(K&N!V.KeLDĕ{D vEꦚdeNƟe(MN9ߜR6&3(a/DUz<{ˊYȳV)9Z[4^n5!J?Q3eBoCM m<.vpIYfZY_p[=al-Y}Nc͙ŋ4vfavl'SA8|*u{-ߟ0%M07%<ҍPK! ѐ'theme/theme/_rels/themeManager.xml.relsM 0wooӺ&݈Э5 6?$Q ,.aic21h:qm@RN;d`o7gK(M&$R(.1r'JЊT8V"AȻHu}|$b{P8g/]QAsم(#L[PK-![Content_Types].xmlPK-!֧6 +_rels/.relsPK-!kytheme/theme/themeManager.xmlPK-!Ptheme/theme/theme1.xmlPK-! ѐ' theme/theme/_rels/themeManager.xml.relsPK] 5  ***-x ')+Q.n1f4<=#$%)-06<F o.') )))).Q...././V2g2x222466'676G6i666= !"&'(*+,./12345789:;=>?@ABCDE $&-!8@0(  B S  ? JS%%x&&&&&&&&''v'~''''' ((S([((( ))..W3X355555555555 z!!%%T&\&)):335555555555533333q/q/X3X355555555q/q/X3X355 bx?Kr`^1(-4B2@@Hp^`o(.   ^ `hH.  L ^ `LhH. xx^x`hH. HH^H`hH. L^`LhH. ^`hH. ^`hH. L^`LhH.808^8`0o(. ^`hH. pLp^p`LhH. @ @ ^@ `hH. ^`hH. L^`LhH. ^`hH. ^`hH. PLP^P`LhH.^`o(.   ^ `hH.  L ^ `LhH. xx^x`hH. HH^H`hH. L^`LhH. ^`hH. ^`hH. L^`LhH.^`o(.   ^ `hH.  L ^ `LhH. xx^x`hH. HH^H`hH. L^`LhH. ^`hH. ^`hH. L^`LhH.808^8`0o(. ^`hH. pLp^p`LhH. @ @ ^@ `hH. ^`hH. L^`LhH. ^`hH. ^`hH. PLP^P`LhH.808^8`0o(. ^`hH. pLp^p`LhH. @ @ ^@ `hH. ^`hH. L^`LhH. ^`hH. ^`hH. PLP^P`LhH.^`o(.   ^ `hH.  L ^ `LhH. xx^x`hH. HH^H`hH. L^`LhH. ^`hH. ^`hH. L^`LhH.88^8`o(. ^`hH.  L ^ `LhH.   ^ `hH. xx^x`hH. HLH^H`LhH. ^`hH. ^`hH. L^`LhH.^`o(.   ^ `hH.  L ^ `LhH. xx^x`hH. HH^H`hH. L^`LhH. ^`hH. ^`hH. L^`LhH.808^8`0o(. ^`hH. pLp^p`LhH. @ @ ^@ `hH. ^`hH. L^`LhH. ^`hH. ^`hH. PLP^P`LhH. H)L*C-M 4I7!H;\<Sw=!>;A&B$C?C HZHQ{HgJ4XzXq\\-_yzabbnfhri$j9]l;nzsQvo(yHz{"\b7wCMH @l{RD!!?#Q=c $?#khrhxTG~Vb 'Da.dx/BO55@X3X3kX3X35X@UnknownG*Ax Times New Roman5Symbol3. *Cx Arial9GaramondA BCambria Math"qhl\&--a-a!24di5i53QHX ?Qv2!xxASSESSMENT REPORT ENGLISH MAJORacameronBruce4         Oh+'0  < H T `lt| ASSESSMENT REPORTENGLISH MAJOR acameron Normal.dotmBruce5Microsoft Office Word@NSI@l@8fjU@ܑ֠-՜.+,0 hp  Indiana Universityai5  ASSESSMENT REPORTENGLISH MAJOR Title  !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGIJKLMNOQRSTUVWXYZ[\]^_`abcdefghijklmopqrstuwxyz{|}Root Entry Fޱ)֠Data H1TableP:WordDocument.SummaryInformation(nDocumentSummaryInformation8vCompObjy  F'Microsoft Office Word 97-2003 Document MSWordDocWord.Document.89q