{"id":268,"date":"2011-10-07T14:35:56","date_gmt":"2011-10-07T14:35:56","guid":{"rendered":"https:\/\/blogs.swarthmore.edu\/institutional-research\/?p=268"},"modified":"2023-09-13T15:41:15","modified_gmt":"2023-09-13T15:41:15","slug":"surveys-and-assessment","status":"publish","type":"post","link":"https:\/\/blogs.swarthmore.edu\/institutional-research\/?p=268","title":{"rendered":"Surveys and Assessment"},"content":{"rendered":"<p>I&#8217;ll be talking a lot about Assessment here, but one thing I&#8217;d like to get off my chest at the outset is to state that assessment does not equal doing a survey.\u00a0\u00a0 I&#8217;m thinking of writing a song about it.\u00a0 So many times when I&#8217;ve talked to faculty and staff members about determining whether they&#8217;re meeting their goals for student learning or for their administrative offices, the first thought is, &#8220;I guess we should do a survey!&#8221;\u00a0 I understand the inclination, it&#8217;s natural &#8211; what better way to know how well you&#8217;re reaching your audience than to ask them!\u00a0 But especially in the case of student learning outcomes, surveys generally only provide indirect measures, at best.\u00a0 In the Venn diagram:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAgwAAAF5CAIAAAB84+W3AAAgAElEQVR4nO2d+1MbV572\/WcRb4by67E3jiFx8DhLPAMYAy\/YGhgLewGboGgVZDQCWxZ4ZMztlWFkRho8YrjYAQWYCMPCYljwqkpVwbUuhhqooYAKGSDhkql+f2h8OGoJoUurT3freerzQ4IF6m51n0fnfC\/nBAdBYbW7tz\/jX+TpH\/W1uMcIOlufpsYZLRXWbvIXJl6\/5f\/y8uoG6xOFICiETrA+AIi9iA3wA7e2rktT40zNs6Rk10pPap6F9xLaRTa3d1hfJAhKUsEkkku8HzgHXlkdI5oaZ07VEyZOEBuZ5a2aGqfVMeIceAXngCBpBJNQucgakabGmVZsi2FoPlf8OL20Lb207cIte67RzaOxDJQ1emND2zBE\/s6l2w7+j6eXtsVwbGeL6jU1zkcur3t4dsa\/uLu3z\/p6Q5DaBJNQm+YXVtzDs9XNLyKfJaTmWYgH5Jt6+KHc3OVjRWXreFmj91rdc+IipwsfRj7bqG5+4Rx45XuzxPqjgCA1CCaheC2vbnin5x+5vJoaZyTD6PkbzZmVT3ON7rJGb2XrOEMziBaDY5o3jyx9V3ppWyRRE355yjPhR2AcgmITTEKR2tze8Uz4zXZPRmlT+FHyzHXbxfL2XKNb2zCks08yH+gTYRu5Rndm5dPzN5rDX4q0YpvO1tc\/6lvb2GL9AUKQYgSTUJJ8b5ba+yYLDI4wQ+Gpgnp+4ais0WtyzTEfxyWmoullobn30m3HmevhAjCZ5a1Wx4h3eh5hDAgKL5iE3LW2sdU\/6tPZ+s4W1YdZQcrSd5VYB\/UdU8yHaflg7Jy9aRvJNbrTS9tOXrkfZkmqvW9yYXmd9UcNQXIUTEKmWl7dcA68ChNmOFf8OMfw7KZthPlYrBQqW8fzTT1hVqUyy1sfubzzCyusP3wIkpFgEvLSwvJ6i3vsqMSk04UPMyufllgHjZ2zzMdc5WJyzWkbhi7rnEctSWWUNlkdI3ALCOJgEjLRwvK61TGSWd4acsy6WN5+re65+sLOckDfMXWt7vnF8vajYt1muwfZtFAyCybBUmsbW86BVyG94eSV+xfL2zWWAUwapMHkmiuxDl667QiZWZtR2tTiHkMeLZSEgkkw0O7efv+oT1vXFTwYpeZZLt12lFgHkzAxST7ctI1c1jlPFYTIFCgwONzDs+gIAiWPYBKSauL12+rmF8HfVU9euZ9Z+VTbMMR8fAQ0la3jWfqukG6hs\/V5JvysbygISrhgElJoc3vHOfAqZOFbemkb1pTkj7Zh6NJtR3AebVqx7ZHLi+o8SMWCSSRWy6sbZrsnuMThdOHDXKMbZQ3Kwtg5e63uecgkWp2tD\/FtSJWCSSRKE6\/fBkcd+GWliqaXzMc7EA\/6jqkcw7PgZajM8tb+UR+quCE1CSYhsnb39t3Ds8EJS6cLHxaae7GspDJKrIPBE4uzRfVWxwhSoSB1CCYhmvjAQ\/CeDRdu2VEXrW4qW8czK58GRyyqm1\/AKiClCyYhgja3d1rcY4LAQ2qe5bLOiahD8mBwTOebeoLXoGAVkKIFk4hLIe3hdOHDa3XPUeiQtJRYB88VPw62CvT5gJQomESMWtvYsjpGBBUPZ67bNJYB5oMUkAM3bSPBe7JWWLthFZCyBJOIWrt7+y3uMYE9nCt+jFI4EExZozfYKsx2D0orIKUIJhGdPBN+QWg6vbQNcWkQnsrWcUEPwbNF9e19k0iWheQvmESkml9YEezukF7aVtboZT4AAaUQbBUZpU3e6XnWtzYEhRNM4nitbWyZ7R5BaBqLSyA2yhq9grC2psaJQAUkW8Ekwml3b7+9b5JOXkrNs+SbepC5BOLkWt1zQbKs1TGC5rKQDAWTOFLe6XlBS75Ltx0GxzTz8QWoA2PnbI7hGV2Cd7ao3jnwivWND0EBgkmEUHD44fyNZjRcAolA3zElCFRklrdOvH7L+iGAoAPBJAIUHH44VVBfYh1kPpQAdRMcqNDWdS0sr7N+ICAIJvFOweGHk1fu5xrdCD8AyQgOVDxyeRGogNgKJsFxHOd7s4TwA5ADwYGKtGIbtsCDGCrZTWJ3b\/+RyyuonUb4AbAlOFBR3fwCUwqIiZLaJBaW1wsMDjr8cK3uOfMBAgCeskbvmeuH5f0ZpU3Y\/A6SXslrEu7hWbr\/0oVbduwIBOSGyTWXY3gmiFKgmQckpZLRJNY2tuiNRU9euY\/WrUDOlDV66YB2gcGBxCdIMiWdSUy8fkunMJ2\/0ayzTzIfBQAIj7Fz9tLtw6XR1DyLe3iW9cMEJYWSyCR29\/arm1\/QM\/ccwzPmDz8AkaOxDNBrpNq6LrQchxKtZDEJ35ulzPJWOkaNFCagRPQdU+dvNNMJsijPhhKqpDCJFvdYQNuDyqeIUQNFk2\/qESTIIpoNJUgqNwlBkmtqngUxaqAOKppe0gmymeWtSJCFEiE1m0T\/qE8Qo0YRNVATJtdcZuVTekrR3jfJ+rGD1CZ1msTu3r7O1kcnueabepg\/0gAkgpu2ETqaralxojYbElEqNInN7R16ienMdRti1EDdGBzTF27Z6aWn5dUN1g8ipBKpzSQWltfpVn2XdU60cQVJQqG5l96\/CCEKSBSpyiRm\/It0EKLQ3Mv8uQVASuilp9Q8C9rHQvFLPSbhmfCTx+PklfvahiHmTywA0lPZOn668CFC2ZBYUolJtPdN0oVyla3jzJ9VAFih75ii97lDFQUUjxRvEoJmG+eKH+s7ppg\/pQCwxdg5S4eykfIExSxlm8Tm9o6mxol23wCE5LLu8OlAyhMUmxRsEsurG3Q7pss6J\/NnEgC5IUh5ml9YYf3gQgqTUk3C92YJiUwAREKJdZBsmp2aZ\/FOz7N+fCElSZEmgUQmAKKiouklXZXtHHjF+iGGFCPlmQQSmQCIAX3HFN0Q0Gz3sH6UIWVIYSaBRCYAYsbYOZte2kbvWYTUWOhYKckkzHYPEpkAiAeTa47eBhU+AR0rxZgEvXFQZuVT5g8bAMolx\/CMPE06Wx\/rhxuStZRhEnAIAMQl1+imS7JZP+KQfKUAk3AOvKJXmdDVFQBRyNJ3wSegYyV3k+gf9cEhAEgQ9MZ28AkopGRtEnAIABIN7RMt7jHWDz0kO8nXJCZevyXlP+dvNMMhAEgQ8AkojGRqErRDnCt+jGxXABIK3TIWPgHRkqNJzPgX4RAASInJNUf7BLYqgohkZxLzCyukc9+Z6zY4BADSIPCJ\/lEf68EAkoXkZRK0Q5wufIiuGwBIicp8Yndvf8a\/OONfdA\/PtrjHCBXWbk2NU0CFtZt+jXPgFf+7qEiXkUksr27AIQBgi7Fzlt76VEE+sby6MeNfbO+bNNs9mhonvZVAnJwtqtfUOM12T4t7bMa\/mGx7N8nFJJZXNzJKm+AQADBH4BOeCT\/r4SG0dvf2vdPzVsdIgcEhlh9EToHBYXWMeKfnVb8vrCxMYndvP6fqScq7TVHQ\/RsAttA+kZpnWVheZz1IHGrGv\/jI5Y3QGNJL2zIrn+Ya3YQS62BZo\/co6Fdm6bvSS9vofTiOIqfqCW8YqlybkoVJ6Gx9SnSIUd\/fp75dJTA\/HgBExNg5S\/afyChtYvt9eXl1o71vUlvXFWbITs2zpJe2XdY58009ZY1eEVcjTK65skbvtbrnuUZ3emnb6cKH4WcYj1xeNW0Ty94k6NZMCtpjbnBmSXAiCyubzI8KABHR2SfJoKyt65J+cNjd2+8f9Wnruo4akc9ct2Xpu7QNQ9KnQVY0vcw39dD7cwjILG91Drxa29iS\/rqJK8YmMeNfJNc01+hm\/lREzpul7wXnsrP3E\/OjAsEMzix9v73LgwlftGgbhsgTKmWRne\/NktnuCRl8Pl348LLOWWIdNDimmV8fc5fP5Jq7aRvJ0nfRgRwana1PtnGdSMTSJOh0pgu37Mw\/7KjY+jHE4uOo7+\/MDwwImPp2lXxAmO3FAN1U3Ds9n9AxYW1jyznwKrO8NXiovXDLrrEMyDylxeCYLrEOXrrtOHnlvuD404ptZrtHVtGdCMXMJOhg9enCh8oqmgtea+K1tLbN\/NiAAJhE\/Fwsb095lwyaoATQ5dUNenNiekEp39Qjk0lD5Bg7Z6\/VPT9\/ozn4jDQ1zhn\/YiKuYYLEzCRIsPrklfs6+yTzDzUqlta2yYn4F78j\/33silOEge7I4+F08HxwZknid+cZnFniXxxyIhX5n4rqXILf\/ai3gEnEj7FzlkRrM8tbxc3hCWkPqXmWzMqnFU0vmZ97nOjskzmGZ6cKhOtmCrIKNiah0GA1YWfvJ\/5EeFcg\/8sdveK08t0Pgouw\/9M\/3yx9H9vLzF0+\/+J39Pvy+n57N+QBiPju+z\/9kz5Twa9s\/bhPDoC2Uv5aHXVxIj+X8O++s\/fT3P+ukxcHx41oRe5DwNzl09knyRJKhbU7zIWNXCHtIb20TWMZUF\/X55u2EXp3cQVZBQOToPv35RieMf\/womXU93dyLvz6Ej0arnz3Q\/CvhAxg8IrhZeZQoznR\/k\/\/FIyt4r47+eGbpe+DR3b+AAZnlkL+Nf6f4jmXY9+d4zgypfh+e\/eov0y\/DEQIHcR2DrwKc22P1VH2UNboZX6aCUXfMUU3ZleEVUhtEsurG2nFNnJPMP\/MYoC2BH4Io21j\/6d\/Cl5Pf5\/d+nF\/YWVzYWVz5bsf+C\/F0b7M3OVbWNkkr9zZ+4l\/5fo\/dugfJu7dI\/mUyff9YAlMNKpzifDdv9\/eDf7jwUKWQQzkGJ6RoS22cW1ze8ds9wQHpVVvDzQhrUJb1yXPhh+SmsTu3j6pk1RcsJogWGsS\/JDjOHrFwxz4fVbwp\/yL30X7MjO15CIYQAWRkgS9u+AzXfnuh8GZpZBTh\/V\/7PD\/RM8VBCYa1bmEeXfBdIS8furbVdr\/Vr77IUz4BEQCqQxIK7ZFO6j1j\/oEWa0Xy9sVVD8rLsFWkZpnkWGTdklNgkwwT165r9A7g46C0rlMYVac6PE3zNgU4cvoIU8wfNM5V+v\/2EnEu5sDh2k6DizI+BJcBPqfYj4Xwd8RvAU9faGXkhC4Fhc6iF1gcEQYxF5YXtfUOGEPwQRbRWZ5q+9N6PxJJpLOJOhgdYl1kPlnExv0N1Z6MA2z4iT4Hr2wshkyZBrhy+ilmOBVdfJPZMlF3Hc3HzHcH\/tPtAmRw472XGJ4CzNMIgFUto6TILbZ7uHCandvv8U9RrfTOFVQf9M2wvwsZEVl67ggX9Zs98ikdaBEJkEHq7P0Xcw\/kpg5annEHLjiRH8vDllUsf6PHcGwGOHLwgdjicjAKu67m0U1iWjPJYa3MMMkEkOJdZAMZ+7h2aM+uxn\/oqAyLsfwTKHrzBJQaO6l3TSt2CaHUm0pTGJtY4sOVis3uW3ufw+rJfd\/+idp9sBDL3fQKyT8L4aM5QqySyN5WQwDq4jvboZJgHdk6bvISnpwP7vdvX2rY4S2h\/M3mlVQ95BoDI5pet8nPuGY7ZRCCpMgdXOnCx8qrnKSJkyyZrCCfz1k1mbwV\/XwL6OHwpXvfuDTgYIJjiuI8u7mhJlEhOcS7VuYYRIJw+SaI0HsnKondHBieXWDbuV98sr9fFMP8wNWEDdtI3T9XUZpE8O2sgk3Cc+En5yq0rPcwmR2BksQiSVMfbtKJwIJ5hzHvuyooTBC4nx3c8JMIsJzifYtzDCJRGJwTJPlEdL+b+L1WzqF6cItu6K\/GrLC2DlL5mr8dC3Msl5ClViToBeaLuuczK97PNDtN0glgQB6nDpq\/DUHBgDotZRIXkbn\/sc25MXz7mZRTSKGc4n2LcyBJhGy1BHEg8YyQC86tbjH6KUSTCDiRNswREcpdLY+6ZeeEmsS9EKTckMRPHQqzlGzBDpowb0bxZbWtgWvp4ct4iURvkyQRhX8BXzU93d6wBX33c2imkS05xLDWwhOhJR8o9xaRMga+un\/a6VTmJS+ciATdPZJugl5ZnmrxK1kE2gS\/aM+1Sw0mcMOTzT0khQf8uUHr\/2f\/skvuy+tbdOvEVS9Hfsyc1C8d+vH\/ZXvflj57gc6eC5Y0hHx3cNchzD\/dNQIHtW5xPYWR7XshU+IhcEx\/X5uQGfs9NI2LDGJiMk1d1nnpJee+kcj6j4gihJlEmsbW2RdUukLTebAtaYw60jmwOD21o\/75rA5PPQyToQv4wnTZ4kXCfaK\/u70PwmOKsw\/hQk\/RH4uMb9FyLODSYiFtmHovZx7ZAi7\/MUfmR+SKtFYBuhtKiTbAypRJkF2HFTBQpM5cPVc0HVDgGBxw9zlG\/X9PXiQ4gvW6F+M8GX0IYUMpG\/9uE8nrYr+7uRNg7tUhfknerEuuEwvwnMJ\/xZH1TnyCM4O2wiKBYlJpGTXvpdz7+c3Oi5+0Wty\/Q\/zA1Mlla3jZOPxlOxaq2Mk+KkRXQkxCTVlNIlIIrZzoPdgEOXPRruZhIhEfi6xcezOEyBartU9J0\/6z\/LrP\/h31wflzz4of3bN+g3zY1Mrxs5ZupCiuvlFIsZwWuKbxOb2jmoymgAAR0Fva3qqyJZ7b\/SzmiHeJD6scOt\/P8P8CNWKyTVH9gpMya7V1nWJuw2UQOKbBOkDfKqgXgULTQCAYOgU\/p9rmnLvjeY9GM97MP5xVR\/vE59Vv2B+kOqGbguoretKXGqsyCbhe7NEjlu5XfwAAGGgh6czv265annJO0Teg\/GcOu+58j\/xPqFtRJPXxEJv75FT9SRBPiGySeRUPSFllsyvIABAdOg9OM9pnxB7IHz65QBvEh9\/\/udq9PJLMPSiX4J8QkyTIM3AT165r++YYn75AADiQq8ypd16GuwQeQ\/Grz4YS7vTzftEXp3ydrBXHHSCmabGKXp8QjSTWNvYIuXjuUY38wsHABCXQnPvYbncv3eGdAieX\/12hDeJD8qffW7H98WEQ\/uEztYn1qjOSzSTqLB2H6xRXrchXg2AyqA3kPjgN\/YwDsHzyRf9vElc+o9+lE1IAG3hj1xesQZ2TiyToOPV2HMKAJVR1ugltb4\/1zTRkeqjuHJ\/lESwi383yvwUkgF6MVDElrHimASJV18sb2d+pQAAIqKzT5KV5NSChyTb9VgyjR4SwcZkQhro+omJ129FGd5FMAnv9DyJV2NncwDUhL5j6nThQ\/4Bf\/+qNds8HKFD8BHs87e7UYMtJSbXHGkZG3LHQDYmQaYRit68GgAggB5x3su596u7nsgd4mAycfdrUoONdFhpMDimia+nFdvWNrYYmwQ9jUBzYADUBN2e+t8M\/dE6BM9Hn\/fwPlFwH9FKiaBXCDU1TpYmsbu3T9o0YRoBgJrQNgwRh\/jkzh9jc4i8B+O\/NA2TyYSuHd8jJaKs0StWU\/G4TIJUz6FNEwBqQt8xRb6K\/mtJW8wOIZhMZNWgVY900MXYM\/5FBiZBTyMKzb3MrwgAQCzSS9tIsDrydKajyK79htTWYTLB5HOMJzgRu0lgGgGAKqG\/gWZ++VWcDsFDautCTSbe\/Oc\/qJHlb381T37PcT\/+5yD7S6F06BlhhbVbUpPANAIAVUKvZX9U\/gdRHCLcZGJwZT30GAOTEAc6tuQceCWdSWAaAYD6MHbOniqoJ5XVYjnE0ZOJd3OIf6y0kcOY\/B4mIS6kEjs1z+J7sySFSWAaAYAqIRtFvH\/VmlP3F3FNItRk4q\/fhvAD3jkOftj7NzLwUC87MBKO477vJb8YMCnhf364kPXtpE+4rsVx3N\/+au7ytfl\/DPwp9TcP3yjoGAKOjfqtwF\/5djLk4b0T7Y4Jw+SaIztj51Q9CTu6h1AsJoFpBADqo7J1XPRQxFGTiXc1E6FmEoHEYRK8Ax3q28moTCLoxYG\/ZY7GJILeIui3EozOPkm6b0W76BS1SWAaAYAqIcXV8ee8HkWW+S\/CAuwQ36+Dx82AucUBB78Y9OLAP0iP0eRLPT+4H37H73o3slNedWAA7\/zgHQfGs+5\/E\/B2ApMT\/vDAbwLekf9TkswkeEg+wtmi+qgynaI2Cc+EnyxvYRoBgDogGxK8l3NP9IUmmtAF2MJVHcHoGZNJhBl\/hZYQNIgfGU4PcXi8nRzaRihLCJxzsAm3mFxzpF2H2e6JfMyP2iTQqQkAlWFyzZF4tYgZTSGhC7BDd3N6N0AHDbtRmUT4ZZzAcTxoGhHCtIQKXuYKXG4KsqhAnzhQ4Nwi4dCZTpH3\/ovOJNCpCQD1QbJf3r9qjWSvCLEmE5qBVY4LXtJ5t4J\/+HPRTYIeykOtBR38kUi\/8lOTiVCHevSvSD+rIL3EI49gR2cSmhonphEAqAk6pPmpvjfRDkFPJm58cxAapiYNYWYS1DgeMnAd8OvHBoTf\/c2\/hfziT6LWITOvgl9\/kKb17d8E9kYd0hFvEXDu0n7c\/aM+kU1ifmGFTFV09knmNzcAIH7IV0vRCyOOguwzcX34qPwh4Sh\/dHYQx70zj5DrObxCD8TUmlKoFwiTo8IcXuARBk0Owi1eSZTdRJNjeEZ6dWxu74Q7S47jojIJq2ME288BoCboReoYtouImU+\/HPig\/NkHD\/xL\/AAdOIyGHNMDfOJvf6VjyzGaxOF04eiROsT4ftQC0TtTCVo9OyoMLvEcgkCHoKyOkWNH\/khNYndvn\/QA0TYMMb+5AQDxc9gA7tZTyRwiL3AHbLW0\/AtZGChTyJeDs0X1u3v74pgEKaA7c93G\/AwBAPFDqucSnfYaElJYl1enhi+dQYmwcoeUxRxbWxepSZDMVxTQAaAOSDRC4mkET4jCOqUROlIiYX1cPJDKmLRiW\/jJREQmMfH6Lcl8NSrz4wQA0NBNOLLNw9KbRB6VC1v8u1HmFyQGFG0SdGQi\/GQiIpOosHYj8xUANUGmEYlrwnEsmUYPbxIff\/5n5hckCSk090ZSM3G8SaxtbJGQdWXrOPMTAwDEib5jiklSk4CrD8ZI+PpO238xvyzJBj2Z8E7Px24S7uFZ\/q+cv9HM\/KwAAPFDSqwZTiN4Luqf8yaRW\/s188uShJCaiTCTieNNosDg4P\/KtbrnzE8JABAnBsc0qbllOI3gIeHr9DvdJtf\/ML84yQZ9M0y8fhuLSSwsryNkDYCaIC2jmU8jeNLudPM+cbMJq9kMINNKna0vFpNocY+hyhoANUE2KfvFF39m7hB5D8YvGQaCtjUF0kECVKl5lpC5sMeYREZpE6qsAVANFU0v+Sf6X3LvS9DwNRJy6rykYOKu8zXzS5SEnL\/RHKblXziT8L1ZwjalAKgJEqg8p33C3B4IH1X18j7xG9tL5pcoCSG5sNq6ruhMwmz38L95WedkfhoAgPghKY8J2sU6NkjBxGfVL5hfoiTE4JgmKdHBO5seaRK7e\/tniw7up4om2DsAiqes0Us2F2JuDDR0vz+D47+ZX6gk5MIt+1HV10eaxIx\/kf+d04UPmZ8AACB+MiufMmzWFJ4Luj6sODGEtHIqMDgiNQmyewRacQCgAkyuOdI64TPjAHNXEJB592veJH559yvm1yoJMbnmSMHEwvJ6RCaRWd7K\/0JZo5f5CQAA4oRsIfCz\/AbmlhDMlXujJMcJVXVMuHT7oG66xT12vEksr26QGjrkNQGgAsha00flf2BuCSEhTWErWrE7MgNu2kZCtugIbRJkiyHU0AGgDk4XPpRJK46jIFV16tiGSHHQK0703tehTUJT40S\/JgBUA6mq\/Zfc+8zN4ChIH6dPqnqYX7HkhGxnSzeFDWES9HbW+o4p5scNAIgTkrsik35NR\/FhhZv3Cf3vZ5hftCSE9PWyOkbCmYR3ev6gJrP4MfODBgDEDwlIfHLnj8ydIAwZ7zqHaxqQL8MAUklDhyVCmER184uD1xmeMT9oAED8yD8gwfNZzRBKrxkSMiwRwiRIUz8kvwKgAhQRkODJtbxEIixbSFjCM+EPbRJIfgVAZSglIMFDEmGxoSkTSFiiuvlFaJPoH\/Xxr0gvbWN+uACA+FFKQILnF4aveJO4Zv2G+aVLQkhYIqO0KbRJkIBErtHN\/HABAPGjlIAEzy9NwwhLMIQOS\/AdYYUmkVP1BAEJAFSDsXNWKQEJHoQlmEP2IOJ3vQ4wic3tHQQkAFATZCu6U0U25gYQIQhLsIWsT7qHZ4UmQSokEJAAQB2UWAf5h\/qD39iZj\/4RgrAEW\/JNPXRJXYBJkPbgCEgAoA7IfqWy7esXDMISbCENgyus3UKTQEACAJVxsbydf6h\/8cWfmY\/+EYKwBFsqW8cP9rgtbw0wid29fbLNKQISAKiDc8WPFZTaREir\/DPvE5\/b0T5OakyuOf6eSc2zBJjE\/MIKWjYBoDJIOmPuvVHmQ3\/kkCZOxb8bZX4NkxCSNr2wvH5oEu7hg1S5S7cdzA8RABA\/pCHH+1etzMf9qMg0erC3BEMu3LKTLNhDkyBR63wTmrkDoAbIXmM\/1zQxH\/ej4le\/HeFN4tJ\/9DO\/jElIlr6Lv3OcA68OTYJsNHTTNsL8EAEA8VNo7uUf6g9LO5iP+1FBx66ZX8YkhNw5VsfIoUmcLarnf2pwTDM\/RABA\/JBmbQrKfyWk3enmfULXjhFJakhTyOrmFwcmsbaxdVCWWVDP\/PgAAKKgaJP45It+3iRuNo0zv5LJBlmoPDQJUmt94Zad+fEBAESB9FfI+PxPzAf9aPn0ywHeJAruYwFcakgvWE2N88Ak2vsmsRsdACqDmMTFqm7mg360kLrrX979ivmVTDZCmITO1sf\/qMQ6yPz4AACicOm2Q3Hl1oQr90Z5k\/j48z8zv5LJBkmezql6cmASBYaDm6mi6SXz4wMAiALZijLzy6+YD\/oxcK78T7xPoDmHxBCTyChtOjCJtGIb\/yNj5yzz4wMAiILSTYI059D\/fob5xUwqhCZBtpFIzbMwPzgAgFicuX7w5S\/bPMx8xI+BC7o+3iQqWieZX8xkg7TyO0F3bTp\/o5n5kQEAxIJ04FGoSVz8jxfo4MSKAJPwTPjRtQkA9aF0kyAdnJAFKz0BJkHyX7HXEABqQukmQbJgs2qQdSk1ASZhtnuQ\/wqA+lC6SbAKQpEAAB2gSURBVGTXfoM2f6wIMAnS2g\/5rwCoCaVnN119MIY2f0wwOKYDspsySpuQ\/wqA+lC6SeQ9GD9\/+6DNXzVGJwkRpsCm5ln4\/2d+ZAAAESEV15\/qe5kP97Hx0ec9vEkYHP\/N\/HomDzr7JNnm+gTZ2hr9XwFQGYru3cTzcdVBqcSdtv9ifj2Th4DeTcurG\/z\/nLluY35kAAARIfuLKdckLr7b7LqseYL59UweAkxixr\/I\/096aRvzIwMAiIii95M4MIl39XTaRuwqIR1k0yGdre8E2UkClXQAqIx8U4\/STYLsKqFp8DK\/nslDwM50\/aMH+bCZlU+ZHxkAQETIo5526ynz4T42Mu9+zZtE4YO\/ML+eyQPZ49ps95xocY+h3BoAVUI2oTzz6xbmw31sXK4Z4k0it\/Zr5tczeSDRLOfAqxNWx8FtVGjuZX5kAAARIYmMP8tvYD7cx0aW+S\/Yn056Ltyy83eOd3r+RHXzi4MotmWA+ZEBAMSFNFe4annJfMSPgZw6L28Sn1W\/YH4xkwfSZH5hef0E6clR1oi4EABqgzztv7rrYT7ixwDZxPSTqh7mFzN5IN8tdvf2YRIAqJmL5e2KLrqGSUgPWaXMKG3iOA4mAYCaIRHIj2+7mI\/4MAlFQPIdtHVdMAkAVM61uuf8A\/5haQfzET8GSCNYmIRkkPxXq2OE47gTBQYH+oQDoFbIt8LT1xqZj\/ixwZvEx5\/\/mfnFTBLo\/FeO406QPuH6jinmBwcAEBfS8\/n9q1bmw308JvFB+TPmFzNJIPmvE6\/fwiQAUD8nr9xX9P50MAmJIRsaLq9uwCQAUD9k6yGF9oKFSUgJvd0Qx3EwCQDUD+kFe077hPmID5OQOSTTobr5hdAkDI5p5scHABAdsjeAQptzwCSkhBTW9I\/6MJMAICkwueYUHZaASUgJ2c2aD0jAJABICki+ihLDEjAJyahsHRcEJGASACQFpDxKiWEJmIT09wkJSHAcdyKn6glMAgB1Q74hKjEsAZOQjOCAREBbjspWbCELgGoha83KCkvkWl7yDpF+p5v5NVQ9wQEJ9G4CIFkgXxIzPv8T86E\/ctDgTzIqml4GByRgEgAkCyT\/\/eeaJuZDP0xChpCWTXRAguO4ExXWbpgEAKrH4JgmibA5dX9hPvrDJOTGqYJ6\/vaY8S8GmATZvhQmAYC6IYmwCtpbAiYhDaRbcFqxjQvUoUmUWAeZHygAIHGUWAf5h\/1UkY356B8hWea\/8Cbxb4bnzC+gismsfMrfG49cXqFJPHIdlOxfq8NnAICaoUuvs347xNwAojKJz6pfML+AaoW+MeYXVoQm0d53sJ1prtHN\/FgBAAmFfGH8qPwPzA0gEj6rGeJNIrf2a+ZXT62QKWZmeSsXpBP9oz7+ny\/rnMyPFQCQUMjSs1Kq6jLvfs2bRMH9EeZXT62Q9Oj2vskQJuGdnj\/wkMqnzI8VAJBQTK45ksTymXGAuQccy6dfDvAmcc36DfOrp0qMnbNkrYmuoTs0iRn\/Iv\/P6aVtzA8XAJBoLusOSqPSbj1l7gHH8gvDV7xJaBvREiIhkH5NmhpnsENwHHdieXXjoPNX8WPmhwsASDSkj9N7OffkXzBxUf+cN4mbTTAJ8aFnlu7h2dAmsbm9w7\/idOFD5kcMAJAAUjAh\/8nEx1V9vEncafsv5tdNfZCQdVqxbXdvP7RJcBzHvyglu5b5EQMAJEDbMKSUycRHVb28Seh\/P8P8uqmPc8WP+TvBOfAqpEMcmERasY1\/nbFzlvlBAwAkgIwOMp9MpN3p5k2iGqOT2JDvCmeL6o+aRhyYBNlSAt3CAUgSyADx\/lXrVctL5mZwFOfK\/\/RB+bMPK1DFJT7ki4LVMXKUQxyYBOnxp20YYn7cAABpIGPEJ3f+yNwMQkIaN138opf55VIZJH8hNc+ytrF1jEmQzhz5JrTQAiBZIEFL2U4mSE+OX979ivnlUhmkgC78NOLAJNzDsyi6BiDZoNMf5TmZIOXWeXVY5BATMo1Iya5dWF4\/3iQmXr\/lX33hlp350QMAJIMUUr1\/1Zp7b5S5Kwi4ZDgoty7+3Sjza6UmSA50hbU7vEMcmMTC8jr\/C2eu25gfPQBAMujJhAzTnDLeVdKVNU8wv1aqgeQspOZZgnu+hjaJ3b19lEoAkJyQISMlu\/ZXdz3MjYHmo897eJPQtU8zv1DqgP5acGw04tAkOI7LKG3if03fMcX8NAAAUpJe2ibP7a8\/rHDzJnHX+Zr5VVIHOYZnx5ZYhzYJTY0Tm5gCkJzQYcxP9b3MvYEn1\/KSd4j0O93ML5E60HdMkYav\/aO+SBzi0CTMdg\/\/m4Vm5CMDkHRk6bvklg6LjUtFh6S9FhgcETrEoUk4B15hVwkAkhaDY5osVctk07pMowf5ryJCB58iiVcLTcL3ZgkNwwFIZkg67Hs597LNw8xNgjQJ\/43tJfOLo3RMrrnThQ8PspPsnsgd4tAkSMPwk1fum1xzzE8JACA9pFHH6WuNzBedSGrT53Zk08QL2ds8rdgWvgnHkSbBcVxmeSva\/AGQzJQ1esmKBNtFp6sPxvjWfh+UPzO5\/of5lVE09EJT5PHqECZB2vxdq0OYCIAkJdfoJgNK5pdfsTKJ7Npv0NpPFPQdU6l5Fv4DrW5+Ea1DBJhEe98k\/4ey9F3MTwwAwApSNsGwV8dnNUO8SeT81sP8gigXk2vu\/I1m\/tPMKG3a3N6JyyS80\/P83zp\/o5n5uQEAWEFnOv1rSRsTk\/iF4SveJDQNqNyKHZLZnJpn8b1ZisEhAkxibWOLxK6ZnxsAgCF0cCLj8z9JbxJk19KK1knmV0Oh3LSNkA+xvW8yNocIMAmO2scUsWsAkhzyJfS9nHtZvx2S0iHoqDUacsQGPR3U1DhjdgihSZDYNequAUhy6OXsn+U3SBmcILXWn1RhG7R4P7sYcl7DmQSpu75Y3s78PAEAbKETY04V2SSrnPj0y4NtJHJrv2Z+EZQIab+Rkl0741+MxyGEJjG\/sEKiHMzPEwDAnJu2EdIS7syvW6QxiY+r+niT0DZi3TtqyDphSnatc+BVnA4hNAmO484WHSxj6eyIFwEAfBrLABl0zmmfJNoh6ICEwfHfzE9fWZDeKpFvFxG1SZCwhMYywPyEAQByIN\/UI1klNgISMUNXVkeyL2mMJoF2sACAYC7rnNIkxSIgERsVTS\/JwmCBwRHhhkKxmAQJS5wufMj8tAEA8uHCLTvxiX8z9CMgIR\/oFIOYK6sjNQmOCktgK1MAAIFOrHwv514i9rBDQCIGdPZJ0gb8bFH98uqGiA4R2iQQlgAAhMTYOUvGo5Ts2otV3QhIsKWydZzMIeLpvRGdSbiHZ1EtAQAIib5jivaJT+78UUSTIC2bsBtdJNy0jRCHOFtUP\/H6regOEdokllc3sAERAOAojJ2zZHsicfOd0u50o2VThGgbhkik+mxRfVQ7ksZrEhzH5VQ94d\/7pm2E+bUAAMgNY+csiU+kZNd+WNoRv0NcuTfKO8SHFW5sNBQeunglo7RpYXk9QQ5xpEm0uMf4t7+sczK\/HAAAGWJyzdH5TvHX2WUaPbxJZNUMMj87OUNXzGWUNokeqY7IJGb8i0iEBQCEx+Sao9sE\/VzTFE8fQCS\/RnLB6a4bOVVPxM12jcIkOCoRFm3DAQBhyKx8Soat969aPzMOxOAQuZaXJPm1unOW+UnJEH3HFL3Ep6lxSuAQ4UyiuvkFfyi5RjfzqwMAkDP019vYUp4uv9uv9N8Mz5mfjgzRNgyRRKaU7FqdrU\/EmuoYTcIz4U\/BbqYAgMgQjGL\/WtIW1dLTRf1z3iSuWb9hfi5yI8fwjFzY1DyLKL1dRTCJze0d8pGjIywA4FgE6yGpBQ9\/ddcTiUNcfTD2YYWbNwn972eYn4h8MDim6UuaVmxLRLlceB1pEhxVeo0VJwBAJJhcc3QrwPdy7kVSlU3Wmi5+gT0xD6Fr5VKya7V1XdIEIQQKZxJkxQk5TgCAyCmxDtKj2881TeF3yf7ki36sNdEYHNN0OkBKdm2Le0wyVxAonEns7u2THKeyRi\/zCwcAUAo6+yRdlf1ezr2Pb7tCboBK5zWhqZ+5y6exDNAWe7aoPv4tSONROJPgqBwnVNUBAKLC5JqjI658lCI4QTbz7tfIa+LR2SfpCERKdm2FtXttY0saMzhKx5gEqapLzbOgjxMAIFoqW8cFA9857RM68YnU0P3G9pL50bLC5JrLNbpJLyY+Rp2ghn3R6hiT4Dgurdh2EDZpQF9GAEAsFJp76SWU969a+YA23a8paWvotA1DZ67baB995PJKVgZxrI43iUcuLzqHAwDixOCYpnt4pGTX\/iy\/Ia3sD7xJ\/PLuV8yPUHq0DUN05CYlu7bA4EhcP9fYdLxJkA1NT165b3BMM7+sAADlctM2cqqgnh4WT+Y++D\/F\/0\/bmFxrTcH2cLaoXuIquQh1vElwVOfwQjOymAEAcWFyzRWaewVWcaqgvtDcmwyBz2B7SM2zWB0jzAPURykik3AOvELBBABAREyuuQ9+\/YgeK4lVqHXFosQ6qCx74BWRSezu7ZOgE8LXAID4MTim342V5nPXHwrc4tJtR4lVJbtKVLaOX9Y56bi9UuyBV0QmwXGc1TGC8DUAQCxICYWmxrm7t+8ceEUSKemJRZa+S6G94wyO6UJzryBtSVn2wCtSk1hYXicnqe+YYv4BAACUi8k1R2IS3ul5fpDZ3dt3D88WGByCUTUlu\/Zc8eNrdc8VsQxlcs2VWAcFeVwp73aRa++bVJA98IrUJDiO09YdtIzP0ncx\/yQAAMqFbNGcVmwLLghYWF5\/5PIGTyx4t8jSd920jcgtxF3W6M01utNL24KP+WxRfXXzC+m7t4qlKEzCOz1P5oBy+4QAAAqCxG\/D963zTs\/rbH3Bw27Ku61uco3uiiZmubMVTS\/zTT0XbtnpSmkaTY2zf9Qnn7K42BSFSXAcl1HadHDylgHm9xkAQIlUto6T1flI1l7WNrbcw7MkET+Yk1fup5e2Zem78k09ZY3eBK2HGxzTZY3eQnNvlr4rvbTtKGNIya7NqXrS4h5bXt2IdViWl6IzCZILe674MfNbDQCgRMh6fYW1O6rxZ3N7xzs9b3WMhDEMep5xsbw91+gusQ6WNXoJxrDNP\/QdU\/SLc43uyzpneEsg8Ybq5heeCb\/iQg7HKjqTWNvYQi4sACBmyDQiJbs2nv4Tm9s7ngm\/2e7JLG891jASxNmiep2tzz08q5pJQ0hFZxIclQuLyQQAIFrIvnXaui6xRrG1ja0Z\/6Jz4NUjl1dT4wwZ8Y6f1DyLpsZZ3fyixT028fqt3DosJU5RmwQmEwCA2DA4psm6Dcl8TZBm\/IueCX+Le6zC2q2pcRLIRmohKTA46Be3uMfcw7Mz\/kUm+4bKRFGbBEdNJs7faGZ+2wEAlEKWvouEdkUfy6AEKRaTWNvYIsZb2TrO\/M4DAMgfKacRkIiKxSQ4jquwdvMfNrp0AAAiAdMIhSpGkyCbTGAyAQA4lpB9OCBFKEaT4DCZAABETL6pB9MIhSp2k6AnE2WNXuZ3IQBAniAaoWjFbhIcNZlAzQQA4CgQjVC04jKJheV11EwAAMKgs09iGqFoxWUSXGABNlrDAgAEkE5NmhqnKGMWJLHiNQm6ALvQ3Mv8jgQAyAexOjVBDBWvSXAc1943yd8E2GcCAEBD9o2ItuErJB+JYBK7e\/ukoxYmEwAAHm3DEGmNh2mEciWCSXDUPhMnr9xXxD60AICEYnLNnS58yA8LVseIKOMMxETimATHcWQbkEu3HcxvUAAAW3KNbjKNUN8+PEkl0Uxixr9IIlQ3bSPM71EAACv0HVMk7dU58EqsQQZiItFMguO46uYX\/G1x5roNEWwAkpYLt+ykem53b1\/EQQaSXmKaxNrGFolg55t6mN+pAADpIfHqlOxa35slEUcYiInENAmO49zDsySCre+YYn6\/AgCkhO72arZ7xB1eICYS2SQ4jiswONAdFoDkJMfwjH\/804ptiFerQ+KbxPzCCho6AZCEVLaOk3h1\/6hP9LEFYiLxTYKjGjqdKqg3ds4yv3cBABJw\/kYz2jSpTwkxid29\/YzSJv52yax8yvzeBQAkGrKtUGqeZWF5PREDC8RECTEJLrBsAotOAKgbeqGpvW8yQaMKxESJMgmO48x2D1l0Qq8OANSKyTVHGvkVGByJG1IgJkqgSezu7WeWt6JXBwDqhu7AgYUm9SmBJsFxnO\/NEll0KrEOMr+bAQDiQi80uYdnEzqeQEyUWJPgOO6Ry4tFJwBUCb3QhIwmtSrhJkEvOqG8DgA1kaXv4h\/ts0X1y6sbiR5MICZKuElwgeV1uUY38zsbABA\/dI8mlM6pWFKYBEftSoSMWABUgM4+SUIROlufNMMIxEQSmQTHcTpbH0mB0Nknmd\/lAIDYMHbOnrl+0O85s7wVzcDVLelMgg5OnLluQ7sOABTKxfJ2hCKSR9KZBMdxy6sbZ4vqEcQGQLmQqoiU7NqJ12+lHEAgJpLUJDiOm3j9ltxhCGIDoCxu2kbI84v2G0kiqU2C47gW9xiC2AAoDn3HFElTrLB2Sz90QEzEwCQ4jquwdiOIDYCCMLnm6GD15vYOk6EDkl5sTGJzewdBbAAUxKXbDhKsRoOmpBIbk+A4bmF5HUFsABRBobmXLBF7p+dZDRoQEzEzCY7jvNPzCGIDIHPKGr2kbu6Ry8twxICYiKVJcFT7PwSxAZAh+o6pUwUHM35tXRfb4QJiIsYmwXGctq4LQWwAZIjJNUe2rc4obUKwOjnF3iQ2t3fIhtgIYgMgHy7rnOQL3PzCCuuhAmIj9ibBBbaJPVf8GD4BAHPoymrPhJ\/1IAExkyxMguM4z4Sf3JEXbtlNrjnmDwkASQvtEFbHCOvhAWIpuZgEx3H9oz74BADMoR2iuvkF64EBYiwZmQQX2LEDPgGA9NAlEXAIiJObSXCBPpFZ+ZT5MwNA8qCxDJCnD92ZIF6yMwkOPgEAC2iH0NZ1YSshiJccTYLjuOrmF\/AJACQDDgEdJZmaBBfoE2jaAUDioHeJKDA44BAQLfmaBAefACDx3LSNkNZMOVVPUFYNCSRrk9jd2ydNO1Kya\/NNPcyfKADUBBwCOlayNgkuyCc0lgHmzxUA6oB2CLRmgo6S3E2Cg08AkAAqW8dJL5yM0qbl1Q3WDzokUynAJDiO29zeyal6Ap8AQBTgEFDkUoZJcEE+UWjuZf6kAaBEbtpGiEOcLaqHQ0DhpRiT4IJ84rLOyfx5A0BZXKt7Tp6gs0X1aAAOHSslmQTHcZvbOwUGB93fCX3FAYiQLP1hbC+jtGlheZ31Aw0pQAozCY7jdvf2dbY+cq+fK36s75hi\/vgBIGdMrrmL5e10xRxymaAIpTyT4EVvjn268GFl6zjz5xAAeWJwTJ8rfkyeF52tDzXVUORSqklwHNc\/6iPxt9Q8y03bCPOnEQC5Udk6frrwIXGIRy4v6wcXUpgUbBIcx834F88W1ZMH4Frdc+bPJADygU5kSsmudQ\/Psn5kIeVJ2SbBcdzC8npGaRN5DLL0XcyfTADkgCCRaeL1W9YPK6RIKd4kuKCUp4vl7djSDiQ5gkQmpLpCMUsNJsGFSnkyOKaZP6gASI8gkSmn6snaxhbrBxRSsFRiEryQ8gSSHEEiU4W1G4lMUJxSlUlwHOeZ8CPlCSQngkQmq2OE9eMIqUFqMwmO43xvluiUpxzDM4QogOrJN\/WQvt9IZIJElApNguO45dWNzPJWOkShs08yf4wBSAQGx\/SFW3YkMkEJkjpNguO4ze2dCms3eXJOXrmPxrFAfWgbhuhKiAKDAx2ZIHGlWpPg1T\/qo5eeLtyyI+sJqAOTay6z8im5t\/lqaoSpIdGlcpPgOG55dYOuokA0G6iAiqaXZ67byF2dVmzzvVli\/ahB6pT6TYJXe98k\/Z0rs\/IpotlAoeSbeuibubr5BVq6QolTspgEx3G+N0t0NPvMdVtF00vmDzwAkaPvmDp\/o5mOUXsm\/KwfLEjlSiKT4Dhud2\/fbPfQ0ex8Uw\/zJx+ASNBYBugYtabGiVJqSAIll0nwmnj9Nq34cD33\/I1mRLOBnDF2zl66HRBXa++bZP0YQcmiZDQJjuPWNra0dV30U6exDDAfCwAIpqzRe6rgMEMvs7wV3fogKZWkJsHLPTxLz98v3XZgSgHkg7FzNsfwDEmuEFsltUlwHLewvE4nyJ68cj\/X6EbiE2DOtbrn9AQirdiGOmqIiZLdJHjR7WNTsmtPFdSXWAeZDxMgOSlr9NKdXPlmrkhyhVgJJnGg+YUVTY2TfjLP32hGs3EgJQbHNB2g5iMQmEBAbAWTCJB3ep7eDDUlu\/ayzolABUg0JtdcrtFNt3E9W1TvHHjF+oGAIJhEkHb39lvcY3RAOzXPkm\/qQaACJIgS6yAdfkjJrjXbPaiBgGQimERorW1s0fuh8lvdaRuGmA8oQE1UNL2kK6j5EjlkuEKyEkwinHxvlujcp5Ts2vTSNgQqQPwEhx8ySpu80\/Osb3kIEgomcbw8E366QhuBChAPJtecYBe5s0X17X2TKICA5CmYRETa3dt\/5PIiUAHiRNswRG9DjfADJH\/BJKLQ8uoGvdsdX1GRb+oxds4yH32AzNFYBgTVDwg\/QIoQTCJqzfgXc6qe0E97ap4l1+jGAhQIicYyIJg9IPwAKUgwiRjVP+oTVFScvHI\/S98FqwA8JtdcoblXYA9pxTbnwCuEHyAFCSYRl0JaRWblU33HFPNBCrDC2DlbaO4VlD7AHiCFCiYhgvpHfYIFqJTs2ovl7dhMO9nQd0xd1jnpBAfYA6R0wSREk3d6Ptgqzly3Xat7jiQo1aNtGLpwyy749DNKm\/pHfbAHSNGCSYgs7\/S8oP6Oj2znGJ5hDUp9GDtn8009gsAD35ivf9TH+maEIBEEk0iIFpbXq5tfCJYdUrJrL912YA1KHVQ0vcysfErXxJG23ujbCqlJMIkEanN7p71vUhDZ5ttAYWKhUPQdUyGnDmeL6q2OkeXVDdY3HQSJLJiEFPJM+OkttQnnbzRrLAOIWMgfk2tOYxlIL20L\/hAzy1vdw7MIPEBqFUxCOi0sr5vtHkEbKJI1W9boZT4UgmBu2kZCLiul5ll0tj6sLEGqF0yCgTwTfkEfctLk47LOiaCFHNA2DF3WOQW1DqSdRv+oD\/uJQkkimAQzbW7vuIdng7Nm+W+pmZVPS6yDWImSEpNrTtswlFn5NDjjgF9Wau+bRNQBSjbBJNhrYXnd6hgJjm+TojyNZQDdPhKHsXO2xDp46bYjeE2JL4Uz2z3oxAclrWASMtL8wkoYtzhX\/DhL34XFKLEoa\/TmGJ4JNoaj6+CsjhF4AwTBJOSo+YWVFvdYZnlryPErJbv2wi17vqkHe+RFi84+WWjuvXDLHnLSkJJdm1P1pMU9trC8zvoWgCC5CCYhay0sr7e4x0LGLUis+9JtR76pB8lRR1HR9LLQ3HvptiNkFJpHW9flHHiFeAMEBQsmoQxtbu94Jvxmu+eoxShSeHFZ59RYBnT2SeajMyv0HVMl1sEsfVfIsgZ6Qcls93in51HiAEFhBJNQnpZXN\/pHfTpbX3DJhaD8Ir20LdfoLrEOVjS9ZD52J47K1nFtw1Cu0X3hlj3MdIFPG6uwdruHZzFpgKAIBZNQtuYXVtzDs9XNL8IEMOjQ98Xy9lyj+6ZtRLlNQYglXCxvF2wIGpK0YluFtbu9b3LGv8j644Ig5QkmoR7t7u3P+Bdb3GMV1u7wkwx6eSq9tC1L35VrdGsbhsoavfLJta1sHS9r9F6re55rdGdWPk0vbQvumHTUdEFT43zk8nqn59c2tlh\/LBCkbMEkVKvl1Q3v9DzvGWFC3yE5c92WXtqWXtp2WefMNbp5SqyDZY1enji9RN8xxf+dm7YR8vcv3LLzbxqyli18dEFT42xxj\/WP+pC0CkHiCiaRRJpfWPFM+FvcY9q6rkiWp+RJZnmrtq6rxT3mmfD73iyxvqgQpHLBJJJaC8vrM\/7F\/lFfi3usuvmFpsYpH\/MoMDg0NU6rY4T3gxn\/ItaOIEh6wSSgENrc3pnxL\/K0uMd4rI4RTY2TJ8KYR0j4mAEP7wEt7jH38Cx5R9ZnD0HQof4\/crYvnxbxqmoAAAAASUVORK5CYII=\" alt=\"Venn diagram shows little overlap between Assessment and Surveys.\" width=\"524\" height=\"377\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>(Sorry, I&#8217;ve been especially amused by Venn diagrams ever since I heard comedian <a title=\"Eddie Izzard Venn - YouTube\" href=\"http:\/\/www.youtube.com\/watch?v=CBpWwC9qNpA\" target=\"_blank\" rel=\"noopener noreferrer\">Eddie Izzard riffing on Venn<\/a>&#8230;)<\/p>\n<p>Surveys are great for a lot of things, and they can provide incredibly valuable information as a piece of the assessment puzzle, but they are often overused and, unfortunately, poorly used.\u00a0 While it is sometimes possible for them to be carefully constructed to yield direct assessment (for example, if there are questions that provide evidence of the knowledge that was attempting to be conveyed &#8211; like a quiz), more often they are used to ask about satisfaction and self-reported learning.\u00a0 If your goal was for students to be satisfied with your course, that&#8217;s fine.\u00a0 But probably your goals had more to do with particular content areas and competencies.\u00a0 To learn about the extent to which students have grasped these, you&#8217;d want more objective evidence than the student&#8217;s own gut reaction.\u00a0 (That, too, may be useful to know, but it is not direct evidence.)<\/p>\n<p>I would counsel people to use surveys minimally in assessment &#8211; and to get corroborating evidence before making changes based on survey results.<\/p>\n<p>What can you do instead?\u00a0 Stay tuned (or for a simple preview, see our webpage on &#8220;<a title=\"Alternatives to surveys\" href=\"http:\/\/www.swarthmore.edu\/x29656.xml\" target=\"_blank\" rel=\"noopener noreferrer\">Alternatives<\/a>&#8220;)&#8230;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ll be talking a lot about Assessment here, but one thing I&#8217;d like to get off my chest at the outset is to state that assessment does not equal doing a survey.\u00a0\u00a0 I&#8217;m thinking of writing a song about it.\u00a0 So many times when I&#8217;ve talked to faculty and staff members about determining whether they&#8217;re &hellip; <a href=\"https:\/\/blogs.swarthmore.edu\/institutional-research\/?p=268\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Surveys and Assessment<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19,6],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts\/268"}],"collection":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=268"}],"version-history":[{"count":19,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts\/268\/revisions"}],"predecessor-version":[{"id":1576,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts\/268\/revisions\/1576"}],"wp:attachment":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=268"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=268"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=268"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}