Author Archive for David

Institutional Growth at The Schwartz Institute: 1997-2007

Published
by
David
on April 8, 2008
in Assessment, Baruch College, Communication Intensive Courses (CICs) and Faculty Development
. 4 Comments

In BLSCI’s application for the TIAA-CREF Hesburgh Award, we made use of the writing diagnostic assessment data to demonstrate the many ways the Institute has grown over the past 10 years.

As Figure 1 and 2 below show, BLSCI fellows support faculty teaching a number of distinct Communication Intensive Courses (CICs) across a variety of disciplines. As Figure 2 shows, the largest representation of faculty teaching CICs is in departments that have traditionally placed a heavy emphasis on both written and oral communication, such as English, Modern Languages, Marketing, Management, Performing Arts, Sociology and Anthropology. However, the institute has also supported CICs in departments that have not traditionally incorporated communication intensive elements into their curricula, such as Accountancy, Natural Sciences (e.g., biology, chemistry, and environmental sciences), and Computer Information Systems.

Figure 1

[click to enlarge] 

Figure 2

[click to enlarge] 

When we look at these data and hear about all of the great work going on at the Institute during our staff meetings, what we often don’t take into consideration is the amount of expansion that has taken place over the past ten years. As Figure 3 demonstrates, the number of faculty supported by BLSCI has steadily increased, reaching a peak of 144 last year. The number of faculty currently teaching CICs is nearly three times what it was ten years ago. Despite some minor fluctuations, the number of sections of CICs has also increased dramatically. Specifically, as shown in Figure 4, the number of sections of CICs offered last year is nearly five times as many as there were in 1997.Figure 3

[click to enlarge] 

Figure 4

[click to enlarge] 

There is no doubt this kind of institutional growth contributed to BLSCI’s being awarded the Hesburgh award. However, the most interesting growth going on at the institute is arguably what happens on a more micro level among students, faculty, and fellows throughout continued mentorship and collaboration. Although we all get to observe this in our individual work, it’s often hard to demonstrate this kind of growth across the institute. As we keep on thinking about and celebrating growth at BLSCI we continue to think about ways to assess it. It’s my hope that this post will spark some ideas among readers on how we might approach this kind of assessment next semester.

Connected

Published
by
David
on February 28, 2008
in Higher Education, Interpersonal Communication, Pedagogy, Podcasts and Podcasting, Technology and What if . . .
. 3 Comments

As part of their Mobile Learning initiative, Abilene Christian University has begun a new program that involves giving iPhones to incoming freshman. With the iPhones and the software they’ve designed, an incredible amount of innovation is possible in extending the classroom and giving students access to learning materials that are both class-related and college-wide. Imagine having syllabi, access to research databases, and course readings available anytime with just a few touches! They also describe plans for the use of podcasting, hybrid online/in-class discussions, and instant polling throughout their “mLearning” initiatives.

This and other programs in their Mobile Learning initiatives are available on their website. They even produced a video entitled “Connected” which provides their vision of what it might be like for a student who has access to this powerful technology.

http://www.youtube.com/watch?v=Tp8fHgp0xhU

http://www.youtube.com/watch?v=TLCTpX3tJEQ

As you’ll notice in the video, the iPhones that students get are not restricted to educational use. Facebook and other social networking sites are accessible, along with general internet, texting, and emailing capabilities. You can also see how the technology may present particular problems for communication in the classroom and more generally between students and professors. For example, professors are texting students and encouraging online research during class discussions.

So, although their programs may have a lot of potential to change the way students learn for the better, I worry that they also risk creating distractions and promoting poor communication. How connected is too connected?

Writing Diagnostic Assessment: Some Preliminary Findings

Published
by
David
on December 5, 2007
in Administration, Assessment, Faculty Development, Funding and Higher Education
. 0 Comments

As many of you know, last month BLSCI applied for external funding from an organization that recognizes exceptional faculty development programs focussed on enhancing undergraduate teaching and learning. In order to make our case for the award, we included some preliminary results from the Writing Diagnostic Assessment data. I’d like to use this post as an opportunity to share some of these results with readers to demonstrate the effectiveness of the work that many have been doing over the years and get some feedback regarding ideas for future analyses.

When looking at the data, on average, students start the semester with scores on both the expectations and writing quality variables in the “middle” range (scores around 3). When we then looked to see if students’ scores significantly improved over the course of one semester in a CIC, there were no major findings. This was because many students started the semester out scoring high (scores from 4 to 5) on many of the variables, and thus did not have any room for improvement (as measured by the diagnostic scoring criteria).

However, when we looked at students who scored in the “low” to “middle” range on all of the variables (thanks Diana for this suggestion!) we observed statistically significant increases from the beginning to the end of the semester on all variables. These increases were consistent across disciplines and schools as well. The figures below illustrate the changes we observed in the data separately for the Weissman and Zicklin Schools.

[click to enlarge]

[click to enlarge]

Although these results are based only on a subset of the data we’ve been able to clean, match, and analyze (~ 5,000 students), they nonetheless illustrate that the work of BLSCI in creating and implementing CICs seems to be paying off for students across the board. Although most probably knew or were able to sense this already, it’s always great to have “hard data.” We would love to hear readers’ thoughts on these findings and how you see these data stacking up next to the work you’re doing with students in your own classes. Also, as always, any general thoughts and/or questions on the assessment data are welcome.

Fun with PowerPoint in the Classroom

Published
by
David
on October 24, 2007
in Fun, Pedagogy and Powerpoint and Presentations
. 1 Comment

I know PowerPoint is not the most popular kid on the block these days.  Without sounding too much like a conservative talking about gun control, I have to confess that I’m a firm believer that PowerPoint itself is not inherently evil, but people tend to use it in primarily evil ways.  While attending the workshop on Technology and Media at Friday’s CUNY Writing Fellows meeting, it was clear that has the potential to engage students in the classroom using visual media.  However, most of us are still struggling to come up with creative ways of using it which do not impose an artificially linear structure to classroom discussions and stifle students’ ability and willingness to communicate their ideas and think critically about the material.

Although I am still one of those people who are constantly trying to come up with better uses of PowerPoint in the classroom, I thought I would share one way I’ve used PowerPoint in class that tends to promote engagement, discussion, and debate among students without feeling imposing.  It’s also fun!

This is Jeopardy!  That’s right, the popular game show format (along with many others) has been creatively employed in PowerPoint presentations using slide links and transitions.  There are several templates available online (just Google “PowerPoint Jeopardy”).  Ethics Jeopardy is one version I’ve created and used several times in a graduate level seminar on research ethics (although I’ve also used it in undergrad classes in social psychology and statistics).  I usually start by splitting the class into two or three teams.  One team picks first and gets to respond to whatever question (answer) they pick.  If that team does not provide an adequate response, the other team can steal the points away.  I usually give the teams a few minutes to talk amongst themselves before they respond.  Once we’re done discussing the first item, the next team gets to pick a category.  As you can see, the items do not have right or wrong answers, and are constructed to promote discussion, debate, and critical engagement with the material.  PowerPoint allows for audio and visual clues to be included, and this is especially fun to do with Daily Doubles.  My favorite is the Debate Daily Double, which requires the teams to take contrasting positions on an issue and spend some time going back and forth on a critical issue.  Final Jeopardy can also be used as great prompt for some low-stakes, in-class writing activities.    Generally, the game show format, although it seems quite corny, creates a low-stakes atmosphere and I often find students who do not normally participate taking more active roles in the discussion.  It’s also great for exam review.

In my opinion, this is just one way in which PowerPoint and other presentation software packages can be employed in useful, engaging, creative, and fun ways.  I definitely agree that PowerPoint is dangerous if it falls into the wrong hands, but I’m not ready to give up on it as a potentially useful teaching tool.  I’d love to hear others’ thoughts and examples of creative uses of PowerPoint in the classroom.

Writing Diagnostic Assessment: Preliminary Research Questions

Published
by
David
on October 5, 2007
in Assessment, Baruch College and Communication Intensive Courses (CICs)
. 0 Comments

After meeting with the Associate Provost and faculty representatives of the Zicklin School of Business and the Weissman School of Arts and Sciences, we have now settled on some initial research questions to ask of the Writing Diagnostic Data. I share them here in hopes of generating discussion around the assessment and further ideas for analysis.

The first and most general research question is “Does the quality of students’ writing improve over the course of a semester in a CIC?” Related to this question, we are interested in whether improvement occurs across the college or only within specific classes or disciplines. We will also explore whether we see improvement for all students, or only among students who are scoring in the low or middle range to begin with. It will also be worthwhile to see what happens over the course of a semester with students who score high on their initial diagnostics.

Second, we hope to answer the questions of “What happens to students’ who are enrolled in multiple CICs throughout their career at Baruch?” and “Is there consistent improvement among these students from one CIC to the next?” These related questions are of particular importance within the Zicklin School, as students there are required to take 4 CICs before graduation.

We hope to have answers to these questions in the form of a preliminary report by the end of the semester. In the meantime, we are continuing to think about how we can use the data to address issues related to changes in admissions requirements, differences between lower level vs. upper level classes and ESL students vs. native English speakers, and how the outcomes of this assessment may correlate with other academic outcomes, like GPA.

As most readers are very familiar with the data (both its strengths and weaknesses) we welcome your comments, questions, and suggestions regarding these preliminary ideas for analysis as well as other research questions you think are important and would like to see addressed.

Writing Diagnostic Assessment Project

Published
by
David
on September 20, 2007
in Assessment, Baruch College and Communication Intensive Courses (CICs)
. 1 Comment

As most readers of CAC.OPHONY already know, we are in the process of delving into the Writing Diagnostic data that BLSCI has been collecting over the past ten years. My work, as a first-year Writing Fellow, is to help organize and make sense of this data. In order to keep the dialogue about this project ongoing and public, I will be posting periodic updates and I welcome feedback in the form of questions, comments, and suggestions. In this first post, I would like to provide readers with an overview of the data and the project more broadly as well as some initial ideas Mikhail, Suzanne, and I have for analysis.

Starting back in 1997 and ending last spring, fellows at BLSCI have done a tremendous amount of work collecting writing samples from students at Baruch enrolled in Communication Intensive Courses (CICs) across a variety of schools and disciplines. As part of an ongoing assessment of the effectiveness of CIC curricula in improving students’ writing, fellows scored students’ writing samples at the beginning and end of each semester. Specifically, fellows scored each writing sample in terms of students’ expectations for the class (i.e., development, tenor, and range of expectations) as well as the quality of their writing (i.e., ideas and development, organization and coherence, spelling and vocabulary, syntax and punctuation, and grammar).

We are currently in the processes of organizing and cleaning the data. So far, we have data from 1,395 CICs and 31,408 students entered into electronic format and (almost) ready for analysis. These data are primarily from 2000 - 2006, so we can expect the size of the sample to almost double when we are finished entering the early data and as fellows continue to enter remaining diagnostic data.

I can honestly say that I have not yet had the pleasure of working with such an extensive and impressive sample, despite having been a part of several large-scale research and assessment projects. The data are very exciting, because of the many lines of analysis we can potentially follow. For example, we have the ability to look across all of the students’ work to see if their writing has been improved by CIC curricula. We can also focus on the effectiveness of CICs within specific student populations (e.g., ESL students) and compare the effectiveness of CICs across schools and disciplines. We can also follow students who have been enrolled in multiple CICs, to see if and how their writing has changed over their entire career at Baruch, not just during one semester.

As with any “good” assessment project (see Luke’s posting from 9/12/07), we will be meeting with representatives from the Zicklin School of Business, Weissman School of Arts and Sciences, and the School of Public Affairs early next week to determine how to best use the data. Our goal is to identify each school’s unique concerns and questions and push forward with an analytical approach that satisfies the needs of each stakeholder as well as our internal curiosities as BLSCI.

I will continue to post updates as we make progress with this project. We welcome your thoughts and suggestions at any stage in the process.