Banner


College of the Canyons -- Title III
The Institute of Teaching and Learning
Instructional Innovation Classroom Research Proposal

Title:  “Blackboard” Online Platform for Students in Anthropology 101L
Researcher: Richard Martinez


IN THE SPACE BELOW, PRESENT A STATEMENT OF YOUR PROPOSED RESEARCH PROJECT (APPROXIMATELY 500-1000 WORDS), INCLUDING A GENERAL DESCRIPTION OF THE SCOPE AND NATURE OF YOUR PROJECT, THE DESIGN OR OUTLINE TO BE FOLLOWED. DESCRIBE YOUR PLANNED ACTIVITIES AND TIMELINES.

My revised proposal (originally submitted for consideration in fall 2005) is as follows:
(1) To complete development of a series of programmed, online tutorials using the “Blackboard” platform for students in Anthropology 101L: Physical Anthropology Laboratory (1 Unit); (2) to test and evaluate the effectiveness of these tutorials with statistical data collected from Blackboard and feedback obtained from student questionnaires; and (3) to adapt these tutorials to the stated objectives, instructions, contents and procedures used for in-class laboratory assignments; and (4) to devise methods to motivate students by actively using computer-assisted materials for in-class lab preparation.

I selected this problem because Anthropology 101L (Laboratory for Physical Anthropology) was designed primarily to meet the needs of non-science majors seeking to completion of lab prerequisite requirements for transfer to four-year institutions. Unfortunately, many of these students do not have even basic background in the measuring, computational, descriptive and/or analytical skills needed for student learning in a laboratory environment. Nor have they directly experienced working cooperatively in groups to solve problems. There remains a need to provide students on a “real-time” basis with specific, well-focused background and “refresher” knowledge which can be used to directly supplement and support activities in the lab course. This is because lab students have the option of taking the co-requisite Anthropology 101 concurrently from any available instructor who may schedule the coverage of critical topics, with different emphases, at different times during the semester. Further, the students who have completed the co-requisite during either of the two preceding semesters have the option to enroll in the lab course up to a year following completion of the co-requisite.

The benefits of flexibility, however, are frequently offset by the difficulty many students experience in relating the topical contents from previous lectures into the directed applications required by a current lab exercise. Personal experience has also shown that many students have neither the time (nor much inclination) to systematically review a previously-used lecture text or substitute reference materials) in order to recall, refresh, re-learn (or even learn anew) the background concepts needed for work in the lab. Hence, the possibilities offered for learning in the laboratory environment are greatly diminished, and the quality of learning as assessed in final laboratory work-products is not all that it might be.

Current experience with my three current Anthropology 101l lab students has largely confirmed the above in two ways. First, an informal oral survey was taken in each section at the beginning of new lab topics. After reading the handout and workbook sections for the current lab (distributed the prior week at the end of class), students were asked: “Do you feel that you have enough background in ______________ from the (anthropology) lecture to start today’s lab?” Most students (90% or more) invariably indicated by show of hands that they both needed and wanted a “review” of the underlying theory and basic lecture concepts. Usually, only 3 or 4 students (from lab sections of approximately 30 students each) indicated that the topics were adequately covered in lecture or that they remembered enough to be able to proceed. This was also true for the students taking both the lecture and lab concurrently: they often responded that “the topic hasn’t been covered yet” (even though the course syllabus may say otherwise).  Some students also grew bored with what they considered “busy work” (a direct quote from one of my student evaluations) because they saw little purpose in the details of lab work without an immediate connection to its overall purpose or significance. These anecdotal responses, together with the need to continually provide intensive, one-on-one remedial assistance to students during the lab period, demonstrate a fairly general “disconnect’ between the past learning and retention of basic, essential concepts obtained in lecture and their present application in the laboratory.

I also discovered, however, a problem in how students actually use (or, properly speaking, not use) the remedial resources made available to correct the so-called “disconnect” between the background requirements for the lab and their self-admitted inadequate preparation to undertake it. Since a relatively complete initial set of tutorials were completed before the start of the fall semester (when I had originally anticipated this research project would commence), I decided offer them via Blackboard to my current lab students on a “non-required” basis.  I amended the course syllabus to include a statement about the availability of the “Online Tutorials” and the advantages of using them—a “pitch” repeated at appropriate times throughout the semester. At the first class meeting on August 15th, I also conducted a one hour virtual “tour” of Blackboard and a complete run-through of Tutorial 1 (“Metric Measurement and Calculator Use”).

The results of the above efforts, thus far, have been disappointing: Based only on  incomplete data from Blackboard (1) only 63 percent of all currently-enrolled students (84 in all) in the three lab sections completed the initial logon procedures for Blackboard during the first seven weeks of the course; (2) among the “logged-on” students, less than 60 “hits” on Blackboard for all three lab sections during the weeks from August 15 through October 1, 2005 were recorded; and (3) overall Blackboard use by students appears largely confined to reading announcements, sending emails and (minimally) online discussion. Use of the actual tutorials (including related discussion board forums) is unclear because of a programming problem with the Blackboard program (i.e. it will not generate any specific statistics from the so-called “Content Areas” (including the “Assignments” section where the tutorials were been uploaded).  It seems probable that it will be at least as important to find practical ways to motivate students to actually use the tutorials as it will be to develop relevant and useful content. Based on the above experience, I will mandate use of the tutorials in the two lab sections designated as “experimental” (i.e. the 12:00 and 3:00 PM sections) and monitor student usage via Blackboard. Students in the experimental group will also be required to complete a specific “homework” assignment based on their personal interaction with the tutorial prior to the in-class lab. The “control” group, however, (i.e. the 7:00 pm section) will not   
have access to the tutorials and will only receive my standard list of websites and written resources to assist them in obtaining background and preparing for the labs. It is anticipated that the overlap in these materials between the experimental and control groups will be minimal.



WHAT ARE THE OBJECTIVES OF YOUR PROJECT? DESCRIBE THE RELEVANCE OF YOUR PROJECT TO STUDENT LEARNING?

Questions continually arise in the teaching of Anthro 101L about the particular types of student learning that take place in the context of separate “lecture” courses and adjunct “laboratory” sections. Relating these in a laboratory environment is a challenge that is also faced by instructors teaching “lecture” and “lab” sections in other disciplines. In a recently-circulated memorandum on “How to Write Student Learning Outcomes,” a “Classification of Cognitive Skills” is presented outlining six “cognitive skills categories” that might provide a useful structure for understanding and operationalizing useful connections between separate  “lecture” and “lab” components” which could be used “…to create “learning outcomes” that tap into each individual (student’s)…ability levels.” For example, the learning behaviors articulated by the author as Category I and II (i.e., “Knowledge” and “Comprehension”) seem directly applicable to the design of the  lecture component of a course , while Category  III, IV, V and VI behaviors (“Application”, “Analysis,” “Synthesis” and “Evaluation”) seem more naturally to fall within the purview of the laboratory component.

My first objective is to define and apply Category I and II definitions and behaviors as lecture review and “refresher” components, which can be used in the lab as an interactive resource that could be accessed by students involved in Category II, IV and V activities  (i.e., collecting and describing data, formulating testable questions, performing analysis and drawing conclusions). Such a resource would help(a) enable rapid and accurate assessment of current student “knowledge” and “comprehension” for particular lab “applications”), (b) provide accessible, directed and structured access to specific information needed for lab activities, (c) encourage and reward individual students to enhance, re-acquire (or acquire for the first time) the knowledge needed to successfully perform “comprehension” tasks in a self-paced, feedback-intensive format on an “as-needed” basis; and which (d) allows regular interaction with and feedback by instructor and student peers. Simply assuming that students possess the knowledge and skills required to perform well in the lab, simply by virtue of the fact that they are completing or have completed a co-requisite course, is insufficient. Delaying a “check for understanding” to assess individual competency in vital knowledge areas until after their application during an in-class lab assignment, does not contribute much either to effective student learning, or to lab instructor satisfaction.

The “Blackboard” platform will serve as an inexpensive, relatively easy resource to deliver such “knowledge tutorials” to lab students. The current set of 15 tutorials will be required for use by all students in two (2) lab sections during spring 2006.  The third lab section will be the “control: section and will be conducted without using the online tutorials. Each tutorial will consist of : (1) background information consistent with that received during lectures; (2) an introductory tutorial  relevant to the background, context and methodological requirements of the entire lab exercise; (3) station by station web-based tutorial materials where students may practice, reinforce and repeat as often as necessary the procedural, measurement, data collection and manipulation, computation, graphing, plotting and other descriptive skills required by a particular in-class lab exercise; and (4) a required “pre-assignment” which summarizes the key points needed for each in-class lab and which provides focused feedback to the instructor on the level of student preparation for each upcoming in-class lab exercise. As planned, each tutorial should provide a self-contained and readily accessible basis for the “application,” “analysis,”  “synthesis” and “evaluation” of skills required in each anthropology lab application.

WHAT EVALUATION METHODOLOGY WILL YOU USE TO PROVIDE PROGRESS MEASURES FOR YOUR PROJECT? INCLUDE A DESCRIPTION OF YOUR BENCHMARKS.

All students (experimental and controls) enrolled in spring 2006 will receive the same basic course orientation and the individual lab exercises. Each will be required to complete a confidential written questionnaire (QUESTIONNAIRE I) dealing with their experience in taking the “co-requisite” Anthro 101 course (either concurrently or as already completed). Part I will contain fixed-choice response questions concerning the topical content of the lecture course will be included to assess the level of past learning and retention of selected core anthropological knowledge-areas (Examples: “Define “Evolution” in two or three short sentences,” “Explain how Natural Selection works,” “List  ______ different species of primates,” “Name ______ important hominid fossil discoveries” and “Solve the following single-trait genetics problem”). Part II will contain more general course-related questions, such as: “How well do you feel the lecture course has prepared you/is preparing you for Anthropology 101L?” or “List three things you learned during the lecture course” Part III contains inquiries about the student’s themselves, their personal, work and educational history, GPA, math and science interest and background (if any), experience with computers (e.g., email, internet, word-processing and spreadsheet use) and whether or not students have experience using “Blackboard.” In Part IV, students will also be asked about their educational plans and their specific reason for taking in Anthropology 101L.

All experimental students will be informed about the required tutorials via the course syllabus and weekly at lab briefings, in addition to a thorough orientation at the first class session on “Blackboard” logon and access procedures (including the use of Blackboard discussion postings and responses, and the various communication functions). Weekly lab handouts will be integrated with online tutorial contents. Students will be required to complete specific parts of the tutorial in writing as a necessary preparation for the in-class lab. Since tutorial/handouts will be available 24/7 online, students will be able to freely download materials and work at their own pace to complete the required preparation for each in-class lab. Both the tutorials and in-class lab exercise(s) based upon them will be turned in as required homework/in-class lab assignments and each will receive a letter grade. The use of all “optional” resources (except for the online bibliography) will be discontinued.

Student progress in the experimental sections will be monitored via Blackboard and via periodic questionnaires (QUESTIONNAIRE II) attached to selected lab handouts for students to provide specific feedback after both the tutorial and the in-class lab assignment have been completed. Some of the specific feedback areas include: (a) quality of tutorial contents, i.e. “Was this tutorial helpful in providing background information and preparation for the lab and how?); (b) design of the tutorial; i.e., “Was this tutorial interesting, engaging and clearly presented and why?; (c)  tutorial focus and efficiency of presentation, i.e. “How much time did you need to complete the tutorial?,” “Were any “gaps” or other problems apparent?;” (d) tutorial relevance, i.e. “Was the tutorial too easy or too hard?” “Did this tutorial really help me to do better in this lab and in the course?” At the end of the course, an effort will be made to link the reported questionnaire data with more objective criteria of student success in the course (tutorial/lab grades, exam and quiz scores, etc.). 

I plan to solicit specific advice regarding the structure and content of Questionnaires I and II from experienced professionals and faculty at COC. I am currently in process of doing an online search for comparable instruments to get some ideas about designing specific forms for evaluating different kinds of online resources. 

Periodic progress reports and the final project report will be prepared in the spring semester based on (a) Blackboard use statistics, (b) student questionnaires and other ad hoc input and (c) personal instructor experiences and anecdotal observations. In addition to enhancing student learning in general, it is anticipated that this project could provide the basis for recommending other course improvements, such as (d) replacing current student lab reports with alternative means of appraisal, such as individual or group skills demonstrations or other presentations; (e) reducing the number and size of the expensive, multi-page lab handouts currently provided to students at Division/District expense, by replacing them with online resources via Blackboard that can be downloaded as-needed and at will; and (f) permanently eliminating the use of expensive laboratory manuals and workbooks in favor of a variety computer-based resources that are compatible with different learning styles and cognitive learning modes.


WHAT TEACHING STRATEGIES/LEARNING CONCEPTS/PEDAGOGICAL THEORIES/TECHNOLOGY SKILLS DID YOU GAIN KNOWLEDGE OF THROUGH THE INTRIRUTE OF TEACHING AND LEARNING COURSES THAT YOU WILL APPLY TO YOUR CLASSROOM RESEARCH?

The objectives of this research are consistent with the mission of the Institute of Teaching and Learning and its stated goals “to promote and enhance instruction…” (through) ongoing support and promotion of teaching skills among faculty, to strengthen the culture of teaching, to serve as a symbol of College of the Canyon’s commitment to excellence in teaching and to influence policy that will support the development of an excellent teaching and learning environment” (Institute Mission Statement). In particular, this research seeks to promote active learning among students. As a trainee in the Institute-sponsored COC Associate Program, I learned critically-important lessons in good teaching, such as the need to teach according to clearly-stated objectives (i.e. “learning outcomes”), care in planning, presentational timing, the need to continually “check for understanding” during the learning process (“assessment”) and, most of all, the need for active learning and “clear, interactive communication between the teacher and learners.” In the Online Certificate Program (June 2004), I was continually impressed with the multiplicity of ways that students learn and continue to be motivated by the  additional possibilities for effective face-to-face teaching and student learning that are supplemented with appropriate online resources appealing to different cognitive styles at any time and on demand. I believe that these approaches are critical if the boundaries between the classroom and the laboratory are to be integrated for the benefit of students in all disciplines. 

This proposal attempts to build on a “hybrid” model for a laboratory course by testing a single question: “Can specific, lab-critical knowledge (Anthropology 101) be newly-acquired, reinforced, supplemented, learned anew, or even corrected by an individual learner in specific laboratory problem-solving contexts? (Anthro 101L) through the controlled use of online resources? Stated another way: “Can student learning in the laboratory be measurably enhanced through the timely delivery of appropriate, supplemental knowledge that is relevant, well-designed, engaging and readily available via Blackboard or other types of electronic media platforms?” Finally, how much structure, programming and “discipline” should be required, as opposed to the number and kind of options, alternatives, flexibility and personal choice tolerated, to ensure that students are ultimately successful in achieving specified learning outcomes and attaining their educational goals, while still remaining motivated to learn? 


HOW MANY STUDENTS (APPROXIMATELY) WILL PARTICIPATE IN THIS RESEARCH PROJECT?

A total of 90 students in three separate lab sections will participate in this research project during the spring 2006 semester. Sixty (60) students will comprise the experimental groups(s) using and evaluating the tutorials. A control group of thirty (30) students will serve as a control group without the use of tutorials.

WHAT DO YOU (AS AN INSTRUCTOR) HOPE TO LEARN FROM YOUR RESEARCH? DESCRIBE ANY INSTRUCTIONAL DEVELOPMENT OR IMPROVEMENT YOU HOPE TO GLEAN FROM THIS PROJECT.

I have learned thus far that individual student initiative and ability in the organizing, scheduling and use of resources is not something that can be taken for granted—especially where teaching and learning must be integrated within a hybrid online and face-to-face environment. I believe, however, that with high expectations and with the parameters clearly set, students will still have room to exercise a tremendous amount of flexibility, creativity and freedom in the process, and thus benefit greatly from the unique learning context of laboratory investigation and discovery. I hope to continue learning about and improving the feasibility of providing of providing remedial information to students on an individual, “as-needed” basis in such a way that student performance in a laboratory environment can be both better motivated and continually improved. I am anxious to use both online and “hands-on” resources together in teaching anthropology. Further, can students be better motivated and enjoy greater success in laboratory learning with opportunities to communicate among themselves and with the instructor and provide critical feedback using email,  “Blackboard” or other online communication platforms? Experience has shown me that student communication skills in a college-level course are always critical—but they are “acquired skills…that are not usually practiced by the majority of students unless (their) value has been demonstrated.” There is also much to be learned, specifically, about laboratory teaching  per se from this project; i.e. what can we learn about the role and function of a “lab instructor,” and the boundaries between what we should absolutely require students to learn and perform, as opposed to what we allow them to discover (or not discover) on their own?



Can't find it? Try the Cougar Search Engine

 

College of the Canyons

Valencia campus:

(661) 259-7800

• 26455 Rockwell Canyon Road, Santa Clarita, CA 91355

Canyon Country campus:

(661) 362-3800

• 17200 Sierra Highway, Santa Clarita, CA 91351