2015–2016 Annual Report Center for Educational Innovation

This annual report is based on the Center for Educational Innovation’s activities from July 1, 2015 to June 30, 2016. For more information about our center, visit our website at www.buffalo.edu/ubcei

Center for Educational Innovation

INSIDE THIS REPORT

Message From the Director......................................................................... 2 Essential University Services........................................................................3

Application Administration of Instructional Technologies



Online Learning



Student Assessment and Program Evaluation



Communication, Engagement and Dissemination

Education........................................................................................................ 7 Research & Development........................................................................... 10

CEI Seed Grant for Promoting Pedagogical Innovation

Research

Development Activities



Sponsored Project Activities



Grant Proposals Submitted



Conference Presentations

Publications Awards & Recognitions................................................................................19 Staff Directory..............................................................................................20

2015–2016 Annual Report

MESSAGE FROM THE DIRECTOR

Xiufeng Liu

The 2015–2016 academic year was an exciting one for the Center for Educational Innovation (CEI). We continued to make strides in promoting excellence in integrated services, education, development and research. Over the year, our center has provided such essential university services as UBlearns, Teaching the UB Curriculum, UB Student Evaluation of Teaching, online instructional design, exam scoring and instructional video production. We again organized such high-impact annual events as the Genteels’ Excellence in Teaching Conference, the Conference for Graduate Teaching Assistants and Assessment Day. One major emphasis of CEI last year was the promotion of scholarship of teaching and learning. We had successful collaborations with The Graduate School in offering the postdoc teaching training certificate program and with select schools and departments in conducting faculty teaching observation. Our second annual seed grant competition resulted in funding five new innovative projects to transform university teaching. We were also active in submitting external grant proposals, and successful in receiving grants from the National Science Foundation and the State University of New York. I invite you to read this annual report to learn more about our diverse activities and accomplishments and, more importantly, to explore ways to get involved. CEI belongs to all of you!

Xiufeng Liu, PhD Director, Center for Educational Innovation Professor, Department of Learning and Instruction

2

Center for Educational Innovation

ESSENTIAL UNIVERSITY SERVICES Application Administration of Instructional Technologies The Application Administration of Instructional Technologies cluster, in coordination with university partners, provides application administration for essential university services that include UBlearns, UBclicks and iTunes U. Members of this cluster also provide technical support for faculty, staff and students, maintain online help documentation, and present workshops and group training sessions on the use of UBlearns, UBclicks and iTunes U.

2015-2016 Activity Highlights • Blackboard on UBlearns • Updated the Blackboard application, including all third-party vendor integrations, which provide new course tools and enhanced functionality. • Collaborated with internal and external university partners to release the following new vendor integrations: • Atomic Learning (digital content library of professional development and learning resources)

AT A GLANCE

6,615

UBlearns courses delivered

257,985 UBlearns student enrollments processed

4,800

UBlearns support requests completed

• Remark Grade Import (streamlined faculty workflow to upload ‘bubblesheet-style’ scores for CEI’s Enhanced Test Scoring (ETS) service) • Helix Medial streaming server building block tools (direct upload, download and viewing of media files). • Continued research, development and testing of faculty requested integrations such as Pearson Publishing Mastering Lab and Digication’s ePortfolio. • Offered 25 individual UBlearns training sessions by request and a specialized presentation on UBlearns for the Department of Sociology. • Worked one on one with faculty to help integrate instructional technology into their curriculum. 2015–2016 Annual Report

3

Online Learning The main focus of this cluster is to support online learning at the university. The cluster provides instructional design consultation for individual faculty, departments and schools, as well as works collaboratively with instructors, academic units and campus committees on university policies and strategic directions for online learning. Our Online Learning cluster also acts as a liaison between the university and regional, state and national online learning organizations to provide resources for faculty development, innovation and the implementation of quality standards and evidence-based best practices. Outside organizations include the SUNY Center for Professional Development (CPD), the Open SUNY Center for Online Teaching Excellence (COTE) and the Online Learning Consortium (OLC).

2015–2016 Activity Highlights • Consulted on instructional design issues with 29 faculty and staff relating to online learning practices and instructional technologies. • Conducted workshops and developed training resources for online learning, UB’s ePortfolio initiative and the effective use of instructional technologies. • Worked with faculty in developing Massive Open Online Courses (MOOCs).

Student Assessment and Program Evaluation AT A GLANCE UB Course Evaluation System Statistics

9,829 Course sections

336,133 Student evaluations

5,700

Unique evaluation reports for faculty

4

Center for Educational Innovation

This cluster provides support for program evaluation, the UB Course Evaluation System and scoring services. CEI supports annual program evaluation through the development of report standards, maintenance of an online depository and the provision of timely feedback for ongoing program improvement. Our center also supports the implementation of the UB Course Evaluation System—the universitywide tool for evaluating academic courses at the university—by providing training to faculty and academic units, analyzing data to monitor technical qualities, and facilitating report generation for faculty, department chairs and deans. In addition, CEI staff provides Enhanced Test Scoring services to instructors of large-enrollment courses.

2015–2016 Activity Highlights • Created a syllabus template that serves as a model for general education program courses and has been used for more than 200 courses.

• Completed transition from Scantron to Enhanced Test Scoring, which increased efficiency and capacity, reduced turnaround times and improved reports and results for faculty. • Scored and generated reports for approximately 1,000 scoring jobs for large-enrollment courses.

AT A GLANCE Enhanced Test Scoring Service

• Consulted with UB faculty on program evaluation components for 10 internal/external grant applications. • Consulted with three outside institutions regarding course and program assessments, as well as assessment documentation for accreditation. • Provided support for the UB Course Evaluation System. • Continued development of the universitywide Program Assessment System, which provides current and historical organization of assessment plans and learning outcomes for programs and administration. • Compiled “Rubric Workbook: All the Moves You’ll Need to Win the Game” for UB’s annual Assessment Day. • Conducted assessment of ANNY (Assessment Network of New York) Assessment Boot Camp and provided a peer review to program presenter.

The switch from Scantron to CEI’s Enhanced Test Scoring resulted in:

42%

Increase in efficiency

61%

Increase in capacity

Communication, Engagement and Dissemination The focus of this cluster is to highlight teaching and learning innovations at UB and beyond. This includes organizing special events with nationally known speakers, producing videos to highlight innovations at UB and informing the campus community of professional development opportunities related to teaching innovation and excellence.

Faculty Teaching Observation Pilot Program Upon request from department chairs or faculty members, CEI professionals with university teaching experience come to a faculty’s class to observe teaching using a standardized protocol. CEI professionals then write a report and meet with the faculty to discuss findings and improvements; CEI professionals also recommend pertinent resources for faculty to consider. Teaching observation reports are confidential; they are not shared with department chairs. During the 2015–2016 academic year, CEI professionals observed 11 faculty members from three schools and four departments.

2015–2016 Annual Report

5

2015–2016 Activity Highlights ENGAGEMENT Assessment Day 4.0: Designing Quality

Planned and organized campuswide events, including: • Annual Conference for Graduate Teaching Assistants (over 200 teaching assistants registered for the daylong conference). • Annual Genteels’ Excellence in Teaching Conference, which featured a keynote by Robert J. Beichner, along with breakout sessions and post-conference workshops (over 90 people registered for the daylong conference).

Keynote speaker Daniel F. Sullivan, senior advisor to the president and advancement fellow, Association of American Colleges and Universities

• Assessment 4.0: Defining Quality, which featured keynotes by Daniel F. Sullivan and Robert W. Aaron, along with breakout sessions and post-conference workshops (over 126 people registered for the daylong conference). Video production projects included: • A three-day video production workshop along with post-production and dissemination support for 21 faculty from across the country as part of the National Science Foundation project “Case Studies and the Flipped Classroom” (in collaboration with the Department of Biological Sciences and the University Libraries). • An introductory video for the university’s first published MOOC, “ADHD: Everyday Strategies for Elementary Students,” for the Graduate School of Education. • “Pharmacy Professional Practice Review Series,” an instructional video for the School of Pharmacy and Pharmaceutical Sciences.

Keynote speaker Robert W. Aaron, executive director of the Center for the Study of Student Life, The Ohio State University

• A series of videos in support of pedagogy and faculty development (“Quality by Design: Backwards Design,” “Feedback for Learning” and “Writing Learning Outcomes”). Digital and electronic communications • Continued enhancement of the CEI website, including expanded content, additional request forms and administration pages. • Redesigned UB Course Evaluation System help website. • Assisted with the development of the UB Curriculum website. • Developed promotional materials to inform the UB community of services, workshops and special events offered by CEI. • Provided design services for the School of Dental Medicine’s Student Research Day.

6

Center for Educational Innovation

EDUCATION DIFCON12 These video interviews give insight into the emotions and reactions of faculty facilitators and students who participated in the DIFCON12 Difficult Conversations events, which were organized by the Office of the Vice Provost for Equity and Inclusion and held in the spring 2016 semester. Each video focuses on one event topic, including “Why the Backlash Against #BlackLivesMatter,” “Race and Privilege on Campus” and “The Myth of the Asian-American Model Minority.” A final video, “DIFCON: Lessons Learned,” includes summary interviews from all the events.

Quality by Design (QbD) QbD is an online faculty development course and open educational resource (OER) that provides open access to high-quality course content and opportunities for participants to engage in meaningful discussions with experts and peers on topics relating to course design, interaction, learner support and assessment. Built and delivered through a collaborative effort between UB and SUNY instructional support staff, QbD is now a SUNY supported resource. The online course has run eight cohorts, with a total of 425 registrants.

EDUCATION

Shequel Jones, a student in the School of Management, discusses his participation and reaction to the “Why the Backlash Against #BlackLivesMatter” DIFCON conversation.

Teaching Certificate For Postdoc Research Associates In 2015–2016, the Center for Educational Innovation and The Graduate School collaborated in offering a teaching certificate program for postdoctoral research associates. This program consisted of six two-hour workshops on the following topics: • Essential Elements of Effective University Teaching • Basic Principles and Effective Techniques of Assessment • The Syllabus: A Contract Between Faculty and Students • Teaching With Technology • Online Learning in the Next Generation • Teaching as Scholarship: Becoming the Next-Generation University Faculty Fifty-two postdoctoral research associates registered for the workshop series, with 37 postdocs completing the series and receiving their teaching certificates jointly issued by the Graduate School and CEI.

2015–2016 Annual Report

7

Teaching Online: An Orientation This course has been developed as a set of self-paced, online modules that allow faculty who are new to online teaching to explore and learn about topics such as asynchronous vs. synchronous, instructor presence and student engagement and interaction.

Teaching Students From Around the World This is a two-part online video workshop that presents faculty and staff with an understanding of international student perspectives and how they can use this information to improve communication and learning among international students. The first of these workshops, Promoting Class Participation, includes presentations on cultural assumptions, the importance of group harmony and attitudes on class participation. The second workshop, Academic Integrity, includes presentations on international student learning styles and student academic relationships. Produced in collaboration with the Office of International Student and Scholar Services.

Teaching UB Seminars This online video workshop provides information to help faculty prepare to teach UB Seminar courses. Video presentations include: a review of the basic goals and learning outcomes of UB Seminars, including some suggestions on how to handle academic success learning outcomes; using ePortfolios in UB Seminars; and the demographics and interests of our incoming freshman class. In addition, Andrew Stott, vice provost and dean of undergraduate education, shares some personal experiences teaching a pilot version of a UB Seminar. Produced in collaboration with the Division of Academic Affairs and the Office of the Vice Provost and Dean of Undergraduate Education.

Tools of Engagement Project (TOEP) TOEP is an on-demand online discovery-learning professional-development resource. The goal of TOEP is to encourage SUNY faculty and staff to explore and reflect upon the use of emerging technology tools to expand tech-infused pedagogy. The TOEP community provides a supportive environment that encourages participants to reflect on how they might integrate these technology tools into teaching and learning. TOEP Phase 4 included 338 registrants from across 21 SUNY campuses (94 registrants were from UB).

8

Center for Educational Innovation

UBlearns Overview This module has been developed as a self-guided online introduction to UBlearns. CEI staff facilitate discussions and answer questions in UBlearns for faculty, staff and teaching assistants who are taking the course.

Workshop for Department Chairs on Teaching Mentoring Upon an invitation from the Office of the Vice Provost for Faculty Affairs, the Center for Educational Innovation conducted a three-hour workshop for department chairs on teaching mentoring. The workshop covered the necessity for teaching mentoring, as well as techniques and resources.

Workshops for Teaching Assistants The Center for Education Innovation offered two workshops for teaching assistants who registered for the Department of Chemical and Biological Engineering CE 599 Supervised Teaching course. The workshops covered topics related to effective teaching and assessment.

ENGAGEMENT

Keynote speaker Robert J. Beichner, Alumni Distinguished Undergraduate Professor, NC State University, introduced the SCALE-UP Project to more than 90 UB faculty and staff at the 2015 Genteels’ Excellence in Teaching Conference.

2015–2016 Annual Report

9

RESEARCH & DEVELOPMENT CEI Seed Grant for Promoting Pedagogical Innovation COMING IN 2017 Pedagogical Innovation

The Center for Educational Innovation serves as a nexus for campuswide efforts to further elevate the scholarship of, and research support for, pedagogical advancement and improved learning at the university. The Seed Grant for Promoting Pedagogical Innovation, offered annually through the Center for Educational Innovation, intends to promote excellence in university teaching, learning and assessment. In particular, it intends to enhance UB’s capacity to successfully obtain external grants to support university pedagogical innovation. Five proposals were awarded funding in 2016:

The next Call For Proposals for CEI’s Seed Grant for Promoting Pedagogical Innovation will take place in February 2017.

Crowdsourcing for Crowd-learning: A New Online Tool for Advanced Peer Assessment PI: Alexander Nikolaev, assistant professor, Department of Industrial and Systems Engineering Co-PI: Suzanne Miller, professor, Department of Learning and Instruction

Digital Music Notation with Auto-Grading and Immediate Feedback PI: Richard Plotkin, professor, Department of Music Promoting Learning Using Telepresence Robots in College Classroom and Labs PI: Changxu Wu, associate professor, Department of Industrial and Systems Engineering Using College Students’ Physiological Cycles to Predict Performance in Gateway Physics Courses PI: Eduardo Mercado III, professor, Department of Psychology Co-PI: Surajit Sen, professor, Department of Physics

Wicked, Messy, Clumsy: Comparing Qualitative Methods for Evaluating Student Experiences in PBL Settings PI: Korydon Smith, associate professor, Department of Architecture Co-PI: James N. Jensen, professor, Department of Civil, Structural and Environmental Engineering

10

Center for Educational Innovation

CEI Sponsored Projects A Case Study of the Role of the Instructor and Student Engagement in Asynchronous Discussion Forum: A Multi-Method Approach (In-Gu Kang) This study aims to investigate how the instructor plays a role in enhancing student engagement in asynchronous discussion forums in an online course by using archives containing student and instructor activities in discussion forums. Student Engagement in University Classrooms (Xiufeng Liu, Carol Van Zile-Tamsen, Clyde Herreid, Surajit Sen) This pilot study intended to validate a published instrument on student engagement in university classrooms. Students in select large biology, physics and mechanical engineering courses in the spring semester responded to an online survey, and construct validation and reliability analysis were conducted. Findings of this pilot study will inform future grant proposals on student engagement in university classrooms. Validity Study of the UB Student Evaluation of Teaching (UBSET) (Christopher Rates) This study is investigating whether UBSET measures what faculty and students consider effective teaching, whether it does so accurately and reliably, and how the measure can be improved.

Externally Sponsored Projects Case Studies and the Flipped Classroom This National Science Foundation-funded project assists faculty in developing video production skills in order to create original video content to accompany their written case studies and publishes the final materials on the National Center for Case Study Teaching in Science online library. Over the past three years, 62 faculty have attended the three-day workshop where they participated in video production, animation and editing activities. Clyde F. Herreid, PI; Nancy Schiller, co-PI; John Wild, CEI video producer National Science Foundation • Sept. 1, 2013–Aug. 31, 2016

Collaborative Research: AGEP Transformation Alliance: CIRTL AGEP-Inclusive Excellence and Improved Climate for Future Faculty Xiufeng Liu, PI; Luis Colon, co-PI; Chris Connor, senior project personnel National Science Foundation • Oct. 1, 2016–Sept. 30, 2021 Status: Funded ($150,098)

2015–2016 Annual Report

11

CTSA/KL2 Mentored Career Development Program: Engaging a Diverse Workforce of Translational Researchers Educational experiences are designed to provide professional development activities in the development of clinical and translation science competencies for junior faculty. Tim Murphy, PI (CTSA); Margarita Dubocovich, PI (KL2); Kim Griswold, co-PI (KL2); Xiufeng Liu, co-PI (KL2); Carol Van Zile-Tamsen, co-PI (KL2) National Institutes of Health • Aug. 12, 2015–Mar. 31, 2019

Enabling Access to Cutting-Edge Biomedical and Behavioral Science A mentoring program to recruit and support underrepresented minority students into biomedical and behavioral sciences doctoral programs. Margarita Dubocovich, PI; Raj Rajnarayanan, co-PI; Xiufeng Liu, co-PI National Institutes of Health • March 28, 2012–Feb. 28, 2017

Increasing Access, Completion and Seamless Transfer Success Through the Development of Common Student Learning Outcomes, Diagnostic Assessment and Supportive Digital Teaching Resources for High Demand/High Impact Gateway Courses A. Scott Weber, PI; Xiufeng Liu, co-PI; Carol Van Zile-Tamsen, co-PI SUNY Expanded Investment and Performance Fund (EIPF) 2016–June 30, 2021

•

July 1,

Status: Funded ($1,000,000 shared with three other SUNY university centers)

Measuring the Effectiveness and Implementation of a Genetics MOOC Christopher Rates, PI; Martha Greatrix, co-PI; Jennifer Surtees, co-PI; Marc Halfon, co-PI; Susan Smith, co-PI SUNY Innovative Instructional Technology Grants (IITG) • July 1, 2016– June 30, 2017 Status: Funded ($19,500)

12

Center for Educational Innovation

MIA: Veteran-Specific Content in SUNY Professional Graduate Degree Programs This SUNY Office of Diversity, Equity and Inclusion Grant was to facilitate a conversation amongst faculty and staff from UB, Empire State College and Oswego to promote the inclusion of veteran and military family content in health care curriculum. Meetings were held in Syracuse, N.Y., and resulted in publication development, conference presentation and model development for curriculum sharing across the SUNY system. Penny Coleman, PI; Cathleen Morreale, CEI representative SUNY ODEI • June 1, 2015–July 31, 2016

Open Door to Open SUNY (ODOS): MOOC multi-dimensional subgroups, prediction and implementation project Christine Kroll, PI; In-Gu Kang, co-PI; Cyndi Burnett, co-PI; Gregory Fabiano, co-PI; Yvonne D. Harrison, co-PI; Margaret Schedel, co-PI SUNY Innovative Instructional Technology Grants (IITG) • July 1, 2016– June 30, 2017 Status: Funded ($43,750)

Research-Based Best Practices for Creation and Integration of Videos Into College Teaching Rebecca Rotundo, PI; Michele Messenger, co-PI; John Wild, co-PI; In-Gu Kang, co-PI; Carol Van Zile-Tamsen, co-PI SUNY Innovative Instructional Technology Grants (IITG) • July 1, 2016– June 30, 2017 Status: Funded ($20,000.00)

Telling My Story: Communicating with Digital Literacy John Wild, production lead, CEI; Melanie Green, faculty lead; Robert Orrange, student lead; Cathleen Morreale, assessment lead UB Graduate School • Sept. 1, 2016–May 30, 2017 Status: Funded ($10,000)

University at Buffalo/Buffalo Public Schools Interdisciplinary Science and Engineering Partnership An innovative approach to teacher professional development among 12 high-needs urban schools via interdisciplinary research experiences during the summer, followed by development of interdisciplinary science teaching and learning materials and implementation in the classroom. Joe Gardella, PI; Xiufeng Liu, co-PI; Alex Cartwright, co-PI; Satpal Singh, co-PI The National Science Foundation • Sept. 1, 2011–Aug. 31, 2016

2015–2016 Annual Report

13

Pending Projects A Personalized Social Belonging App (SNAPP) for Promoting Retention of Underrepresented Students in STEM Majors Rohini Srihari, PI; Carol Van Zile-Tamsen, co-PI UB IMPACT Grants Status: Under Review

Strategies: Geotechnology Experiences for Students and Teachers Joseph A. Gardella, PI; Ling Bian, co-PI; Xiufeng Liu, co-PI; Sandro Sodano, co-PI; John Cerne, co-PI National Science Foundation Status: Pending

Conference presentations Chudyk, S. A., Liu, X., Eades-Baird, M., Waight, N., & Yang, Y. (April 2016). The implementation of interdisciplinary science inquiry of biology teachers compared to physical science teachers. Paper presented at the annual meeting of the NARST-A Worldwide Organization for Improving Science Teaching and Learning through Research, Baltimore, MD. Eades-Baird, M., & Liu, X. (April 2016). Urban science teachers’ implementation of common core state standards for ELA within the context of interdisciplinary science inquiry. Paper presented at the annual meeting of the NARST-A Worldwide Organization for Improving Science Teaching and Learning through Research, Baltimore, MD. Greatrix, M. (June 2016). On the leading edge of faculty development: Incorporating gamification, open access and large-scale collaboration. Presented at SUNY Conference on Instructional Technologies (CIT), Potsdam, NY. Greatrix, M., Slomka, T., Tsembelis, A. & Van Zile-Tamsen, C. (April 2016). Promoting and assessing learning in the classroom: Using the Rubrics tool in UBlearns. Presented at Assessment 4.0: Defining Quality, University at Buffalo, Buffalo, NY. Grinslade, S., Van Zile-Tamsen, C., Winkelman, T.A., & Lacara, M. (July 2015). A metacognitive learning strategy that guides intentional learning and reflection in nursing. Paper presented at the 26th International Nursing Research Congress, San Juan, Puerto Rico.

14

Center for Educational Innovation

Kang, I.-G., Liu, X., & Van Zile-Tamsen, C. (June 2016). Student engagement and the role of instructor in online learning: A multimethod approach of using social network analysis (SNA) and content analysis (CA). Poster presented at the 8th Annual UB Postdoc Research Symposium, University at Buffalo, Buffalo, NY. Morreale, C. & Carter, M. (June 2016). Online course evaluation project. Presented at the Society for Teaching and Learning in Higher Education (STLHE) Conference, London, Ontario. Rates, C. (June 2016). Validity study of the UB Student Evaluation of Teaching (UBSET). Poster presented at the 8th Annual UB Postdoc Research Symposium, University at Buffalo, Buffalo, NY. Slomka, T. (April 2016). UB annual academic program assessment service: Web application. Presented at ANNY Regional Conference, University at Buffalo, Buffalo, NY. Slomka, T. (April 2016). The value of assessment: A crowd source research project. Presented at ANNY Regional Conference, University at Buffalo, Buffalo, NY. Sullivan, R. (April 2016). Tools of Engagement Project (TOEP): Ondemand discovery learning professional development. Presented at Association of Program Directors in Vascular Surgery (APDVS), Chicago, IL. Sullivan, R. (June 2016). Tools of Engagement Project (TOEP): Systemwide inquiry-based professional development. Presented at New Media Consortium (NMC), Rochester, NY. Sullivan, R. (October 2015). Measuring the impact of the Tools of Engagement Project (TOEP). Presented at Genteels’ Excellence in Teaching Conference, Buffalo, NY. Sullivan, R. (February 2016). TOEP as a SUNY-wide accessible resource. Presented at Center for Online Teaching Excellence (COTE) Summit, Syracuse, NY. Sullivan, R. (September 2015). Using social media tools of engagement together with your learning management system. Presented at Western New York Blackboard User Group (WNYBUG), Hamburg, NY. Sullivan, R. (August 2015). Using social media tools of engagement for creative student assessments. Presented at Annual Teaching and Learning Conference, Fredonia, NY.

2015–2016 Annual Report

15

Sullivan, R. (January 2016). Tools of Engagement Project (TOEP): Online, on-demand faculty development creating community across system boundaries. Presented at International Academic Forum Conference (IAFOR) on Technology in the Classroom, Honolulu, HI. Sullivan, R. (June 2016). Quality by Design panel session for the SUNY FACT2 Excellence Award for Instructional Support. Presented at SUNY Conference on Instructional Technologies (CIT), Potsdam, NY. Sullivan, R. (June 2016). The evolution of TOEP as a SUNY-wide resource. Poster presented at SUNY Conference on Instructional Technologies (CIT), Potsdam, NY. Trainor, D. (November 2015). Creating poster presentations that make your audience happy. Presented at the Annual Conference of the Northeast Association of Institutional Research, Burlington, VT. Van Zile-Tamsen, C. (November 2015). Using Rasch analysis to review the quality of rating scales. Paper presented at the Annual Conference of the Northeast Association of Institutional Research, Burlington, VT. Van Zile-Tamsen, C. (November 2015). Leading institutional change from below: A case study. Paper presented at the Annual Conference of the Northeast Association of Institutional Research, Burlington, VT. Van Zile-Tamsen, C., & Liu, X. (October 2015). Using psychometric analysis to inform change to university course evaluations. Paper presented at the Annual Conference of the International Society for the Scholarship of Teaching and Learning, Melbourne, Australia. Van Zile-Tamsen, C., & Liu, X. (October 2015). Shared leadership and advocacy efforts to promote institutional change: A case study. Paper presented at the Annual Conference of the International Society for the Scholarship of Teaching and Learning, Melbourne, Australia. Van Zile-Tamsen, C., Morreale, C., Emerson, C., & Herzog, M. (April 2016). Thinking skills by design: Using a capstone ePortfolio to promote reflection, critical thinking and integration. Paper presented at the Conference on Teaching Innovations and Enhancing Learning (TIEL), Amherst, NY.

16

Center for Educational Innovation

Yang, Y., Liu, X., & Eades-Baird, M. (April 2016). Effects of an ISEP professional development on teachers’ PCK and students’ understanding of science. Paper presented at the annual meeting of the NARST-A Worldwide Organization for Improving Science Teaching and Learning Through Research, Baltimore, MD. Yang, Y., Peng, H., Liu, X., & Eades-Baird, M. (April 2016). Validation of an instrument for measuring students’ understanding of science in grades 4-8 over multiple semesters: A Rasch measurement study. Paper presented at the annual meeting of the NARST-A Worldwide Organization for Improving Science Teaching and Learning Through Research, Baltimore, MD.

Publications CEI Publications Kang, I.-G., (2016). Descriptive Statistics of UB Online Course Offering in 2015. Kang, I.-G., (2016). An Overview of Classroom Response Systems (CRS) in Higher Education. Kang, I.-G., (2016). Trends and Future of Learning Management Systems (LMSs) in Higher Education. Kang, I.-G., (2016). Trends of Online Learning in Higher Education: How Online Learning Will Shape Higher Education. Rates, C., (2016). Validity Study of the UB Student Evaluation of Teaching (UBSET): Technical Report.

Refereed Publications Chi, S., Liu, X., & Gardella, J. A. (2016). Measuring university students’ perceived self-efficacy in science communication in middle and high schools. Universal Journal of Educational Research, 4(5), 1089-1102. Fish, J., Livingston, J. A., Van Zile-Tamsen, C., & Patterson, D. (in press). Victimization and substance use among Native American college students. Journal of College Student Development. Hadenfeldt, J. C., & Neumann, K., Bernholt, S., Liu, X., & Parchmann, I. (2016). Students’ progression in understanding the matter concept. Journal of Research in Science Teaching, 53(5), 683–708.

2015–2016 Annual Report

17

Liu, K., & Liu, X. (2016). Opportunities to learn at home and ChineseAmerican high school students’ mathematics achievement. In Li G. & M. Wen (eds.), Chinese Heritage Students in North American Schools: Understanding Hearts and Minds Beyond Test Scores (Chapter 8, pp. 120-134). New York: Routledge. Liu, X. (2016). Commentary: Innovative curriculum materials: Development, pilot-testing, and scaling-up. In Mei-Hung Chiu (Ed.), Science Education Research and Practice in Asia (chapter 26, pp. 483-488). New York: Springer. Morreale C. & Fronczak, N. (2016). Experiential learning in postsecondary education: Application of a learner-centered online internship program model. In Keengwe, J., & Bull, P. H. (Eds.), Handbook of Research on Digital Content and Learning Technologies. Park, M., & Liu, X. (2016). Assessing understanding of the energy concept in different science disciplines. Science Education, 100, 483516. Patterson, D. A., Perkins, J., Van Zile-Tamsen, C. (in press). Impact of stranger violence and intimate partner violence on the grades of American Indian/Alaska Native undergraduate college students. Journal of Interpersonal Violence. Patterson, D. A., Van Zile-Tamsen, C., Black, J., Billiot, S., & Tovar, M. (2015). Impact of disability and other physical health issues on academic outcomes among American Indian and Alaskan Native college students: An exploratory analysis. Journal of Social Work in Disability & Rehabilitation 14(3) 208-221. Peng, H., Liu, X., Zheng, & Jia, M. (2016). Using Rasch measurement to validate an instrument for measuring the quality of classroom teaching in secondary chemistry lessons. Chemistry Education Research and Practice, 17, 381-393. Van Zile-Tamsen, C. (2016). Instructional strategies to promote higher-order thinking skills: The importance of reflection. In G. Gibson (ed.), Critical thinking: Theories, Methods and Challenges (pp. 143-162). New York, NY: Nova Science Publishers. Waight, N., Liu, X., & Gregorius, R. (in press). Understanding the life cycle of computer-based models: The role of expert contributions in design, development and implementation, Educational Technology Research and Development, DOI: 10.1007/s11423-0159402-9.

18

Center for Educational Innovation

AWARDS & RECOGNITIONS SUNY Chancellor’s Award for Excellence in Professional Service Roberta (Robin) Sullivan was one of the recipients of this Chancellor’s award, which recognizes consistently superior professional achievement within and beyond the position. SUNY FACT2 Excellence Award for Instructional Support Roberta (Robin) Sullivan received the Instructional Support Award, which acknowledges innovative uses of educational technologies to meaningfully improve teaching and learning by working individually or in collaboration with teaching faculty in the strategic application of curriculum within SUNY. Open SUNY Center for Online Teaching Excellence Effective Practice Award Quality by Design (QbD) received the Effective Practice Award, which showcases online best practices, strategies and innovative online teaching and learning activities of exemplary Open SUNY Fellows and online practitioners from across the SUNY system. Martha Greatrix and Roberta (Robin) Sullivan were part of the team that designed and developed QbD. Professional and Organizational Development Network in Higher Education (POD) Innovation Award Finalist The Tools of Engagement Project (TOEP) was one of six nationally recognized finalists for creative ideas for faculty development for the enhancement of teaching and learning. Roberta (Robin) Sullivan is the project director of TOEP. Murray Straus Interpersonal Violence Original Research Award Presented at the 20th International Summit and Training on Violence, Abuse and Trauma Across the Lifespan in San Diego, Calif., to collaborators Jill Fish, Jennifer Livingston, David Patterson and Carol Van Zile-Tamsen. Eighth Annual Postdoctoral Research Symposium Christopher Rates was awarded first place in the poster competition for his research poster Validity Study of the UB Student Evaluation of Teaching (UBSET).

2015–2016 Annual Report

19

STAFF DIRECTORY Administration Xiufeng Liu, Director, Center for Educational Innovation; Professor, Department of Learning and Instruction 212 Capen Hall, North Campus 716-645-4050 • [email protected] Carol Van Zile-Tamsen, Associate Director 212 Capen Hall, North Campus 716-645-3905 • [email protected] Renee Crandall, Office Manager 212 Capen Hall, North Campus 716-645-1801 • [email protected]

Application Administration of Instructional Technologies Mark Woodard, UBlearns Lead Application Administrator 212 Capen Hall, North Campus 716-645-6128 • [email protected] Gary Koteras, UBlearns Application Administrator 212 Capen Hall, North Campus 716-645-2189 • [email protected] Rebecca Rotundo, Instructional Technology Specialist 212 Capen Hall, North Campus 716-645-7748 • [email protected]

Communication, Engagement and Dissemination Donald Trainor, Communications and Marketing 316 Harriman Hall, South Campus 716-829-3687 • [email protected] Monica Carter, Engagement and Dissemination 316 Harriman Hall, South Campus 716-829-3686 • [email protected] John Wild, Instructional Video Production 212 Capen Hall, North Campus 716-829-2972 • [email protected]

20

Center for Educational Innovation

Online Learning Martha Greatrix, Online Learning Specialist 316 Harriman Hall, South Campus 716-829-3582 • [email protected] In-Gu Kang, Online Learning Analytics Postdoctoral Research Associate 316 Harriman Hall, South Campus 716-645-1833 • [email protected] Michele Messenger, Online Instructional Designer 316 Harriman Hall, South Campus 716-829-2115 • [email protected] Roberta (Robin) Sullivan, Online Learning Specialist 316 Harriman Hall, South Campus 716-645-0773 • [email protected]

Student Assessment and Program Evaluation Cathleen Morreale, Curriculum, Student Assessment and Course Evaluation Support 212 Capen Hall, North Campus 716-645-5593 • [email protected] Christopher Rates, Psychometrics Postdoctoral Research Associate 212 Capen Hall, North Campus 716-645-0780 • [email protected] Thomas Slomka, Program Assessment and Annual Assessment Reporting 212 Capen Hall, North Campus 716-645-0776 • [email protected] Carol Tutzauer, Curriculum and Student Learning Assessment 212 Capen Hall, North Campus 716-645-3901 • [email protected]

2015–2016 Annual Report

21

Center for Educational Innovation The Center for Educational Innovation (CEI) serves as a nexus for campuswide efforts to further elevate the scholarship of, and research support for, pedagogical advancement and improved learning at the university. Email

[email protected] Web

www.buffalo.edu/ubcei North Campus

212 Capen Hall Buffalo, NY 14260-1680 716-645-7700 South Campus

316 Harriman Hall Buffalo, NY 14214-8025 716-829-3030