SLOs in Action: Tracking Competency and Mastery Learning

SLOs in Action: Tracking Competency and Mastery Learning

By Jarek JanioEducation
Download on the App Store

SLOs in Action: Tracking Competency and Mastery Learning episodes

  • Rethinking Grades in the Age of AI

    "Grades as the Goal vs. Mastery of Learning: Lessons from Friday SLO Talks"

    The integration of AI tools like ChatGPT into education is spotlighting the limitations of grade-centric learning. While AI offers significant benefits, it exacerbates the existing problem of prioritizing grades over genuine mastery, necessitating a shift toward competency-based assessment.

    Key Themes

    1. Grades as a Flawed Metric Grades have long been the dominant measure of success in education, but this reliance undermines true learning. Students are incentivized to focus on achieving high marks rather than deeply engaging with and applying knowledge. As one analogy highlights, “keeping track of student attendance as an assurance of student learning is like measuring the weight of a cookbook to determine how much someone has learned about cooking.”

    2. AI Amplifies the Issue AI tools enable students to produce polished work with minimal engagement, reinforcing grades as the ultimate goal while bypassing intellectual development. This raises the stakes for reassessing how learning is evaluated.

    3. The Case for Competency-Based Assessment Shifting from output-focused evaluations to competency-based assessments offers a better measure of student growth. These assessments evaluate skills such as critical thinking, problem-solving, and the ability to apply knowledge in real-world contexts, emphasizing depth and process over final products.

    4. Faculty’s Role in Driving Change Educators are key to redefining success in education. They must design assessments that differentiate genuine understanding from AI-assisted output and create environments where learning is driven by curiosity and intrinsic motivation rather than grades.

    5. AI as a Partner in Learning Rather than treating AI as a threat, educators can reframe its role as a collaborative tool. AI can support brainstorming, critiquing work, and exploring diverse problem-solving methods, enriching the learning process.

    Proposed Strategies

    • Competency-Based Assessment: Develop assessments that emphasize the application of knowledge and demonstration of skills rather than traditional exams and assignments.
    • Process-Oriented Learning: Incorporate reflective practices such as journals, peer reviews, and iterative submissions to evaluate the learning journey.
    • Promoting Intrinsic Motivation: Engage students with real-world applications and meaningful connections, ensuring that learning itself becomes the reward.
    • Responsible AI Use: Encourage students to use AI for exploration and skill enhancement, fostering deeper engagement and understanding.

    Notable Quotes

    • “John Dewey, in Democracy and Education (1916), argued for an educational approach grounded in experiential learning and problem-solving.”
    • “David Boud and colleagues, in Rethinking Assessment in Higher Education (2007), critique traditional assessment systems for promoting shallow engagement.”
    • “Keeping track of student attendance as an assurance of student learning is like measuring the weight of a cookbook to determine how much someone has learned about cooking.”

    Conclusion

    The rise of AI in education calls for a reevaluation of traditional grading systems. Competency-based learning, process-oriented assessments, and the responsible use of AI can shift the focus from grades to skill mastery. By promoting intrinsic motivation and prioritizing meaningful learning, educators can better prepare students for the challenges of the AI age. Initiatives like Friday SLO Talks play a vital role in advancing this paradigm shift, fostering discussions that redefine educational success.

    13 min
  • Misalignment Between Grading and Learning Objectives in the Age of AI

    Rethinking Grading in the AI Era: Prioritizing Learning Over Metrics

    The growing use of AI tools in education, such as ChatGPT, is revealing fundamental flaws in traditional grading systems that emphasize quantifiable metrics over genuine learning. This shift calls for a systemic realignment of assessment practices to better reflect meaningful student learning outcomes (SLOs).

    Key Insights

    1. The Disconnect Between Grades and Learning: Traditional grading systems focus on measurable outputs like test scores, attendance, and assignment completion. While these metrics offer a surface-level indication of participation, they fail to capture deeper aspects of learning, such as critical thinking, problem-solving, and the application of knowledge. Grades often reward outcomes rather than the intellectual processes behind them, encouraging a transactional approach to education.

    2. The Impact of AI on Assessment: AI tools make it easier for students to complete assignments without demonstrating genuine understanding. This exposes the inadequacy of traditional assessments, as faculty struggle to differentiate between authentic student work and AI-assisted submissions. The situation highlights the need for assessments that evaluate the depth of intellectual engagement, not just surface-level outcomes.

    3. Challenges Faced by Faculty: Educators encounter multiple obstacles, including:

    • The limitations of traditional assessment tools in measuring true learning.
    • Time constraints that hinder the implementation of process-oriented evaluations.
    • Institutional pressures to maintain high grades and retention rates, often at the expense of deeper learning.

    4. Proposed Solutions: The document outlines several strategies for aligning assessments with genuine learning:

    • Process-Oriented Assessments: Evaluate learning through iterative processes like drafts, journals, and peer reviews to capture intellectual growth.
    • Competency-Based Grading: Shift from final grades to assessing specific skills and competencies, offering a clearer picture of student capabilities.
    • SLO Integration: Align grades with well-defined SLOs to ensure assessments measure meaningful learning outcomes.
    • Leveraging AI for Learning: Encourage students to use AI as a collaborative tool for brainstorming, refining ideas, and deepening their understanding, transforming AI from a perceived threat into an educational asset.

    5. The Need for Systemic Change: The document emphasizes that the misalignment between grading and learning is a systemic issue requiring institutional reform. Key recommendations include:

    • Advocating for funding models that prioritize skill development over performance metrics.
    • Fostering an educational culture that values mastery and intellectual engagement over grades.

    Key Quotes

    • “Grades reward outcomes, not processes.”
    • “AI tools have made it easier than ever for students to meet surface-level requirements, leaving faculty to grapple with authentic assessment.”
    • “Higher education must shift its focus from traditional performance metrics to a more holistic understanding of student success.”

    Takeaway

    The rise of AI in education underscores the urgency of rethinking traditional grading systems. By adopting process-oriented assessments, competency-based grading, and leveraging AI as a learning tool, institutions can align grades with genuine learning. This shift is essential to prepare students for a future where critical thinking, problem-solving, and adaptability are paramount.

    9 min
  • AI and the Shortcuts to Learning

    Rethinking Education in the Age of Artificial Intelligence

    AI Enables Students to Shortcut the Learning Process discussion from Friday SLO Talks.

    Main Themes:

    1. The Erosion of Authentic Learning: AI tools like ChatGPT allow students to circumvent the traditional learning process, completing assignments without genuine engagement or understanding. This "shortcut" mentality prioritizes grades over intellectual growth, mirroring existing systemic issues within education. As Alfie Kohn argues in "Punished by Rewards," grades can "strip students of their natural curiosity," incentivizing them to chase external rewards rather than develop a genuine appreciation for learning (Kohn, 1993).
    2. The Inadequacy of Traditional Assessment: Traditional methods like exams and assignments become unreliable indicators of learning in the presence of AI. As Friday SLO Talks highlights, relying on these metrics is akin to "measuring the weight of a cookbook to determine how much someone has learned about cooking." Presence and completion do not equate to mastery.
    3. The Need for a Paradigm Shift in Education: Educators must move away from superficial metrics like grades and attendance and embrace assessments that focus on competency and skill development. This requires a redefinition of learning itself, emphasizing critical thinking, problem-solving, and the process of intellectual growth.

    Key Ideas and Facts:

    • AI exacerbates existing problems: The pressure to prioritize grades over learning, as explored by Susan Blum in "I Love Learning; I Hate School," is amplified by AI, which offers a tempting path to "passing" without true understanding (Blum, 2016).
    • Focus on process over product: Assessment strategies need to emphasize iterative projects, critical reflections, and performance-based tasks that demonstrate genuine engagement with the material.
    • Cultivating intrinsic motivation: A classroom culture that values curiosity and the inherent joy of learning can help counter the allure of AI shortcuts.

    Call to Action:

    Educators and institutions must adapt to the reality of AI in education. This involves:

    • Rethinking assessment: Develop methods that accurately measure competency and skill development, focusing on the process of learning rather than simply the end product.
    • Fostering deeper engagement: Encourage intellectual curiosity and intrinsic motivation through innovative teaching practices and a supportive classroom environment.
    • Embracing AI’s potential: Utilize AI thoughtfully to enhance learning experiences, rather than allowing it to become a crutch that undermines genuine intellectual growth.

    By embracing these changes, we can harness the power of AI to create a more meaningful and effective educational experience for all students.

    8 min
  • AI and the Future of Learning

    Friday SLO Talks: AI and the Future of Education

    The recent Friday SLO Talks explored the integration of artificial intelligence (AI) in education, focusing on its opportunities and challenges. Central to the discussions was the need for pedagogical and systemic changes that prioritize student learning over traditional metrics.

    Key Themes & Insights

    1. AI's Dual Potential: AI tools like ChatGPT present significant opportunities:

    • Enhanced Accessibility: AI provides students with immediate access to resources and guidance, fostering creativity and supporting independent learning, especially for those with limited access to traditional resources.
    • Personalized Learning: AI can adapt educational content to individual needs and styles, potentially creating more effective and engaging learning experiences.

    However, these benefits come with challenges:

    • Risk of Superficial Engagement: The convenience of AI-generated solutions may discourage deep learning and critical thinking.
    • Assessment Challenges: Traditional evaluations struggle to distinguish genuine understanding from AI-assisted work, raising concerns about academic integrity and the validity of current practices.

    2. Rethinking Assessment in the AI Age:

    • Limitations of Traditional Metrics: Grades, attendance, and course completion fail to capture intellectual growth. There is a growing need for assessments that measure critical thinking, problem-solving, and other essential competencies.
    • Evolving SLOs: Student Learning Outcomes must be updated to emphasize skills and competencies necessary in a technology-driven world, shifting the focus from grades to real-world preparedness.

    3. Systemic Transformation:

    • Faculty Development: Educators require training to integrate AI responsibly, ensuring it enhances intellectual engagement. Professional development programs focusing on innovative pedagogy are essential.
    • Funding Reform: Current funding models, tied to enrollment and completion rates, do not incentivize the development of critical thinking and problem-solving skills. Advocating for funding structures that prioritize competency development is crucial.

    4. Aligning AI with Pedagogical Goals: AI must be intentionally integrated with clear learning objectives to develop the skills and competencies outlined in SLOs. Unfocused adoption risks undermining educational goals.

    Call to Action

    The discussions outlined actionable steps for the future of education:

    • Leverage AI to enhance learning while reevaluating how success is defined and measured.
    • Advocate for funding models that prioritize skill and competency development.
    • Develop assessments that genuinely measure critical thinking and problem-solving.
    • Foster a culture that values intellectual growth over traditional performance metrics.

    The Friday SLO Talks highlighted the transformative potential of AI in education while underscoring the need for thoughtful implementation to ensure that it supports meaningful learning and competency attainment.

    5 min
  • Rethinking Student Success: Moving Beyond Superficial Metrics in Higher Education

    Rethinking Student Success: Moving Beyond Superficial Metrics in Higher Education

    This podcast analyzes the equity implications of using proxies like course completion rates, GPAs, and graduation rates as the primary measures of student success in higher education. The podcast argues that these metrics perpetuate inequities by failing to account for the structural barriers faced by students from underrepresented backgrounds.

    Key Themes:

    • Structural Barriers: Students from marginalized communities face systemic challenges like economic pressures and unequal K-12 preparation that impact their ability to succeed based on traditional metrics. These metrics fail to capture the significant progress these students make despite these hurdles.
    • "Many students from marginalized communities must work full- or part-time jobs...limiting their ability to attend classes regularly or complete courses on traditional timelines."
    • "Students from underfunded K-12 schools often enter college needing remedial education... procedural metrics like course completion and GPAs fail to account for this progress."
    • Misaligned Incentives: Funding models that prioritize metrics like retention and graduation rates create perverse incentives for institutions. This can lead to the exclusion of at-risk students, a lowering of academic rigor, and a deprioritization of crucial skill-building programs.
    • "Institutions may become reluctant to admit students from underrepresented backgrounds, fearing their perceived 'risk' could negatively impact metrics tied to funding."
    • "Institutions incentivized to push students through the system quickly may neglect critical investments in skill-building programs...that would truly benefit underrepresented students."
    • The Skills Gap: Focusing on procedural metrics neglects the development of critical skills like communication and problem-solving, skills highly valued by employers. This skills gap disproportionately affects underrepresented students, hindering their social mobility.
    • "Employers consistently report that graduates lack essential skills...This skills gap disproportionately impacts underrepresented students, who may rely on their education as a pathway out of poverty."

    Call to Action:

    The podcast advocates for a shift to equity-centered metrics that:

    • Assess Real Progress: Measure demonstrated skill growth, competency attainment, and the application of knowledge in real-world settings.
    • Provide Institutional Support: Incentivize investments in tutoring, mentorship, and competency-based learning focused on skill and competency attainment and tailored to the needs of marginalized students.
    • Value Diverse Outcomes: Recognize diverse student goals beyond traditional pathways like workforce readiness or academic advancement.

    Conclusion:

    Equating superficial metrics with student success undermines the transformative potential of higher education, particularly for marginalized students. By embracing equity-centered funding models that prioritize skill and competency development, higher education can truly fulfill its promise as a driver of social mobility and empower all students to thrive.

    11 min
  • Funding Higher Education: Aligning Resources with Learning Outcomes

    Rethinking Higher Education Funding: A Focus on Observable Outcomes

    This podcast reviews arguments for shifting higher education funding models to prioritize observable student learning outcomes (SLOs) over traditional metrics like attendance and degree attainment.

    The Problem: A System Misaligned with Learning

    Current higher education funding and evaluation rely on metrics that fail to answer the crucial question: "What are students actually learning?" While diplomas may indicate persistence, they don't necessarily guarantee mastery or workforce readiness. As the source states, "a diploma may reflect persistence but not necessarily mastery or readiness for the workforce." This disconnect between metrics and real-world outcomes undermines the value of higher education.

    The Solution: Funding Based on Skill and Competency Attainment

    The proposed solution advocates for funding models that prioritize observable student learning outcomes (SLOs). SLOs represent demonstrable skills and competencies, like problem-solving, effective communication, and the practical application of knowledge.

    This approach offers several advantages:

    • Transparency: A clear link between instruction and learning outcomes is established, benefiting faculty, administrators, and students.
    • Accountability: Institutions can showcase their effectiveness in preparing students for real-world challenges.
    • Equity: Focusing on outcomes creates a level playing field for students from diverse backgrounds, prioritizing their abilities over traditional success markers.

    The source emphasizes that valuable traits like "growth mindset, grit, and habits of mind are valuable only when tied to learning outcomes. They are means to an end—not the end itself."

    Call to Action: Engaging Stakeholders

    The document outlines a clear call to action for different stakeholders:

    • Politicians: Policymakers must recognize that funding tied to observable learning outcomes ensures tangible results from public investment in higher education, directly addressing workforce needs and societal challenges.
    • Students: Higher education should be about acquiring skills and knowledge for career success and societal contribution, not just obtaining a degree.
    • Faculty: Educators should embrace SLOs to enhance their teaching practices and support student mastery by aligning instruction with measurable outcomes.
    • General Public: Focusing on learning outcomes yields broader societal benefits, with graduates equipped to solve problems, drive innovation, and participate as active citizens.

    Final Reinforcement: Reclaiming Higher Education's Value

    By focusing on observable learning outcomes, we can restore faith in the value of higher education. The narrative shifts from degrees as mere credentials to education as a transformative process that empowers individuals to thrive in a rapidly changing world. "When higher education delivers clear evidence of student learning, it reclaims its relevance and appeal," argues the source.

    Conclusion

    This approach emphasizes measurable, actionable outcomes and addresses stakeholder concerns while reinforcing the importance of skill and competency attainment as the core purpose of higher education.

    6 min
  • Proxies and Student Success in Higher Education

    The Danger of Equating Proxies with Student Success in Higher Education

    This podcast critiques the use of proxy metrics like course completion rates and GPAs as the primary indicators of student success in higher education.

    Main Theme: The current funding models in higher education, which rely heavily on proxy metrics, are detrimental to the true purpose of education and fail to prepare students for success in the real world.

    Key Arguments:

    • Proxies Misrepresent Learning: Metrics like GPAs and diplomas do not accurately reflect the depth and quality of a student's learning. "A student may attend classes regularly, complete all assignments, and earn a degree without acquiring critical skills or competencies." This leads to a system that prioritizes superficial achievements over genuine understanding and skill development.
    • Misaligned Incentives Undermine True Success: Tying funding to proxy metrics encourages institutions to prioritize metrics over meaningful learning experiences. "When funding is tied to these proxies, institutions face immense pressure to maximize these metrics rather than ensuring students develop the skills and knowledge necessary for success beyond the classroom." This can result in grade inflation, lowered academic rigor, and a focus on pushing students through the system rather than equipping them for real-world challenges.
    • The Cost of Bypassing Skill and Competency Attainment: The excerpt argues that employers and society value individuals who can apply their knowledge and skills, not just those who possess degrees. "The workforce and society do not reward students for diplomas, GPAs, or attendance records. They reward individuals for their ability to apply what they have learned to solve problems, innovate, and contribute meaningfully." The current funding model perpetuates a disconnect between the skills graduates possess and those required by the workforce.
    • Student Learning as the True Measure of Success: The true measure of student success lies in their ability to demonstrate the skills and competencies necessary to adapt and thrive in their chosen fields and in society. "True student success is not about moving through the system quickly or collecting credentials; it is about demonstrating the skills and competencies needed to adapt and excel."
    • Shifting Funding Models Towards Learning Outcomes: The excerpt advocates for a shift in funding models away from proxies and towards assessments of student learning outcomes directly tied to competencies and skills. This would require evidence of mastery through portfolios, performance-based assessments, or real-world projects.

    Conclusion:

    The excerpt concludes that the current reliance on proxy metrics to define student success is misleading and detrimental to the integrity of higher education. To truly serve students and society, funding models must prioritize skill and competency attainment, ensuring graduates possess the tools to thrive beyond the classroom.

    14 min
  • Performance-Based Funding: A Flawed Approach

    Performance-Based Funding in Higher Education: A Critical Review

    This podcast examines the concept of Performance-Based Funding (PBF) in higher education, The podcast argues that while PBF aims to improve accountability and efficiency, it ultimately fails to promote authentic student learning.

    Key Themes & Issues:

    1. Misalignment of Funding Metrics with Learning Outcomes:

    PBF relies heavily on quantifiable metrics such as credit attainment, course completion rates, and degrees conferred. However, these metrics are criticized for failing to capture the complexities of learning and competency development.

    Quote: "While these indicators may suggest progress, they fail to reflect whether students are acquiring the skills and knowledge necessary for their personal and professional lives."

    The document emphasizes that simply completing a course or obtaining a degree doesn't guarantee mastery of the subject matter or the acquisition of essential skills.

    2. Prioritizing Quantity Over Quality:

    By tying funding to completion rates, PBF inadvertently incentivizes institutions to prioritize quantity over quality.

    Quote: "Colleges and universities may feel compelled to lower academic standards or inflate grades to ensure higher completion rates. This practice undermines the value of the credentials awarded and devalues the learning process itself."

    This focus on easily measurable outcomes can lead to the neglect of crucial skills like critical thinking, creativity, and problem-solving, which are harder to quantify but essential for student success.

    3. Neglecting Skill and Competency Development:

    The podcast argues that PBF rarely measures the attainment of practical skills and competencies that prepare students for real-world challenges.

    Quote: "Without mechanisms to evaluate and reward genuine learning, PBF remains disconnected from its stated goal of improving educational outcomes."

    This lack of focus on demonstrable skills undermines the purpose of education, which is to equip students with the necessary tools for success in their chosen fields.

    4. Overemphasis on Institutional Metrics:

    PBF systems often prioritize institutional performance over individual student development.

    Quote: "This approach treats learning as a byproduct rather than the core mission of higher education."

    This shift in focus can overlook the diverse goals of individual students, particularly those pursuing specific skills rather than a traditional degree.

    Conclusion:

    The podcast concludes that while PBF has good intentions, its current implementation relies on flawed metrics that fail to reflect genuine learning. To effectively support student learning, funding models must shift their focus from superficial measures of progress to the development of practical skills and competencies. This requires a move beyond easily quantifiable metrics and a deeper consideration of the nuances and complexities of the learning process.

    5 min
  • Performance-Based Funding: A Flawed Approach

    Performance-Based Funding: A Misguided Approach to Student Learning

    This briefing document analyzes the flaws of performance-based funding (PBF) in higher education based on the provided excerpt from "Performance Based Funding PBF.pdf".

    Main Theme: PBF, despite its aim of improving higher education, fails to genuinely support student learning by focusing on superficial metrics rather than actual competency development.

    Key Arguments:

    • Misalignment Between Funding Metrics and Learning: PBF relies on metrics like course completion and degree attainment, which are only indirect indicators of learning. The document states, "While these indicators may suggest progress, they fail to reflect whether students are acquiring the skills and knowledge necessary for their personal and professional lives." Students might complete courses without truly grasping the subject matter, especially when institutions are pressured to boost these metrics.
    • Incentivizing Quantity Over Quality: By linking funding to completion rates, PBF encourages institutions to prioritize quantity over quality. This can lead to lowering academic standards and grade inflation, ultimately devaluing the learning process and the credentials awarded. The document emphasizes, "This practice undermines the value of the credentials awarded and devalues the learning process itself."
    • Neglect of Skill and Competency Development: PBF rarely directly measures the development of skills and competencies crucial for real-world success. While credit accumulation might show program progression, it doesn't guarantee students possess the necessary analytical, technical, or interpersonal skills for their chosen careers. The document argues, "Without mechanisms to evaluate and reward genuine learning, PBF remains disconnected from its stated goal of improving educational outcomes."
    • Overemphasis on Institutional Metrics: PBF often prioritizes institutional performance over individual student development. Metrics like retention and graduation rates shift the focus from student learning to institutional success. This overlooks the diverse goals of students, especially non-traditional learners who might prioritize specific skills over a degree.

    Conclusion:

    The document concludes that PBF, while well-intentioned, falls short of its goal of fostering genuine student learning. Its focus on superficial metrics incentivizes superficial progress instead of substantive learning. To truly support students, funding models need to prioritize the development of skills and competencies relevant to real-world demands and lifelong learning. Until then, PBF will remain a flawed approach that measures institutional success without truly promoting student learning.

    5 min
  • SLOs and the Purpose of Higher Education

    Takeaways from Friday SLO Talks:

    The fundamental purpose of higher education should be to ensure students learn and develop the skills, competencies, and mastery necessary to thrive in their personal and professional lives. While course completion is often used as a proxy for progress, it is not synonymous with meaningful learning. Here’s why focusing on learning over mere completion is essential:

    1. Competency Over Compliance

    Completing a course may indicate that a student has met attendance and submission requirements, but it does not guarantee they have acquired the knowledge or skills intended by the curriculum. True success lies in whether students can apply what they've learned in real-world scenarios. For instance, a graduate in engineering should not just pass courses but demonstrate the ability to solve complex problems and design solutions.

    2. Observable Learning Outcomes

    Higher education should prioritize observable outcomes—skills students can demonstrate, competencies they can apply, and mastery they can build upon. This focus ensures that students are not merely collecting credits but genuinely growing in their fields of study.

    3. Relevance to Life and Work

    Employers and society demand graduates who can think critically, collaborate effectively, and solve problems innovatively. These competencies are best cultivated through intentional learning experiences, not the rote completion of courses. By centering higher education on learning, institutions align more closely with the needs of the workforce and the broader community.

    4. Lifelong Learning and Adaptability

    In a world of rapid change, the ability to learn continuously is more critical than ever. When the emphasis is on learning rather than completion, students develop habits of inquiry and critical thinking that serve them throughout their lives, enabling them to adapt to new challenges and opportunities.

    5. Equity in Outcomes

    A completion-focused model risks reinforcing inequities, as students from underprivileged backgrounds may graduate without the necessary skills to succeed. A learning-focused approach ensures all students leave with the competencies they need, leveling the playing field and promoting genuine success.

    6. Accountability in Education

    Education systems should be accountable for what students actually learn, not just the number of diplomas awarded. When learning becomes the metric of success, institutions are driven to improve teaching, provide meaningful feedback, and support students in achieving mastery.

    Conclusion

    Higher education should not be about checking boxes or accumulating credits; it should be about fostering transformative learning experiences that equip students with the skills and knowledge they need to succeed. By shifting the focus from course completion to actual learning, we elevate the role of education as a driver of individual and societal progress.

    14 min

About SLOs in Action: Tracking Competency and Mastery Learning

From the publisher's feed

This podcast is focused on what truly matters in education: skill and competency attainment. We examine how well-designed Student Learning Outcomes (SLOs) provide a framework for measuring…