70 // Design Thinking and Getting Learner Perspective with Laura Fletcher

75// Evaluation and the Judgement of "What Is" against "What Should Be" with Dr. David Williams

Today’s guest is my father Dr. David Williams. Dr. Williams is an emeritus professor from the Department of Instructional Psychology and Technology at Brigham Young University where he conducted and studied evaluations of teaching and learning in various settings. He currently serves as a missionary with his wife Denise for the Church of Jesus Christ of Latter-day saints.

Today we discuss:

• Everything Evaluation, what it is, and all of the moving parts associated with it
• The difference between evaluation, measurement, and assessment
• Dr. Williams’ 10 part evaluation model, along with multiple examples

Resources

• Dr. Williams Evaluation Model (image): https://drive.google.com/file/d/1VEGkVJMQYoJRX2SP4iSEVd8wqYtaRvRQ/view?usp=sharing
• Seven North American Evaluation Pioneers (Book) https://books.google.com/books/about/Seven_North_American_Evaluation_Pioneers.html?id=8HpTDAAAQBAJ
• Twenty-Nine Evaluation Lives (Book) https://onlinelibrary.wiley.com/doi/10.1002/ev.20273
• Dr. Williams blog with entries about various individual evaluation lives: https://evaluationlives.blogspot.com/2017/08/introduction-and-invitation.html?m=1
• Dr. Williams Qualitative Inquiry book (open access) mentioned in the end of our conversation - https://edtechbooks.org/qualitativeinquiry
• Interview with Dr. Bonnie Beresford (episode 44) https://www.buzzsprout.com/1797613/8659885
• Interview with Megan Torrence (episode 63) https://www.buzzsprout.com/1797613/8659853
• Interview with Sam Whitney (episode 26) https://www.buzzsprout.com/1797613/8659853
• Interview with Beth Wilkins (episode 49) https://www.buzzsprout.com/1797613/8659879
• Malcolm Gladwell and testing (podcast episode) https://www.pushkin.fm/episode/puzzle-rush/

Join the conversation on the LX Leader LinkedIn page: https://www.linkedin.com/company/learning-experience-leader-podcast

Bonus: Measuring the Outcomes of Learning Programs

Today's show is a solo episode in which Greg gives an audio version of a mini-research study he conducted this year.

Check out the article here, and don't miss all the resources listed at the end!

https://uxdesign.cc/solving-the-greatest-challenge-to-measuring-organizational-outcomes-of-learning-programs-5e4677a78ca7

74 // Building Your Career Using Product Management Tools with Aaron Airmet and Ash Roberts

Aaron Airmet and Ash Roberts join me again, but this time to talk about career development using PM tools and mindsets. Together they host Path into Product, a podcast for college students or professionals considering a career as a product manager but don't know where to start. Both Aaron and Ash are currently working as Product Managers at Weave Communications and have previous experience working with and in learning design environments.

Today we discuss:

• Building your career through curiosity, experimentation, and data collection
• Examples and stories of using product management tools for personal development
• The importance of reflection and giving yourself space to be wrong
• Using product management prioritization principles in career decisions

Resources

• Path into Product Podcast - https://anchor.fm/pathintoproduct
• Design Your Life (Book): https://designingyour.life/the-book/
• Design Your Worklife (Book Review Podcast Episode): https://www.buzzsprout.com/1797613/episodes/8659877
• Aaron’s article, “Want to be a Product Manager in Tech? Study the Humanities”: https://medium.com/@aaron.airmet/want-to-be-a-product-manager-in-tech-study-the-humanities-4ff169d9d0e6
• The Proximity Principle (Book): https://www.ramseysolutions.com/store/books/the-proximity-principle-by-ken-coleman
• Borrowing Brilliance (Book): https://www.penguinrandomhouse.com/books/304339/borrowing-brilliance-by-david-kord-murray/
• How Will You Measure Your Life? (Book): https://claytonchristensen.com/books/how-will-you-measure-your-life/
• Measure What Matters (Book): https://www.whatmatters.com/the-book/
• Linchpin (Book): https://www.amazon.com/gp/product/B00354Y9ZU/ref=dbs_a_def_rwt_bibl_vppi_i5
• Way of the Peaceful Warrior (Book): https://www.peacefulwarrior.com/way-of-the-peaceful-warrior/

Join the conversation on the LX Leader LinkedIn page: https://www.linkedin.com/company/learning-experience-leader-podcast

73 // A Product Manager Mindset with Aaron Airmet and Ash Roberts

Today’s guests are Aaron Airmet and Ash Roberts. Together they host Path into Product, a podcast for college students or professionals considering a career as a product manager but don't know where to start. Both Aaron and Ash are currently working as Product Managers at Weave Communications and have previous experience working with and in learning design environments.

Today we discuss:

• Different ways of defining product management
• Frameworks and mindsets instructional designers can utilize to build better learning solutions
• Curiosity, ruthless prioritization, and being a partner rather than an order taker
• Measurement in product and navigating the constraints to make an impact

Resources

• Path into Product (Podcast) - hosted by Aaron and Ash - https://anchor.fm/pathintoproduct
• Borrowing Brilliance (Book) - https://www.amazon.com/Borrowing-Brilliance-Business-Innovation-Building/dp/1592405800

Join the conversation on the LX Leader pages:

• Facebook (NEW)
• LinkedIn

Book Review - Make It Stick: The Science of Successful Learning with Dr. Bryan Tanner

Today I’m joined with Bryan Tanner, a recent PhD graduate from BYU’s Instructional Psychology and Technology department. He has a professional background in K-12, higher ed, and corporate instruction. Bryan is an avid reader of biographies and business nonfiction and our discussion today is all about this book.

From the book description: "To most of us, learning something "the hard way" implies wasted time and effort. Good teaching, we believe, should be creatively tailored to the different learning styles of students and should use strategies that make learning easier. Make It Stick turns fashionable ideas like these on their head. Drawing on recent discoveries in cognitive psychology and other disciplines, the authors offer concrete techniques for becoming more productive learners."

In summarizing and reflecting on the book we cover topics such as:

• Learning myths and tactics to overcome them
• 8 principles from the book that will change how you approach learning
• And a bunch of examples from the book and our own lives of these principles in practice

Resources

• Make it Stick book resources: https://www.retrievalpractice.org/make-it-stick
• Bryan’s blog post book summary: https://bryantanner.wordpress.com/2018/04/02/8-techniques-to-encourage-long-term-memory-retention/
• Feynman learning technique: https://fs.blog/2021/02/feynman-learning-technique/
• BYU Idaho learning model - https://www.byui.edu/learning-model

Credits

Introduction music, “For Mimi” by Twin Musicom is licensed under a Creative Commons Attribution 4.0 license.