November 20, 2019 Delivery WG Call Notes

From LADCO Wiki
Jump to: navigation, search

Action Items

Attendees

Zac, Jeff, Amy, Chris

Agenda

  • Discuss EPA training delivery webinar
  • Review training evaluation and develop approach for integration into APTI-Learn/new LMS
  • Update on instructor list, and interface with planning and support WG on recruitment
  • Develop instructors/auditors evaluation instrument

Call Notes

Discuss EPA training delivery webinar

  • EPA contractor developed a report that describes the delivery methods; Chris will send document and ask for comments; send comments back to Chris in an email rather than in document
  • Contractor will give webinar on 12/16 that will summarize the document
  • Next step will be a decision tool, what will that be? Probably web-based but don’t yet have details
  • Borrowing Amy’s charter concept to provide users with a plan to carry out the different training delivery methods for their course
  • It’s important to have a common language that also reflects the vernacular being used in the greater training community

Review training evaluation and develop approach for integration into APTI-Learn/new LMS

  • Evaluation instrument developed by previous JTC WG's, piloted over course of last year or so
  • Zac to send Chris new evaluation instrument link; Chris to check with EPA on getting the evaluation put into APTI-Learn

Update on instructor list, and interface with planning and support WG on recruitment

  • Jeff has been maintaining the list; contacted people on the list to see if they’re still teaching; about 40 or so people
  • There are other lists, e.g., LADCO approved contractor list, that Jeff has compared and tried to pare down and make consistent
  • Worked through some of the lists and removed groups/people who don’t make sense to the community;
  • Will starting working on these lists again
  • How is it being communicated? Next step is to ask others in the community about their experience with different people on the training list
  • Jeff also sits on the LMS workgroup and can provide some interaction there
  • Ask curriculum WG what they need in terms of delivery regarding course development
  • When a course development process starts, walk through the tool with the development team
  • How to best used different delivery methods

Develop instructors/auditors evaluation instrument

  • Course summary reports from instructors historically had been collected from EPA
  • WESTAR is creating these (so are some other MJOs) reports, but don’t know how they’re getting back to EPA
  • Summary reports have space for instructors and course auditors to provide feedback
  • One challenge is to identify which materials are being taught and how they compare to what’s in the national LMS
  • Think about survey tools, and how to match a training contractor with the materials that they taught from; this should be a functionality in the LMS
  • Example with air dispersion modeling: EPA course, Lakes, Trinity, and Providence ??; some overlap in materials, but a lot of propriety too, could cause confusion in associating evaluation with the materials
  • Amy hasn’t experienced great surveys in LMSs, star ratings usually; whatever survey you create does it need to be in there, or could it be triggered by the LMS; send link to students; may be a need to have an external software, and then somehow link the results back to the LMS and associate with the training materials/course/instructor
  • Preferable to have the eval in the LMS, but not sure how feasible
  • Would there need to be separate instruments from the instructor and auditor?
    • Are the questions different between instructor and expert auditor
    • Both instruments could have some common questions, but auditor would provide feedback on delivery and materials; instructor on materials and training logistics/course
    • Amy thinks they should be separate instruments
    • Jeff questions whether it’s generally the case that there is an auditor in the course, probably not;
  • Start with some information that we would like to know about; target a single instrument to keep it simple
  • What information do we need to know
    • New information that’s not in the class; what’s dated
    • Errors/inaccuracies/typos in the materials
    • Try to get a template/format for the instructors to provide feedback into; need to prompt for specific questions

Next Call

  • Wednesday January 15, 2019 @ 11:00 Central
  • Next call brainstorm on evaluation questions for instructors/auditors
  • What else does delivery entail?
  • Debrief on delivery webinar