Final report for ONE22-419
Project Information
There is a documented need for increased training in scouting and identification of greenhouse disease and insect pests. The optimum would be to have training in each greenhouse operation but that is logistically untenable. The use of online communications platforms like Zoom and teaching platforms like Moodle have potential to combine hands-on learning with information presentation from a distance. We used these two platforms to create and present a Greenhouse Scout School for growers, students, and anyone else interested in learning how to scout. The course was presented as a tuition-based certificate program – a certificate presented if sufficient aspects of the course like activities and posting in forums were accomplished, but also as a webinar series with a much lower cost where attendees were presented with the information in a more typical lecture format. Certificate students received a package of equipment that allowed them to complete the activities and had to find a greenhouse or some plant-oriented collection to scout in. The Scout School was presented 3 times – early spring 2023, fall 2023, and early spring 2024 with improvements based on student feedback each time. There were 92 people who attended at least one program over the 3 series of webinars and watched on average 5.3 of the 6 presentations. Fifty signed up for one of the certificate programs and 72% finished the required activities to receive a certificate of completion. This level of completion suggests the enthusiasm with which most students took the course. This is also borne out by the 100% survey response that they would recommend others do the same program. The Greenhouse Scout School will continue after the end of the grant period as it was designed to be a self-sustaining program.
The project seeks to ensure that trained Integrated Pest Management scouts are available to work in the NE greenhouse industry, improving the efficacy of pest management and reducing unnecessary pesticide applications, with the potential to positively affect the economic stability of the enterprise, the environment and human health
- Create, advertise, and implement an on-line training program for IPM Scouts (Scout School) including webinars, hands-on activities, and interactive discussion sessions advertised to students, existing greenhouse employees and other interested parties
- Short term impacts
- 30 people will gain knowledge from the Scout School by participating in the webinars, hands-on activities and discussion sessions
- 100 people will gain knowledge from participating in the webinars alone
- 15 people will achieve the certificate
- 75 will indicate intent to use the knowledge gained from the webinars or certificate program
- Intermediate impacts
- 25 people will report adoption of IPM scouting techniques learned
- 1 additional person will be employed as an IPM scout
- Evaluate the training program and the methods used to provide information and access a broad base of participants
- Continuing impact (increased knowledge and application of knowledge gained)
- 1 additional greenhouse IPM scouting school will be put on after the grant
Greenhouse production in the Northeast has a significant effect on the economy. In 2020, in 8 northeastern states (MA, ME, NH, CT, VT, RI, NY, NJ), the greenhouse, nursery, and floriculture industry had a value of $1,775 million in direct sales and $2,931 million in economic impact and provided 35,034 jobs (Farm Credit East 2020). In addition, NY and ME are in the top 10 states for greenhouse vegetable production (HortiDaily 2019). Due to the high value and aesthetic demands of the crop, pesticides are often the primary pest management method. In a set of 6 program states (none in the Northeast but with several having similar sales values to NYS), 1,122,600 lbs of pesticide were applied to floriculture crops in 2009 (USDA NASS 2011) indicating the potential economic impact of the pests affecting floricultural crops. For these states, 34% of growers applied pesticides on a preventative schedule and 51% used scouting data to determine pesticide use. Most scouted as a general observation while performing routine tasks while only 20% deliberately went to a crop area to scout. There is clearly a need for additional scouting training in floriculture greenhouses to limit pesticide use to only necessary applications.
A 2019 survey of 220 NY greenhouse growers (Lamb, unpublished) found that 84% scout on a regular basis and 88% encourage their staff to report issues seen while doing other tasks but only 43% have a designated scout. Sixty-two percent of those with employees train them in scouting, fewer than are trained in watering or sanitation practices. When asked if they would like additional training, 62% said they would like to learn more about disease and insect identification and 37 would like to learn more about creating IPM plans, both supported by training in IPM scouting. They would also like additional training for their staff – 31% for disease and insect identification and 24% for creating an IPM plan (these values do not account for those without employees so may be underestimates). A survey of greenhouse growers in Maine, NYS, Vermont, done as part of the current NE SARE grant, showed that 79% of growers would give an employee paid time off to participate in a scouting school and 86% would pay for an employee to attend online scout training, so we believe there is grower support for this project.
Current conditions have forced us all to learn to educate and connect to growers and students through new and expanded on-line and active learning methodologies. Growers now have more experience using on-line tools which extend our reach both in distance and in time and provide an opportunity to fill an expressed need for more training in scouting and IPM. Regional experience with integrating active and hands-on activities with on-line learning in a distanced environment is available. The green industry is poised to expand with the increased interest in gardening and employees trained in scouting methods and IPM will be needed and appreciated. While we expect this window of opportunity to continue, we think that this is the best time to offer on-line training, as proposed in this project, combined with active learning methodologies to reach a greater number of growers than could be done with in person training.
We propose to fill these information and training gaps by providing an on-line greenhouse IPM scout school in a flexible manner to provide resources to the greatest possible population. The school would consist of a 6 week period of weekly on-line webinars plus discussion (1.5 hours per week proposed). A webpage will be created to allow easy access to information on the webinar and associated resources. Growers and others who want information can participate live in some or all of the online webinars, gaining pesticide recertification credits where possible, or can access the recorded webinars and resources through the project webpage asynchronously. Those desiring a certificate from the Greenhouse IPM Scout School would register, receive an equipment package to allow them to do the hands-on activities associated with each webinar topic, and then complete the requirements of webinars, discussion, reporting and hands-on activities. If students wanted course credit from their institutions, we could work with them to accomplish that.
The intent of this project is to reach a broad audience including people of color, women, the differently abled and other diverse communities, as all have the potential to train and work as greenhouse scouts. We will work to find ways of contacting and involving such stakeholder groups to ensure that all information is accessible to them. NYS Integrated Pest Management recently hired a Bilingual Project Specialist who can help us access Hispanic greenhouse workers. For this initial program, training will be offered in English, but we will work to determine if a Spanish language version would be useful in the future. We recognize the limitations of programs requiring internet connectivity and computer equipment, as well as potential economic barriers, but we will work to overcome these obstacles as we carry out the project. Project materials, including recorded webinars, will be available through the teaching platform and a project webpage to allow as many people as possible to access them asynchronously and still participate in the program. We will follow all Cornell’s requirements for accessibility of webinars, resources, and participation in all activities.
We believe that training more growers and employees in successful scouting practices will limit the unnecessary use of pesticides while improving pest management, and result in the production of higher quality greenhouse crops, greater safety for those working in the greenhouses and better environmental outcomes. We believe these factors support SARE’s desired outcomes of sustainability and resilience, quality of life for farmers, and profitability of farming in the Northeast.
Cooperators
- - Producer
- (Educator and Researcher)
- - Producer
- - Technical Advisor
- - Producer
- - Technical Advisor
- (Educator and Researcher)
- (Educator and Researcher)
- (Educator and Researcher)
Research
As there is a perceived need for additional training in IPM scouting for greenhouse operations and few training programs available to train greenhouse scouts as an occupation, and as growers and students are becoming more used to active on-line education methods, we propose developing, presenting and evaluating an on-line Greenhouse IPM Scouting School leading to a certificate and with the objective of expanding the adoption of IPM scouting throughout the greenhouse industry.
We realize that not all those looking for information on scouting will want, need, or have the time or financial resources necessary to complete an entire Scout School program with requirements to complete. Therefore, we are creating a training program that can be completed for a certificate of completion, with registration and associated costs, but also accessed in parts for low or no cost and either live or archived to access asynchronously.
Updates for the 9.30.24 report are included in italics.
Objective 1: Create, advertise, and implement an on-line training program for IPM Scouts (Scout School) including webinars, hands-on activities, and interactive discussion sessions advertised to students, existing greenhouse employees and other interested parties
Audiences
- College students for whom a certificate in IPM scouting would provide a hiring benefit
- Existing greenhouse employees for whom a certificate in IPM scouting is desirable for themselves or their employers
- Existing greenhouse employees or students interested in learning more about IPM scouting but for whom a certificate is not necessary or desired
(The latter would not necessarily participate in all aspects of the program.)
Training will be appropriate for both floriculture and vegetable greenhouse operations. Advertising will be through lists/listservs of growers run by the PD and cooperators, social media, faculty at Universities throughout the NE, farmers’ organizations. See Outreach section for more information on advertising to a broadly diverse population.
Proposed training methodology for the certificate program
- A series of webinars on topics relevant to IPM scouting
- These will be presented using Zoom. Topics will be stand-alone but also part of the interconnected curriculum. There are 6 proposed based on the curriculum previously developed.
The first Greenhouse Scout School ran from February 1-March 8, 2023 – 6:00-7:30 Wednesday evenings. The second Greenhouse Scout School ran September 21-Oct 26 - 6:00-7:30 Thursday evenings. Both were presented as a certificate program (6:00-7:30) and a series of 1 hour webinars at the same time (6:30-7:30), with certificate students getting the full 1.5 hour program with some programming just for them, and both groups participating in the same hourlong webinar. Webinar attendees could sign up for 1 or more webinars. Certificate students attended (live or recorded) all 6 sessions.
The 2024 spring session ran from February 13-March 26 with the same format as before. We did add an additional certificate session in the middle to include a panel discussion by previous students working as greenhouse scouts and a Kahoot quiz as an interactive activity. As in past years, pesticide recertification credits were available for the 1 hour webinar portion of the session to both webinar and certificate students that wanted them.
- Webinars will be advertised individually as well as part of the certificate curriculum
The 2023 Spring Scout School and associated webinars were advertised through grower listservs in NY and VT, through presentations given by Lamb and Sullivan, through teaching faculty at Cornell, UMaine, University of Vermont, and the State Universities of NY at Cobleskill and Morrisville. The 2023 Fall Scout School and associated webinars were advertised through the same methods, plus NYS Integrated Pest Management Facebook page.
In 2024 we added some additional advertising through industry publications that have free announcement sections.
- Recorded webinars will be available on Moodle for certificate students who must miss one, and on the project webpage for other interested users. The project webpage will be linked to websites associated with all key personnel as desired and can be shared with others.
We are working with the webmaster of NYS IPM to find a suitable place to post the webinars for those just registering for the hour long webinars. The NYS IPM YouTube channel may be the best option but we may need a different option to include the related resources. We have not yet sorted this issue out. For people who paid for a webinar and missed it (Spring and Fall), I provided the recording through Cornell's Video on Demand. I provided information as pdfs at the end of the Fall webinar series. We were a little dismayed to find one of the pdfs posted on-line rather quickly (we later discovered this was something that Cornell did, not an attendee). While we think the information is valuable to everyone, we want to provide some exclusivity for at least a while to those who paid for it.
We are still debating the issue of making the content available free and online, particularly as the webinars do not change from year to year (there may be some adjustments but overall the information presented is the same). We did provide all the webinar recordings to everyone who had paid for that webinar, regardless of whether they attended or not, which seemed fair.
- Webinars will be created and presented by project staff but also may include other specialists on specific topics. Identification of speakers and the timing of the webinars will be done at the beginning of the project. Webinars can include previously recorded video for demonstrations of tactics and the creation of those videos will also take place at the beginning of the project.
For sections 2-4:
We used the teaching platform Moodle through Cornell for interacting with the certificate students. For each week Spring and Fall, there was a forum for Q&A, a place to post webinar materials, an activity that students must complete, a ‘did-you-understand-the-material’ quiz, and additional resources relating to the week’s topic. Mary McKellar has been invaluable in helping us learn to use Moodle. Based on Mary's evaluation of the Spring quiz responses, we learned that students were using them more than we expected, as they are not required. For the Fall program, we improved test questions, based on her suggestions, and doubled the number of questions available. An example topic outline and screen shots from the Moodle course are attached at the end of this section.
- Collected resources to support the information in the webinars and to use as continuing references for the scouts
- Lists of electronic references will be provided to all participants of the webinars and available on the teaching platform. Some hard copy references (the Northeast Greenhouse or Cornell Guidelines, for example) will be provided only to those registered for the certificate program.
As this is primarily a scouting course, we did not provide hard copies of the the Northeast Greenhouse or Cornell Guidelines, which primarily focus on management. We continue to update the reference lists available to certificate students through Moodle as we find new resources or improved versions of existing resources or if links to electronic sources break. There is a separate resource page for each week's topic. We provided webinar students with some of the same resources.
- Many resources will also be available on the project webpage in association with archived webinars
This hasn't been done as we don't have a location for the archived webinars yet. See comment above. For online resources, they could be sent as a list to webinar attendees and we will try to expand on this in 2025.
- Hands-on activities done individually by Scout School participants in cooperation with a local greenhouse or other approved site.
- Students registering for the certificate program will receive a set of equipment, including magnification tools, sticky cards, etc. that will be used to do the required activities.
The equipment we provided to students in the Spring was a handlens, an Optivisor, a handheld wireless microscope, yellow sticky cards and clothespin holders, flagging tape, a mockup of the GreenhouseScout app as we could not provide the actual version, a bedding plant scouting manual, practice insects on sticky cards and examples of scouting checklists. Based on what students said they did not use in Spring, for Fall we included less flagging tape, no app, and only electronic versions of the checklists and the bedding plant manual, which we are trying to get reprinted.
The equipment list for Spring 2024 was the same as for Fall 2023. For 2025, we have reprinted the bedding plant scouting manual and will send that out.
- The activities will relate to the webinar topics.
For both Spring and Fall, activities were similar and certificate student were required to complete at least 5. We improved the timing for the Fall session. The activities were: 1. a set of questions to introduced themselves to us and other students and information on where they will scout plus a map of the scouting location, 2. placing and evaluating sticky cards in the scouting location, evaluating the plants at the site, and practicing with their magnification devices (pictures submitted), 3. checking sticky cards and potato wedges and finding information on insects and diseases on one of the crops they were scouting, 4. updating the scouting map and creating a scouting form for that greenhouse, 5. posting their local Extension office and favorite sources of scouting information as part of creating a scouting resource collection and scouting the greenhouse for weeds as well as examining the plants, and 6. fill out a class evaluation.
We continue to refine the hands-on activities; both in timing to make them more relevant and for the flow of information to make sense, and in the specifics of what we are asking them to do for clarity.
- Students will report on their activities through discussion boards (see Appendix 1)
- McKellar and others have experience developing such activities. Creation of the activities will also take place in the first 4 months of the project.
- Project staff will assist participants with identifying greenhouses to work with.
During the Spring session, when it can be difficult to find an operating greenhouse in January, students were very imaginative in finding plants to scout - including school plant collections or greenhouses, a nursery in a grocery store and houseplants. In Fall 2023, students scouted commercial greenhouses and a botanical garden greenhouse.
The majority of the certificate students in Spring 2024 had greenhouses available. We did organize some linkages with University greenhouses (UMaine and Cornell) for one student and one grower whose greenhouse was not yet open to use.
- Interactive sessions to answer questions, compare experiences, encourage networking between participants and provide a framework for discussion and learning.
- Interactive sessions will be done using the Moodle teaching platform and can be live or on-line.
Instructors interacted with both certificate and webinar students through the live sessions in Spring and Fall 2023. The certificate sessions extra half hour included a set time for questions, as well as at the end of the webinar. There is a lot of information provided and it can be hard to fit in an actual discussion of a topic, especially for webinar attendees. We offered them our emails if they had further questions. For the certificate students, the online forums worked well to ask questions and get responses from all the instructors on a quick turnaround time.
In Spring 2024, we had one asynchronous certificate student. While the intent is to have the certificate program work asynchronously, there is a lot that is missed. While we believe it is possible to complete the requirements for the certificate watching the recorded videos and posting information and questions on Moodle and via instructor's emails, it does take a lot of self-starting and this student chose not to complete the requirements.
Note: Accessibility accommodations required by Cornell will be followed on webinars, resources, advertising, interactive sessions and any other activities. We will strive to make this program available and accessible to as broad a range of communities as possible.
Topic 1 for Scout School - outline (22 Nov)
Technological support needed: Cornell supports Zoom for video conferencing and Moodle as a course management system (teaching platform). The University of Maine supports Brightspace as a course management system. Project participants have experience with both. Cost of additional software as needed is included in the budget.
Timing of IPM Scout Schools
The IPM Scout Schools will be presented in early spring 2023 and in fall 2023 to learn the best time to offer future scout schools. The different time periods have advantages and disadvantages in available greenhouses/crops and competition with other activities. It may be that early spring works best for growers and fall works best for students, but we are proposing to do one of each to test the waters.
This report relates to the Spring and Fall 2023 Scout Schools, and an additional Spring 2024 Scout School.
Objective 2: Evaluate the training program and the methods used to provide information and access a broad base of participants
There are 2 aspects to evaluating the Scout School: Input from the grower advisory committee and input from participants in the webinars and the certificate program.
In Spring 2023, there were 4 students comped in to provide us with feedback on the course – 2 graduate students, 1 non-student and 1 grower. We have invited the grower advisory committee to participate in as many programs as they wish in order to provide feedback. Since Spring 2023, we have not invited anyone to attend specifically to evaluate the program, although the advisory committee are always invited.
The grower advisory committee will meet with the project staff throughout the project but in particular after the completion of each scout school. We don’t expect them to participate in the entire school program, but they are welcome to attend any webinars or view student reporting, etc.
Evaluation of participants will be through surveys. For those participating in individual webinars, we have had success with Qualtrics surveys linked through the chat, particularly if they are required for pesticide recertification credits. Those surveys will primarily measure knowledge gain and intent to apply information. For those participating in the entire certificate program, there will be a final evaluation, as well as questions throughout the program. In addition to knowledge gain, we will include questions to determine the success of the various aspects of the school. Both populations will be surveyed after the end of the program, using emails gathered at registration, for intent to apply knowledge and, in particular, if they are employed as scouts in greenhouse production.
Online Qualtrics surveys were used for all sessions, with separate sets of questions for certificate and webinar attendees. It is much easier to get responses from the certificate students than the webinar attendees. We have not yet surveyed people who completed the previous Scout School certificate sessions but plan to do that as part of the planning for 2025. We will survey both certificate and webinar attendees, particularly on their application of the information that they learned.
** Note for number of farmers who participated in research - this is the total number of people who participated in the webinars and certificate programs. The majority could be classified as farmers, but not all.
Results (new information in italics):
In Spring 2023 (Feb-Mar), there were 28 certificate students (21 greenhouse owners/employees, 6 student - graduate to high school and 1 Extension educator) and 46 people who attended at least one webinar (41 greenhouse owners/employees, 5 other plant industry). In Fall 2023 (Sept-Oct), there were 8 certificate students (3 greenhouse owners/employees, 1 student, 1 Extension educator, 1 other plant industry and 2 Master Gardeners) and 23 people who attended at least 1 webinar (all greenhouse owner/employees).
The following information is from the evaluations completed by the certificate and webinar students for the 2 time periods. Certificate and webinar evaluations are similar but not exactly the same as some questions weren't relevant. It was much easier to get certificate students to fill out the survey and the numbers for the Fall classes were quite low. Also, I recognize that evaluation completers are self-selected and possibly biased. However, I believe there is useful information in the responses. In some cases we made changes based on the Spring responses for the Fall classes so the two series are not identical although in large part the same.
Spring 2023 Certificate students (26 responses)
- As self selected:
- 20 greenhouse owner/worker
- 7 students
- 2 educators
- Students would pay $300-500 for the cours
- Best times to find a greenhouse to work in
- March/April with Jan-Feb and Sept -Oct tied for second
- With comment – harder in busier growing season
- Majority liked the time of day and 1.5 hours and 6 sessions - some would go as high as 8, none below 5 sessions
- Most would consider a 2-3 day in person scout school, with the majority saying yes, only if it was nearby
- Students didn’t mind the hybrid certificate/webinar system
- We provided a box of equipment – students thought we gave them too much flagging tape, not enough sticky cards
- Some suggested some type of text but all had different takes on it
- Moodle was okay as a teaching platform even when a little frustrating
- They wanted help on embedding pictures and getting into Moodle initially, and how to set it up so you could tell if your questions were answered in the forums without looking at all the entries again.
- We added these help documents for Fall 2023
- Students liked all the topics
- They wanted to add management information, including how to use biocontrols, although this is advertised as training in scouting
- There were no clear preferences on how the topics were organized (mixing disease and insect sections or not, etc.)
- Students thought the recorded sessions were easy to use
- Providing pdfs of presentations before class would have been useful – which we did - earlier - in the Fall
- Almost all students used the references
- Most students liked and used the Q&A forums and the quizzes
- Most thought the assignments were helpful, some wanted more
- Favorite assignments – sticky cards and potato wedges and mapping the greenhouse
- Most helpful aspect of the course was most commonly stated as having all the professors together each session and the openness of sharing questions and answers in person and through the Q&A
- Almost all would recommend this to someone else or take it again.
- We maxed certificate students at 30 – number wasn’t important to students.
Spring 2023 Webinar students (22 responses)
- As self selected:
- 19 greenhouse grower or employee, 1 student
- Overwhelmingly preferred January-February, 6-7:30 for class
- 1-1.5 hours was preferred
- No consensus on number of sessions, with most responding that it didn’t matter as they only took the ones that they wanted/could do
- Fewer were willing to do an in-person 2-3 day training and those who were wanted it nearby
- Students didn’t mind the hybrid system
- Students wanted to keep all the sessions ( but only take those they want/can as stated above…)
- Similar to certificate students, most wanted to add management information
- Most like the pace and mix of information
- What they found most helpful =- visuals and real world examples
- What they would like – more time per topic
- Everyone would take it again or recommend it to others
- Pesticide recertification credits are very important
Fall 2023 Certificate students (7 responses)
- As self selected:
- 2 greenhouse employees
- 2 students
- Considered $300 about right as price
- January-February and November-December tied for preference based on finding a greenhouse to scout in
- Most liked 6-7:30
- 1-2 hours about equal by choice
- 6-8 sessions about equal by choice
- No strong preference on having an in-person training – and more of this group said no or maybe than in spring
- Hybrid system was not a problem
- These students used all the equipment and thought it was all about the right types and numbers
- Most had no problems with Moodle once they got into it and got started
- The majority thought we should keep all the topics and had no suggestions for additional ones, except more time for each topic, which also was evident in the answers on the organization of the classes
- All found watching the recordings easy and most looked at or printed the pdfs of the presentations before class. All used the resources and most found the posts in the Q&A useful. All did the quizzes and found the assignments useful – again several liked the mapping best.
- Best aspect of the course – diversity of knowledge and accessibility of the instructors and having them all present each week
- Several wished we could have one in-person meeting – to meet everyone and to watch a scout in action
- All would take it again or recommend it
- No consensus on whether more students would have improved the class or not
Fall 2023 Webinar students (13 responses)
- As self-selected
- 13 greenhouse growers or employees
- 1 student
- January-February selected by almost as many as November–December - about half also selected September-October as the best time to hold class
- Majority selected 6-7:30, almost half also 7-8:30
- 1-1.5 hours most preferred, a few said 2 hours
- Most liked having 6 sessions, while some indicated that the number of sessions wasn’t important as they could take the ones they wanted/had time for
- Most said no or maybe to an in-person 2-3 day progam, some said if it was nearby
- The hybrid program wasn’t a problem
- All said keep all the topics – the majority liked having an insect and a disease each week and about half liked the pace and mix of information
- The most helpful aspect of the course was the mix of information in each session
- Most wished there was some way to rewatch the information (this group received pdfs of the sessions at the end of the series)
- Most would recommend it or take it again because of the breadth of information
- Most appreciated the information but also though pesticide recertification credits were important.
Survey results for Spring 2024
There were 14 certificate students, which included one graduate and one undergraduate student (who used her certificate to help her get a coveted plant pathology summer internship), a University greenhouse manager, a Youth Farm grower, a cut flower grower, a greenhouse grower for the city of Syracuse NY, an industry rep, and 7 greenhouse owners or employees.
Overall survey results were similar to those from previous sessions. Some of the most telling information is anecdotal from the overall comments and those for certificate and webinar attendees are appended under media.
Certificate survey results (9 of 14 students)
- From an open ended question on cost of the certificate program, a range of $200-500 was mentioned, with the majority agreeing that the price charged was appropriate based on the information and equipment provided.
- 78% preferred January- February for the class, with 56% saying November - December and 44% saying March - April. We had fewer students when we moved the course back 2 weeks, but it is hard to know if the dates were the reason.
- 78% like the 6:00-7:30 timing. Only 11% preferred a lunch time class, while 44% would have like the class later from 7-8:30. The instructors would probably revolt if the 7:00 start time was suggested.
- Although we often receive comments that the class feels we are rushing to fit in all the information, and we have worked to reduce that problem, 56% would like the class to be shorter at 1 hour, compared to 44% at 1.5 hours. Interestingly, 33% indicated they would prefer a 2-2.5 hour class.
- 33% liked the 7 sessions, but 56% said they would prefer 8 sessions, with some comments that more would be better. (44% said 6 sessions)
- 78% used and appreciated all the equipment provided. Some said that the handlens or Optivisor were unnecessary, but that may be because they already have one.
- Even if it is a little frustration at first (33%), with organization and navigation noted, no-one thought Moodle was too difficult to use.
- A few students didn't think we should include the session in the middle with the panel discussion and the Kahoot exercise (25%) although only 1 didn't like it at all, but all thought everything else should be included. There were requests for more vegetable-oriented information and some additional biocontrol information.
- 67% like having both insect and disease information provided each week and 44% liked the pace of instruction - with a comment that having the recordings to watch helped. 89% said it was easy to access the videos through Moodle.
- 67% looked at the pdfs of the presentations before class but 22 % didn’t know they could so we need to make sure students know they are available in advance.
- Almost everyone used the associated resources and did some or all of the quizzes and found them helpful. All like reading other students posts in the forums.
- Everyone thought the assignments were helpful in making them think about what was presented in class, even if some were frustrated that they didn't have a good greenhouse to scout in. About as many wanted more assignments as wanted fewer.
- People found out about the class through listservs and websites run by the instructors, or from other individuals. This suggests that there was not much response for certificate students from the industry publications, but they may have brought in more webinar attendees. My favorite answer -“I'm don't remember what I was googling but I ended up on the CALS page and went right to my Superintendent and told him I wanted to take it.”
There were 22 people who attended 1 or more webinars. Very few completed the survey at the end of the sessions. Most of the answers were similar to those of the certificate students (not all questions were the same as webinar students don't use Moodle and the associated materials). They did prefer 6 sessions. Pesticide recertification credits are considered important for most students. Many watched some or all of the recorded videos (this was the first time that they all received them all for the sessions they paid for) - especially those they missed live or wanted to review for information.
Individual comments on Greenhouse Scout School by webinar attendees2024
Individual comments on Greenhouse Scout School by webinar attendees2024
Discussion (new information in italics):
-Spring is a better time to offer the class. We are teaching it again in 2024 and moving it slightly later in February in order to make it easier to find a greenhouse, especially in more northern regions. While there were lots of votes for January-February, it is difficult to find open greenhouses then. November-December gets difficult with greenhouse availability and holidays. We understand that we are balancing between times when growers are open and are too busy to take the class.
It is impossible to tell if the lower number of certificate and webinar students in Spring 2024 with the 2 week delay in starting was due to the starting date, advertising, or the fact it is the 3rd time the Scout School was offered in about a year. We still think early spring is the best time to offer the Scout School and will be offering it again in 2025, exact dates yet to be determined. Part of the planning will be advertising and promotion.
We believe that improving advertising is crucial to the long term sustainability of this project. Expanding the use of industry publications– perhaps including comments from previous students in the advertising – will help to bring in existing greenhouse employees. In Spring 2024, we had a student from the Southwest and a webinar attendee from Michigan.
Continued advertising to encourage webinar participation after the initial webinar is also important. Webinar attendees signed up for on average 5.3 webinars of the 6. This suggests most sign up at the beginning of the series where there is a price benefit (6 for the price of 5) but that may be because we do most of the advertising before the series starts.
To encourage students, graduate or undergraduate, we will need better linkages with college and University programs to promote the Scout School as a benefit in potential hiring. Cost is perhaps more limiting for students than employees who may have greenhouse owners support their registration fees. We have not yet had any students do the course for college credit.
-The certificate/webinar hybrid system doesn't bother students. It makes the information more available to a wider number of people.
-6 sessions seems about right to most people. We will try adding one more for the certificate students in the middle of the set to add an interactive activity.
Interestingly in Spring 2024, over half of the students wanted 8 sessions. We did add the interactive activity for a 7th session in 2024, which was in general appreciated although it did not free up any time in the usual weekly sessions. We will modify the activity to see if we can make it more relevant to actual scouting and perhaps encourage sharing of information. The student panel was interesting from the presenter point of view and students seemed to enjoy it, but it is hard to determine if it was a worthwhile use of time.
- While students would like more time for each topic and for questions, which we appreciate, they didn't always follow that up with suggesting longer sessions. An hour and a half is a long time to pay attention even with a break after the first half hour to let webinar students in and splitting the session up into different topics. We could add an optional time at the end to let people ask more questions, which we did to some extent in the Fall.
We continue to try to refine the presentations to be as concise as possible to make sure there is time for questions. In Spring 2024, we reorganized some topics and which topics were in each session to maximize the amount of time available. We continue to be available at the end of each session but people are ready to call it a night so the discussion then is fairly limited
- The cost is about right and the equipment provided is usually appreciated. Some suggested making it optional for a lower price but by everyone having the same equipment, it makes doing the assignments easier. We did send more sticky cards and less flagging tape in the Fall.
Another aspect of sustainability to consider is the need to pay some of the presenters as time goes forward. That may affect the cost of the program
-Overall Moodle worked well, once everyone got in. It is not an inherently obvious system and Moodle is a little clunky so we were impressed that students did as well as they did, especially as many had never used a teaching platform. We have added additional help documents and need to emphasize where people can find them.
- The assignments, quizzes, Q&A forums, and references were used and appreciated.
- Because there is so much information provided, we appreciate the desire of the webinar students to have some way to review it. Certificate students get pdfs they can review before class and recordings they can watch after class. We may return to the idea of the NYS IPM YouTube channel as an option, although reviewing the transcript and accessibility issues need to be considered.
For Spring 2024, all students received the recordings of all programs they had paid for. Certificate students received the 1.5 hour recordings and webinar attendees, the 1 hour webinar recordings. This was appreciated as indicated by the number of both groups who said they watched the recordings. Looking at the number of times the recordings were accessed, certain topics were more desirable to watch, or people ran out of time. Webinars were accessed from 1-20 times (av 8.3), and certificate programs from 0-12 times (av 6.3). We will continue with this system in 2025.
- Pesticide recertification credits are important. They are available to both certificate and webinar students and we have figured out how to have them for NYS and the New England states. If we have students from other states, we will have to learn how to make the classes credit-worthy.
In Spring 2024, we organized pesticide recertification credits for Michigan, as well as New York and New England, where most of the participants come from.
-Most would recommend the class to someone else or take it again. In general, having all the instructors present each week and available to students, and the breadth of information were rated highly.
This suggests we should use previous students to help us advertise the course to other people. It may be a way of encouraging other employees to gain skills, and employers to encourage employees to enroll by paying for the course.
-We intended this program to fit into asynchronous learning so that people from a wide area could participate, even though we knew that some flexibility would be lost – for example having questions asked during the presentations. With providing recorded webinars to all participants and emails to ask questions, we can expand the potential for asynchronous webinar participation, although it does not allow for pesticide recertification credits, from NYS at any rate. Asynchronous certificate education is more difficult even though all the information is available, and activities are reported on-line. Students really need to be self-motivated to watch presentations, do activities and send in questions to get the maximum from the course. Encouraging more asynchronous participation is another function of expanded advertising.
Objective 1: Create, advertise, and implement an on-line training program for IPM Scouts (Scout School) including webinars, hands-on activities, and interactive discussion sessions advertised to students, existing greenhouse employees and other interested parties.
- Short term impacts (expected numbers in parentheses)
- 50 (30) people will gain knowledge from the Scout School by participating in the webinars, hands-on activities and discussion sessions
- 92 (100) people will gain knowledge from participating in the webinars alone
- 36 (15) people will achieve the certificate
- 75 will indicate intent to use the knowledge gained from the webinars or certificate program
- Intermediate impacts
- 25 people will report adoption of IPM scouting techniques learned
- 1 additional person will be employed as an IPM scout
We created and trialed 3 iterations of an on-line training program – the Greenhouse Scout School – that was both a certificate granting program with practical information on creating and running a scouting program, hands-on activities for practice, student forums for questions and answers and sharing results, quizzes and resources and a webinar series with live and recorded webinar sessions covering insect and disease identifications. The participants included greenhouse growers and owners, students, industry reps and others.
For most measures of short term impacts, we exceeded the expected numbers. It is hard to establish the number who plan to use the information gained from our current evaluations, but extrapolating from the results on the value of each session and the likelihood of people recommending the program to others, we would estimate that we at least reached the stated goal.
Intermediate impacts were not yet directly measured, but anecdotally from current surveys and discussions with students, we know that many adopted at least some of the techniques taught and applied the information presented. One student became the scout at Planting Fields on Long Island during the program. Employers of people who have taken the course have come up to thank. Presenters. Further information will be gathered in a subsequent survey.
Objective 2: Evaluate the training program and the methods used to provide information and access a broad base of participants
There are 2 aspects to evaluating the Scout School: Input from the grower advisory committee and input from participants in the webinars and the certificate program.
Student evaluations were overall positive with useful feedback that allowed us to make improvements in quizzes, activities, timing and provision of resources over the 3 iterations of the course during the project period. The population reached and surveyed were predominantly greenhouse growers and owners, both private and public, with some students and industry reps included so it was not, perhaps, as broad a clientele group as hoped, but we intend to expand our reach over time.
A further evaluation of past students to gather more information on use of insect and disease identification knowledge, increased use of scouting, continuing education on scouting or change in career based on the certificate is planned.
We did not continue to ask the advisory committee for feedback as they did not participate in the programs each time and had made excellent suggestions in the initial period. We will provide them with this final report.
The benefits of effective scouting and identification of greenhouse disease and insect pests are improved pest management with its consequent improvement in plant quality and/or yield and increased income. On a larger scale, the reduction in inappropriate or overuse of pesticides has benefits to the environment and to human health. Because of the variety of participants and operations that they represent (public/private, scale, production methods, etc.) it is difficult to quantify the effects of this project. However, we believe that the overall effect of the training program created as part of this project has had a positive effect on participants ability to scout effectively , that the techniques are transferable across crops and systems, and that those that were trained are more valuable as employees.
Education & Outreach Activities and Participation Summary
Participation Summary:
Because this project is a training program rather than a research project, outreach is built into all aspects of the project. There are some additional methods to share the mechanics of the program more widely once it is finished.
The first necessity is to reach the audiences for both the Scout School and the associated webinars – without which the project will not work. We advertised the courses in 2023 and 2024 through grower organizations in Maine, NYS, and Vermont to advertise and our listservs that reach growers as well as multipliers like County Extension Educators and associated industry representatives. Because we are on college campuses, we also advertised to student audiences by presenting information when teaching college classes; for example, Cornell’s Greenhouse Production and Hydroponics courses, UMaine’s Horticulture courses and State University of NY at Cobleskill’s IPM course. The announcement as a pdf and as a Powerpoint slide that are being used for the Spring 2025 class are attached. It is more difficult to reach the underserved populations who might be interested in this training as they are less likely to be on a listserv or in an organization. We continue to work on this problem in our programs but have not sufficiently met the need. Each University involved in this project has some programs and personnel who could be accessed to help reach these more diverse audiences. For example, Cornell has a Farmworker Program, and Urban Agriculture Program Work Team and the Cornell Small Farms program. We have had one staff member from the Small Farms Program Veterans Program take the course who we will ask to help us advertise in the future. Our certificate program does not overlap with any of the existing Small Farms courses currently. In addition to finding the audience, we also need to provide means to make the training as accessible as possible. For example, two-way Spanish translation would be necessary to make the program workable for many farmworkers.
In addition to advertising to students, we have included information on the certificate program when presenting to grower audiences, including the 2023 Northeast Greenhouse Conference and 2024 Long Island Ag Forum. We have also used materials created by students for their assignments in a number of presentations on scouting to greenhouse grower audiences,
To date, the final evaluation results have not been presented at any conferences. However, interim results were presented as a 2023 Northeastern IPM Toolbox Talk to approximately 24 Zoom attendees.
An announcement as a pdf and as a Powerpoint slide for the Spring 2025 class are attached. They have been distributed to college professors to announce to their classesIt will also be promoted to previous attendees and through the listservs and through the NYS IPM social media channels announcement Slide - Read-Only
The draft curricula were created in a previous grant and are attached to the Materials and Methods. The final overall curriculum (6 weekly curricula plus an activity week meant to encourage interaction) is attached here. Based on the results of evaluations, we will keep the 7th week in Spring 2025 but not include the activity, instead opting to include identification of some additional pests and an interactive discussion on issues that occurred during class.Run of show - overall
Learning Outcomes
- Identification of common greenhouse disease and insect pests
- using a variety of methods for magnification
- understanding the timing of which pests tend to arrive under which conditions or time periods
- using traps and indicator plants to find the insect pests
- Identification and background knowledge on biological control agents for these pests
- Basic activities related to creating a scouting system
- mapping the greenhouse to understand movement of pests
- using timing and traps to create a plan of when and how to scout for which organisms
- communicating with growers or owners
- finding and using resources
Project Outcomes
The specific changes in practice will vary widely across the student group – both certificate students and webinar participants, so are difficult to quantify here. However, we believe most people who attended any part of the program has applied some aspect of what they learned to their own situation.
Quotes from participant surveys are available in the attachments to the research results section
We believe that this project did indeed answer the question that was proposed – could an on-line course with hands-on but not in-person activities and learning platform based interactions actually teach specific and practical techniques and applicable information.
One of the primary reasons for the success of this project is the dedication of the project team that was created to initially create the curriculum and then teach the webinars and work with certificate students. The level of collaboration meant that 1) the team was willing to try a teaching system that none of us had much experience in, and 2) the course was flexible and changes based on student and presenter feedback could lead directly to improvements.
The certification students in particular were also key to the success of the project in that they were willing to try a training program that asked a lot more of them than just listening to prepared information. Perhaps not all of them liked the system, but their reactions and willingness to provide feedback improved the course.
We intend to continue teaching the Greenhouse Scout School in 2025 because we believe it was successful and that we can reach additional audiences.. In fact, we have already had requests from potential students and have a planning meeting in the near future. As noted elsewhere, we will survey past students for how they applied what they learned and use that information to improve advertising and presentation. We are sure that modifications will need to be made – some of which are listed in the discussion section, and we will have new and exciting ideas to incorporate but that what we learned as part of this project will continue to form the basis of the course.
The information developed for this program has also been used in a variety of other ways – presentations at industry conferences, like the Northeast Greenhouse Conference; as classes presented in courses at Cornell and SUNY Cobleskill, and for training youth educators in Cooperative Extension.
We believe that our experience would be of value to others considering on-line interactive teaching, regardless of subject.