This is the second of a two part series on IGIS impacts in 2019. See also: IGIS 2019 Year in Review Part I. Impact on UCANR's Strategic Goals Framework
PV #2. Developing a Qualified Workforce for California
Training and professional development continue to be two of the pillars of our mission. We started off 2019 with a needs assessment for ANR staff and academics on GIS training, broadly defined. We last did a survey like this in 2014, so were curious about where the demand has shifted. With a healthy 360 responses, the results revealed strong demand for GIS training across the board, including traditional desktop software, as well as newer online platforms and tools to collect and work with data.
In 2019 we were pleased to work with UCCE Forestry Advisor Ricky Satomi to develop and implement a new curricula on GIS for foresters. With support from a RREA Grant, we developed a brand new two-day Forest GIS workshop, and offered it in five locations: Santa Rosa, Humboldt State, South Lake Tahoe, Redding, and Berkeley. Each workshop sold out within 48 hours, and nearly as many people were on the waitlist (85) as participated (118) - more signs that natural resource professionals everywhere want to upgrade their GIS skills. The reviews were excellent, with an overall rating of 4.5/5, with the biggest complaint being that we should have made it longer!
Our drone mapping and regulations workshops continue to be popular as well. This is not a surprise as the technology is still rapidly evolving, has a wide range of applications, and we are one of the few outfits that can bring together all the equipment, a half-dozen flight instructors, and vetted data processing exercises needed for a comprehensive multi-day training. We repeated our partnership with The Wildlife Society Western Section, UCNRS Hastings Reserve, and California Dept of Fish and Wildlife with another offering of Drone Technology and Regulations for Natural Resources, reaching 26 participants. This year we added a capstone project, which allowed participants to practice everything they had learned over the past three days to complete a simulated ‘turkey census' mission. It was a great model we hope to use again.
DroneCamp 2019 was our biggest training ever, with 65 participants. To handle such a large group, we held concurrent indoor and outdoor sessions, with flight practice at the UCSC Fort Ord Reserve. It was hugely successful, but we never could have pulled it off without the support from CSU Monterey Bay, the UC Center of Excellence on UAS Safety, Monterey Bay DART, and a team of flight instructors from UC Davis, UC Merced, UC Berkeley, and UC NRS.
Some of our favorite workshops in 2019 were with the Karuk Department of Natural Resources (KDNR) in northern Humboldt County. This is part of a larger project studying and managing forests for agro-ecological resilience, in collaboration with CE Specialist Jennifer Sowerwine. In May, we adapted our standard Story Map training for a youth audience, then made the long drive to Orleans to teach two groups of middle school students to how to make Story Maps. This was part of school project and play the kids produced on Coyote's Journey, one of the Karuk Tribe's traditional narratives. On that and another trip in the fall, we held field training on drone mapping, and collected imagery for two monitoring plots. Two other workshops for the Karuk Tribe focused on mobile data collection apps, which will go a long way toward helping manage several ambitious monitoring programs. These efforts will continue and expand in 2020, when KDNR gets their own ArcGIS Enterprise server.
We continued to upgrade our training materials to keep up with the latest developments in software. There's been a huge shift in the world of desktop GIS in the last couple of years, with industry giant ESRI announcing the retirement of the venerable ArcMap suite in the early 2020s, and pumping out new features for ArcGIS Pro. The transition has been bumpy for a lot of people, but is a lot easier with a workshop that explains the layout of the new software. With the assistance of our GIS Service Center, Maggi upgraded all the labs for her undergraduate GIS class at UC Berkeley, giving us a rich pool of material to build upon. The Forest GIS workshop series we pioneered with Rick Satomi also featured the newer version of the software, and highlighted its interoperability with cloud based storage, visualization, and processing. Andy also did a major upgrade to his Spatial Analysis with R workshop, which he offers every semester at Berkeley, incorporating standards from the new sf R package, which has been a game changer in the R world.
PV #3. Safeguarding Abundant and Healthy Food for all Californians
Many of our GIS and drone projects support research and extension in food systems, both on and off-farm. Some of the notable examples in 2019 include:
We continue to develop and maintain web tools like the Marin County Master Gardener Community Gardens Map that help people connect with healthy food systems and build communities. The latest project to join the fold is a pilot web app for Alameda Urban Agriculture in collaboration with Rob Bennaton (UCCE Alameda & Contra Costa Counties). Still a work in progress, underneath the web map was a year-long process to build consensus and gather input from the east bay urban ag community, and an innovative data architecture whereby site managers give permission to have their garden appear on the map and update their garden info. This work will continue in 2020.
We also expanded our collection of GIS projects that safeguard food safety and help producers cope with a changing climate and pest threats. We built the Huanglongbing Proximity web app for Beth Grafton-Cardwell (UCR / LREC) to help homeowners assess their risk for HLB infection and consider replacing their citrus trees. In a similar vein, we built the California Waterfowl Tracker for Maurice Pitesky (CE Specialist UC Davis) to help poultry producers, regulators, and risk managers in the Central Valley assess their risk for avian influenza from migrating waterfowl, and take protective action. Under the hood, the map uses a machine learning approach developed by Jeff Buler at the University of Delaware to predict waterfowl density, updated daily based on remotely sensed temperature, precipitation, soil moisture content, flooded rice cover, and wetland cover. Even more cool, historical patterns are derived from weather surveillance radars stations that can measure the densities of waterfowl near their roosting locations.
An invasive species that impacts the bottom line for ranchers is the hideous Medusahead weed. To help ranchers make choices about what type of management strategy to use (or none at all), in 2019 we developed a calculator to estimate the returns on managing Medusahead for Jeremy James (SFREC).
Early detection is a critical component of managing invasive species, but is particularly difficult when the invasive species is similar in appearance and traditional field inspections are resource intensive. To assess whether multispectral drone imagery might play a part in early warning systems, we flew 5 acres of fields infected with weedy rice with a Matrice 100 drone for Whitney Brim-DeForest (UCCE - Sutter and Yuba Counties). The answer is...it's complicated. Check back in 2020 for details.
Another challenge growers must contend with is increasingly variable weather conditions. Short term seasonal forecasts are available, and getting increasingly accurate, however delivering this data into a form useful to growers remains a big bottleneck. In 2019, we started a new multi-year project with Tapan Pathak (CE Specialist UC Merced) to develop agro-climatic decision support tools for growers. Although not yet ready for public release, we've already cracked the two most daunting technical pieces - tapping into live seasonal forecast data from NOAA, and integrating these data streams in a user-friendly interface via the industry standard Django open-source web development platform. These technological building blocks will reap dividends for years to come.
Water scarcity and variability is arguably the most worrisome consequence of climate change for California agriculture, and an active area of ANR research. We had several drone mapping projects in 2019 to better understand the complex relationships between genetics, irrigation, crop management, productivity, and climate. We flew and processed over 300 acres of orchard data for Ali Montazar (CE Specialist Davis) for a project investigating the response of orchard trees to irrigation practices in the Imperial Valley. In a similar vein, we processed and analyzed drone images for 70 acres of almond orchard for Brady Holder (Kearney REC), including the notoriously difficult thermal band. We also collected drone data for over 40 acres of mature micro-irrigated citrus orchards in the San Joaquin Valley for Daniele Zaccaria (CE Specialist, UC Davis) to improve models of evapotranspiration.
Other drone mapping projects supported more basic research on the complex relationships between plant genetics, growth, phenotypes, and soil and water conditions. Drones have a real niche in measuring interactions between system components due to their remarkable ability to generate both 3-dimensional and multispectral models of vegetation. In 2019, we mapped nearly every individual plant over 50 acres for a spatial database of crop and flowers species, under Karl Krist (UC Davis Foundation Plant Services). The data will be used to compare productivity and phenotypic expressions in relation to genotype, soil, and water conditions.
We also flew a pistachio orchard at Russell Ranch for Ewelina Jacygrad (UC - Davis) - eight times! These time series data can be overlayed thanks high accuracy ground control points, and will be used to quantify structural changes in the orchard over the growing season.
PV #4. Protecting California's Natural Resources
Managing natural resources is getting increasingly more sophisticated. Part of our technology mission is helping managers take advantage of new tools and data for better management and to comply with increasingly technical regulatory requirements. In addition to the series of GIS workshops for professional foresters (see PV2 above), we worked with Ricky Satomi and Larry Forero (both UCCE Shasta County) to create an online stock pond volume calculator that helps landowners comply with new reporting requirements under SB588. As described in a technical paper about the project, the calculator generates a depth-capacity curve based on very simple measurements, from which the landowner can report pond volume based purely on the current water depth from a simple staff gague.
Also in support of sustainable rangeland management, Andy Lyons was coauthor on a paper that looked at the differences in grazing pressure between heritage and conventional cattle in semi-arid rangeland. Using the tlocoh R package he wrote to analyze movement patterns, we were able to quantify that heritage breeds are better equipped to take advantage of dispersed resources during periods of water scarcity.
Another long-term thread our research approach is revisiting historic imagery and map data to better understand the present and manage for the future that we wish to see. This continued in 2019 with an extremely ambitious and challenging analysis of a 53,000-acre watershed in Humboldt County with Lenya Quinn-Davidson and Yana Valachovic (both UCCE Humboldt County). Starting with literally dozens of scanned 1948 aerial photos, Sean Hogan began the painstaking task of orthorectifying them (not easy in mountainous terrain with sparse roads!), and then classifying the landscape into coniferous and broadleaf forests. This later step required developing new classification workflow due to the lack of spectral information. The hard work paid off, and for the first time ever we can do a detailed comparison with vegetation classes from contemporary remotely sensed data.
Post-fire landscape recovery is another area of active research where the fine spatial resolution of drone data provides a unique lens. In 2019 we completed analyzing the data from the extremely large mapping mission (3500 acres) we flew at Hopland REC for John Bailey (UCANR HREC), after the River Fire burned over half the property in July 2018. Those data are now available for researchers. We completed another post-fire monitoring project in 2019 for Leslie Roche (CE Specialist, UC Davis), mapping over 570 acres of rangeland in Lassen and Modoc Counties. That area had also burned a few years back, and the classified imagery will be used to better understand plant succession after a fire and strengthen guidelines for adaptive range management.
Other drone projects focused on basic ecology and development of new analytical techniques. Our collaborative monitoring program with the UC Natural Reserve System (Becca Fenwick, UCNRS) remains our largest ongoing drone project. Under the California Heartbeat Initiative (funded by the Gordon and Betty Moore Foundation), we are helping NRS collect time series drone data at 10 of the 40 NRS sites in California to better understand the interaction between plants, soil, and water. In 2019 we mapped 1300 acres at 7 NRS sites, and supported the NRS team with training, equipment maintenance, and data management. We also built a data portal for NRS and started to populate it with processed drone imagery as well as other baselayers.
To capture lessons in addition to data, we published a paper in 2019 where we experimentally tested how precisely drone imagery can detect changes in plant water content. Using an experimental design we ran at Blue Oak Ranch, we tested different altitudes, times of the day, and vegetation indices. The results reveal that drone imagery is in fact fairly effective in picking up differences in plant water content (much better than satellite imagery, which we tested also), but there are some best practices to follow. For details see Easterday et al (2019).
Another natural resource project examined wildlife habitat for endangered voles in the Mojave Desert. We flew over 500 acres for PI Stephanie Castle (UC Davis) in the ironically named Tecopa Marsh, about half way between Death Valley National Park and Mojave National Preserve. Although we've mapped habitat in desert areas before, but this was an especially challenging project as the extreme heat required us to land the drone every 15 minutes. Eventually we got it all done, and the data are illuminating resource requirements and behavior of this charismatic yet endangered species.
PV #5. Building Climate-Resilient Communities and Ecosystems
We continue to be the administrative lead for developing and maintaining the Climate Adaptation Clearinghouse, California's official information portal for climate adaptation, which we launched in 2018 with the UC Berkeley Geospatial Innovation Facility. In 2019, we added additional local and regional planning resources to the Clearinghouse, as well climate risk assessment guidelines developed for the financial sector by powerhouse firms like Moody's Investor Services and S&P Global Ratings. In 2020, look for even more California endorsed adaptation resources, including a digital version of the California Adaptation Planning Guide.
We were excited to launch in 2019 a new three-year project with Cal-Adapt with funding from the Strategic Growth Council to develop decision support tools with Cal-Adapt data for agriculture and natural resources. This is part of a broader wave of extension efforts in ANR around climate adaptation, of which we participated in a number of initiatives in 2019 including the Ranching and Range Management in a Drying Climate workshop at Sierra Foothill REC, where Andy presented on climate data for rangelands, the Advancing Climate Change Policy and Environmental Justice Symposium at Elkus Ranch, the Rangeland Climate and Drought workshop series, and the Climate Change Program Team annual meeting. Our piece of the new Cal-Adapt project is to conduct needs assessments in agriculture and natural resources, and develop programming tools to make it easier to work with Cal-Adapt data outside the website. We already have working prototypes of extensions for R and Python, and are currently seeking beta testers (if you're a R or Python user and would like try them out, let us know!).
Also building steam in 2019 was our continued support for the Karuk Tribe in northern Humboldt County, who made significant progress establishing a longitudinal monitoring system for agroecological resilience in forested areas home to traditional food and fibre resources. Supported by a USDA grant, this work addresses one of the most vexing and important questions about climate change - how local ecosystems will respond to expected changes in the macro environment, and how holistic management approaches that native people have practiced for generations can also adapt. Our role has been to provide technology support and innovation for the Karuk - UC Berkeley Collaborative team, including training and development of mobile data collection apps, and drone data collection.
PV #7. Developing an Inclusive and Equitable Society
IGIS is actively involved in efforts to address the lack of diversity in geospatial technologies through the provision of workshops that focus on underserved clients. We have conducted workshops in Spanish and English that included students from Mexicali, Mexico, and we have delivered several workshops with several Native American Tribes. In 2019, IGIS developed and delivered workshops in collaboration with Jennifer Sowerwine (CE Specialist UC Berkeley) on geospatial technology (Story Map training for youth, development of mobile data collection tools and drone mapping for agro-ecological resilience) in concert with the Karuk Tribe's climate change adaptation project. Additionally, at our annual DroneCamp, we developed a student scholarship program aimed toward under-represented groups, and we actively include women instructors in the program./h3>/h3>/h3>/h3>/h3>/h2>
- Author: Andy Lyons
Do you find climate data confusing? If so, you're not alone!
IGIS is pleased to co-host a webinar on Thursday January 23, 2020 at 12:30pm on an Introduction to Climate Data with our colleagues at Cal-Adapt. Join us online to hear about:
- Introductory concepts that are important for using climate data
- Common climate change scenarios
- Climate models and downscaling
- Climate variables, including how they can be used for planning
- Show how Cal-Adapt can be used to access, display, aggregate, and download basic climate change data
- Support and resources for learning more
The webinar is aimed at beginners and novices looking to improve their understanding of climate basics. Everyone is welcome!
Details are below, and registration is requested. Hope to see you there, but if you miss it the recording will be posted on Cal-Adapt.org.
Introduction to Climate Data
Thursday, January 23
12:30pm - 1:30pm (PST)
Registration: Click here
Webinar ID: 383100714
- Author: Andy Lyons
To support broad participation for next month's DroneCamp in Monterey, IGIS has launched the DroneCamp Scholarship Program. DroneCamp is an intensive three-day workshop that covers everything one needs to know to use drones for mapping and data collection. The Scholarship Program is aimed at defraying the cost of participation for students, non-profits and under-represented communities.
Drones have revolutionized our ability to produce high resolution, spatially accurate images of any area of interest. Drone mapping has become possible due to simultaneous breakthroughs over the past 5 years in multi-rotor drone platforms, navigation systems, lightweight sensors, autonomous flight planning apps, and photogrammetry software. It is now easier than ever to generate stunning, highly accurate 2D and 3D models of an area, on demand. Despite the technological progress, the learning curve for drone mapping is steep, and mistakes can be costly. DroneCamp covers the entire workflow including hardware selection, compliance with FAA regulations, mission planning, manual flight operations, emergency procedures, data management, stitching images together, quality assessment, and data analysis.
Scholarship applications are now open and will continue through June 6. If you or your organization would like to help a deserving student, non-profit, or under-represented community get up to speed on this amazing technology, please consider making a donation to the DroneCamp Scholarship Program!
At the recent conference of the American Association of Geographers (AAG) in Washington DC, IGIS was recognized for its work in developing open source data management tools for drone data. The AAG is the largest association of geographers, GIS specialists, environmental scientists in the world, and its annual conference attracts over 8,500 people and over 6,900 presentations. IGIS researchers Andy Lyons, Jacob Flanagan, and Sean Hogan won second place in a poster competition sponsored by the AAG Remote Sensing Specialty Group and photogrammetry company Pix4D.
Data management involves protocols and file transfer utilities to help you organize data, assess quality, create backups, find and retrieve files, and reproduce workflows. Photogrammetry programs are brilliant at stitching photos into beautiful high resolution imagery, but they don't offer many tools for managing data before or after the processing. This is the gap IGIS is addressing.
IGIS has been working on data management tools for the past couple of years to help us manage the dozens of drone projects we conduct each year on behalf of UC researchers. In keeping with our public mission and research innovation focus, we use open source programming platforms such as Python and R and share our tools on GitHub so anyone can use them.
The poster presented at the AAG conference showcases 5 data management projects. The foundation of all our projects is a directory structure and file naming protocol that encompasses all the types of data in a drone project, including images, ground control points, GIS layers, documentation, intermediate files, and final outputs. Building upon this, the uavimg package for R creates offline HTML catalogs and maps of images, allow for quality control checks in the field and a master catalog to help an analyst find the right set of images for a project. The IGIS Drive Monitor, written in Python, is designed to run on a laptop in the field and automates the process even further by monitoring a USB drive and copying files into the right place automatically. The IGIS Pix4D Controller, also written in Python, runs on a server and automates the next step of the process, launching the Pix4D stitching software when a new set of images is detected, creating a new project, and initiating the stitching process. Finally, the IGIS Drone Data Management Logbook, still being developed, combines functionality of the previous utilities with additional visualization tools for quality control.
Our drone data management utilities are still under development, but they are available currently available for testing (see GitHub links in the poster). If you'd like to be a beta tester, please let us know!). Later this year, we plan on holding a webinar describing how to use these tools and invite feedback from users. Open source software is designed for collaboration, and our ultimate hope is to collaborate with other drone users and programmers facing similar needs. In the meantime, it's great to be recognized by leading experts in the field.
- Author: Robert Johnson
The Esri Developer Summit in Palm Springs was, as usual, a very informative look into the resources Esri provides for those who want to take their software to the next level. Although this year's conference was a bit light on major announcements (they're probably saving all the good stuff for the User Conference in July) there were still a few interesting takeaways:
- ArcGIS Notebooks are continuing the trend of tight integration of Python with the ArcGIS suite. While currently available through ArcGIS Enterprise portal, the next release of ArcGIS Pro is going to support Python Notebooks directly in the desktop environment.
- Web apps are becoming lighter, more efficient and more mobile-friendly. Progressive web app standards are making it easier to develop functional, responsive web apps rather than needing to delve into the more complicated world of native apps.
- ArcGIS Pro is finally going to support publishing to standalone servers in the next release! Esri is framing this as a tool for transitioning to Portal servers, but those of us that still use standalone servers will take it.
- ArcMap really has become obsolete. While Esri is still pledging to support it for "years to come", all new functionality will only be available in Pro.
All in all, the Dev Summit is a great resource for keeping up to date on all the cutting-edge technology that Esri has to offer. It's a great learning experience and I look forward to attending again in the future.