During this coronavirus lock down, IGIS has set out to revamp its data infrastructure to address our growing needs for big data storage and management moving forward. In particular, over the past few years we have accumulated over a dozen terabytes of drone data and associated mapping products, constituting tens of thousands of project files, and the quantity of this data is only expected to keep growing. Typically this drone data has been processed on a number of local desktop computers, and then backed up onto RAID hard drives or the cloud for cold storage; however, this is far from ideal in terms of consistent organization, versioning and ease of distribution.
As a solution to the problem, IGIS purchased a web server, equipped with multiple virtual machines (for processing, analysis and web services) along with a 30TB RAID data store/repository. The repository was networked to our various IGIS computers and RAID storage devices, so that all of our drone data could be transferred over to it. After much consideration, we settled on a standardized file structure, which could accommodate both datasets from past and future drone projects, with room for growth as needed. A python script was written to automatically generate this file structure, with some metadata inputs for each project, and our previous projects' data were then moved into their appropriate slots in the new structure, while jettisoning unwanted intermediary processing files; freeing up a ton of storage space. It would be correct to assume that this process of moving data was quite time consuming. However, moving forward, it will be easy to automatically set up our projects' file structures right from the inception of every new project, beginning with running the python script in ArcGIS Pro's Jupyter Notebook utility in the field, to eventually be delivered to the server repository down the pipeline, in a nicely organized package (similar to what we would provide to our non-IGIS project collaborators).
That alone is a big step in the right direction, but it gets better. Because all of this data is now in a standardized file structure, with standardized folder naming conventions, scripting our ArcGIS portal to automatically connect with the data via the imager server was only a small step away. With this complete, now any IGIS team member can access our entire post-processed, GIS-ready, drone data inventory of layers via ArcGIS Online or ArcGIS Pro.
Ultimately this has been a big leap forward, in terms of IGIS's informatics infrastructure; to compliment our significantly evolved pipeline for drone data collection and processing, depicted below.
- Author: Sean Hogan
IGIS is pleased to announce its second offering of DroneCamp! This three-day intensive workshop will take place at UC San Diego, between June 18th and the 21st, 2018, and will cover everything you need to know about drones for mapping, research, and land management. This intensive bootcamp style workshop will include instruction and hands on training in the following areas:
- Technology - The different types of drone and sensor hardware, costs and applications
- Drone science - Principles of photogrammetry and remote sensing
- Safety and regulations - Learn to fly safely and legally, including tips on getting your FAA Part 107 Remote Pilot Certificate
- Mission planning - Flight planning tools and principles for specific mission objectives
- Flight operations - Hands-on practice with both manual and programmed flights
- Data processing - Processing drone data into orthomosaics and 3D digital surface models; assessing quality control
- Data analysis - Techniques for analyzing drone data in GIS and remote sensing software
- Visualization - Create 3D models of your data
- Latest trends - Hear about new and upcoming developments in drone technology, data processing, and regulations
The cost of this three-day event will be $500 for UC Employees and $900 for everyone else.
Additional information and registration info can be found at http://igis.ucanr.edu/dronecamp/. Registration requires a short application (no fee), that will inquire about your background and learning goals. Anyone interested in attending is encouraged to submit an application by April 15, 2018 for early priority registration. Be aware, last year's event filled up very quickly.
We hope to see you there!
UC ANR IGIS
Drone Service Coordinator
IGIS is pleased to announce a three-day "Dronecamp" to be held July 25-27, 2017, in Davis. This bootcamp style workshop will provide "A to Z" training in using drones for research and resource management, including photogrammetry and remote sensing, safety and regulations, mission planning, flight operations (including 1/2 day of hands-on practice), data processing, analysis, and visualization. The workshop content will help participants prepare for the FAA Part 107 Remote Pilot exam. Participants will also hear about the latest technology and trends from researchers and industry representatives.
Dronecamp builds upon a series of workshops that have been developed by IGIS and Sean Hogan starting in 2016. Through these workshops and our experiences with drone research, we've learned that the ability to use mid-range drones as scientifically robust data collection platforms requires a proficiency in a diverse set of skills and knowledge that exceeds what can be covered in a traditional workshop. Dronecamp aims to cover all the bases, helping participants make a great leap forward in their own drone programs.
Dronecamp is open to all but will have a focus on applications in agriculture and natural resources. No experience is necessary. We expect interest to exceed the number of seats, so all interested participants must fill in an application before they can register. Applications are due on April 15, 2017. For further information, please visit http://igis.ucanr.edu/dronecamp/.
- Author: Sean Hogan
IGIS is thrilled to have a fantastic relationships with Parrot S.A. (one of the largest consumer drone corporations in the world), and Parrot's subsidiary company, Pix4D (the leading developer of drone data processing applications in the world), who together have been have been extremely generous and supportive of the IGIS drone program, and the UC System at large.
Please check out Parrot's Educational Blog, which recently featured an outstanding short article on IGIS's research into rangeland applications of drone technology, including the use of Parrot's Sequoia multispectral camera, by clicking here:
Also - Please stay tuned for the upcoming February 2017 issue of California Agriculture, which features an article on unmanned aerial systems (UAS) for agriculture and natural resources (co-authored by myself, Dr. Maggi Kelly, Brandon Stark, and Dr. YangQuan Chen), which will also be accompanied by an editorial written by Dr. Kelly on the need for a coordinated approach to scale up drone research and teaching across the UC system.