issues and problems on data integration of … › meetings › apan43 › pres › 28 ›...
TRANSCRIPT
![Page 1: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/1.jpg)
National Agricultureand Food Research Organization
Food and Agriculture for the Future
Issues and Problems on Data Integration of Agricultural BigData using UAV
Atsushi ITOHNational Agriculture and Food Research Organization
![Page 2: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/2.jpg)
Introduction
Agricultural Big‐Data projects in Japan
• Social Big Data Platform Project (2014‐2018)• National Institute of Information and Communications
Technology (NICT)
• CREST (2016‐2022)• Japan Science and Technology Agency
![Page 3: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/3.jpg)
Field Sensing using UAV
Experimental field Actual fields
![Page 4: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/4.jpg)
Field Monitoring by UAV on farmers’ fields
Tokachi Area in Hokkaido(Large-Scale Farming Area in Japan)
![Page 5: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/5.jpg)
UAV
enRoute inc. Zion QC630
• Weight:3.2kg• Flight Time:15-20min• Flight Distance:10km• Payload:2.0kg
![Page 6: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/6.jpg)
Farmer’s field
Crop: WheatArea:4haFlight time:7minNumber of shots: 90pics, 910MB(JPG), 2.2GB(RAW)
Crop: Azuki bean,Sugar Beet, Potato
Area: 7haFlight time:7+6min(Twice)Number of shots: 180pics
PotatoArea:5haFlight time:9minNumber of shots:
120pics
WheatArea:4haFlight time:7minNumber of shots: 95pics
WheatArea: 4.5haFlight time: 8minNumber of shots:
110pics
![Page 7: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/7.jpg)
UAV flight plan (2015)
Target: 5 fields (25ha)Date:5/25, 6/2, 6/10, 6/19, 6/25, 7/2, 7/10, 7/16, 7/24, 8/7, 8/19, 9/3, 9/15, 10/6 (14 times)
Camera:SONY α6000 (ILCE‐6000), 4000x6000 pixels, 350dpi
Flight altitude:100mGround speed:7‐8m/sShooting interval:2sec eachGround resolution:2.5cm
![Page 8: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/8.jpg)
Flight Plan
Mission Planner (Open Source, GPLv3)
![Page 9: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/9.jpg)
Orthomosaic Generation
Agisoft PhotoScan (Commercial Software)
![Page 10: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/10.jpg)
Orthomosaic Generation
for 5ha fields:120 pictures1GB (JPG), 3GB(RAW)
![Page 11: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/11.jpg)
GeoTiff, Tiling
GeoTiff
Tiled Picsfor Google Maps
![Page 12: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/12.jpg)
View on Google Maps
![Page 13: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/13.jpg)
Detect the crop quality variation
・Wheat yellow mosaic virus (left fig.)・Lodging (right fig.)
![Page 14: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/14.jpg)
Summary
• To shoot image by UAV is not so difficult• Automatic flight• 10min for 5ha field
• To manage image data is very hard• Takes many hours to gain orthomosaic image• Big storage, Powerful CPU
• Improve farming?• Decision support system?
![Page 15: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/15.jpg)
Field Phenotyping for plant breeding
![Page 16: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/16.jpg)
UAV
DJI: Phantom 3
Litchi (Mission Hub for DJI Drones)
![Page 17: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/17.jpg)
Pictures taken by UAV(Phantom3)Altitude: 10m
Experimental field(Sugar beet)
![Page 18: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/18.jpg)
Orthomosaic generation
Success Failure
![Page 19: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/19.jpg)
Hillside orchard
Mandarin orange fieldson steep sloping land
![Page 20: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/20.jpg)
DJI: Matrice 600Payload: 6kgFlight time: 18-40min
CameraDJI: ZENMUSE X5R
RTK-GPS options
UAV with RTK‐GPS
![Page 21: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/21.jpg)
Flight planner
![Page 22: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/22.jpg)
![Page 23: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/23.jpg)
Summary
• We could operate UAV in various environments• Generate flight plan automatically• Automatic operation• Experimental fields, sloping fields
• 3D reconstruction, many problems to be solved• Breeding fields• Sloping orchard
• High resolution images are desirable• General cameras are not enough
![Page 24: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/24.jpg)
Future work
• The key is high‐resolution images• How to flight• Which equipment we should select
• Environment for BigData management• Storage• Database• System to create metadata
• Environment for data analysis• 3D reconstruction• ….
![Page 25: Issues and Problems on Data Integration of … › meetings › apan43 › pres › 28 › APAN_India...National Agriculture and Food Research Organization Food and Agriculture for](https://reader033.vdocuments.net/reader033/viewer/2022060322/5f0d94d37e708231d43b10d1/html5/thumbnails/25.jpg)
Acknowledgment
This research has been carried out in CREST Program(Japan Science and Technology Agency). Also this work was supported by “Social Big Data Platform Project” (National Institute of Information and Communications Technology).