SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

Harnessing Open Data in Agriculture: A Hands-On Tutorial for Building Data Workflows

alma avatar
alma
15 diapositives · 306 Views · Aug 23, 2014

Explore how to utilize open data infrastructures to enhance your agricultural data products. This tutorial, supported by EU projects, guides users through the process of creating a customizable dataset from existing data sources. Designed for both novice and advanced users, it illustrates the use of the agINFRA-powered RING panel to select data sources and execute complex workflows, enabling on-the-fly dataset downloads. Learn about configuring workflows, utilizing remote APIs, and accessing grid resources for data processing in agriculture.

Harnessing Open Data in Agriculture: A Hands-On Tutorial for Building Data Workflows - slide 1
01 / 15Harnessing Open Data in Agriculture: A Hands-On Tutorial for Building Data Workflows
1 / 17

Télécharger la présentation

Harnessing Open Data in Agriculture: A Hands-On Tutorial for Building Data Workflows
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. Open Data in Agriculture Hands-on with data infrastructures that can power your agricultural data products 12/12/2013 Athens, Greece Supported by EU projects

  2. Tutorial on how to use from external tools or build new complex data processing workflows (example: data aggregation) Robert Lovas MTA SZTAKI, Hungary

  3. Intro: user scenario • a user (information manager) wants to create a data set on-the-fly that will include specific filtered subsets of existing data sources, e.g. CIARD RING • E.g. covering a particular geographical region, time period, type of resources • use agINFRA-powered RING panel (Drupal module) to select desired data sources and relevant metadata properties, facets, formats • aggregation workflow executed when grid resources are available, notifying user to collect produced data set when ready • an advanced user wants to develop further the existing workflows or create new complex data processing workflows

  4. Objectives This presentation aims to provide • illustration how an agINFRA powered data aggregation works with simple but powerful interface to • select targets, execute complex workflow, and provide the downloadable outputs (data sets on the fly) • overview on designing workflows for data processing with user access and documentation details

  5. Targets from CIARD RING vs. manual settings

  6. Checking progress (with details)

  7. Executionfinished recordscan be downloaded

  8. The background Steps: • Configuration • Starting aggregation (workflowsubmissionthroughRemote API ) • Enactingtheworkflow (Initharvests,etc.doingone-by-one) • As a step of theworkflow, uploadingtheharvesteddatato Grid Storage LFN(using Robot certificate) • RegisteringthedatasetinagCrouchDB • Retrievingthe HTTP location • Provide the downloadable datasets

  9. Aggregation workflow

  10. Workflow support with gUSE (www.guse.hu)

  11. agINFRA Science Gateway for workflows Liferay-basedgUSE/WS-PGRADE for creating and running workflows  http://aginfra-portal.lpds.sztaki.hu/liferay-portal-6.0.5/ • or on-demand deployment • agINFRA VO is accessible (ca. 3500 CPU cores, 900 TB storage)

  12. Example: REST-specific featuresin job settings

  13. Documentation of gUSE For workflows Used from the GUI

  14. New! Request form for a new instance of a workflow engine (+ workflows and other components) on the Cloud  http://www.desktopgrid.hu/oc-public-aginfra

  15. Thank you! Robert Lovas MTA SZTAKI Robert.Lovas@sztaki.mta.hu