TimberID
Log In
  • 🌳Welcome to TimberID
  • Overview
    • 🌳Background
  • User Guide
    • πŸ”°Registering
    • πŸͺ΅Single Reference Sample + Import
      • ⁉️Import Errors
    • πŸ”ŽOrigin Verification
    • πŸ“€Exporting
    • 🌎Earth Engine API
    • ⚑Administration Guide
      • πŸ§‘β€πŸ€β€πŸ§‘Creating Organizations
      • 🚸Managing Users
    • πŸ“—Glossary
    • πŸ›Report an Issue
  • Architecture of TimberID
    • πŸ› οΈHigh Level Design
    • πŸ“šOpen Source Github Repositories
    • 🏯Detailed Design
      • 🌐Client
      • πŸ–₯️Server
      • πŸ—ΊοΈExternal integrations and maps
      • 🌎Earth Engine
      • πŸ‘©β€πŸ”¬Research Colabs
        • Data Ingestion
        • Model Training (Variational Inference)
        • Isoscape Generation
        • Validation of Isoscapes
    • 🌩️GCP Guide
      • πŸ“ˆAnalytics
      • πŸ’ΎDatabase Query Builder
      • πŸ’°Budget Alerts
      • πŸŒ„Domain Name Configuration
      • ⚠️Backups and Disaster Recovery
    • πŸš€Test Procedure for Production Release
  • Internal
    • πŸ”Internal Information
Powered by GitBook
On this page
  • Background
  • Data + Model Pipeline
  • Notebooks and Repositories
  • DDF Common Stub
  • DDF Common

Was this helpful?

  1. Architecture of TimberID
  2. Detailed Design

Research Colabs

Documentation of Colab notebooks intended for researchers and advanced users

PreviousEarth EngineNextData Ingestion

Last updated 1 year ago

Was this helpful?

Last Updated: 2023-09-27

Background

Very broadly, TimberID consists of a production-oriented web application that delivers insights about illegal logging both in reference to specific timber samples based on stable isotopes and in general. Insights about specific timber samples include fraud detection, which determines the likelihood that a set of isotope measurements from a timber sample originate from a given location. Together with our original research and prior work from leading researchers such as Professor Martinelli of the University of Sao Paulo (USP), these Colab notebooks justify our fraud detection methodology and produce the artifacts (isoscapes) that the fraud detection system requires to function.

For more information, see High Level Design.

Data + Model Pipeline

Notebooks and Repositories

DDF Common Stub

The DDF common stub contains the ddfimport library, which loads DDF Common for development in Colab by cloning a Git repository and mounting it within the Colab host filesystem. There are two ways to import ddf_common:

  • ddfimport.ddf_source_control_pane()

  • ddfimport.ddf_import_common()

The first method opens a graphical source control pane in the Colab that integrates with GitHub and prompts developers to authenticate with their credentials. This is the best way to iterate on and contribute to the DDF Common code library.

Most users will want ddfimport.ddf_import_common() instead, which does not require user interaction but also does not facilitate committing changes to DDF Common.

import sys
!if [ ! -d "/content/ddf_common_stub" ] ; then git clone -b test https://github.com/tnc-br/ddf_common_stub.git; fi
sys.path.append("/content/ddf_common_stub/")
import ddfimport
# ddfimport.ddf_source_control_pane() # Developers use this
ddfimport.ddf_import_common() # Most people will want this

DDF Common

This library contains utility functions that we use across various repositories, including these research Colabs. Key functionality includes:

  • Data partitioning

  • Fraud determination logic (hypothesis test)

  • Raster manipulation

  • Isoscape generation from a TensorFlow SavedModel

  • Script that uploads isoscapes to EarthEngine

Our research and fraud detection methodology is concentrated in , with helper functions in , and a small loader shim in to help manage the complexity of dependency management in Colab across multiple repositories. Additionally, contains some code that we use to experimentally validate our production logic for TimberID.

🏯
πŸ‘©β€πŸ”¬
DDF Isoscapes
DDF Common
DDF Common Stub
DDF Insights Analytics
End-to-End Research Workflow for Training a Model and Publishing an Isoscape
Flow of Control and Organization of Research Colabs
Drawing
Drawing