NCSA Research Programmer Max Burnette has recorded a tutorial for computational scientists interested in adding their algorithms to Clowder. NOTE: This is aimed at pipeline developers rather than data users.
The TERRA REF program has an instance of Clowder at https://terraref.ncsa.illinois.edu/clowder being used for the TERRA REF data stream.
This video follows the slides above.
It is about 80 minutes, much of which is just installing a development environment. If you open it in YouTube; the first comment contains the following bookmarks to jump to specific topics.
- Overview 0:00
- Setting up a test environment 3:12
- Extractor Basic Design 29:15
- Writing an extractor 1:02:11
Please get in touch or create a github issue once you are starting to actually develop your extractor and I can help get you off to a good start.
- Orignially posted on the Clowder wiki
- Clowder Documentation
- Use of Clowder within TERRA REF
docker-compose.xmlfile you can use to start the Clowder stack
- Sample extractor
wordcount.py. See also
- Clowder API documentation