extensions

Tripal User's Meeting 2020/03/03 Tripal Community Meeting Notes

Community Highlights

Please add anything you would like to highlight about your Tripal-based projects: publications, new extension modules, new collaborations, newly funded grants, project update, etc.  We won't talk about these in the meetings but may tweet them from the Tripal twitter account if you approve!

Name

Highlight Description

Can we tweet it? Yes/No

Jill/TreeGenes

Irene Cobo just joined us from Spain as Postdoc to develop CartograTree in collaboration with HWG

Yes

Jill/Oregon Biodiversity Genome Project

We (Peter) have setup a base installation of Tripal for these folks to migrate their system to: https://www.obgp.org/

Next Month, Yes ;)

Jill/TreeGenes

Funding received (starting soon) from NSF to develop a deep learning genome annotation workflow that will operate independently and as a Tripal module.  Will be deployed first at TreeGenes

Yes

Jill/Meg

Tripal will serve as the framework for data associated with the timber tracking objectives - World Forest ID

Will tag Tripal to retweet

Jill/Mimubase

This is not fully new but Mimubase should be added to sites using Tripal!  http://mimubase.org/ (developed by Peter)

Yes!  

Valentin

MSAViewer in a module for Drupal 7 (Tripal not required)

https://www.drupal.org/project/msaviewer

yes

 

Agenda

  1. Messages from the PMC (Lacey Sanderson, Bradford Condon, Stephen Ficklin)

  2. Messages from the TAC Chair (Meg Staton)

    • At PAG meeting had discussion about how to expand 

    • White paper and movement on grants.

    • Next month is the advisory committee meeting we may need to move a week or two later as Meg may be out of town.

      • Talk about grants and white paper

        1. Ethy and Monica had indicated support to lead the white paper discussion/work.

      • Everyone is invited!  Even if not a TAC member.

  3. Demo of Tripal HQ by Sean Buehler

  4. Brief update on gene pages (Monica Poelchau)

    • see https://github.com/tripal/tripal/issues/100, https://github.com/tripal/tripal/issues/732

    • i5k and HWG are picking up the gene page issue again. I suspect that we will tackle individual components in stages, and will seek feedback for each one

    • will start with Jbrowse field for feature pages

    • will abandon the idea of populating gene page with 'grandchild' info 

    • what considerations should we have in developing this for Drupal 8/Tripal 4

      • Lacey:  

        1. currently tripal fields are being ported now to D8 so once that is done we should have a better idea of what considerations there might be.  

        2. we're working to make sure that upgrading is as easy as possible and there will be as few requirements to update a field as possible.

  5. AgBioData meeting tomorrow to discuss GFF3 format.  See if there are enough use cases to identify the main issues in the format to see if we can get the AgBioData community to rally around a way to represent structural and functional data across databases.

Tripal User's Meeting 2020/05/05 Tripal Community Meeting Notes

Agenda

Tripal User's Meeting 2020/06/02 Tripal Community Meeting Notes

Community Highlights

Please add anything you would like to highlight about your Tripal-based projects: publications, new extension modules, new collaborations, newly funded grants, project update, etc.  We won't talk about these in the meetings but may tweet them from the Tripal twitter account if you approve!

Name

Highlight Description

Can we tweet it? Yes/No

Lacey Sanderson

Private BioData received Gold Medal status! Make individual pages private while others of the same Tripal Content Type remain public!

Yes

     
     

 

Agenda

  1. Messages from the PMC (Lacey Sanderson, Bradford Condon, Stephen Ficklin)
  1. Tripal 3 Updates
  2. Tripal 4 Updates
    • Will be covered in the demo portion of today’s meeting
    • Drupal 7 end-of-life is November 2021: https://www.drupal.org/psa-2019-02-25 
    • Tripal 4 will be compatible with Drupal 9 although its currently being developed on Drupal 8.8.x
  1. Messages from the TAC Chair (Meg Staton)
  2. Tripal 4 Development (https://github.com/tripal/t4d8)
Tripal User's Meeting 2021/04/06 Tripal Community Meeting Notes

Agenda

  1. Notices for the Advisory Committee
  2. An introduction to the Main Lab Breeding Module by Taein Lee
    • Breeding Information Management System
    • BIMS Overview
      • secure and comprehensive online breeding data management system.
      • store, manage, backup private breeding data.
      • comparable with the field back app (an android app for collecting data in the field)
      • BIMs is installed on all Main Lab databases, including GDR under the Tools menu.
      • Online documentation at https://www.breedwithbims.org/ 
      • You can access public data and there are private data only accessible to breeders.
      • Mange Breeding
        1. Manage Program
          1. Can add users
        2. Manage Traits
          1. Can manage all traits used by the program 
          2. Can view plots of usage of each trait
        3. Accessions
          1. You can view details about each accession (organism and parental information).  
        4. Trials
          1. You can view information about trials
      • Data Import
        1. Can import data using the BIMS t template file. There are various templates for different data types, or you can download a single template of all.
        2. Templates are excel files with headers.  Users can add data to the template files and use those to import data into BIMS.
      • Field Book Management Page
        1. On this page you can import data from the field book.
        2. Export field file from the field book app and import it on this page.
      • Archive page
        1. Allows you to retrieve previously uploaded data files.
        2. Can create new archive files for download so you have a backup of data in BIMS
      • Search
        1. You can search for phenoyptes, crosses, genotypes (SNP/SSR), Haplotypes. 
        2. Search results show histogram of selected trait.  
        3. Search results page has a default set of columns but you can add any column of interest to expand the results table.  
      • BIMS is currently available at https://gitlab.com/mainlabwsu/bims
      • It is a Drupal 7 module.  
      • Limitations
        1. Does not currently handle the organism table of Chado v1.3 (due to addition of infraspecific name).  
        2. Uses BrAPI 1.3 but currently BrAPI is at 2.0
      • Requirements
        1. Mainlab Chado Loader
        2. OAuth 2 SErver
        3. Breeding API module
          1. Druplal 7, BrAPI 1.3
Tripal User's Meeting 2021/09/07 Tripal Community Meeting Notes

Agenda

  1. Reminders
  2. Any Updates from the Advisory Committee?
  3. Next Month's Meeting:  Advisory Committee Meeting.
  4. AgBioData Research Coordinate Network (RCN) Award
    • https://www.nsf.gov/awardsearch/showAward?AWD_ID=2126334&HistoricalAwards=false
    • Monica and Meg are both on the steering committee!
    • Will hold an online meeting in 2022 and there will be some working groups for folks to join.  Meg hopes Tripal can be involved!
      • Meg:  Education
      • Monica: Data Federation
    • Looking to hire a project coordinator.
    • Kick-off meeting was held Sept 1st.
    • Please watch for AgBioData notices and news for further information.
    • Any updates from folks in the leadership team?
    • Chado and the Semantic Web paper
      • If interested please consider volunteering with this.
  5. Tripal Hackathon and PAG Workshop
    • Currently the Tripal Workshop is scheduled with PAG.
    • Due to international travel restrictions, the PMC has decided to hold the annual Hackathon/Codefest online again this year.
    • Suggestions:
      • pre-record talks
  6. Presentation by Stephen Ficklin.  Tripal Network Module Introduction. 
    • Purpose: stores and integrates gene co-expression, protein-protein interaction and other network data within a Tripal site to help researchers explore gene function through relationships. 
    • It is still under development. We are hoping to offer it for use early 2022.
    • History: the module has been in use as a Tripal v2 site at http://gene-networks.org/. The site and the module have languished but with the release of the new KINC workflow (https://kinc.readthedocs.io/en/latest/) we wanted a place to display the networks we and our collaborators are constructing.
    • Features
      • Integrates with the Tripal file module for sharing network files and data with licenses.
      • Designed to support multiple network types with nodes as genomic features:
        1. Gene co-expression
        2. Protein-protein interaction
      • Fully supports controlled vocabularies for edge and node annotations.
      • Supports KINC workflow (https://kinc.readthedocs.io/en/latest/)
      • Database and Code Review
        1. A new set of tables in Chado for storing network data
        2. New Content Type:
          1. Network content types
        3. New Fields
          1. For the Network content type
            1. Network attribute
          2. For the feature-based content types (e.g. gene)
            1. Network Neighborhood Viewer   
        4. New Importers
          1. Imports networks in GraphML format (http://graphml.graphdrawing.org/
        5. New Bulk Loader Template
          1. Functional data importer
      • Website Review
        1. Example network data source:
          1. https://www.ncbi.nlm.nih.gov/bioproject/PRJNA301554/ 
        2. Network Content Type
          1. View existing
          2. View creation form
        3. GraphML Loader
        4. Interactive whole network 3D viewer application
          1. Fully Drupal compatible
          2. Uses Plotly for interactive networks
          3. Feature review
            1. Network selection
            2. Network layering
            3. Selected node and edge
            4. Network filtering
            5. Help and info
        5. Interactive gene neighborhood
        6. Web services
    • TODO:
      • selecting networks by data source.
      • Integration of expression data (perhaps in conjunction with the Staton Lab Expression module)
      • Improvements to the gene neighborhood viewer
      • Better graph layouts
      • Bug fixes!
      • Step-by-step installation and usage documentation.
      • Functional enrichment of the filtered network.
    • Thoughts or feature requests?
      • How to do cross-species comparisons.
      • Add the ability to turn on and off node labels
Tripal User's meeting 7/13/18 Announcement

This Friday, July 13th 2018, 11am EST 8am PST, we will have our Tripal User’s meeting.

Tripal User's Meeting @ San Diego 2017-01-13 Tripal Community Meeting Notes

Friday, January 13

8am - 12pm Round-table Discussion

12pm - 1pm LUNCH

1pm - 5pm Free Collaboration, continued Round-table Discussion

 
  • Tripal 3 update
  • Full stable release: May 2017
  • Just about finished main core functionality done
  • Uses the semantic web and controlled vocabularies to exchange data between Tripal sites as well as to expose it to the outside world
  • Uses controlled vocabularies for everything: column names are given cvterms as well as relationships, etc.
  • Content created by type (ie: gene) rather than by chado table (ie: feature)
  • All chado content is now fields which allows you to use the web interface to reorder and change display rather than needing a php template
  • What you see on the page is what is available on your web services
  • Thus your web services are tailored to your site
  • Beautiful upgrade process that allows you to upgrade immediately while keeping your nodes. Then you can upgrade on a per content type basis
  • You can also use your old templates on entities
  • Tripal v2.3
  • Victor has started unit testing module which will allow much quicker releases
  • Data type evolution: dealing with NGS type of data with Tripal and what about Chado? (Valentin)
  • Includes: Genotype analysis and viewing tools: use cases and survey of tools now under development (Ethy)

Challenges:

  • How to pick sets of germplasm efficiently
  • Core data storage and extraction problem
  • How to display the data to the user: zoomed in, haplotype viewer, etc.
  • Speed, avoiding server overload (can some analysis be done on client side?)
  • Valentin’s team stores its NGS data in MongoDB
  • Uses tomcat on top of MongoDB
  • https://www.crop-diversity.org/mgis/gigwa
  • Genotypic data associated with markers
  • Lacey uses PostgreSQL (tested 5 billion: 5 million SNPs x 1000 germplasm)
  • Ethy: MaizeGDB
  • Mini, incomplete slides on other tools here: https://docs.google.com/presentation/d/1TVt74oQi3EON6DtQlcjZDirJpw5R53_…;
  • HDF5 in the backend (TASSEL)
  • MaizeGDB SNPversity is still having troubles with some of the larger jobs completing
  • Flapjack is great but is a standalone java application
  • Support for VCF is good (easier for researchers)
  • VCF export? So far, not wanted, prefer matrix formats now, but need is likely 
  • Tripal Job launcher (Ethy)
  • Can’t limit the number of parallel jobs
  • This one shouldn’t be too difficult
  • Drupal module cron queue
  • Would be nice if job launcher could send jobs to a separate system
  • Would be nice for the job launcher to respect priority
  • Need a lot more fine-grained control about which jobs can be run in parallel and which can not
  • Cannot cancel jobs through the job interface
  • Job log is not extremely helpful -date/time for when messages are logged
  • About 5 are using the drush daemon
  • Tripal Elasticsearch launches multiple queues with
  • QueueUI
  • UltimateCron
  • Import/export module: extend Tripal Download API? (Valentin)
  • Sofia uses perl to write SQL
  • Ethy uses perl
  • MainGroup lab has a PHP chado loader https://www.rosaceae.org/mcl 
  • RNAseq has it’s own internal loader in php
  • Data checking as you go, perl interactive loaders
  • Also need to ability to share these loaders with other groups
  • Perhaps it would be useful for the API to be a PHP library/class-based so it would not need drupal
  • Mention this on the mailing list
  • Some people have a Tripal site solely for loading data, not for content display
  • Tripal cv loader fails for GO.
  • Probably due to a chado stored procedure
  • Disable stored procedure then run chado’s perl set-cvtermpath script by hand? ISU will test.
  • Tree Visualization of multiple species relationships using the organism and phylo tables (Chris)
  • There is a newick file loader in Tripal 2.1 that populates the phylo* tables
  • This one will pull lineage from NCBI taxonomy; documentation embedded in bulk loader documentation. Taxonomy/Organism linker (http://tripal.info/node/109 )
  • Can be used to store taxonomy tree
  • Has a visualize of a tree
  • LegumeInfo phylotree module here.
  • This one more based on gene families
  • How indices of phylonodes are computed: http://archive.oreilly.com/pub/a/network/2002/11/27/bioconf.html
  • And have look to the picture there: http://archive.oreilly.com/pub/a/network/2002/11/27/bioconf.html?page=2
  • Tripal 3 and entity permissions based on drupal users and roles (Sofia)
  • Will be very similar but will be on an entity-bases
  • Would like the permissions moved as well **
  • Will it handle permissions on a per-node basis?
  • Need documentation on how to do this in Tripal 3
  • Some people are using Organic groups
  • Galaxy module and Data Exchange
  • Trying to integrate Tripal with Galaxy so that users can see a Tripal interface but run galaxy workflows
  • Uses webforms to create the interface for workflows
  • Module queries galaxy and creates the webform for it
  • Then admin can go in and tweak various things like defaults and help text
  • Parameters can be re-arranged and grouped, etc.
  • BLAST Module https://github.com/tripal/tripal_blast
  • How many people are using it?
  • Is it meeting your needs?
  • BLAST module new feature: filter database list by organism. (Sofia)
  • Overview of BLAST at PeanutBase and LegumeInfo here.
  • Slides also show CViTjs
  • Shows features of a gff3 file in the context of the whole genome
  • blast https://docs.google.com/presentation/d/1iKnHgVyeGWe2pE2OFrjTD_FHb7yTIGslWGiPqQc5qX4/edit?usp=sharing
  • BLAST at KnowPulse (current core module)
  • Consumption of Web services planned, especially of CoGe, which has a nice REST API and a way of grouping target databases that are of interest to your users.
  • Question from LegFed meeting: if target is a set of genomes, could multiple genomes be displayed on multiple instances of CViTjs?
  • Meta data submission system (Chris)
  • Drupal forms to control submission of metadata
  • Data is not in chado
  • Chado Multi-chado
  • Needs reviews on Drupal.org --Please help by reviewing this module!
  • Supports multiple chado databases attached at the same time
  • Each user/session can only access one chado at a time
  • Elastic search
  • Site-wide search -much faster than Drupal views
  • Dorries group wants to be able to use it with multiple sites on the same server
  • Now available
  • Expression module
  • Creates biomaterials (reflects NCBIs concept)
  • Separately you can load in your gene expression data -beautiful heatmap visualization
  • Has an independent page where you enter a number of genes
  • Builds a two dimensional heatmaps
  • basket/cart functionality would be helpful
  • Does anyone want biomaterials separate from expression?
  • Search by normalized values above or below a threshold
  • Might want to store p-values
  • Sofia volunteered to be a tester for search functionality
  • Hackathon produced an implementation of the Tripal Download API to download the expression values for a given node
  • New functionality for blast analysis and interpro and upgraded the go module
  • Basket/Cart functionality
  • What are examples of existing carts on biological (or not) sites that people like?
  • Valentin - how is flag module working out? Should we continue to leverage that?
  • Flag module - working well with Musa to hold stock and 3 other entities, can apply actions on cart
  • Long term goal: workspace with multiple user-provided and db-source datasets
  • Think about a chart focused on entities rather then nodes so that it works with Tripal 3
  • Do we want to ensure a cart can only contain one subtype (ie: only features (Tripal2) or only genes (Tripal3))?
  • What do you love/hate about Tripal?
    • Difficult to become proficient
    • Drupal can be challenging to learn.
    • Very Large (improved in Drupal8/Tripal 3?)
    • Reusability of code and functionality
    • Customizable
    • Need a sustainability plan
    • NSF research coordination network grant
    • Stephen has ideas from DIBBS meeting about long term funding goals for NSF
    • Chado (several versions) instantiation/update made easy
    • Online documentation
    • perhaps develop documentation standards for Tripal modules.
    • currently have tripal.info - could pull in extension docs as well
  • Is there a way to leverage read the docs functionality to combine all the documentation together?
    • Mailing lists
    • Idea: remove all mailing lists except announce. All bugs/requests routed through issue queue on github
    • Seems ok with everyone
    • Can become part of organization and auto-watch all repos without adding their own repos

Feature requests:

  • Interproscan html output: Can we add functionally to incorporate this into the interpro scan feature node/entity tab? (Sofia)
  • This now has visualizations thanks to A. Bretaudau
  • Feature Request: Interpro scan module -being able to add terms outside GO terms, etc. For example Reactome, KEGG. (Sofia)
  • These are native options to IPS, need to add code to deal with these new options.
  • KAAS/KEGG loader required output that is no longer available from KEGG. I have hacked a method for downloading the KEGG output with a shell script using curl and I have modified the KEGG loader to work with this new downloaded data. But I loose all the links. (new downloaded data does not have any links). Would be nice to get links back in. (Sofia) 
  • I have an undergraduate student working on this, hope to have something to release within a month or two (Meg)
  • Possible Problems/Bugs:
  • Issues with updating custom cv terms. Might be my fault. Do I/can I reload my obo files to update terms. I get errors when trying this. (Sofia)

 

Random questions: 

 

Tripal Users Meeting 2020/08/04 Tripal Community Meeting Notes

 

Agenda

  1. HacktoberFest with Free T-Shirts! 
    • 5 commits to core (?) = a free shirt in the mail 
    • Anyone handy with design?
    • Creating issues
    • Advertising
    • Commits count twice! You could also get a github t-shirt
    • Stickers too!
  2. Update on the white paper and community survey results - Meg Staton
  3. Updates to Phylotree and Demo of Use for Orthogroups - Noah Caldwell
  4. Consider joining the Tripal Dev Calls weekly

 

Tripal Users Meeting 2020/09/01 Tripal Community Meeting Notes

Agenda

  1. Messages from the TAC
    • The whitepaper is still in progress. It is a bit long and so needs some further changes.  
    • If you're interested in reviewing please ask for the link and it can share.
  2. Oct 6th User's Meeting is a TAC meeting.  
    • possible discussion items are the annual CodeFest
    • OctoberFest.
  3. Tripal 4 updates
    • Repository: https://github.com/tripal/t4d8 
    • README on the tripal 4 developmental repository with a timeline.
    • We are running about 1 month behind so we need help from the community
    • Our plan is to release the beta on time
    • We've updated the documentation to make it easier to jump in. 
    • If you want to contribute but feel lost please reach out on Slack or comment on GitHub.
  4. Tripal File Module Discussion (Stephen)

 

Tripal Users Meeting 2020/11/03 Tripal Community Meeting Notes

Agenda

  1. HacktoberFest Wrap Up - how’d we do?
    • PRs made to Core Tripal: 20
      • Ferrisx4(1), michizhou(2), risharde(4), katherynbuble(1), spficklin(5), dsenalik(4), laceysanderson(2), bradfordcondon(1)
    • PRs made to Tripal 4: 4 (plus two that haven’t been accepted yet)
      • Ferrisx4(1), spficklin(1), laceysanderson(2)
    • Don’t forget to fill out the form: https://forms.gle/Pp737HjruK9roCph8 
      • Only 3 so far: michizhou, dsenalik, laceysanderson
      • Stephen and Rish need to fill out the form :)
  2. Tripal 4 Status & Call for Help
  3. Next Month's Meeting: Preparation for the annual Tripal Codefest
    • We will be sending out a form requesting topics of interest
    • We will organize into groups, with each group organizing their session with a combination of Slack/Zoom 
    • Hackathon will proceed Jan 11-15th 
    • We will hold a final get-together to review progress Friday 1/15.
    • Coordinating with GMOD?
  4. White Paper Update
    • Thanks Valentin for additions! (Val: you’re welcome ;) )
    • Sending out soon. If you would still like to review let Meg know.
  5. Demonstration of AnalyzedPhenotypes & ND Genotypes by Carolyn Caron
    • AnalyzedPhenotypes provides a researcher-friendly importer, violin plots and histograms, trait pages and integration on germplasm pages for phenotypic data. Additionally there is download functionality in R-friendly formats.
    • ND Genotypes provides integration of large-scale genotypic data on sequence variant, genetic marker, germplasm and project pages. Additionally, there is a genotype matrix view with download capabilities.
    • These modules provide Tripal support for large-scale Genotypic and Phenotypic data in a proven generic manner with both modules having gold badge status! There is extensive configuration with sensible defaults to get you started quickly!