Difference between revisions of "Tutorials"

(Pattern Discovery)
 
(18 intermediate revisions by the same user not shown)
Line 4: Line 4:
  
  
The tutorials shown on this page provide a quick introduction to the most important features of geWorkbench.  Additional information can be found in the User Guide and in the Online Help section of the program.  
+
The tutorials shown on this page provide a quick introduction to the most important features of geWorkbench.  
  
 +
For the '''web version''' of geWorkbench, please see [[GeWorkbench-web/Tutorials | GeWorkbench-web Tutorials]]
  
==Using the basic framework of geWorkbench: Projects, files and data==
+
 
 +
 
 +
==Using the basic framework of geWorkbench==
 +
The graphical interface, files and data==
  
 
===[[QuickStart | Quick Start]]===
 
===[[QuickStart | Quick Start]]===
Line 14: Line 18:
 
===[[Basics | Basics]]===
 
===[[Basics | Basics]]===
 
An introduction to the use of geWorkbench.
 
An introduction to the use of geWorkbench.
 +
 +
===[[Menu_Bar]]===
 +
Many geWorkbench commands are available in the upper menu bar, as well as in the [[Workspace]].
  
 
===[[Component_Configuration_Manager | Component Configuration Manager]]===
 
===[[Component_Configuration_Manager | Component Configuration Manager]]===
 
Customize geWorkbench to your needs.  geWorkbench comes initially configured with only basic components installed.  Use the CCM to load additional available modules.
 
Customize geWorkbench to your needs.  geWorkbench comes initially configured with only basic components installed.  Use the CCM to load additional available modules.
  
===[[Projects| Projects]]===
+
===[[Workspace]]===
The Project Folders component is where data is loaded and analysis results are stored.
+
The [[Workspace]] is where data is loaded and analysis results are stored.
  
===[[Project Details | Project Details]]===
+
===[[Information Panel]]===
 
Describes components use to record details of calculations and datasets.
 
Describes components use to record details of calculations and datasets.
  
Line 30: Line 37:
 
Details of several different file formats supported by geWorkbench.
 
Details of several different file formats supported by geWorkbench.
  
===[[Remote Data Sources | Remote Data Sources (caArray)]]===
+
===[[CaArray|caArray]]===
 
How to download microarray data from caArray.  geWorkbench can download "derived" data sets from caArray.
 
How to download microarray data from caArray.  geWorkbench can download "derived" data sets from caArray.
  
===[[Data_Subsets - Arrays | Data Subsets - Arrays]] ===
+
===[[Array Sets]] ===
 
How to create and use sets of arrays for controlling data analysis.
 
How to create and use sets of arrays for controlling data analysis.
  
===[[Data_Subsets - Markers| Data Subsets - Markers]] ===
+
===[[Marker Sets]] ===
 
How to create and use sets of markers for controlling data analysis.
 
How to create and use sets of markers for controlling data analysis.
  
Line 58: Line 65:
 
===[[Tutorial_Data | Tutorial Data]]===
 
===[[Tutorial_Data | Tutorial Data]]===
 
Downloadable data used in the tutorials.
 
Downloadable data used in the tutorials.
 
 
  
 
==Individual analysis and visualization components==
 
==Individual analysis and visualization components==
Line 75: Line 80:
 
Submits BLAST jobs to the NCBI server and displays and allows further interaction with alignment results.
 
Submits BLAST jobs to the NCBI server and displays and allows further interaction with alignment results.
  
===[[Cellular Networks KnowledgeBase | Cellular Networks KnowledgeBase]]===
+
===[[Cellular Networks KnowledgeBase | Cellular Networks KnowledgeBase (CNKB)]]===
 
The CNKB component queries a database of protein-protein and protein-DNA interactions maintained at Columbia University.
 
The CNKB component queries a database of protein-protein and protein-DNA interactions maintained at Columbia University.
 +
 +
===[[CeRNA_Query]]===
 +
This component provides query access to a precomputed database of competitive endogenous RNA (ceRNA) interactions, also called "sponge" interactions. These interactions underlie a post-transcriptional layer of regulation, and were predicted using the Hermes algorithm (Sumazin et al., 2011).
  
 
===[[Classification | Classification]]===
 
===[[Classification | Classification]]===
Line 85: Line 93:
  
 
===[[Consensus_Clustering | Consensus Clustering]]===
 
===[[Consensus_Clustering | Consensus Clustering]]===
 
+
This component allows geWorkbench to run Consensus Clustering on a GenePattern server.
  
 
===[[Cytoscape_Network_Viewer | Cytoscape]]===
 
===[[Cytoscape_Network_Viewer | Cytoscape]]===
 
Cytoscape is used to display network interaction diagrams (from adjacency matrices).  It features two-way interaction with the geWorkbench Markers component.
 
Cytoscape is used to display network interaction diagrams (from adjacency matrices).  It features two-way interaction with the geWorkbench Markers component.
  
===[[Differential Expression | Differential Expression (t-test)]]===
+
===[[Cupid]]===
Several variants of the t-test are available.
+
Cupid (Sumazin et al. 2011) generates information that can help predict if a gene is a target of a specific miRNA. The Cupid service provides a simple query interface to a database of precalculated Cupid results.
 +
 
 +
===[[DeMAND]]===
 +
The DeMAND (Drug Mode of Action through Network Dysreguation) algorithm measures dysregulation between the expression of two genes in a network caused by e.g. a drug perturbation. The list of top dysregulated gene pairs can reveal details of a drug's mode of action in the tested cellular system or tissue.
 +
 
  
 
===[[Expression Value Distribution | Expression Value Distribution]]===
 
===[[Expression Value Distribution | Expression Value Distribution]]===
 
View and manipulate a histogram of the distribution of expression values for each array.
 
View and manipulate a histogram of the distribution of expression values for each array.
 +
 +
===[[Fold Change]]===
 +
Compare the ratio of the expression of genes between two sets of arrays, e.g. case and control sets.
  
 
===[[Gene_Ontology_Term_Analysis | Gene Ontology Term Analysis]]===
 
===[[Gene_Ontology_Term_Analysis | Gene Ontology Term Analysis]]===
Line 101: Line 116:
 
===[[Gene_Ontology_Viewer | Gene Ontology Viewer]]===
 
===[[Gene_Ontology_Viewer | Gene Ontology Viewer]]===
 
The Gene Ontology Viewer provides both a standalone GO Term browser, as well as displaying results of GO Term Analysis.  Genes associated with a term can be copied back into a marker set for further analysis.
 
The Gene Ontology Viewer provides both a standalone GO Term browser, as well as displaying results of GO Term Analysis.  Genes associated with a term can be copied back into a marker set for further analysis.
 +
 +
===[[GenomeSpace]]===
 +
GenomeSpace allows for the transfer of data between a number of different genomics and bioinformatics software analysis platforms, including geWorkbench.
  
 
===[[genSpace | genSpace]]===
 
===[[genSpace | genSpace]]===
Line 107: Line 125:
 
===[[Grid Services | Grid Services]]===
 
===[[Grid Services | Grid Services]]===
 
A number of geWorkbench data analysis components have been implemented as services on the National Cancer Institute's caGrid.  caGrid is an infrastructure component of the NCI's [http://cabig.nci.nih.gov/ caBIG(R)] program.
 
A number of geWorkbench data analysis components have been implemented as services on the National Cancer Institute's caGrid.  caGrid is an infrastructure component of the NCI's [http://cabig.nci.nih.gov/ caBIG(R)] program.
 +
 +
===[[GSEA]]===
 +
Implements a front-end for submitting data to and viewing the results of a GSEA (Subramanian et al, 2005) analysis on a GenePattern server.
  
 
===[[Hierarchical Clustering | Hierarchical Clustering]]===
 
===[[Hierarchical Clustering | Hierarchical Clustering]]===
 
geWorkbench implements its own agglomerative hierarchical clustering algorithm.
 
geWorkbench implements its own agglomerative hierarchical clustering algorithm.
 +
 +
===[[IDEA]]===
 +
The IDEA (interactome dysregulation enrichment analysis) algorithm uses a genome-wide molecular interaction map as a systematic framework for the identification of genes playing a role in oncogenesis.
  
 
===[[Jmol | Jmol]]===
 
===[[Jmol | Jmol]]===
 
Jmol is a molecular structure viewer for viewing PDB format files.
 
Jmol is a molecular structure viewer for viewing PDB format files.
  
===[[MarkUs | MarkUs]]===
+
===[[K-Means_Clustering]]===
The MarkUs component assists in the assessment  of the biochemical function for a given protein structure. The component in geWorkbench provides an interface to the MarkUs web server at Columbia. MarkUs identifies related protein structures and sequences, detects  protein cavities, and calculates the surface electrostatic potentials  and amino acid conservation profile.
+
Provides an interface to running K-Means Clustering on a GenePattern server, and a viewer for the results.  
 +
 
 +
===[[LINCS_Query]]===
 +
This component provides for query and display of data generated by the Columbia LINCS Technology U01 and Computation U01 Centers. It provides experimental and computational results for drug mode of action and similarity calculations, and for synergy experiments.  
  
 
===[[Marker Annotations | Marker Annotations]]===
 
===[[Marker Annotations | Marker Annotations]]===
 
Marker annotations can be retrieved, including BioCarta pathway diagrams.
 
Marker annotations can be retrieved, including BioCarta pathway diagrams.
 +
 +
===[[MarkUs | MarkUs]]===
 +
The MarkUs component assists in the assessment  of the biochemical function for a given protein structure.  The component in geWorkbench provides an interface to the MarkUs web server at Columbia.  MarkUs identifies related protein structures and sequences, detects  protein cavities, and calculates the surface electrostatic potentials  and amino acid conservation profile.
  
 
===[[Master Regulator Analysis | Master Regulator Analysis]]===
 
===[[Master Regulator Analysis | Master Regulator Analysis]]===
The Master Regulator Analysis (MRA) component attempts  to identify transcription factors which control the regulation of a set  of differentially expressed target genes (TGs). Differential expression  is determined using a t-test on microarray gene expression profiles from  2 cellular phenotypes, e.g. experimental and control.
+
Master Regulator analysis [Lefebvre et al., 2010] is an algorithm used to identify transcription factors whose targets (e.g., as represented in an ARACNe-generated interactome) are enriched for a particular gene signature (e.g. a list of differentially expressed genes).  
 +
 
 +
====[[MRA-FET]]====
 +
Master Regulator Analysis using Fisher's Exact Test.
 +
 
 +
====[[MARINa]]====
 +
Master Regulator Analysis using the MARINa algoarithm. GSEA is used to compute enrichment.
  
 
===[[MatrixREDUCE | MatrixREDUCE]]===
 
===[[MatrixREDUCE | MatrixREDUCE]]===
Line 131: Line 167:
 
===[[Pattern Discovery | Pattern Discovery]]===
 
===[[Pattern Discovery | Pattern Discovery]]===
 
Upstream seqeunce can be analyzed for conserved sequence patterns.
 
Upstream seqeunce can be analyzed for conserved sequence patterns.
 
  
 
===[[PCA| Principle Component Analysis (PCA)]]===
 
===[[PCA| Principle Component Analysis (PCA)]]===
Find components of the data responsible for the greatest variance.
+
Find components of the data responsible for the greatest variance.  Provides a front-end to analysis on a GenePattern server, and graphical visualization of the results.
  
 
===[[Promoter Analysis | Promoter Analysis]]===
 
===[[Promoter Analysis | Promoter Analysis]]===
Line 143: Line 178:
  
 
===[[SAM|SAM]]===
 
===[[SAM|SAM]]===
 +
Interface to run the R implementation of Significance Analysis of Microarrays.
  
Significance Analysis of Microarrays
+
===[[Sequence_Retriever | Sequence Retriever]]===
 +
Genomic and protein sequences for selected genes can be retrieved for further analysis.
  
 +
===[[SkyBase]]===
 +
Search the SkyBase database with a sequence of interest to find homology models which meet user-defined alignment coverage and sequence identity constraints.
 +
SkyBase is a database that stores the homology models built by SkyLine analysis for
 +
* structures in the RCSB Protein Data Bank (PDB) with a 60% redundancy cutoff
 +
* (PDB60) structures in the Northeast Structural Genomics Consortium database
  
===[[Sequence_Retriever | Sequence Retriever]]===
+
===[[SkyLine]]===
Genomic and protein sequences for selected genes can be retrieved for further analysis.
+
SlyLine is a pipeline for large-scale protein homology modeling.  [[SkyBase]] provides access to precomputed models generated using SkyLine.
  
 
===[[SOM | SOM]]===
 
===[[SOM | SOM]]===
Line 156: Line 198:
 
Classification using Support Vector Machines.
 
Classification using Support Vector Machines.
  
==Coming Soon==
+
===[[T-test | T-Test]]===
Tutorials for a number of components are under development, including:
+
Several variants of the Student's t-Test for Differential expression are available.
 
 
* SkyLine
 
 
 
 
 
  
Gene Pattern components:
+
===[[Viper_Analysis]]===
 +
The VIPER (Virtual Inference of Protein-activity by Enriched Regulon analysis) [Alvarez et al., manuscript in preparation] component in geWorkbench transforms the expression profile for each sample (column) into a transcription-factor activity profile, representing the relative activity of each TF in each sample.
  
* PCA (GenePattern) - Analysis and Viewer
+
===[[Volcano_Plot]]===
 +
The Volcano Plot graphically depicts the results of the t-test for differential expression.  The log2 fold change for each significant marker is plotted against the -log10 of the P-value.

Latest revision as of 11:12, 29 April 2015

Home | Quick Start | Basics | Menu Bar | Preferences | Component Configuration Manager | Workspace | Information Panel | Local Data Files | File Formats | caArray | Array Sets | Marker Sets | Microarray Dataset Viewers | Filtering | Normalization | Tutorial Data | geWorkbench-web Tutorials

Analysis Framework | ANOVA | ARACNe | BLAST | Cellular Networks KnowledgeBase | CeRNA/Hermes Query | Classification (KNN, WV) | Color Mosaic | Consensus Clustering | Cytoscape | Cupid | DeMAND | Expression Value Distribution | Fold-Change | Gene Ontology Term Analysis | Gene Ontology Viewer | GenomeSpace | genSpace | Grid Services | GSEA | Hierarchical Clustering | IDEA | Jmol | K-Means Clustering | LINCS Query | Marker Annotations | MarkUs | Master Regulator Analysis | (MRA-FET Method) | (MRA-MARINa Method) | MatrixREDUCE | MINDy | Pattern Discovery | PCA | Promoter Analysis | Pudge | SAM | Sequence Retriever | SkyBase | SkyLine | SOM | SVM | T-Test | Viper Analysis | Volcano Plot




The tutorials shown on this page provide a quick introduction to the most important features of geWorkbench.

For the web version of geWorkbench, please see GeWorkbench-web Tutorials


Using the basic framework of geWorkbench

The graphical interface, files and data==

Quick Start

A quick jump into the most important topics for learning to use geWorkbench.

Basics

An introduction to the use of geWorkbench.

Menu_Bar

Many geWorkbench commands are available in the upper menu bar, as well as in the Workspace.

Component Configuration Manager

Customize geWorkbench to your needs. geWorkbench comes initially configured with only basic components installed. Use the CCM to load additional available modules.

Workspace

The Workspace is where data is loaded and analysis results are stored.

Information Panel

Describes components use to record details of calculations and datasets.

Local Data Files

Covers loading data from files on your local computer.

File Formats

Details of several different file formats supported by geWorkbench.

caArray

How to download microarray data from caArray. geWorkbench can download "derived" data sets from caArray.

Array Sets

How to create and use sets of arrays for controlling data analysis.

Marker Sets

How to create and use sets of markers for controlling data analysis.

Viewing a Microarray Dataset

Survey of geWorkbench visualiztion tools for microarray data. Includes:

Filtering

geWorkbench provides numerous methods for filtering microarray data.

Normalization

geWorkbench provides numerous methods for normalizing microarray data.

Tutorial Data

Downloadable data used in the tutorials.

Individual analysis and visualization components

Analysis Framework

Most analysis routines are located in the command area located in the lower right quadrant of geWorkbench. This section describes a common framework for saving parameter settings that these components share.

ANOVA

How to set up and run Analysis of Variance.

ARACNE

Formal method for reverse Engineering - microarray datasets can be analyzed for interactions between genes. Now includes new ARACNe2, which implements the much faster Adaptive Partitioning algorithm and accurate parameter estimation.

BLAST

Submits BLAST jobs to the NCBI server and displays and allows further interaction with alignment results.

Cellular Networks KnowledgeBase (CNKB)

The CNKB component queries a database of protein-protein and protein-DNA interactions maintained at Columbia University.

CeRNA_Query

This component provides query access to a precomputed database of competitive endogenous RNA (ceRNA) interactions, also called "sponge" interactions. These interactions underlie a post-transcriptional layer of regulation, and were predicted using the Hermes algorithm (Sumazin et al., 2011).

Classification

Several classification components have been ported by the GenePattern development team to work with geWorkbench. These include K-nearest neighbors (KNN), Principle Component Analysis (PCA), Support Vector Machines (SVM) and Weighted Voting (WV).

Color Mosaic

Displays expression results as a heat map.

Consensus Clustering

This component allows geWorkbench to run Consensus Clustering on a GenePattern server.

Cytoscape

Cytoscape is used to display network interaction diagrams (from adjacency matrices). It features two-way interaction with the geWorkbench Markers component.

Cupid

Cupid (Sumazin et al. 2011) generates information that can help predict if a gene is a target of a specific miRNA. The Cupid service provides a simple query interface to a database of precalculated Cupid results.

DeMAND

The DeMAND (Drug Mode of Action through Network Dysreguation) algorithm measures dysregulation between the expression of two genes in a network caused by e.g. a drug perturbation. The list of top dysregulated gene pairs can reveal details of a drug's mode of action in the tested cellular system or tissue.


Expression Value Distribution

View and manipulate a histogram of the distribution of expression values for each array.

Fold Change

Compare the ratio of the expression of genes between two sets of arrays, e.g. case and control sets.

Gene Ontology Term Analysis

Finds Gene Ontology terms that are over-represented in a list of genes of interest.

Gene Ontology Viewer

The Gene Ontology Viewer provides both a standalone GO Term browser, as well as displaying results of GO Term Analysis. Genes associated with a term can be copied back into a marker set for further analysis.

GenomeSpace

GenomeSpace allows for the transfer of data between a number of different genomics and bioinformatics software analysis platforms, including geWorkbench.

genSpace

GenSpace is a social networking tool which allows patterns of use (putative workflows) of geWorkbench components to be inferred and queried. If desired, (participation is entirely optional) it can be used to identify potential expert users of particular components who may be able provide advice.

Grid Services

A number of geWorkbench data analysis components have been implemented as services on the National Cancer Institute's caGrid. caGrid is an infrastructure component of the NCI's caBIG(R) program.

GSEA

Implements a front-end for submitting data to and viewing the results of a GSEA (Subramanian et al, 2005) analysis on a GenePattern server.

Hierarchical Clustering

geWorkbench implements its own agglomerative hierarchical clustering algorithm.

IDEA

The IDEA (interactome dysregulation enrichment analysis) algorithm uses a genome-wide molecular interaction map as a systematic framework for the identification of genes playing a role in oncogenesis.

Jmol

Jmol is a molecular structure viewer for viewing PDB format files.

K-Means_Clustering

Provides an interface to running K-Means Clustering on a GenePattern server, and a viewer for the results.

LINCS_Query

This component provides for query and display of data generated by the Columbia LINCS Technology U01 and Computation U01 Centers. It provides experimental and computational results for drug mode of action and similarity calculations, and for synergy experiments.

Marker Annotations

Marker annotations can be retrieved, including BioCarta pathway diagrams.

MarkUs

The MarkUs component assists in the assessment of the biochemical function for a given protein structure. The component in geWorkbench provides an interface to the MarkUs web server at Columbia. MarkUs identifies related protein structures and sequences, detects protein cavities, and calculates the surface electrostatic potentials and amino acid conservation profile.

Master Regulator Analysis

Master Regulator analysis [Lefebvre et al., 2010] is an algorithm used to identify transcription factors whose targets (e.g., as represented in an ARACNe-generated interactome) are enriched for a particular gene signature (e.g. a list of differentially expressed genes).

MRA-FET

Master Regulator Analysis using Fisher's Exact Test.

MARINa

Master Regulator Analysis using the MARINa algoarithm. GSEA is used to compute enrichment.

MatrixREDUCE

MatrixREDUCE is a tool for inferring the binding specificity and nuclear concentration of transcription factors from microarray data.

MINDy

MINDy identifies modulators of gene regulation using conditional ARACNe calculations.

Pattern Discovery

Upstream seqeunce can be analyzed for conserved sequence patterns.

Principle Component Analysis (PCA)

Find components of the data responsible for the greatest variance. Provides a front-end to analysis on a GenePattern server, and graphical visualization of the results.

Promoter Analysis

Search a set of sequences against a promoter database.

Pudge

Pudge provides an interface to a protein structure prediction server (Honig lab) which integrates tools used at different stages of the structural prediction process.

SAM

Interface to run the R implementation of Significance Analysis of Microarrays.

Sequence Retriever

Genomic and protein sequences for selected genes can be retrieved for further analysis.

SkyBase

Search the SkyBase database with a sequence of interest to find homology models which meet user-defined alignment coverage and sequence identity constraints. SkyBase is a database that stores the homology models built by SkyLine analysis for

  • structures in the RCSB Protein Data Bank (PDB) with a 60% redundancy cutoff
  • (PDB60) structures in the Northeast Structural Genomics Consortium database

SkyLine

SlyLine is a pipeline for large-scale protein homology modeling. SkyBase provides access to precomputed models generated using SkyLine.

SOM

Clustering using Self-Organizing Maps.

SVM

Classification using Support Vector Machines.

T-Test

Several variants of the Student's t-Test for Differential expression are available.

Viper_Analysis

The VIPER (Virtual Inference of Protein-activity by Enriched Regulon analysis) [Alvarez et al., manuscript in preparation] component in geWorkbench transforms the expression profile for each sample (column) into a transcription-factor activity profile, representing the relative activity of each TF in each sample.

Volcano_Plot

The Volcano Plot graphically depicts the results of the t-test for differential expression. The log2 fold change for each significant marker is plotted against the -log10 of the P-value.