tag:blogger.com,1999:blog-80610674975935840602024-03-14T09:01:07.765+11:00SLiMSuite & SeqSuite sequence analysis toolsOpen source bioinformatics for Short Linear Motif (SLiM), molecular evolution and genomics sequence analysis.Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.comBlogger82125tag:blogger.com,1999:blog-8061067497593584060.post-11905875916092388582022-01-12T16:21:00.009+11:002022-01-12T16:21:52.325+11:00SLiMSuite release v1.11.0 (2022-01-12)<p><a href="https://doi.org/10.5281/zenodo.5839162"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.5839162.svg" alt="DOI"></a></p>
<p>SLiMSuite v1.11 sees the introduction of six genome assembly tools:</p>
<ul>
<li><strong>DepthCharge</strong> = Genome assembly quality control and misassembly repair. DepthCharge is an assembly quality control and misassembly repair program. It uses mapped long read depth of coverage to charge through a genome assembly and identify coverage “cliffs” that may indicate a misassembly. If appropriate, it will then blast the assembly into fragment at those misassemblies.</li>
<li><strong>DepthKopy</strong> = DepthKopy: Read-depth based copy number estimation. DepthKopy applies the same single-copy read depth estimate as DepthSizer to estimate the copy number of different gene regions in a slightly modified version of the approach used in the basenji genome paper.</li>
<li><strong>DepthSizer</strong> = DepthSizer: Read-depth based genome size prediction. DepthSizer uses long-read depth profiles and BUSCO single-copy orthologues to predict genome size. DepthSizer works on the principle that Complete BUSCO genes should represent predominantly single copy (diploid read depth) regions along with some poor quality and/or repeat regions. Assembly artefacts and collapsed repeats etc. are predicted to deviate from diploid read depth in an inconsistent manner. Therefore, even if less than half the region is actually diploid coverage, the modal read depth is expected to represent the actual single copy read depth.</li>
<li><strong>GapSpanner</strong> = GapSpanner: Genome assembly gap long read support and reassembly tool. GapSpanner uses (or generates) a BAM file of long reads mapped to a genome assembly to assess assembly “gaps” for spanning read support. Optionally, reads spanning each gap can be extracted and re-assembled with Flye. If the new assembly spans the gap, crude gap-filling can be performed. This will be reversed if edits are not subsequently supported by spanning reads mapped onto the updated assembly.</li>
<li><strong>NUMTFinder</strong> = NUMTFinder: Nuclear mitochondrial fragment (NUMT) search tool. NUMTFinder uses a mitochondrial genome to search against genome assembly and identify putative NUMTs. NUMT fragments are then combined into NUMT blocks based on proximity.</li>
<li><strong>Taxolotl</strong> = Taxolotl: Genome assembly taxonomy summary and assessment tool. Taxolotl combines the MMseqs2 easy-taxonomy with GFF parsing to perform taxonomic analysis of a genome assembly (and any subsets given by taxsubsets=LIST) using an annotated proteome. Taxonomic assignments are mapped onto genes as well as assembly scaffolds and (if assembly=FILE is given) contigs.</li>
</ul>
<p>Documentation for these tools can be found in their individual repos. Please note that individual repos may be ahead of the main SLiMSuite repo.</p>
<p>More information can also be found in the corresponding publications:</p>
<ul>
<li><b>Chen SH, Rossetto M, van der Merwe M, Lu-Irving P, Yap JS, Sauquet H, Bourke G, Amos TG, Bragg JG & <U>Edwards RJ</U> (accepted):</b> <a href="http://edwardslab.blogspot.com/2021/06/chromosome-level-de-novo-genome.html" target="_blank">Chromosome-level de novo genome assembly of Telopea speciosissima (New South Wales waratah) using long-reads, linked-reads and Hi-C</a>. <i>Molecular Ecology Resources</i>.
[<a href="https://onlinelibrary.wiley.com/doi/abs/10.1111/1755-0998.13574">Mol Ecol Res</a>]
[<a href="https://doi.org/10.1101/2021.06.02.444084">bioRxiv</a>]
</p>
<li><b><u>Edwards RJ</u>, Field MA, Ferguson JM, Dudchenko O, Keilwagen K, Rosen BD, Johnson GS, Rice ES, Hillier L, Hammond JM, Towarnicki SG, Omer A, Khan R, Skvortsova K, Bogdanovic O, Zammit RA, Aiden EL, Warren WC & Ballard JWO (2021):</b> <a href="https://edwardslab.blogspot.com/2021/03/chromosome-length-genome-assembly-and.html">Chromosome-length genome assembly and structural variations of the primal Basenji dog (Canis lupus familiaris) genome.</a> <i>BMC Genomics</i> <b>22:</b>188
[<a href="https://bmcgenomics.biomedcentral.com/articles/10.1186/s12864-021-07493-6">BMC Genomics</a>]
[<a href="https://www.ncbi.nlm.nih.gov/pubmed/33726677">PubMed</a>]
[<a href="https://www.biorxiv.org/content/10.1101/2020.11.11.379073v2">bioRxiv</a>]
</p>
<li><b>Stuart KC*, <U>Edwards RJ</U>*, Cheng Y, Warren WC, Burt DW, Sherwin WB, Hofmeister NR, Werner SJ, Ball GF, Bateson M, Brandley MC, Buchanan KL, Cassey P, Clayton DF, De Meyer T, Meddle SL & Rollins LA (preprint):</b> <a href="http://edwardslab.blogspot.com/2021/04/transcript-and-annotation-guided-genome.html">Transcript- and annotation-guided genome assembly of the European starling</a>. <i>bioRxiv</i> 2021.04.07.438753; doi: <a href="https://doi.org/10.1101/2021.04.07.438753">10.1101/2021.04.07.438753</a>. [*Joint first authors]
[<a href="https://www.biorxiv.org/content/10.1101/2021.04.07.438753v1">bioRxiv</a>]
</p>
</ul>
<p>See also the included release_notes.txt on GitHub for a full list of the python module updates since v1.9.0.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-79904101378556174432021-10-11T17:37:00.004+11:002021-10-11T17:37:32.542+11:00BUSCOMP v0.13.0 (MetaEuk) release<p><a href="https://github.com/slimsuite/buscomp">BUSCOMP v0.13.0</a> is now on GitHub. This release features updates to parse additional BUSCO v5 outputs, including transcriptome and proteome mode. It has also been updated to be compatible with MetaEuk runs by generating the missing <code>*.fna</code> files where possible.</p>
<p>The citation remains:</p>
<blockquote>
<p>Stuart KC<em>, Edwards RJ</em>, Cheng Y, Warren WC, Burt DW, Sherwin WB, Hofmeister NR, Werner SJ, Ball GF, Bateson M, Brandley MC, Buchanan KL, Cassey P, Clayton DF, De Meyer T, Meddle SL, Rollins LA (preprint): Transcript- and annotation-guided genome assembly of the European starling. <a href="https://www.biorxiv.org/content/10.1101/2021.04.07.438753v1">bioRxiv 2021.04.07.438753</a>; doi: 10.1101/2021.04.07.438753. [*Joint first authors]</p>
</blockquote>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-51788458079301123802021-10-11T16:55:00.005+11:002021-10-11T16:55:37.289+11:00DepthSizer v1.4.0 (IndelRatio) release<p><a href="https://github.com/slimsuite/depthsizer">DepthSizer v1.4.0</a> has been released on GitHub. DepthSizer is a program to estimate genome size from an assembly, long-read sequencing data, and BUSCO single-copy orthologue predictions.</p>
<p>DepthSizer works on the principle that Complete BUSCO genes should represent predominantly single copy (diploid read depth) regions along with some poor quality and/or repeat regions. Assembly artefacts and collapsed repeats etc. are predicted to deviate from diploid read depth in an inconsistent manner. Therefore, even if less than half the region is actually diploid coverage, the modal read depth is expected to represent the actual single copy read depth.</p>
<p>This release features an extensive reworking under the hood, which moves the main calculation into R and smooths the read depth modal density calculation. Some of the older, less accurate, approaches have been dropped in favour of some additional mapping adjustments that aim to frame the upper and lower bounds of genome size.</p>
<p>Current citation:</p>
<blockquote>
<p>Chen SH, Rossetto M, van der Merwe M, Lu-Irving P, Yap JS, Sauquet H, Bourke G, Bragg JG & Edwards RJ (preprint): Chromosome-level de novo genome assembly of Telopea speciosissima (New South Wales waratah) using long-reads, linked-reads and Hi-C. <a href="https://www.biorxiv.org/content/10.1101/2021.06.02.444084v1.full">bioRxiv 2021.06.02.444084</a>; doi: 10.1101/2021.06.02.444084.</p>
</blockquote>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-22235396611619479022020-12-27T20:00:00.001+11:002020-12-28T08:37:17.282+11:00SLiMSuite release v1.9.1 (2020-12-27)<p><a href="https://zenodo.org/badge/latestdoi/36636777"><img id="doi" src="https://zenodo.org/badge/36636777.svg" alt="DOI" title="" /></a></p>
<p>SLiMSuite release <code>v1.9.1</code> (2020-12-27) is now on <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.9.1">GitHub</a> and <a href="https://zenodo.org/record/4394731">Zenodo</a>:</p>
<ul>
<li><strong>Edwards RJ (2020):</strong> SLiMSuite v1.9.1 (2020-12-27). Zenodo DOI: <a href="https://zenodo.org/record/4394731">10.5281/zenodo.3229523</a></li>
</ul>
<p>SLiMSuite v1.9 sees the introduction of four genome assembly tools:</p>
<ul>
<li><strong>Diploidocus</strong> = Diploid genome assembly analysis toolkit. Includes assembly cleanup (haplotig/artefact removal), genome size prediction and read depth copy number analysis.</li>
<li><strong>PAFScaff</strong> = Pairwise mApping Format reference-based scaffold anchoring and super-scaffolding. Uses minimap2 to map a genome assembly onto reference chromosomes.</li>
<li><strong>SAAGA</strong> = Summarise, Annotate & Assess Genome Annotations. Uses a reference proteome to summarise and assess genome annotations.</li>
<li><strong>SynBad</strong> = Synteny-based scaffolding adjustment tool for comparing two related genome assemblies and identify putative translocations and inversions between the two that correspond to gap positions. (Development only.)</li>
</ul>
<p>There have also been significant updates to:</p>
<ul>
<li><strong>BUSCOMP</strong> = BUSCO Compiler and Comparison tool. Used for genome assembly completeness estimates that are robust to sequence quality, and for compiling BUSCO results.</li>
</ul>
<p>Other changes include some initial reformatting for Python3 compatibility. This is ongoing work; please report any odd behaviour.</p>
<p>See the included <a href="https://github.com/slimsuite/SLiMSuite/blob/master/release_notes.txt">release_notes.txt</a> for a full list of the python module updates since v1.8.1.</p>
<p><strong>NOTE:</strong> At time of posting, the REST servers have not yet been updated with the latest version. This will happen soon.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-50659150479104843252019-05-27T23:17:00.000+10:002019-05-27T23:17:40.817+10:00SLiMSuite release v1.8.1 (2019-05-27)<p>SLiMSuite release <code>v1.8.1</code> (2019-05-27) is now <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.8.1">on GitHub</a> and <a href="https://zenodo.org/record/3229523">Zenodo</a>:</p>
<ul>
<li><strong>Edwards RJ (2019):</strong> SLiMSuite v1.8.1 (2019-05-27). <em>Zenodo</em> DOI: <a href="https://zenodo.org/record/3229523">10.5281/zenodo.3229523</a></li>
</ul>
<p>This update has fast-forwarded the SLiMSuite release to <code>v1.8.1</code> to be consistent with the <code>tools/slimsuite.py</code> wrapper script. A top level <code>SLiMSuite.py</code> file can now be run to access the main tools and functions of the package. The <a href="http://rest.slimsuite.unsw.edu.au/">REST servers</a> have also been updated to run this version of the code.</p>
<p>This release of SLiMSuite contains a number of updates related to the <a href="http://rest.slimsuite.unsw.edu.au/">REST servers</a> and some new tools, notably <a href="https://github.com/slimsuite/SAMPhaser">SAMPhaser</a> long read diploid phasing algorithm, and <a href="https://github.com/slimsuite/buscomp">BUSCOMP</a> BUSCO compiler and comparison tool. See release notes (below) for more details.</p>
<h1>SLiMSuite updates</h1>
<h2>Updates in extras/:</h2>
</p>
<p><b>• rje_pydocs:</b> <i>Updated from Version 2.16.7.</i>
<br>→ Version 2.16.8: Updated to to parse https.
<br>→ Version 2.16.9: Tweaked docstring parsing.
</p>
<h2>Updates in libraries/:</h2>
<p><b>• rje:</b> <i>Updated from Version 4.19.0.</i>
<br>→ Version 4.19.1: Added code for catching non-ASCII log filenames.
<br>→ Version 4.20.0: Added quiet mode to log object and output of errors to stderr. Fixed rankList(unique=True)
<br>→ Version 4.21.0: Added hashlib MD% functions.
<br>→ Version 4.21.1: Fixed bug where silent=T wasn't running silent.
</p>
<p><b>• rje_blast_V2:</b> <i>Updated from Version 2.22.2.</i>
<br>→ Version 2.23.3: Fixed LocalIDCut error for GABLAM and QAssemble stat filtering.
</p>
<p><b>• rje_db:</b> <i>Updated from Version 1.9.0.</i>
<br>→ Version 1.9.1: Updated logging of adding/removing fields: default is now when debugging only.
</p>
<p><b>• rje_disorder:</b> <i>Updated from Version 1.2.0.</i>
<br>→ Version 1.3.0: Switched default behaviour to be md5acc=T.
<br>→ Version 1.4.0: Fixed up disorder=parse and disorder=foldindex.
<br>→ Version 1.5.0: Added iupred2 and anchor2 parsing from URL using accnum. Made default disorder=iushort2.
</p>
<p><b>• rje_genbank:</b> <i>Updated from Version 1.5.3.</i>
<br>→ Version 1.5.4: Added recognition of *.gbff for genbank files.
</p>
<p><b>• rje_obj:</b> <i>Updated from Version 2.2.2.</i>
<br>→ Version 2.3.0: Added quiet mode to object and stderr output.
<br>→ Version 2.4.0: Added vLog() and bugLog() methods.
<br>→ Version 2.4.1: Fixed bug where silent=T wasn't running silent.
</p>
<p><b>• rje_paf:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.1.0: Initial working version. Compatible with GABLAM v2.30.0 and Snapper v1.7.0.
<br>→ Version 0.2.0: Added endextend=X : Extend minimap2 hits to end of sequence if with X bp [10]
<br>→ Version 0.3.0: Added mapsplice mode for dealing with transcript mapping.
<br>→ Version 0.3.1: Correct PAF splicing bug.
<br>→ Version 0.4.0: Added TmpDir and forking for GABLAM conversion.
<br>→ Version 0.5.0: Added uniquehit=T/F : Option to use *.hitunique.tdt table of unique coverage for GABLAM coverage stats [False]
</p>
<p><b>• rje_ppi:</b> <i>Updated from Version 2.8.1.</i>
<br>→ Version 2.9.0: Added ppiout=FILE : Save pairwise PPI file following processing (if rest=None) [None]
</p>
<p><b>• rje_qsub:</b> <i>Updated from Version 1.9.2.</i>
<br>→ Version 1.9.3: Updates the order of the qsub -S /bin/bash flag.
</p>
<p><b>• rje_rmd:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
</p>
<p><b>• rje_samtools:</b> <i>Updated from Version 1.20.0.</i>
<br>→ Version 1.20.1: Fixed mlen bug. Added catching of unmapped reads in SAM file. Fixed RLen bug. Changed softclip defaults.
<br>→ Version 1.20.2: Fixed readlen coverage bug and acut bug.
</p>
<p><b>• rje_seq:</b> <i>Updated from Version 3.25.0.</i>
<br>→ Version 3.25.1: Fixed -long_seqids retrieval bug.
<br>→ Version 3.25.2: Fixed 9spec filtering bug.
</p>
<p><b>• rje_seqlist:</b> <i>Updated from Version 1.29.0.</i>
<br>→ Version 1.30.0: Updated and improved DNA2Protein.
<br>→ Version 1.31.0: Added genecounter to rename option for use with other programs, e.g. PAGSAT.
<br>→ Version 1.31.1: Fixed edit bug when not in DNA mode.
<br>→ Version 1.32.0: Added genomesize and NG50/LG50 to DNA summarise.
<br>→ Version 1.32.1: Fixed LG50/L50 bug.
</p>
<p><b>• rje_sequence:</b> <i>Updated from Version 2.6.0.</i>
<br>→ Version 2.7.0: Added shift=X to maskRegion() for 1-L input. Fixed cterminal maskRegion.
</p>
<p><b>• rje_slimcore:</b> <i>Updated from Version 2.9.0.</i>
<br>→ Version 2.10.0: Added seqfilter=T/F : Whether to apply sequence filtering options (goodX, badX etc.) to input [False]
<br>→ Version 2.10.1: Fixed default results file bug.
<br>→ Version 2.10.2: Improved handling and REST output of disorder scores.
<br>→ Version 2.11.0: Modified qregion=X,Y to be 1-L numbering.
</p>
<p><b>• rje_slimlist:</b> <i>Updated from Version 1.7.3.</i>
<br>→ Version 1.7.4: Modified concetanation of SLiMSuite results to use "|" in place of "#" for better compatibility.
</p>
<p><b>• rje_uniprot:</b> <i>Updated from Version 3.25.0.</i>
<br>→ Version 3.25.1: Fixed proteome download bug following Uniprot changes.
<br>→ Version 3.25.2: Fixed Uniprot protein extraction issues by using curl. (May not be a robust fix!)
</p>
<h2>Updates in tools/:</h2>
</p>
<p><b>• buscomp:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.1.0: Basic working version.
<br>→ Version 0.2.0: Functional version with basic RMarkdown HTML output.
<br>→ Version 0.3.0: Added ratefas=FILELIST: Additional fasta files of assemblies to rate with BUSCOMPSeq (No BUSCO run) [].
<br>→ Version 0.4.0: Implemented forking and tidied up output a little.
<br>→ Version 0.5.0: Updated genome stats and RMarkdown HTML output. Reorganised assembly loading and proeccessing. Added menus.
<br>→ Version 0.5.1: Reorganised code for clearer flow and documentation. Unique and missing BUSCO output added.
<br>→ Version 0.5.2: Dropped paircomp method and added Rmarkdown control methods. Updated Rmarkdown descriptions. Updated log output.
<br>→ Version 0.5.3: Tweaked log output and fixed a few minor bugs.
<br>→ Version 0.5.4: Deleted some excess code and tweaked BUSCO percentage plot outputs.
<br>→ Version 0.5.5: Fixed minlocid bug and cleared up minimap temp directories. Added LnnIDxx to BUSCOMP outputs.
<br>→ Version 0.5.6: Added uniquehit=T/F : Option to use *.hitunique.tdt table of unique coverage for GABLAM coverage stats [False]
<br>→ Version 0.6.0: Added more minimap options, changed defaults and dev generation of a table changes in ratings from BUSCO to BUSCOMP.
<br>→ Version 0.6.1: Fixed bug that was including Duplicated sequences in the buscomp.fasta file. Added option to exclude from BUSCOMPSeq compilation.
<br>→ Version 0.6.2: Fixed bug introduced that had broken manual group review/editing.
<br>→ Version 0.7.0: Updated the defaults in the light of test analyses. Tweaked Rmd report.
<br>→ Version 0.7.1: Fixed unique group count bug when some genomes are not in a group. Fixed running with non-standard options.
<br>→ Version 0.7.2: Added loadsummary=T/F option to regenerate summaries and fixed bugs running without BUSCO results.
</p>
<p><b>• comparimotif_V3:</b> <i>Updated from Version 3.13.0.</i>
<br>→ Version 3.14.0: Modified memsaver mode to take different input formats.
</p>
<p><b>• gablam:</b> <i>Updated from Version 2.29.0.</i>
<br>→ Version 2.30.0: Added mapper=X : Program to use for mapping files against each other (blast/minimap) [blast]
<br>→ Version 2.30.1: Fixed BLAST LocalIDCut error for GABLAM and QAssemble stat filtering.
</p>
<p><b>• gopher:</b> <i>Updated from Version 3.4.3.</i>
<br>→ Version 3.5.0: Added separate outputs for trees with different alignment programs.
<br>→ Version 3.5.1: Added capacity to run DNA GOPHER with tblastx. (Not tested!)
<br>→ Version 3.5.2: Added acc=LIST as alias for uniprotid=LIST and updated docstring for REST to make it clear that rest=X needed.
</p>
<p><b>• haqesac:</b> <i>Updated from Version 1.12.0.</i>
<br>→ Version 1.13.0: Modified qregion=X,Y to be 1-L numbering.
</p>
<p><b>• pagsat:</b> <i>Updated from Version 2.4.0.</i>
<br>→ Version 2.5.0: Reduced the executed code when mapfas=T assessment=F. (Recommended first run.) Added renaming.
<br>→ Version 2.5.1: Added recognition of *.gbff for genbank files.
<br>→ Version 2.6.0: Added mapper=X : Program to use for mapping files against each other (blast/minimap) [blast]
<br>→ Version 2.6.1: Switch failure to find key report files to a long warning, not program exit.
<br>→ Version 2.6.2: Fixed bugs with mapper=minimap mode and started adding more internal documentation.
<br>→ Version 2.6.3: Fixed default behaviour to run report=T mode.
<br>→ Version 2.6.4: Fixed summary table merge bug.
<br>→ Version 2.6.5: Fixed compile path bug.
<br>→ Version 2.6.6: Fixed BLAST LocalIDCut error for GABLAM and QAssemble stat filtering.
<br>→ Version 2.6.7: Generalised compile path bug fix.
<br>→ Version 2.6.8: Added ChromXcov fields to PAGSAT Compare.
</p>
<p><b>• pingu_V4:</b> <i>Updated from Version 4.9.0.</i>
<br>→ Version 4.9.1: Fixed Pairwise parsing and filtering for more flexibility of input. Fixed fasid=X bug and ppiseqfile names.
<br>→ Version 4.10.0: Added hubfield and spokefield options for parsing hublist.
</p>
<p><b>• qslimfinder:</b> <i>Updated from Version 2.2.0.</i>
<br>→ Version 2.3.0: Modified qregion=X,Y to be 1-L numbering.
</p>
<p><b>• samphaser:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.1.0: Updated SAMPhaser to be more memory efficient.
<br>→ Version 0.2.0: Added reading of sequence and generation of SNP-altered haplotype blocks.
<br>→ Version 0.2.1: Fixed bug in which zero-phasing sequences were being excluded from blocks output.
<br>→ Version 0.3.0: Made a new unzip process.
<br>→ Version 0.4.0: Added RGraphics for unzip.
<br>→ Version 0.4.1: Fixed MeanX bug in devUnzip.
<br>→ Version 0.4.2: Made phaseindels=F by default: mononucleotide indel errors will probably add phasing noise. Fixed basefile R bug.
<br>→ Version 0.4.3: Fixed bug introduced by adding depthplot code. Fixed phaseindels bug. (Wasn't working!)
<br>→ Version 0.4.4: Modified mincut=X to adjust for samtools V1.12.0.
<br>→ Version 0.4.5: Updated for modified RJE_SAMTools output.
<br>→ Version 0.4.6: splitzero=X : Whether to split haplotigs at zero-coverage regions of X+ bp (-1 = no split) [100]
<br>→ Version 0.5.0: snptable=T/F : Output filtered alleles to SNP Table [False]
<br>→ Version 0.6.0: Converted haplotig naming to be consistent for PAGSAT generation. Updated for rje_samtools v1.21.1.
<br>→ Version 0.7.0: Added skiploci=LIST and phaseloci=LIST : Optional list of loci to skip phasing []
<br>→ Version 0.8.0: poordepth=T/F : Whether to include reads with poor track probability in haplotig depth plots (random track) [False]
</p>
<p><b>• seqmapper:</b> <i>Updated from Version 2.2.0.</i>
<br>→ Version 2.3.0: Added GABLAM-free method.
</p>
<p><b>• seqsuite:</b> <i>Updated from Version 1.19.1.</i>
<br>→ Version 1.20.0: Added rje_paf.PAF.
<br>→ Version 1.21.0: Added NG50 and LG50 to batch summarise.
<br>→ Version 1.22.0: Added BUSCOMP to programs.
<br>→ Version 1.23.0: Added rje_ppi.PPI to programs.
</p>
<p><b>• slimbench:</b> <i>Updated from Version 2.18.2.</i>
<br>→ Version 2.18.3: Added better handling of motifs without TP occurrences for OccBench. Added minocctp=INT.
<br>→ Version 2.18.4: Fixed ELMBench rating bug.
<br>→ Version 2.18.5: Fixed Balanced=F bug.
<br>→ Version 2.19.0: Implemented dataset=LIST: List of headers to split dataset into. If blank, will use datatype defaults. []
</p>
<p><b>• slimfarmer:</b> <i>Updated from Version 1.9.0.</i>
<br>→ Version 1.10.0: Added appending contents of jobini file to slimsuite=F farm commands.
</p>
<p><b>• slimfinder:</b> <i>Updated from Version 5.3.4.</i>
<br>→ Version 5.3.5: Fixed slimcheck and advanced stats models bug.
<br>→ Version 5.4.0: Modified qregion=X,Y to be 1-L numbering.
</p>
<p><b>• slimparser:</b> <i>Updated from Version 0.5.0.</i>
<br>→ Version 0.5.1: Minor docs and bug fixes.
<br>→ Version 0.6.0: Improved functionality as replacement pureapi with rest=jobid and rest=check functions.
</p>
<p><b>• slimsuite:</b> <i>Updated from Version 1.7.1.</i>
<br>→ Version 1.8.0: Added BUSCOMP and basic test function.
<br>→ Version 1.8.1: Updated documentation and added IUPred2. General tidy up and new example data for protocols paper.
</p>
<p><b>• smrtscape:</b> <i>Updated from Version 2.2.2.</i>
<br>→ Version 2.2.3: Fixed bug where SMRT subreads are not returned by seqlist in correct order. Fixed RQ=0 bug.
</p>
<p><b>• snapper:</b> <i>Updated from Version 1.6.1.</i>
<br>→ Version 1.7.0: Added mapper=minimap setting, compatible with GABLAM v2.30.0 and rje_paf v0.1.0.
</p>
<!-- ~~~~~~~~~~~~~~ HTML tail data ~~~~~~~~~~~~~~~~~ -->
<HR><FONT COLOR=#979E45 SIZE=2>© RJ Edwards 2019. Last modified 27 May 2019.</FONT></P>
Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-64460727297086117552018-07-02T15:55:00.000+10:002019-05-27T23:26:23.403+10:00SLiMSuite Downloads<p><strong>UPDATE:</strong> Please see the <a href="https://slimsuite.blogspot.com/p/downloads.html">Downloads</a> page for the most recent release.</p>
<hr>
<a href="https://github.com/slimsuite/SLiMSuite/releases/download/v1.4.0/slimsuite.2018-07-02.tgz" ><img border="0" src="https://2.bp.blogspot.com/-ESRr4JnoYao/VWQ4hfnPhSI/AAAAAAAAVqQ/ydf8R1QwFSo/s150/button-download.png" align="left" style="margin-right:10px"></a>
<a href="https://github.com/slimsuite/SLiMSuite" ><img border="0" src="https://3.bp.blogspot.com/-2rirZPz4Tdc/VWv8RDJvm4I/AAAAAAAAVsc/TSZhCv2du-s/s150/button-github-logo.jpg" align="right" style="margin-left:10px"></a>
<hr style="height:0pt; visibility:hidden;" />
<p>The current SLiMSuite release is <code><a href="http://slimsuite.blogspot.com/2018/07/slimsuite-release-v140-2018-06-02-now.html">v1.4.0 (2018-07-02)</a></code> and can be downloaded by clicking the button (left).</p>
<p>In addition to the <a href="https://github.com/slimsuite/SLiMSuite/releases/download/v1.4.0/slimsuite.2018-07-02.tgz">tarball</a> available via the links above, SLiMSuite is available as a <a href="https://github.com/slimsuite/SLiMSuite">GitHub repository</a> (right).</p>
<a href="https://zenodo.org/badge/latestdoi/36636777"><img src="https://zenodo.org/badge/36636777.svg" alt="DOI"></a>
<p><strong>See also:</strong> <a href="http://slimsuite.blogspot.com.au/2013/08/availability-installation-and-setup.html">Installation and Setup</a>.</p>
<!-- hr -->
<h2 id="previousreleases">Previous Releases</h2>
<ul>
<!-- li>v1.4.0 (<code><a href="http://slimsuite.blogspot.com/2018/07/slimsuite-release-v140-2018-06-02-now.html">2018-07-02</a>)</code></li -->
<li><code>v1.3.0 (<a href="http://slimsuite.blogspot.com.au/2017/12/slimsuite-release-v130-2017-12-19-online.html">2017-12-18</a>)</code></li>
<li><code>v1.2.0 (<a href="http://slimsuite.blogspot.com.au/2016/09/slimsuite-release-v120-2016-09-12-online.html">2016-09-12</a>)</code></li>
<li><code>v1.1.0 (<a href="http://slimsuite.blogspot.com.au/2015/12/slimsuite-release-v110-2015-11-30-online.html">2015-11-30</a>)</code></li>
<li><code><a href="http://slimsuite.blogspot.com.au/2015/06/slimsuite-release-2015-06-01-now.html">2015-06-01</a></code></li>
<li><code>v1.0.0 (<a href="http://slimsuite.blogspot.com.au/2015/01/slimsuite-release-2015-01-07-now.html">2015-01-07</a>)</code></li>
</ul>
Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-38010339048692722202018-07-02T15:49:00.001+10:002018-07-02T15:49:56.153+10:00SLiMSuite release v1.4.0 (2018-06-02) now oline<p>SLiMSuite release <code>v1.4.0</code> (2018-07-02) is now <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.4.0">on GitHub</a>. The <a href="http://rest.slimsuite.unsw.edu.au/">REST servers</a> have also been updated to run this version of the code.</p>
<p>This release of SLiMSuite contains a number of updates related to the <a href="http://rest.slimsuite.unsw.edu.au/">REST servers</a> and some new pre-release dev tools in the main repo (but not the <code>*.tgz</code> file). </p>
<p><strong>SeqList</strong> has updated sequence summary statistics and grep-based redundancy removal for large genomes.</p>
<p>One major bug fix is a change to parsing Uniprot entries from the website following a change in behaviour of the API.</p>
<h1>SLiMSuite updates</h1>
<h2>Updates in extras/:</h2>
</p>
<p><b>• rje_pydocs:</b> <i>Updated from Version 2.16.3.</i>
<br>→ Version 2.16.4: Tweaked formatDocString.
<br>→ Version 2.16.5: Added general commands to docstring HTML for REST servers.
<br>→ Version 2.16.6: Modified parsing to keep DocString for SPyDarm runs.
<br>→ Version 2.16.7: Fixed T/F/FILE option type parsing bug.
</p>
</p>
<h2>Updates in libraries/:</h2>
</p>
<p><b>• rje_blast_V2:</b> <i>Updated from Version 2.18.0.</i>
<br>→ Version 2.19.0: Added blastgz=T/F : Whether to zip and unzip BLAST results files [False]
<br>→ Version 2.19.1: Fixed erroneous i=-1 blastprog over-ride but not sure why it was happening.
<br>→ Version 2.20.0: Added localGFF output
<br>→ Version 2.21.0: Added blasttask=X setting for BLAST -task ['megablast']
<br>→ Version 2.22.0: Added dust filter for blastn and setting blastprog based on blasttask
<br>→ Version 2.22.1: Added trimLocal error catching for exonerate issues.
<br>→ Version 2.22.2: Fixed GFF attribute case issue.
</p>
<p><b>• rje_db:</b> <i>Updated from Version 1.8.6.</i>
<br>→ Version 1.9.0: Added comment output to saveToFile().
</p>
<p><b>• rje_disorder:</b> <i>Updated from Version 0.8.</i>
<br>→ Version 1.0.0: Added random disorder function and elevated to v1.x as fully functional for SLiMSuite
<br>→ Version 1.1.0: Added strict option for disorder method selection. Added minorder=X.
<br>→ Version 1.2.0: Added saving and loading scores to IUScoreDir/.
</p>
<p><b>• rje_gff:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.1.0: Basic functional version.
</p>
<p><b>• rje_hpc:</b> <i>Updated from Version 1.1.</i>
<br>→ Version 1.1.1: Added output of subjob command to log as run.
</p>
<p><b>• rje_html:</b> <i>Updated from Version 0.2.1.</i>
<br>→ Version 0.3.0: Added optional loading of javascript files and stupidtable.js?dev default.
</p>
<p><b>• rje_qsub:</b> <i>Updated from Version 1.9.1.</i>
<br>→ Version 1.9.2: Modified qsub() to return job ID.
</p>
<p><b>• rje_samtools:</b> <i>Updated from Version 1.19.2.</i>
<br>→ Version 1.20.0: Added parsing of BAM file - needs samtools on system. Added minsoftclip=X, maxsoftclip=X and minreadlen=X.
</p>
<p><b>• rje_seq:</b> <i>Updated from Version 3.24.0.</i>
<br>→ Version 3.25.0: 9spec=T/F : Whether to treat 9XXXX species codes as actual species (generally higher taxa) [False]
</p>
<p><b>• rje_seqlist:</b> <i>Updated from Version 1.25.0.</i>
<br>→ Version 1.26.0: Updated sequence statistics and fixed N50 underestimation bug.
<br>→ Version 1.26.1: Fixed median length overestimation bug.
<br>→ Version 1.26.2: Fixed sizesort bug. (Now big to small as advertised.)
<br>→ Version 1.27.0: Added grepNR() method (dev only). Switched default to RevCompNR=T.
<br>→ Version 1.28.0: Fixed second pass NR naming bug and added option to switch off altogether.
<br>→ Version 1.29.0: Added maker=T/F : Whether to extract MAKER2 statistics (AED, eAED, QI) from sequence names [False]
</p>
<p><b>• rje_slimcalc:</b> <i>Updated from Version 0.9.3.</i>
<br>→ Version 0.10.0: Added extra disorder methods to slimcalc.
</p>
<p><b>• rje_taxonomy:</b> <i>Updated from Version 1.2.0.</i>
<br>→ Version 1.3.0: taxtable=T/F : Whether to output results in a table rather than text lists [False]
</p>
<p><b>• rje_tree:</b> <i>Updated from Version 2.15.0.</i>
<br>→ Version 2.16.0: 9spec=T/F : Whether to treat 9XXXX species codes as actual species (generally higher taxa) [False]
<br>→ Version 2.16.1: Modified NSF reading to cope with extra information beyond the ";".
</p>
<p><b>• rje_uniprot:</b> <i>Updated from Version 3.24.1.</i>
<br>→ Version 3.24.2: Updated HTTP to HTTPS. Having some download issues with server failures.
<br>→ Version 3.25.0: Fixed new Uniprot batch query URL. Added onebyone=T/F : Whether to download one entry at a time. Slower but should maintain order [False].
</p>
<p><b>• rje_zen:</b> <i>Updated from Version 1.3.2.</i>
<br>→ Version 1.4.0: Added some more words and "They fight crime!" structure.
</p>
<h2>Updates in tools/:</h2>
</p>
<p><b>• gablam:</b> <i>Updated from Version 2.28.3.</i>
<br>→ Version 2.29.0: Added localGFF=T/F output
</p>
<p><b>• gasp:</b> <i>Updated from Version 1.4.</i>
<br>→ Version 2.0.0: Upgraded to rje_obj framework for REST server.
</p>
<p><b>• gasp_V1:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 1.0: Improved version with second pass.
<br>→ Version 1.1: Improved OO. Restriction to descendant AAs. (Good for BAD etc.)
<br>→ Version 1.2: No Out Object in Objects
<br>→ Version 1.3: Added more interactive load options
<br>→ Version 1.4: Minor tweaks to imports.
</p>
<p><b>• gopher:</b> <i>Updated from Version 3.4.2.</i>
<br>→ Version 3.4.3: Added checking and warning if no bootstraps for orthtree.
</p>
<p><b>• haqesac:</b> <i>Updated from Version 1.11.0.</i>
<br>→ Version 1.12.0: 9spec=T/F : Whether to treat 9XXXX species codes as actual species (generally higher taxa) [False]
</p>
<p><b>• multihaq:</b> <i>Updated from Version 1.3.0.</i>
<br>→ Version 1.4.0: Added SLiMFarmer batch forking if autoskip=F and i=-1.
<br>→ Version 1.4.1: Added haqblastdir=PATH: Directory in which MultiHAQ BLAST2FAS BLAST runs will be performed [./HAQBLAST/]
</p>
<p><b>• pagsat:</b> <i>Updated from Version 2.3.3.</i>
<br>→ Version 2.3.4: Fixed full.fas request bug.
<br>→ Version 2.4.0: Added PAGSAT compile mode to generate comparisons of reference chromosomes across assemblies.
</p>
<p><b>• seqsuite:</b> <i>Updated from Version 1.14.0.</i>
<br>→ Version 1.14.1: Added zentest for testing the REST servers.
<br>→ Version 1.15.0: Added GASP to REST servers.
<br>→ Version 1.16.0: Add rje_gff.GFF to REST servers.
<br>→ Version 1.17.0: Added batch summarise mode.
<br>→ Version 1.18.0: Added rje_apollo.Apollo to REST servers.
<br>→ Version 1.19.0: Tweaked the output of batch summarise, adding Gap% and reducing dp for some fields.
<br>→ Version 1.19.1: Fixed GapPC summarise output to be a percentage, not a fraction.
</p>
<p><b>• slimbench:</b> <i>Updated from Version 2.14.0.</i>
<br>→ Version 2.14.1: Fixed up PPIBench results loading.
<br>→ Version 2.14.2: Fixed ByCloud bug.
<br>→ Version 2.15.0: Updated assessSearchMemSaver() to handle different data types properly. dombench not yet supported.
<br>→ Version 2.16.0: Added ppi hub/slim summary and motif filter for assessment datasets post-rating (still count as OT)
<br>→ Version 2.16.1: Bug-fixing PPI generation from pairwise PPI files.
<br>→ Version 2.16.2: Fixed benchmarking setup bug.
<br>→ Version 2.16.3: Fixed bug when Hub-PPI links fail during PPI Benchmarking.
<br>→ Version 2.17.0: Added output of missing datasets when balanced=T.
<br>→ Version 2.18.0: Added dev OccBench with improved ratings and more efficient results handling. (dev only)
<br>→ Version 2.18.1: Added additional OccBench options (bymotif, occsource, occspec)
<br>→ Version 2.18.2: Fixed problem with source file selection ignoring i=-1.
</p>
<p><b>• slimfarmer:</b> <i>Updated from Version 1.7.0.</i>
<br>→ Version 1.8.0: jobforks=X : Number of forks to pass to farmed out run if >0 [0]
<br>→ Version 1.9.0: daisychain=X : Chain together a set of qsub runs of the same call that depend on the previous job.
</p>
<p><b>• slimfinder:</b> <i>Updated from Version 5.3.3.</i>
<br>→ Version 5.3.4: Fixed terminal (^/$) musthave bug.
</p>
<p><b>• slimsuite:</b> <i>Updated from Version 1.7.0.</i>
<br>→ Version 1.7.1: Added error raising for protected REST alias data.
</p>
<p><b>• smrtscape:</b> <i>Updated from Version 2.2.1.</i>
<br>→ Version 2.2.2: Added dna=T to all SeqList object generation.
</p>
<p><b>• snapper:</b> <i>Updated from Version 1.6.0.</i>
<br>→ Version 1.6.1: Fixed bug for reducing to unique-unique pairings that was over-filtering.
</p>
<!-- ~~~~~~~~~~~~~~ HTML tail data ~~~~~~~~~~~~~~~~~ -->
<HR><FONT COLOR=#979E45 SIZE=2>© RJ Edwards 2018. Last modified 2 Jul 2018.</FONT></P>
Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-46712395466097411992018-01-16T08:52:00.002+11:002018-01-16T08:52:38.039+11:00SLiMSuite REST server is back upThe REST server is back up. The development server is currently having an upgrade and should not be used.Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-91116590734353083162018-01-16T08:35:00.000+11:002018-01-16T08:35:12.834+11:00SLiMSuite REST server is currently downThe SLiMSuite REST server is experiencing some technical difficulties at the moment. It will hopefully be back up soon.Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-47742774308083674792017-12-19T16:21:00.001+11:002017-12-19T16:21:39.565+11:00SLiMSuite REST Servers updated<p>The <a href="http://rest.slimsuite.unsw.edu.au/">SLiMSuite REST Servers</a> have been updated to the <a href="http://slimsuite.blogspot.com.au/2017/12/slimsuite-release-v130-2017-12-19-online.html">latest release code (<code>v1.3.0</code>)</a>. Please report any issues!</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-33231200447377514692017-12-19T16:07:00.001+11:002017-12-19T16:11:02.182+11:00SLiMSuite release v1.3.0 (2017-12-18) online<p>SLiMSuite release <code>v1.3.0</code> (<code>2017-12-18</code>) is <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.3.0">now on GitHub</a>. Funding for SLiMSuite development is proving elusive at present, so this release is a little less organised (and later) than planned. The main additions are various programs in development for PacBio genomics and a draft SLiMSuite parser Shiny app in the new <code>shiny/</code> directory. The old <code>packages/</code> directory has also been removed. Check the <code>docs/release/</code> files and see below for more information on this release.</p>
<p>Another release with improved documentation is currently planned for early 2018. As ever, if you want access to the latest code, email to download the full svn repository.</p>
<h1>SLiMSuite updates</h1>
<h2>Updates in extras/:</h2>
</p>
<p><b>• rje_dbase:</b> <i>Updated from Version 2.3.</i>
<br>→ Version 2.3.1: Updated the dbdownload function to recognise individual files and wildcard file lists.
</p>
<p><b>• rje_pydocs:</b> <i>Updated from Version 2.16.3.</i>
<br>→ Version 2.17.4: Tweaked formatDocString.
<br>→ Version 2.17.5: Added general commands to docstring HTML for REST servers.
</p>
<h2>Updates in legacy/:</h2>
</p>
<h2>Updates in libraries/:</h2>
</p>
<p><b>• rje:</b> <i>Updated from Version 4.17.0.</i>
<br>→ Version 4.18.0: Added Roman numeral functions.
<br>→ Version 4.18.1: Updated error handling for full REST output.
<br>→ Version 4.18.2: Fixed rje module call bug.
<br>→ Version 4.19.0: Tweaked Docstring. Added extra parameter catching. Added report of INI loading.
</p>
<p><b>• rje_blast_V2:</b> <i>Updated from Version 2.11.2.</i>
<br>→ Version 2.12.0: Added localidcut %identity filter for GABLAM calculations.
<br>→ Version 2.13.0: Added GFF and SAM output for BLAST local tables for GABLAM, PAGSAT etc.
<br>→ Version 2.14.0: Updated gablamfrag=X and fragmerge=X usage. Fixed localFragFas position output.
<br>→ Version 2.15.0: Fragmerge no longer removes flanks and can be negative for enforced overlap!
<br>→ Version 2.16.0: Added qassemblefas mode for generating fasta file from outfmt 4 run.
<br>→ Version 2.16.1: Improved error messages for BLAST QAssembly.
<br>→ Version 2.17.0: qconsensus=X : Whether to convert QAssemble alignments to consensus sequences (None/Hit/Full) [None]
<br>→ Version 2.17.1: Modified QAssembleFas output sequence names for better combining of hits. Added QFasDir.
<br>→ Version 2.17.2: Modified QAssembleFas output file names for better re-running. Fixed major QConsensus Bug.
<br>→ Version 2.18.0: Added REST output. Fixed QConsensus=Full bug.
</p>
<p><b>• rje_db:</b> <i>Updated from Version 1.8.1.</i>
<br>→ Version 1.8.2: Fixed minor readSet bug.
<br>→ Version 1.8.3: Minor debugging message changes.
<br>→ Version 1.8.4: Cosmetic log message changes.
<br>→ Version 1.8.5: Added saveToFileName() function.
<br>→ Version 1.8.6: Minor IndexReport tweak.
</p>
<p><b>• rje_genbank:</b> <i>Updated from Version 1.5.2.</i>
<br>→ Version 1.5.3: Fixed https genbank download issue.
</p>
<p><b>• rje_menu:</b> <i>Updated from Version 0.4.0.</i>
<br>→ Version 0.5.0: Enabled simpler return tuples.
</p>
<p><b>• rje_obj:</b> <i>Updated from Version 2.2.1.</i>
<br>→ Version 2.2.2: Updated error handling for full REST output.
</p>
<p><b>• rje_qsub:</b> <i>Updated from Version 1.6.3.</i>
<br>→ Version 1.7.0: Added option for email when job started
<br>→ Version 1.8.0: Added modpurge=T/F : Whether to purge loaded modules in qsub job file prior to loading [True]
<br>→ Version 1.9.0: Added precall=LIST : List of additional commands to run between module loading and program call []
<br>→ Version 1.9.1: Removed default module list: causing conflicts. Better to have in INI file.
</p>
<p><b>• rje_samtools:</b> <i>Updated from Version 1.8.1.</i>
<br>→ Version 1.9.0: Added depthplot data generation. (Will need to add R function for plot itself.)
<br>→ Version 1.9.1: Changed mincut default to 0.1.
<br>→ Version 1.10.0: Added readlen output, which is like the depth plot but uses max read length (kb) instead of depth.
<br>→ Version 1.11.0: Added dirnlen=X : Include directional read length data at X bp intervals (depthplot=T; 0=OFF) [500]
<br>→ Version 1.11.1: Minor tweaks to try and speed up pileup parsing.
<br>→ Version 1.12.0: Updated the snpfreq run code to make clearer and check for parsing issues. Set mincut=1 default.
<br>→ Version 1.13.0: Added skiploci=LIST - need to screen out mitochondrion from Illumina Pileup parsing!
<br>→ Version 1.14.0: Added forking of pileup parsing for SNPFreq analysis.
<br>→ Version 1.14.1: Fixed SNPFreq rerunning bug.
<br>→ Version 1.15.0: Added rgraphics=T/F : Whether to generate snpfreq multichromosome plots [True]
<br>→ Version 1.16.0: Add coverage calculation per locus to depth plot table output (depthplot=T).
<br>→ Version 1.16.1: Added reporting of existing files for parsing Pileup.
<br>→ Version 1.17.0: Added parsing of lengths from SAM files to RID file.
<br>→ Version 1.18.0: Updated processing of Treatment and Control without Alt to still limit to SNPTable. Fixed SNPFreq filters.
<br>→ Version 1.19.0: snptableout=T/F : Output filtered alleles to SNP Table [False]
<br>→ Version 1.19.1: Fixed AltLocus SNP table bug.
<br>→ Version 1.19.2: Updated forker parsing to hopefully fix bug.
</p>
<p><b>• rje_seqlist:</b> <i>Updated from Version 1.20.1.</i>
<br>→ Version 1.21.0: Added capacity to add/update database object from self.summarise() even if not seqmode=db. Added filedb mode.
<br>→ Version 1.22.0: Added geneDic() method.
<br>→ Version 1.23.0: Added seqSequence() method.
<br>→ Version 1.24.0: Add NNN gaps option and "delete rest of sequences" to edit().
<br>→ Version 1.24.1: Minor edit bug fix and DNA toggle option.
<br>→ Version 1.25.0: Added loading of FASTQ files in seqmode=file mode.
</p>
<p><b>• rje_sequence:</b> <i>Updated from Version 2.5.3.</i>
<br>→ Version 2.6.0: Added mutation dictionary to Ks calculation.
</p>
<p><b>• rje_slim:</b> <i>Updated from Version 1.12.0.</i>
<br>→ Version 1.12.1: Modified error message.
</p>
<p><b>• rje_slimcalc:</b> <i>Updated from Version 0.9.2.</i>
<br>→ Version 0.9.3: Changed fudge error to warning.
</p>
<p><b>• rje_slimcore:</b> <i>Updated from Version 2.7.7.</i>
<br>→ Version 2.7.8: Fixed batch=FILE error for single input files.
<br>→ Version 2.8.0: Added map and failed output to REST servers and standalone uniprotid=LIST input runs.
<br>→ Version 2.8.1: Updated resfile to be set by basefile if no resfile=X setting given
<br>→ Version 2.9.0: Added separate IUPred long suffix for reusing predictions
</p>
<p><b>• rje_synteny:</b> <i>Updated from Version 0.0.0.</i>
<br>→ Version 0.0.1: Altered problematic ValueError to warnLog()
<br>→ Version 0.0.2: Updated the synteny mappings to be m::n instead of m:n for Excel compatibility.
<br>→ Version 0.0.3: Added catching of the Feature locus/accnum mismatch issue.
</p>
<p><b>• rje_tree:</b> <i>Updated from Version 2.14.0.</i>
<br>→ Version 2.14.1: Fixed clustalw2 makeTree issue.
<br>→ Version 2.15.0: Added IQTree.
</p>
<p><b>• rje_uniprot:</b> <i>Updated from Version 3.22.0.</i>
<br>→ Version 3.23.0: Added accnum map table output. Fixed REST output bug when bad IDs given. Added version and about output.
<br>→ Version 3.24.0: Added pfam out and changed map table headers.
<br>→ Version 3.24.1: Fixed process Uniprot error when uniprot=FILE given.
</p>
<p><b>• rje_zen:</b> <i>Updated from Version 1.3.1.</i>
<br>→ Version 1.3.2: Added some more words.
</p>
<p><b>• snp_mapper:</b> <i>Updated from Version 1.0.0.</i>
<br>→ Version 1.1.0: Added pNS and modified the "Positive" CDS rating to be pNS < 0.05.
<br>→ Version 1.1.1: Updated pNS calculation to include EXT mutations and substitution frequency.
<br>→ Version 1.2.0: SNPByFType=T/F : Whether to output mapped SNPs by feature type (before FTBest filtering) [False]
</p>
<h2>Updates in tools/:</h2>
</p>
<p><b>• gablam:</b> <i>Updated from Version 2.23.0.</i>
<br>→ Version 2.23.1: Added tuplekeys=T to cmd_list as default. (Can still be over-ridden if it breaks things!)
<br>→ Version 2.24.0: Added localidmin and and localidcut as %identity versions of localmin and localcut. (Use for PAGSAT.)
<br>→ Version 2.25.0: Added localsAM=T/F : Save local (and unique) hits data as SAM files in addition to TDT [False]
<br>→ Version 2.26.0: Fixed fragfas output and clarified fullblast=T/F, localmin=X and localcut=X. Set fullblast=T keepblast=T.
<br>→ Version 2.26.1: Fixed keepblast error.
<br>→ Version 2.26.2: Fixed gablamcut fragfas filtering bug.
<br>→ Version 2.26.3: Fixed nrseq=T to use Query OR Hit stat for NR filtering.
<br>→ Version 2.26.4: Minor bug fix to nrchoice command parsing.
<br>→ Version 2.27.0: Fragmerge no longer removes flanks and can be negative for enforced overlap!
<br>→ Version 2.28.0: Added localidmin=PERC to localUnique (and thus Snapper).
<br>→ Version 2.28.1: Fixed missing combinedfas when using existing blastres.
<br>→ Version 2.28.2: Minor bug fix for NRSeq manual choice when i=-1.
<br>→ Version 2.28.3: Fixed NRSeq query sorting bug.
</p>
<p><b>• haqesac:</b> <i>Updated from Version 1.10.2.</i>
<br>→ Version 1.10.3: Added catching of bad query when i=-1.
<br>→ Version 1.11.0: Added resdir=PATH [./HAQESAC/] for d>0 outputs.
</p>
<p><b>• multihaq:</b> <i>Updated from Version 1.2.2.</i>
<br>→ Version 1.3.0: MultiCut : Restrict BLAST to the top X hits from each database [100]
</p>
<p><b>• pagsat:</b> <i>Updated from Version 1.11.2.</i>
<br>→ Version 1.11.3: Added reference=FILE as alias for refgenome=FILE. Fixed orphan delete bug.
<br>→ Version 1.12.0: Tidying up and documenting outputs. Changed default minloclen=250 and minlocid=95. (LTR identification.)
<br>→ Version 2.0.0: Major overhaul of outputs to improve consistency and clarity. Added Snapper to main run.
<br>→ Version 2.1.0: Added localSAM output.
<br>→ Version 2.1.1: Fixed the case of some output files.
<br>→ Version 2.1.2: Fixed some issues with reverse hits in Snapper and application of minlocid.
<br>→ Version 2.2.0: Added mapout=T, which is recommended for first run if going to subsequently tidy. (Run tidy on mapfile.)
<br>→ Version 2.2.1: Tried to fix covplot bug in compare=FILES mode.
<br>→ Version 2.2.2: Cleaned up *.map.* output for SAMPhaser output files. Added tidy/mapfas option selection.
<br>→ Version 2.2.3: Added #NOTE to tidy and fixed makesnp=T bug.
<br>→ Version 2.2.4: Fixed `fragrevcomp=F` bug for Gene and Protein TopHits.
<br>→ Version 2.2.5: Hopefully really fixed makesnp=T bug now!
<br>→ Version 2.2.6: Fixed Haploid tidy sequence output naming bug.
<br>→ Version 2.2.7: Fixed Compare File path bug & dropped some empty outputs.
<br>→ Version 2.3.0: Minor bug fixes and extra tidy options (join gaps and multi-deletes).
<br>→ Version 2.3.1: Minor bug fixes.
<br>→ Version 2.3.2: Updated the synteny mappings to be m::n instead of m:n for Excel compatibility.
<br>→ Version 2.3.3: Fixed bad assembly sequence name bug.
</p>
<p><b>• pagsat_V1:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 1.0.0: Initial working version for based on rje_pacbio assessment=T.
<br>→ Version 1.1.0: Fixed bug with gene and protein summary data. Removed gene/protein reciprocal searches. Added compare mode.
<br>→ Version 1.1.1: Added PAGSAT output directory for tidiness!
<br>→ Version 1.1.2: Renamed the PacBio class PAGSAT.
<br>→ Version 1.2.0: Tidied up output directories. Added QV filter and Top Gene/Protein hits output.
<br>→ Version 1.2.1: Added casefilter=T/F : Whether to filter leading/trailing lower case (low QV) sequences [True]
<br>→ Version 1.3.0: Added tophitbuffer=X and initial synteny analysis for keeping best reference hits.
<br>→ Version 1.4.0: Added chrom-v-contig alignment files along with *.ordered.fas.
<br>→ Version 1.4.1: Made default chromalign=T.
<br>→ Version 1.4.2: Fixed casefilter=F.
<br>→ Version 1.5.0: diploid=T/F : Whether to treat assembly as a diploid [False]
<br>→ Version 1.6.0: mincontiglen=X : Minimum contig length to retain in assembly [1000]
<br>→ Version 1.6.1: Added diploid=T/F to R PNG call.
<br>→ Version 1.7.0: Added tidy=T/F option. (Development)
<br>→ Version 1.7.1: Updated tidy=T/F to include initial assembly.
<br>→ Version 1.7.2: Fixed some bugs introduced by changing gablam fragment output.
<br>→ Version 1.7.3: Added circularise sequence generation.
<br>→ Version 1.8.0: Added orphan processing and non-chr naming of Reference.
<br>&rRichard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-51690443858922650362017-07-28T14:26:00.001+10:002017-07-28T14:27:13.880+10:00Edwards Lab: The SLiMEnrich Shiny App is now live<a href="http://edwardslab.blogspot.com/2017/07/the-slimenrich-shiny-app-is-now-live.html?spref=bl">Edwards Lab: The SLiMEnrich Shiny App is now live</a>: Sobia ’s first Shiny App is now up and running for final pre-publication testing on our new EdwardsLab RShiny server. See post for details.Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-18718547030746027042017-03-05T21:51:00.002+11:002017-03-05T21:51:58.877+11:00Problem with SLiMFinder bioware webserver<p>There is currently a problem with the SLiMFinder webserver hosted at UCD, where masking is failing to be performed, regardless of settings. <em>This severely impacts the quality of results.</em> (Disorder, low complexity and n-terminal methionine masking are generally recommended for SLiMFinder.)</p>
<p>I am in communication with the Shields lab to try and get the issue fixed but, until it has been rectified, <strong>the bioware.ucd.ie SLiMFinder webserver should not be used</strong>.</p>
<p>If you wish to run SLiMFinder online, you can do so via <a href="http://rest.slimsuite.unsw.edu.au/slimfinder">the SLiMFinder REST server</a> (see <a href="http://slimsuite.blogspot.com.au/2015/12/bioinfosummer2015-slimsuite-workshop.html">BioInfoSummer 2016 workshop</a>), which can also be run from within Cytoscape using <a href="https://f1000research.com/articles/4-477/v1/pdf">the SLiMScape App</a>.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-20666965107974185212017-01-27T09:29:00.003+11:002017-01-27T09:29:32.530+11:00SLiMSuite species codes<p>SLiMSuite species codes are designed to follow the <a href="http://www.uniprot.org/docs/speclist">UniprotKB organism (species) identification codes</a>,
using them wherever possible. They form part of the standard <code>gene_SPECIES__AccNum</code> naming convention for sequences within
SLiMSuite. Species codes should be upper case, and unique for each species.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-60461702802904464292016-10-11T17:01:00.002+11:002016-10-11T17:15:19.451+11:00Odd blog behaviour<p>For some reason, the Download blog page is not working properly. Until rectified, please <a href="http://slimsuite.blogspot.com.au/search/label/downloads">check the downloads tag</a> if a link to SLiMSuite downloads breaks.</p>
<p><em>Update: this should be fixed now!</em></p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-9724042167333793592016-09-12T12:35:00.002+10:002016-09-12T12:35:49.505+10:00SLiMSuite release v1.2.0 (2016-09-12) online<p>The long-overdue September 2016 release of SLiMSuite <code>2016-09-12</code> - <code>v1.2.0</code> is <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.2.0">now on GitHub</a>. Apart from a few bug fixes, the main updates in this release are to the tools for PacBio genomics, notably <code>PAGSAT</code>, <code>SMRTSCAPE</code> and a new SNP Mapping tool, <code>Snapper</code>. These are still in development and need further documentation but are ready for use with a little help. Please get in touch if you are interested. Proper documentation and example use will hopefully follow soon, as the first PacBio yeast paper is written.</p>
<p><code>GABLAM</code> has had some minor tweaks for improved function with <code>Snapper</code>, <code>PAGSAT</code> and another developmental tool that will be in the next release (<code>REVERT</code> - available via the REST servers). These have been focused on the <code>fragfas=T</code> output of fragmented BLAST hits based on local alignments. This includes addition of a new default to reverse complement reverse hits (<code>fragrevcomp=T</code>) and the separation of parameters for splitting up local hits into multiple fragments (<code>gablamfrag=X</code>) and merging close/overlapping fragments (<code>fragmerge=X</code>).</p>
<h1>SLiMSuite updates in this release</h1>
<h2>Updates in extras/:</h2>
<p><b>• rje_pydocs:</b> <i>Updated from Version 2.16.2.</i>
<br>→ Version 2.16.3: Fixed docstring REST parsing to work with _V* modules.
</p>
<h2>Updates in libraries/:</h2>
<p><b>• rje:</b> <i>Updated from Version 4.15.1.</i>
<br>→ Version 4.16.0: Added list2dict(inlist,inkeys) and dict2list(indict,inkeys) functions.
<br>→ Version 4.16.1: Improved handling of integer parameters when given bad commands.
<br>→ Version 4.17.0: Added extra functions to randomList()
</p>
<p><b>• rje_blast_V2:</b> <i>Updated from Version 2.9.1.</i>
<br>→ Version 2.10.0: Added nocoverage calculation based on local alignment table.
<br>→ Version 2.11.0: Added localFragFas output method.
<br>→ Version 2.11.1: Fixed snp local table revcomp bug. [Check this!]
<br>→ Version 2.11.2: Fixed GABLAM calculation bug when '*' in protein sequences.
</p>
<p><b>• rje_db:</b> <i>Updated from Version 1.8.0.</i>
<br>→ Version 1.8.1: Added sfdict to saveTable output.
</p>
<p><b>• rje_genbank:</b> <i>Updated from Version 1.3.2.</i>
<br>→ Version 1.4.0: Added addtags=T/F : Add locus_tag identifiers if missing - needed for gene/cds/prot fasta output [False]
<br>→ Version 1.4.1: Fixed genetic code warning.
<br>→ Version 1.5.0: Added setupRefGenome() method based on PAGSAT code.
<br>→ Version 1.5.1: Fixed logskip append locus sequence file bug.
<br>→ Version 1.5.2: Fixed addtag(s) bug.
</p>
<p><b>• rje_hprd:</b> <i>Updated from Version 1.2.</i>
<br>→ Version 1.2.1: Fixed "PROTEIN_ARCHITECTURE" bug.
</p>
<p><b>• rje_menu:</b> <i>Updated from Version 0.3.</i>
<br>→ Version 0.4.0: Changed handling of default for exiting menu loop. May affect behaviour of some existing menus.
</p>
<p><b>• rje_mitab:</b> <i>Updated from Version 0.2.0.</i>
<br>→ Version 0.2.1: Fixed redundant evidence/itype bug (primarily dip)
</p>
<p><b>• rje_obj:</b> <i>Updated from Version 2.1.3.</i>
<br>→ Version 2.2.0: Added screenwrap=X.
<br>→ Version 2.2.1: Improved handling of integer parameters when given bad commands.
</p>
<p><b>• rje_samtools:</b> <i>Updated from Version 0.1.0.</i>
<br>→ Version 0.2.0: Added majmut=T/F : Whether to restrict output and stats to positions with non-reference Major Allele [False]
<br>→ Version 1.0.0: Major reworking. Old version frozen as rje_samtools_V0.
<br>→ Version 1.1.0: Added snptabmap=X,Y alternative SNPTable mapping and read_depth statistics []. Added majref=T/F.
<br>→ Version 1.2.0: Added developmental combining of read mapping onto two different genomes.
<br>→ Version 1.3.0: Major debugging and code clean up.
<br>→ Version 1.4.0: Added parsing of read number (to link SNPs) and fixed deletion error at same time. Added rid=T/F and snponly=T/F.
<br>→ Version 1.5.0: Added biallelic=T/F : Whether to restrict SNPs to pure biallelic SNPs (two alleles meeting mincut) [False]
<br>→ Version 1.5.1: Fixed REF/Ref ALT/Alt bug.
<br>→ Version 1.6.0: Added majfocus=T/F : Whether the focus is on Major Alleles (True) or Mutant/Reference Alleles (False) [True]
<br>→ Version 1.7.0: Added parsing of *.sam files for generating RID table.
<br>→ Version 1.8.0: Added read coverage summary/checks.
<br>→ Version 1.8.1: Fixed issue when RID file not generated by pileup parsing. Set RID=True by default to avoid issues.
</p>
<p><b>• rje_samtools_V0:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 0.1.0: Modified version to handle multiple loci per file. (Original was for single bacterial chromosomes.)
<br>→ Version 0.2.0: Added majmut=T/F : Whether to restrict output and stats to positions with non-reference Major Allele [False]
</p>
<p><b>• rje_seq:</b> <i>Updated from Version 3.23.0.</i>
<br>→ Version 3.24.0: Added REST seqout output.
</p>
<p><b>• rje_seqlist:</b> <i>Updated from Version 1.15.3.</i>
<br>→ Version 1.15.4: Fixed REST server output bug.
<br>→ Version 1.15.5: Fixed reformat=fasta default issue introduced from fixing REST output bug.
<br>→ Version 1.16.0: Added edit=T sequence edit mode upon loading (will switch seqmode=list).
<br>→ Version 1.17.0: Added additional summarise=T output for seqmode=db.
<br>→ Version 1.18.0: Added revcomp to reformat options.
<br>→ Version 1.19.0: Added option log description for deleting sequence during edit.
<br>→ Version 1.20.0: Added option to give a file of changes for edit mode.
<br>→ Version 1.20.1: Fixed edit=FILE deletion bug.
</p>
<p><b>• rje_sequence:</b> <i>Updated from Version 2.5.2.</i>
<br>→ Version 2.5.3: Fixed genetic code warning error.
</p>
<p><b>• rje_slimcore:</b> <i>Updated from Version 2.7.5.</i>
<br>→ Version 2.7.6: Added feature masking log info or warning.
<br>→ Version 2.7.7: Switched feature masking OFF by default to give consistent Uniprot versus FASTA behaviour.
</p>
<p><b>• rje_synteny:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
</p>
<p><b>• rje_taxonomy:</b> <i>Updated from Version 1.1.0.</i>
<br>→ Version 1.2.0: Added storage of Parents.
</p>
<p><b>• rje_tree:</b> <i>Updated from Version 2.13.0.</i>
<br>→ Version 2.14.0: Added cladeSpec().
</p>
<p><b>• rje_uniprot:</b> <i>Updated from Version 3.21.4.</i>
<br>→ Version 3.22.0: Tweaked REST table output.
</p>
<p><b>• rje_xref:</b> <i>Updated from Version 1.8.0.</i>
<br>→ Version 1.8.1: Added rest run mode to avoid XRef table output if no gene ID list is given. Added `genes` and `genelist` as `idlist=LIST` synonym.
<br>→ Version 1.8.2: Catching self.dict['Mapping'] error for REST server.
</p>
<p><b>• snp_mapper:</b> <i>Updated from Version 0.4.0.</i>
<br>→ Version 0.5.0: Added CDS rating.
<br>→ Version 0.6.0: Added AltFT mapping mode (map features to AltLocus and AltPos)
<br>→ Version 0.7.0: Added additional fields for processing Snapper output. (Hopefully will still work for SAMTools etc.)
<br>→ Version 0.8.0: Added parsing of GFF file from Prokka.
<br>→ Version 0.8.1: Corrected "intron" classification for first position of features. Updated FTBest defaults.
<br>→ Version 1.0.0: Version that works with Snapper V1.0.0. Not really designed for standalone running any more.
</p>
<h2>Updates in tools/:</h2>
</p>
<p><b>• comparimotif_V3:</b> <i>Updated from Version 3.12.</i>
<br>→ Version 3.13.0: Added REST server function.
</p>
<p><b>• gablam:</b> <i>Updated from Version 2.20.0.</i>
<br>→ Version 2.21.0: Added nocoverage Table output of regions missing from pairwise SNP Table.
<br>→ Version 2.21.1: Added fragrevcomp=T/F : Whether to reverse-complement DNA fragments that are on reverse strand to query [True]
<br>→ Version 2.22.0: Added description to HitSum table.
<br>→ Version 2.22.1: Added localaln=T/F to keep local alignment sequences in the BLAST local Table.
<br>→ Version 2.22.2: Fixed local output error. (Query/Qry issue - need to fix this and make consistent!)
<br>→ Version 2.22.3: Fixed blastv and blastb error: limit also applies to individual pairwise hits!
<br>→ Version 2.23.0: Divided GablamFrag and FragMerge.
</p>
<p><b>• pagsat:</b> <i>Updated from Version 1.6.1.</i>
<br>→ Version 1.7.0: Added tidy=T/F option. (Development)
<br>→ Version 1.7.1: Updated tidy=T/F to include initial assembly.
<br>→ Version 1.7.2: Fixed some bugs introduced by changing gablam fragment output.
<br>→ Version 1.7.3: Added circularise sequence generation.
<br>→ Version 1.8.0: Added orphan processing and non-chr naming of Reference.
<br>→ Version 1.9.0: Modified the join sorting and merging. Added better tracking of positions when trimming.
<br>→ Version 1.9.1: Added joinmargin=X : Number of extra bases allowed to still be considered an end local BLAST hit [10]
<br>→ Version 1.10.0: Added weighted tree output and removed report warning.
<br>→ Version 1.10.1: Fixed issue related to having Description in GABLAM HitSum tables.
<br>→ Version 1.10.2: Tweaked haploid core output.
<br>→ Version 1.10.3: Fixed tidy bug for RevComp contigs and switched joinsort default to Identity. (Needs testing.)
<br>→ Version 1.10.4: Added genetar option to tidy out genesummary and protsummary output. Incorporated rje_synteny.
<br>→ Version 1.10.5: Set gablamfrag=1 for gene/protein hits.
<br>→ Version 1.11.0: Consolidated automated tidy mode and cleaned up some excess code.
<br>→ Version 1.11.1: Added option for running self-PAGSAT of ctidX contigs versus haploid set. Replaced ctid "X" with "N".
<br>→ Version 1.11.2: Fixed Snapper run choice bug.
</p>
<p><b>• pingu_V4:</b> <i>Updated from Version 4.5.3.</i>
<br>→ Version 4.6.0: Added hubonly=T/F : Whether to restrict pairwise PPI to those with both hub and spoke in hublist [False]
<br>→ Version 4.6.1: Fixed some ppifas=T/F bugs and added combineppi=T/F : Whether to combine all spokes into a single fasta file [False]
<br>→ Version 4.6.2: Added check/filter for multiple SpokeUni pointing to same sequence. (Compilation redundancy mapping failure!)
<br>→ Version 4.6.3: Fixed issue with 1:many SpokeUni:Spoke mappings messing up XHub.
<br>→ Version 4.7.0: Added ppidbreport=T/F : Summary output for PPI compilation of evidence/PPIType/DB overlaps [True]
<br>→ Version 4.8.0: Fixed report duplication issue and added additional summary output
</p>
<p><b>• qslimfinder:</b> <i>Updated from Version 2.1.0.</i>
<br>→ Version 2.1.1: Switched feature masking OFF by default to give consistent Uniprot versus FASTA behaviour.
</p>
<p><b>• seqsuite:</b> <i>Updated from Version 1.11.0.</i>
<br>→ Version 1.11.1: Redirected PacBio to call SMRTSCAPE.
<br>→ Version 1.11.2: Fixed batchrun batchlog=False log error.
<br>→ Version 1.12.0: Added Snapper.
</p>
<p><b>• slimfarmer:</b> <i>Updated from Version 1.4.3.</i>
<br>→ Version 1.4.4: Modified default vmem request to 126GB from 127GB.
<br>→ Version 1.4.5: Updated BLAST loading default to 2.2.31
</p>
<p><b>• slimfinder:</b> <i>Updated from Version 5.2.1.</i>
<br>→ Version 5.2.2: Added warnings for ambocc and minocc that exceed the absolute minima. Updated docstring.
<br>→ Version 5.2.3: Switched feature masking OFF by default to give consistent Uniprot versus FASTA behaviour. Fixed FTMask=T/F bug.
</p>
<p><b>• slimparser:</b> <i>Updated from Version 0.3.3.</i>
<br>→ Version 0.3.4: Tweaked error messages.
<br>→ Version 0.4.0: Added simple json format output.
</p>
<p><b>• slimprob:</b> <i>Updated from Version 2.2.4.</i>
<br>→ Version 2.2.5: Fixed FTMask=T/F bug.
</p>
<p><b>• slimsearch:</b> <i>Updated from Version 1.7.</i>
<br>→ Version 1.7.1: Minor modification to docstring. Preparation for update to SLiMSearch 2.0 optimised for proteome searches.
</p>
<p><b>• slimsuite:</b> <i>Updated from Version 1.5.1.</i>
<br>→ Version 1.5.2: Updated XRef REST call.
<br>→ Version 1.6.0: Removed SLiMCore as default. Default will now show help.
</p>
<p><b>• smrtscape:</b> <i>Updated from Version 1.8.0.</i>
<br>→ Version 1.9.0: Updated empirical preassembly mapefficiency calculation.
<br>→ Version 1.10.0: Added batch processing of subread files.
<br>→ Version 1.10.1: Fixed bug in batch processing.
</p>
<p><b>• snapper:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.1.0: Tidied up with improved run pickup.
<br>→ Version 0.2.0: Added FASTQ and improved CNV output along with all features.
<br>→ Version 0.2.1: Fixed local output error. (Query/Qry issue - need to fix this and make consistent!) Fixed snp local table revcomp bug.
<br>→ Version 0.2.2: Corrected excess CNV table output (accnum AND shortname).
<br>→ Version 0.2.3: Corrected "intron" classification for first position of features. Updated FTBest defaults.
<br>→ Version 1.0.0: Working version with completed draft manual. Added to SeqSuite.
<br>→ Version 1.0.1: Fixed issues when features missing.
</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-88499088333392192352016-08-23T21:40:00.001+10:002016-09-08T12:06:49.806+10:00SMRTSCAPE: SMRT Subread Coverage & Assembly Parameter Estimator<p>SMRTSCAPE (<strong>SMRT</strong> <strong>S</strong>ubread <strong>C</strong>overage & <strong>A</strong>ssembly <strong>P</strong>arameter <strong>E</strong>stimator) is tool in development as part of our <a href="http://edwardslab.blogspot.com.au/search/label/pacbio">PacBio sequencing projects</a> for predicting and/or assessing the quantity and quality of useable data required/produced for HGAP3 <em>de novo</em> whole genome assembly. The current documentation is below. Some tutorials will be developed in the future - in the meantime, please get in touch if you want to use it and anything isn’t clear.</p>
<p>The main functions of <code>SMRTSCAPE</code> are:</p>
<ol>
<li><p>Estimate Genome Coverage and required numbers of SMRT cells given predicted read outputs. <strong>NOTE:</strong> Default settings for SMRT cell output are not reliable and you should speak to your sequencing provider for up-to-date figures in their hands.</p></li>
<li><p>Summarise the amount of sequence data obtained from one or more SMRT cells, including unique coverage (one read per ZMW).</p></li>
<li><p>Calculate predicted coverage from subread data for difference length and quality cutoffs.</p></li>
<li><p>Predict HGAP3 length and quality settings to achieve a given coverage and accuracy.</p></li>
</ol>
<p><code>SMRTSCAPE</code> will be available in the next <a href="http://slimsuite.blogspot.com.au/search/label/downloads">SLiMSuite download</a>. The <code>coverage=T</code> mode can be run from the EdwardsLab server at: <a href="http://www.slimsuite.unsw.edu.au/servers/pacbio.php">http://www.slimsuite.unsw.edu.au/servers/pacbio.php</a>. (This is currently running a slightly old implementation but should be updated shortly.)</p>
<h2 id="smrtscape">SMRTSCAPE Documentation</h2>
<pre><code>Version: 1.10.1
Last Edit: 26/05/16</code></pre>
<h2 id="commandline:">Commandline:</h2>
<pre><code>### ~ General Options ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ###
genomesize=X : Genome size (bp) [0]
### ~ Genome Coverage Options ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ###
coverage=T/F : Whether to generate coverage report [False]
avread=X : Average read length (bp) [20000]
smrtreads=X : Average assemble output of a SMRT cell [50000]
smrtunits=X : Units for smrtreads=X (reads/Gb/Mb) [reads]
errperbase=X : Error-rate per base [0.14]
maxcov=X : Maximmum X coverage to calculate [100]
bysmrt=T/F : Whether to output estimated coverage by SMRT cell rather than X coverage [False]
xnlist=LIST : Additional columns giving % sites with coverage >= Xn [1+`minanchorx`->`targetxcov`+`minanchorx`]
### ~ SubRead Summary Options ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ###
summarise=T/F : Generate subread summary statistics including ZMW summary data [False]
seqin=FILE : Subread sequence file for analysis [None]
batch=FILELIST : Batch input of multiple subread fasta files (wildcards allowed) if seqin=None []
targetcov=X : Target percentage coverage for final genome [99.999]
targeterr=X : Target errors per base for preassembly [1/genome size]
calculate=T/F : Calculate X coverage and target X coverage for given seed, anchor + RQ combinations [False]
minanchorx=X : Minimum X coverage for anchor subreads [6]
minreadlen=X : Absolute minimum read length for calculations (use minlen=X to affect summary also) [500]
rq=X,Y : Minimum (X) and maximum (Y) values for read quality cutoffs [0.8,0.9]
rqstep=X : Size of RQ jumps for calculation (min 0.001) [0.01]
### ~ Preassembly Fragmentation analysis Options ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ###
preassembly=FILE: Preassembly fasta file to assess/correct over-fragmentation (use seqin=FILE for subreads) [None]
### ~ Assembly Parameter Options ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ###
parameters=T/F : Whether to output predicted "best" set of parameters [False]
targetxcov=X : Target 100% X Coverage for pre-assembly [3]
xmargin=X : "Safety margin" inflation of X coverage [1]
mapefficiency=X : [Adv.] Efficiency of mapping anchor subreads onto seed reads for correction [1.0]
xsteplen=X : [Adv.] Size (bp) of increasing coverage steps for calculating required depths of coverage [1e6]
parseparam=FILES: Parse parameter settings from 1+ assembly runs []
paramlist=LIST : List of parameters to retain for parseparam output (file or comma separated, blank=all) []
predict=T/F : Whether to add XCoverage prediction and efficiency estimation from parameters and subreads [False]
### ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ###</code></pre>
<h2 id="function">Function</h2>
<p><code>SMRTSCAPE</code> has a number of functions for PacBio sequencing projects, concerned with predicting and/or assessing the quantity and quality of useable data produced:</p>
<ul>
<li><strong>Summarise subreads (<code>summarise=T</code>).</strong> This function summarises subread data from a given <code>seqin=FILE</code> fasta file, or a set of subread fasta files given with <code>batch=FILELIST</code>.</li>
<li><strong>Calculate length cutoffs (<code>calculate=T</code>).</strong> Calculates length cutoffs for different XCoverage combinations from subread summary data.</li>
<li><strong>Parameters (<code>parameters=T</code>).</strong> This function attempts to generate predicted optimum assembly settings from the <code>summary=T</code> and <code>calculate=T</code> table data.</li>
<li><strong>Genome Coverage (<code>coverage=T</code>).</strong> This method tries to predict genome coverage and accuracy for different depths of PacBio sequencing.</li>
<li><strong>Preassembly fragmentation analysis (<code>preassembly=FILE</code>).</strong> </li>
<li><strong>Parse Parameters (<code>parseparam=FILES</code>).</strong> This method parses assembly parameters from the SmrtPipeSettings Summary file.</li>
<li><strong>Prediction (<code>predict=T</code>).</strong> This method compares predicted coverage from seed reads with estimated coverage from preassembly data.</li>
</ul>
<p>These are explored in more detail below.</p>
<h3 id="setup">Setup</h3>
<p>The setup phase primarily sorts out the <code>SMRTSCAPE</code> objects. With the exception of pure <code>ParseParam</code> runs, it will also set up:</p>
<ol>
<li><strong>Genome Size.</strong> Unless given with <code>genomesize=X</code>, this will be asked for as it is required X coverage/depth and accuracy calculations.</li>
<li><strong>Target Error Rate.</strong> Unless given with <code>targeterr=X</code>, a target error rate of 1/<code>GenomeSize</code> will be set.</li>
<li><strong>Basefile.</strong> Finally, if no <code>basefile=X</code> setting is given, the basename for output files will be set to the basename of <code>seqin=FILE</code> if given (stripping <code>.subreads</code> if present), else <code>smrtscape.*</code>.</li>
</ol>
<h2 id="summarisesubreadssummariset">Summarise subreads (summarise=T)</h2>
<p>This function summarises subread data from a given <code>seqin=FILE</code> fasta file, or a set of subread fasta files given with <code>batch=FILELIST</code>. This uses the <code>summarise=T</code> function of <code>rje_seqlist</code> to first give text output to the log file of some summary statistics:</p>
<ul>
<li>Total number of sequences.</li>
<li>Total length of sequences.</li>
<li>Min. length of sequences.</li>
<li>Max. length of sequences.</li>
<li>Mean length of sequences.</li>
<li>Median length of sequences.</li>
<li>N50 length of sequences.</li>
</ul>
<p>Next, Pacbio-specific subread header information will be parsed to generate three summary tables (described in more detail below):</p>
<ol>
<li><code>*.zmw.tdt</code> summary of all subreads.</li>
<li><code>*.unique.tdt</code> summary of the longest subread per ZMW.</li>
<li><code>*.rq.tdt</code> summary of subread data for different Read Quality values.</li>
</ol>
<p>These are generated by parsing both the sequence data and the sequence name data:</p>
<pre><code>>m150625_001530_42272_c100792502550000001823157609091582_s1_p0/9/0_3967 RQ=0.784
>m150625_001530_42272_c100792502550000001823157609091582_s1_p0/11/0_20195 RQ=0.868</code></pre>
<p>These are split into component parts:</p>
<ul>
<li><code>m150625_001530_42272_c100792502550000001823157609091582_s1_p0</code> = SMRT cell (<code>SMRT</code>).</li>
<li><code>/9</code> = ZMW (<code>ZMW</code>).</li>
<li><code>/0_3967</code> = raw read positions used for subread (5’ adaptor removed) (<code>Pos</code>).</li>
<li><code>RQ=0.784</code> = read quality (mean per base accuracy) (<code>RQ</code>).</li>
</ul>
<p>The numbers and “best” subreads for each ZMW are summarised in <code>#RN</code> log file entries.</p>
<h3 id="subreadoutput.zmw.tdt">Subread output (*.zmw.tdt)</h3>
<p>The first output file is the <code>*.zmw.tdt</code>, which stores the subread information:</p>
<ul>
<li><code>SMRT</code>, <code>ZMW</code>, <code>Pos</code>, <code>RQ</code> = as above.</li>
<li><code>RN</code> = subread number within ZMW (1 to N).</li>
<li><code>Len</code> = length of subread.</li>
<li><code>Seq</code> = sequence file position.</li>
</ul>
<p>The unique key for this file is: <code>SMRT</code>,<code>ZMW</code>,<code>RN</code>.</p>
<h3 id="uniquesubreadoutput.unique.tdt">Unique subread output (*.unique.tdt)</h3>
<p>This table is made from <code>*.zmw.tdt</code> by reducing each ZMW’s output to a single read. Reads are kept in preference of (a) longest, (b) read quality (if tied), and finally (c) earliest read (if tied for both). It hase the same fields as <code>*.zmw.tdt</code> with keys determined by: <code>SMRT</code>,<code>ZMW</code>.</p>
<h3 id="readqualityoutput.rq.tdt">Read Quality output (*.rq.tdt)</h3>
<p>This table outputs the number and percentage of subreads and longest reads at each read quality (<code>RQ</code>). Fields:</p>
<ul>
<li><code>RQ</code> = read quality (per base accuracy)</li>
<li><code>xerr</code> = the Xdepth required @ that <code>RQ</code> to meet the <code>targeterr=X</code> error per base accuracy.</li>
<li><code>subread</code> = number of subreads with that <code>RQ</code>.</li>
<li><code>unique</code> = number of “best” unique subread per ZMW with that <code>RQ</code>.</li>
<li><code>f.subreads</code> = proportion of subreads with that <code>RQ</code>.</li>
<li><code>f.unique</code> = proportion of unique subreads with that <code>RQ</code>.</li>
<li><code>cum.subreads</code> = proportion of subreads with quality >=<code>RQ</code>.</li>
<li><code>cum.unique</code> = proportion of unique subreads with quality >=<code>RQ</code>.</li>
<li><code>x.subreads</code> = XCoverage of subreads with quality >=<code>RQ</code>.</li>
<li><code>x.unique</code> = XCoverage of unqiue subreads with quality >=<code>RQ</code>.</li>
<li><code>MeanRQ</code> = mean read quality of bases in subreads with quality >=<code>RQ</code>.</li>
<li><code>Mean.XErr</code> = the Xdepth required at that <code>MeanRQ</code> to meet the <code>targeterr=X</code> error per base accuracy. </li>
</ul>
<h2 id="calculatelengthcutoffscalculatet">Calculate length cutoffs (calculate=T)</h2>
<p>This function calculates length cutoffs for different XCoverage combinations from subread summary data. It uses the <code>*.zmw.tdt</code>, <code>*.unique.tdt</code> and <code>*.rq.tdt</code> files from above, generating if required (and regenerating if <code>force=T</code>).</p>
<p>First, <code>XCovLimit</code> data are calculated. These are the summed read lengths required to generate the desired genome coverage (<code>targetcov=X</code>) at different depths of X coverage. Note that the <em>square root</em> of the <code>targetcov=X</code> value is used, as the HGAP assembly process involves two layers of genome coverage: (1) coverage of seed reads by anchor reads to generate the pre-assembly; (2) coverage of the pre-assembly. </p>
<p><code>XCovLimit</code> data are calculated by incrementing total summed read lengths in 1 Mb increments (adjusted with <code>xsteplen=X</code>). At each incremment, <code>genomesize=X</code> is used to calculate the total X coverage. The probability of the target <code>X</code> coverage (starting at <code>1X</code>) given the total X coverage is then calculated using a Poisson distribution. If this probability exceeds the target genome coverage, the current summed length is set as the <code>XCovLimit</code> for <code>X</code> and the target <code>X</code> increased by 1. The total summed read length is then incremented by <code>xsteplen</code> and the process repeated until the summed length reaches the total length of all subreads of at least the size set by <code>minreadlen=X</code> (default 500 bp).</p>
<p>Next, the read quality steps to calculate are established using <code>rq=X,Y</code> (minimum (<code>X</code>) and maximum (<code>Y</code>) read quality cutoffs, defaults=0.8-0.9) and <code>rqstep=X</code> (the size of <code>RQ</code> steps for calculations, default=0.01 (min 0.001).</p>
<p>Finally, the seed and anchor lengths required to achieve certain minimum Xdepths of target genome coverage are calculated and output to <code>*.cutoffs.tdt</code>.</p>
<p>For each <code>RQ</code> cutoff, <code>TargetErr</code> is used to establish the min. required anchor read Xdepth (<code>AnchorMinX</code>). If this exceeds the specified <code>minanchorx=X</code> value, this will be used as the minimum target instead. Next, the seed read length (<code>SeedLen</code>) required to get a combined unique seed read length to give a minimum Xdepth (<code>SeedMinX</code>) of <code>targetxcov=X</code> is calculated. Where <code>xmargin</code> > 0, additional seed lengths will also be calculated to give deeper minimum seed Xdepths. <em>e.g.</em> <code>targetxcov=3 xmargin=2</code> will calculate <code>SeedLen</code> for <code>3X</code>, <code>4X</code> and <code>5X</code>. For each <code>SeedLen</code>, anchor read length cutoffs are also calculated such that the summed length of unique reads where <code>AnchorLen</code> <= length < <code>SeedLen</code> is sufficent to give <code>AnchorMinX</code> values from the minimum established above until <code>XMargin</code> is reached. </p>
<p>If there is insufficient data to meet the minimum seed and anchor read depths, the “optimal” seed XCoverage will be calculated from the unique seed reads, as described for <code>coverage=T</code>. In essence, <code>SeedMinX</code> will be reduced to meet <code>AnchorMinX</code> until it falls below zero and then the two values will be optimised to try and maximise genome coverage at the required target error. Users may prefer instead to relax the <code>targetxcov=X</code> and/or <code>minanchorx=X</code> values. This optimisation is based on unique Xcoverage and the precise values subsequently output in <code>*.cutoffs.tdt</code> may differ. (Relaxed variations could be run with higher <code>xmargin=X</code> values to output a range from which the chosen values can be selected for <code>predict=T</code>.)</p>
<p><strong>NOTE:</strong> <code>mapefficiency=X</code> is used during this process to reduce the effective seed coverage at a given summed length and thus inflate the required <code>SeedX</code> needed to achieve a given <code>SeedMinX</code>.</p>
<h3 id="cutoffs.tdt">*.cutoffs.tdt</h3>
<p>This table contains the main output from the <code>calculate=T</code> function. Unique entries are determined by combinations of <code>'RQ</code>, <code>SeedMinX</code> and <code>AnchorMinX</code>.</p>
<ul>
<li><code>RQ</code> = Read Quality Cutoff.</li>
<li><code>SeedMinX</code> = Min seed XCoverage for TargetCov % of genome (unique reads). If this is <1, it indicates the proportion of the genome covered at 1X.</li>
<li><code>SeedLen</code> = Seed length Cutoff.</li>
<li><code>SeedX</code> = Total Seed read XCoverage (all reads).</li>
<li><code>AnchorMinX</code> = Min anchor XCoverage for TargetCov % of genome (unique reads). If this is <<code>minanchorx=X</code>, it indicates the proportion of the genome covered at <code>minanchorx</code>X.</li>
<li><code>AnchorLen</code> = Anchor read (<em>i.e.</em> overall subread) length cutoff.</li>
<li><code>AnchorX</code> = Total Anchor read XCoverage (all reads).</li>
</ul>
<h2 id="preassemblyfragmentationanalysispreassemblyfile">Preassembly fragmentation analysis (preassembly=FILE)</h2>
<pre><code>[ ] : Add preassembly details here.</code></pre>
<h2 id="optimalassemblyparametersparameterst">Optimal Assembly Parameters (parameters=T)</h2>
<p>The <code>parameters=T</code> function attempts to generate predicted optimum assembly settings from the <code>summary=T</code> and <code>calculate=T</code> table data.</p>
<ol>
<li>The <code>*.cutoffs.tdt</code> table is read in (or generated if required).</li>
<li>The <code>targetxcov=X</code> and <code>xmargin=X</code> settings are used to determine the desired <code>SeedMinX</code> value, <em>i.e.</em> the miniumum depth of coverage of the chosen seed reads. (NB. The <code>mapefficiency=X</code> setting is used for inflating the required XCoverage needed to meet this Min XDepth during the calculate process.)</li>
<li>Each potential <code>RQ</code> cutoff is now assessed and the <code>targeterr=X</code> setting used to determine the required Xdepth per base for error correction. <strong>Note:</strong> This uses the minimum RQ value and should thus be conservative. Using the mean RQ was considered but it was deemed that conservative is best in this scenario.</li>
<li>The desired <code>AnchorMinX</code> is calculated from the target Xdepth and <code>xmargin=X</code>. The final value is reduced by one to allow for the fact that the seed read counts as X=1 for error estimation.</li>
<li>Parameter combinations have now been reduced to those with the desired Seed and Anchor minimum Xdepth. Two parameter combinations are then output:
<ul><li><strong>MaxLen</strong> parameters using the <em>mininum RQ</em> value and thus the longest seed and anchor read length cutoffs.</li>
<li><strong>MaxRQ</strong> parameters using the <em>maximum RQ</em> value.</li></ul></li>
</ol>
<p>Note that the predicted parameter settings are only output as <code>#PARAM</code> log entries: the full set (including these “optimal” ones) are part of the <code>*.cutoffs.tdt</code> file.</p>
<h2 id="genomecoveragecoveraget">Genome Coverage (coverage=T)</h2>
<p>This method tries to predict genome coverage and accuracy for different depths of PacBio sequencing based on predicted usable output statistics and the genome size. Statistics for existing runs can be generated using the <code>summarise=T</code> option and used to inform <code>calculate=T</code> if run together.</p>
<p><strong>Setup.</strong> If the <code>summarise=T</code> option is used and/or there is an existing <code>BASEFILE.unique.tdt</code> file (and <code>force=F</code>) then the <code>*.unique.tdt</code> table will be used to generate SMRT cells statistics: mean read count (used to populate <code>smrtreads=X</code>); mean total read count (used to populate <code>avread=X</code>); mean RQ (used to populated <code>errperbase=X</code>). Otherwise, the corresponding commandline options will be used. If <code>smrtunits</code> is <code>Gb</code> or <code>Mb</code> then <code>smrtreads=X</code> will be recalculated as <code>smrtreads</code>/<code>avread</code>.</p>
<p><strong>XnList.</strong> The second stage of setup is to calculate the %coverage at certain X depth coverage to be calculated along with overall depth of coverage <em>etc.</em> These numbers are based on the subread <code>summarise</code> and <code>calculate</code> settings: <code>targetxcov</code> and <code>targetxcov</code>+<code>minanchorx</code>. Any levels explicitly chosen by <code>xnlist=LIST</code> will also be calculated.</p>
<p><strong>TargetXDepth.</strong> Next, target Xdepth values are calculated in the same fashion as <code>XCovLimit</code> data (above), except that these are now converted to Xcoverage (based on <code>GenomeSize</code>) rather than total subread lengths.</p>
<p><strong>Accuracy.</strong> The % genome coverage and accuracy for different X coverage of a genome are then calculated assuming a non-biased error distribution. Calculations use binomial/poisson distributions, assuming independence of sites. Accuracy is based on a majority reads covering a particular base with the correct call, assuming random calls at the other positions (i.e. the correct bases have to exceed 33% of the incorrect positions). The <code>errperbase=X</code> parameter is used for this calculation.</p>
<p><strong>Coverage.</strong> Coverage statistics are then calculated for each Xdepth of sequencing (or SMRT cell if <code>bysmrt=T</code>) First, the optimal seed read Xcoverage is calculated. The target seed Xdepth (<code>targetxcov=X</code>) and anchor depth (<code>minanchorx=X</code>) are used to identify the total target Xcoverage. If this is met (inflating required seed coverage to account for <code>mapefficiency=X</code>), the largest seedX value that meets the <code>minanchorx=X</code> anchor depth is selected. If this cannot be achieved with seedX >= 1, the optimal balance between seed length and anchor length is achieved by maximising the probability of 1X seed coverage and <code>MinAnchorX</code>+ anchor coverage. This seed read length is then used to generate the predicted coverage output.</p>
<h3 id="coverage.tdt">*.coverage.tdt</h3>
<p>Main output is the <code>*.coverage.tdt</code> file. All calculations are based on subreads, and therefore using the “raw” polymerase read data for the <code>smrtreads=X</code> value for SMRT cells will overestimate coverage. Note that <code>smrtreads=X</code> can be used to input sequence capacity in Gb (or Mb) rather than read counts by changing <code>smrtunits=X</code>.</p>
<ul>
<li><code>XCoverage</code> = Total mean depth of coverage.</li>
<li><code>SMRT</code> = Total number of SMRT cells.</li>
<li><code>%Coverage</code> = Estimated %coverage of assembly.</li>
<li><code>%Accuracy</code> = Estimated %accuracy of assembled genome. This is established by working out the predicted proportion of the genome at each Xcoverage (given the total <code>XCoverage</code>) and the accuracy at that depth (as described above).</li>
<li><code>%Complete</code> = Product of %coverage and %accuracy.</li>
<li><code>SeedX</code> = Estimated optimal depth of coverage for seed reads.</li>
</ul>
<h2 id="parsingassemblyparametersparseparamfiles">Parsing assembly parameters (ParseParam=FILES)</h2>
<p>This method will take a bunch of <code>*.settings</code> text files (wildcards allowed) and parse out the assembly parameter settings into a delimited text file. The contents of these files should be consistent with the <code>Assembly_Metrics_*.xlsx</code> file produced by the <strong>SMRT Portal</strong>. </p>
<p>Output for this method is a <code>*.settings.tdt</code> file, which has the following field headers:</p>
<ul>
<li><code>Setting</code>. The full setting name, <em>e.g.</em> <code>p_preassemblerdagcon.minCorCov</code>.</li>
<li><code>Prefix</code>. The setting prefix, <em>e.g.</em> <code>p_preassemblerdagcon</code>.</li>
<li><code>Suffix</code>. The setting suffix, <em>e.g.</em> <code>minCorCov</code>. (This is used for some of the <code>*.predict.tdt</code> fields.)</li>
<li><code>Variable</code>. Whether the parameter is variable (“TRUE”) or fixed (“FALSE”) in the set of <code>*.settings</code> files being parsed.</li>
<li><code>Assemblies</code>. Each assembly (the <code>*</code> in <code>*.settings</code>) will get its own field containing the actual value used for that parameter in that assembly.</li>
</ul>
<p><strong>NOTE:</strong> The files coming off SMRT Portal have some undesirable non-unicode characters in them. These are hopefully stripped by <code>SMRTSCAPE</code> but it is possible that some parameters may not be correctly parsed.</p>
<h3 id="paramlist">ParamList</h3>
<p>It is possible to parse a selected subset of parameters using <code>paramlist=LIST</code>. (This is easiest where <code>LIST</code> is a text file with one parameter per line.) This should be a list of the full parameter name, <em>i.e.</em> the content of the <code>Setting</code> field.</p>
<pre><code>[ ] : Add the recommended list of parameters here.</code></pre>
<h2 id="predictingassemblycoveragepredictt">Predicting assembly coverage (Predict=T)</h2>
<p>This function predicts coverage from parsed assembly parameters and compares to pre-assembly subreads if possible. Its primary function is to check that the parameter settings from <code>calculate=T</code> are working as expected (at least in terms of preassembly generation) and to tweak the <code>mapefficiency=X</code> option if required. Where a reference is available, it can also be used to test the make <code>SRMTSCAPE</code> calculations in terms of coverage <em>etc.</em></p>
<p><code>Predict</code> uses data from the <code>summarise=T</code> and <code>parseparam=FILES</code> functions. (These will be run if required.) As such, it requires the original subread data (<code>seqin=FILE</code>) and the list of <code>*.settings</code> files that identifies the assemblies. (See <code>ParseParam=FILES</code>.) Pre-assembly <code>*.preassembly.fasta</code> files should match the <code>*.settings</code> files. (The file looked for will be identified as a <code>#PREX</code> log entry.)</p>
<p>If it already exists, the <code>*.predict.tdt</code> will be loaded and updated. Otherwise a new <code>*.predict.tdt</code> file will be created. (See below.) <code>Predict</code> first loads in the relevant data and assembly parameters (see output) before calculating expected coverage from subread data and observed coverage from preassembly data.</p>
<h2 id="predictoutput">Predict output</h2>
<p>The output of <code>Predict</code> mode is a <code>*.predict.tdt</code> output file with the following fields:</p>
<ul>
<li><code>Assembly</code> = The assembly base filename for a given file in <code>parseparam=FILES</code>.</li>
<li><code>minSubReadLength</code> = parsed <code>p_filter.minSubReadLength</code> setting.</li>
<li><code>readScore</code> = parsed <code>p_filter.readScore</code> setting.</li>
<li><code>minLongReadLength</code> = parsed <code>p_preassemblerdagcon.minLongReadLength</code> setting.</li>
<li><code>minCorCov</code> = parsed <code>p_preassemblerdagcon.minCorCov</code> setting.</li>
<li><code>ovlErrorRate</code> = parsed <code>p_assembleunitig.ovlErrorRate</code> setting.</li>
<li><code>SeedX</code> = mean depth of coverage for seed reads given seed length and min RQ score.</li>
<li><code>AnchorX</code> = mean depth of coverage for anchor reads given seed length and min RQ score.</li>
<li><code>SeedMinX</code> = minimum depth of coverage of <em>unique</em> seed reads to achieve <code>XCovLimit</code> (see <code>calculate=T</code>.</li>
<li><code>AnchorMinX</code> = minimum depth of coverage of <em>unique</em> anchor reads to achieve <code>XCovLimit</code> (see <code>calculate=T</code>.</li>
<li><code>PreCov</code> = predicted base coverage of pre-assembly.</li>
<li><code>CorPreCov</code> = corrected predicted base coverage of pre-assembly given <code>mapefficiency=X</code>.</li>
<li><code>PreX</code> = average depth of coverage of <code>*.preassembly.fasta</code> sequences, given <code>genomesize</code>.</li>
<li><code>PreMinX</code> = minimum depth of coverage of <code>*.preassembly.fasta</code> sequences to achieve <code>XCovLimit</code> (see <code>calculate=T</code>.</li>
<li><code>PreMapEfficiency</code> = <code>PreX</code> / <code>SeedX</code> as an estimate of the loss of seed sequence during the preassembly mapping phase. Ideally, this should be close to the <code>mapefficiency=X</code> setting. (NOTE: SMRTSCAPE has not undergone extensive testing of this assumption.</li>
</ul>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-29458568062337174502015-12-10T11:00:00.001+11:002017-09-06T16:39:56.802+10:00BioInfoSummer2015 SLiMSuite Workshop<blockquote><p>Dr Richard Edwards, University of New South Wales<br>Thursday 10<sup>th</sup> December 2015</p></blockquote>
<h2>Session outline</h2>
<a href="https://www.dropbox.com/s/mc9kqp28vbvyylq/2015-12-10.BIS15.SLiMSuite.pptx?dl=0" imageanchor="1" ><i>Click for slides</i></a>.
<a href="https://www.dropbox.com/s/mc9kqp28vbvyylq/2015-12-10.BIS15.SLiMSuite.pptx?dl=0" imageanchor="1" ><img border="1" src="https://2.bp.blogspot.com/-eN-GLAaVOcM/VmipKUGqUOI/AAAAAAAAWPI/Dtbn0XGZbsw/s320/2015-12-10.BIS15.SLiMSuite.jpg" align="right"></a><h3>Part I: Theory</h3>
<ul>
<li>Introduction to workshop</li>
<li>What are SLiMs?</li>
<li>What is SLiMSuite</li>
</ul>
<h3>Part II: Practice</h3>
<ul>
<li>Installing/running SLiMSuite</li>
<li>Data types and main input formats</li>
<li>Motif discovery using the SLiMSuite REST Servers</li>
<li>Motif discovery using the SLiMScape app for Cytoscape</li>
</ul>
<h2>Additional help and documentation</h2>
<p>General information about SLiMs and motif discovery can be found in the literature. Some good places to start are the recent <a href="http://www.ncbi.nlm.nih.gov/pubmed/26615199">ELM 2016</a> paper and our <a href="http://edwardslab.blogspot.com.au/2015/01/computational-prediction-of-short.html">2015 Methods in Molecular Biology review</a> as well as the <a href="http://edwardslab.blogspot.com.au/2015/08/slimscape-3x-cytoscape-3-app-for.html">SLiMScape app paper</a>:</p>
<ul>
<li><a href="http://docs.slimsuite.unsw.edu.au/papers/edwards_palopoli_2015.pdf">Motif discovery review paper (PDF)</a></li>
<li><a href="https://f1000research.com/articles/4-477/v1/pdf">SLiMScape app paper (PDF)</a></li>
<li><a href="https://github.com/slimsuite/SLiMSuite/blob/master/docs/manuals/SLiMFinder%20Manual.pdf">SLiMFinder manual (PDF)</a></li>
<li><a href="https://github.com/slimsuite/SLiMSuite/blob/master/docs/manuals/SLiMProb%20Manual.pdf">SLiMProb manual (PDF)</a></li>
<li><a href="https://github.com/slimsuite/SLiMSuite/blob/master/docs/manuals/CompariMotif%20Manual.pdf">CompariMotif manual (PDF)</a></li>
</ul>
<p>For information about SLiMSuite, please visit the <a href="http://www.slimsuite.unsw.edu.au">EdwardsLab webpage</a> and the <a href="http://slimsuite.blogspot.com/">SLiMSuite blog</a>. Help and documentation for the REST servers can also be found at the <a href="http://rest.slimsuite.unsw.edu.au/restcmd">REST homepage</a>. If in doubt, please email: <code>richard.edwards@unsw.edu.au</code>.</p>
<p>Several <a href="http://edwardslab.blogspot.com.au/p/publications.html">EdwardsLab publications</a> also cover motifs and SLiMSuite tools.</p>
<h2 id="installingrunningslimsuite">Installing/Running SLiMSuite</h2>
<p><strong>NOTE:</strong> For this workshop, you do not need to install SLiMSuite. You will need <a href="http://www.cytoscape.org/download.php">Cytoscape</a> and the <a href="http://apps.cytoscape.org/apps/slimscape">SLiMScape app</a> for the later parts.</p>
<a href="https://github.com/slimsuite/SLiMSuite/releases/download/v1.1.0/slimsuite.2015-11-30.tgz" ><img border="0" src="https://2.bp.blogspot.com/-ESRr4JnoYao/VWQ4hfnPhSI/AAAAAAAAVqQ/ydf8R1QwFSo/s150/button-download.png" align="left" style="margin-right:10px"></a>
<a href="https://github.com/slimsuite/SLiMSuite" ><img border="0" src="https://3.bp.blogspot.com/-2rirZPz4Tdc/VWv8RDJvm4I/AAAAAAAAVsc/TSZhCv2du-s/s150/button-github-logo.jpg" align="right" style="margin-left:10px"></a>
<hr style="height:0pt; visibility:hidden;" />
<p>The current SLiMSuite release is <code><a href="http://slimsuite.blogspot.com.au/2015/12/slimsuite-release-v110-2015-11-30-online.html">2015-11-30</a></code> and can be downloaded by clicking the button (left).</p>
<p>In addition to the <a href="https://github.com/slimsuite/SLiMSuite/releases/download/v1.1.0/slimsuite.2015-11-30.tgz">tarball</a> available via the links above, SLiMSuite is now available as a <a href="https://github.com/slimsuite/SLiMSuite">GitHub repository</a> (right).</p>
<p><strong>See also:</strong> <a href="http://slimsuite.blogspot.com.au/2013/08/availability-installation-and-setup.html">Installation and Setup</a>.</p>
<p>For this workshop, we will primarily be running the tools (and looking at pre-generated results) via the online servers:</p>
<a href="http://www.slimsuite.unsw.edu.au/servers.php" imageanchor="1" ><img border="0" src="https://3.bp.blogspot.com/-71X9Z_hbyL4/VmivKlBF_OI/AAAAAAAAWPY/37eGRZjS6fw/s600/EdwardsLab.Servers.png" align="center"></a>
<h2 id="datatypesandmaininputformats">Data types and main input formats</h2>
<p>From a computer science perspective, input and output for SLiMSuite is just plain ASCII text. This makes it easy to plug SLiMSuite into existing scripts and pipelines - and manually view/edit any input or output files if required. However, “plain text” is not very informative, and SLiMSuite actually deals with a lot of different formats of plain text (from a “human formatting” rather than “file type” point of view). The documentation is currently in the process of being updated to better reflect these formats but some commandline options will still simply list <code>FILE</code>, <code>FILES</code> or <code>FILELIST</code> as input parameters: see the accompanying descriptions to see what format these should be. Ask if it’s not clear! (File format documentation will also be added to the SLiMSuite blog, so check there.)</p>
<p>Within SLiMSuite, each file type has a distinct “file extension” that denotes the file type. Note that these are not enforced for input, although some programs may not always recognise the right format if a different extension is used. If you get odd input behaviour/errors that you do not understand, see if changing the file extensions helps. If you want a common file extension to be auto-recognised, let me know and I might be able to add it. SLiMSuite file extensions will not necessarily be recognised by other programs. <strong>NOTE:</strong> Operating systems will sometimes hide file extensions by default. If you are getting very confused, or have problems of extra <code>*.txt</code> extensions on everything, try changing the system settings. (And/or becoming familiar with command-line file manipulation.)</p>
<p>The main input formats for SLiM discovery are:</p>
<ul>
<li>A source of protein sequence data. This could be a protein <a href="http://slimsuite.blogspot.com.au/2015/10/file-format-fasta-seqfile-fasfile.html">FASTA file</a>, a <a href="http://web.expasy.org/docs/userman.html#entrystruc">Uniprot plain text</a> file, or a list of <a href="http://www.uniprot.org/help/accession_numbers">Uniprot accession numbers</a> to download. For some tools, a single Uniprot accession number will work.</li>
<li>A source of motif (regular expression) definitions. This is only required if looking for known (or other pre-defined) motifs and/or wanting to compare a set of de novo predictions with known motifs. A number of different formats are accepted for motif input, including SLiMFinder (summary) results and ELM downloads. The simplest/easiest is a plain text file of regular expressions. For more on motif regular expression formats, please see <a href="http://docs.slimsuite.unsw.edu.au/papers/edwards_palopoli_2015.pdf">Edwards and Palopoli 2015</a>.</li>
</ul>
<!-- style>
h3{margin-top:1em;border-top:1px dotted;}
</style -->
<h2>Common motif discovery tasks</h2>
<p>Jobs can be run and retrieved at: <a href="http://www.slimsuite.unsw.edu.au/servers.php">http://www.slimsuite.unsw.edu.au/servers.php</a>. (This is a bit easier than making the URL directly, although this is also an option as we will see.)</p>
<p>
<i><strong>NOTE:</strong> Some of the jobs take a while to run and the SLiMSuite servers have limited resources. It would therefore be useful if you could click on the example JobID links rather than trying to run every example REST command yourself. The first output tab (and the log tab) will show you the run times for that job, so you can see which jobs are fast or slow before you experiment.</i>
</p>
<hr width="80%">
<h3>Task 1: Find known SLiMs in a protein (ELM/SLiMProb)</h3>
<p><strong>ELM.</strong> Visit <a href="http://www.elm.eu.org/">http://http://www.elm.eu.org/</a> and enter your protein of choice as Uniprot identifier or accession number in the box. (Identifiers will auto-complete and fill in some extra details.) For non-Uniprot protein sequences, you can also enter fasta format.</p>
<p>Try this now with <a href="http://www.uniprot.org/uniprot/P03070">P03070 (LT_SV40)</a> or <a href="http://www.uniprot.org/uniprot/P03254">P03254 (E1A_ADE02)</a>. Each of them should have a True Positive <a href="http://elm.eu.org/elms/LIG_Rb_LxCxE_1.html">LIG_Rb_LxCxE_1</a> motif.</p>
<p><strong>SLiMProb.</strong> We can do a similar search using the <code>SLiMProb</code> <a href="http://rest.slimsuite.unsw.edu.au/slimprob">REST server</a> (paste the contents of the grey box onto the end of the <code>http://rest.slimsuite.unsw.edu.au/</code> URL):</p>
<pre><code>slimprob&uniprotid=E1A_ADE02&motifs=elm
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120800029"><code>15120800029</code></a></p>
<p><strong>NOTE:</strong> The ELM <a href="http://rest.slimsuite.unsw.edu.au/alias">alias</a> currently searches the 2015 ELM classes.</p>
<hr width="80%">
<h3>Task 2: Find custom SLiMS in a protein (SLiMProb)</h3>
<pre><code>slimprob&uniprotid=E1A_ADE02&motifs=LxCxE,PxDLS
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120800031"><code>15120800031</code></a></p>
<hr width="80%">
<h3>Task 3: Finding proteome-wide occurrence of a motif using Bioware (SLiMSearch)</h3>
<p>The SLiMSearch server is accessible at: <a href="http://slim.ucd.ie/slimsearch/">http://slim.ucd.ie/slimsearch/</a>. This has been recently updated to Version 4 and now brings in a lot of information, so it is recommended that you <a href="http://slim.ucd.ie/slimsearch/index.php?page=help">read the Help pages</a> for the server.</p>
<p>Example (LIG_CtBP_PxDLS_1): <a href="http://slim.ucd.ie/rest/#/slimsearch/annotations?jobId=7R8Tvssm9HEdjWW7jQsgEHUfP0VlHdR6">http://slim.ucd.ie/rest/#/slimsearch/annotations?jobId=7R8Tvssm9HEdjWW7jQsgEHUfP0VlHdR6</a></p>
<p>Human protein PRDM16 is particularly interesting: it does not have an annotated ELM but does match a region annotated to interact with CTBP1. (See the <b>Region</b> column - <b>Expand</b> the instance <b><a href="http://slim.ucd.ie/slimsearch/index.php?page=help#instancesAnnotations">Feature annotations</a></b> for a clearer look.) This kind of search can be a good way of identifying new instances of known motifs - some of which may be in the literature but may not have yet made it into database annotation.</p>
<p>The ELM definition for this motif <code>P[LVIPME][DENS][LM][VASTRG]</code> is very degenerate with a lot of hits - over-prediction is a <em>big</em> problem in motif discovery. We can try to make the definition a little tighter as the expense of some instances, using another tool called SLiMMaker:</p>
<pre><code>slimmaker&peptides=LIG_CtBP_PxDLS_1&iterate=T&align=F&minfreq=0.67&minseq=2
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120600004"><code>15120600004</code></a></p>
<p>Repeating the SLiMSearch analysis with the redefined motif (<code>P[EILMV][DN]L[ARST]</code>) gives a greater density of known ELMs (see the <b>Motif</b> column) in the top ranked motifs: <a href="http://slim.ucd.ie/rest/#/slimsearch/annotations?jobId=L41BRpXQ1oTD6ByDuUSqjWbQZ22WBKbw">http://slim.ucd.ie/rest/#/slimsearch/annotations?jobId=L41BRpXQ1oTD6ByDuUSqjWbQZ22WBKbw</a>.</p>
<hr width="80%">
<h3>Task 4: Predicting novel SLiMs <em>de novo</em> in a set of proteins (SLiMFinder)</h3>
<p>SLiMFinder is designed to look for convergently evolved motifs that are shared between unrelated proteins. For example, we can look at the proteins known (in ELM) to contain the <code>LIG_PCNA_PIPBox_1</code>. As SLiMs are generally in disordered regions, we will switch disorder masking on with <code>dismask=T</code>, which uses IUPred to predict globular regions, which are masked out:</p>
<pre><code>slimfinder&uniprotid=LIG_PCNA_PIPBox_1&dismask=T
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120800001"><code>15120800001</code></a></p>
<p>(We will look at the UPC and motif cloud output among others.)</p>
<hr width="80%">
<h3>Task 5: Identifying known motifs from <em>de novo</em> predictions (CompariMotif)</h3>
<p>When you have a lot of motif predictions, it can be tiresome and error-prone to manually scan them for things that look familiar. SLiMSuite has a tool called <a href="http://rest.slimsuite.unsw.edu.au/comparimotif">CompariMotif</a>, which compares sets of motifs for similarity.</p>
<p>The comparimotif server can take motif files/lists (like <a href="http://rest.slimsuite.unsw.edu.au/slimprob">SLiMProb</a> or SLiMFinder output directly. These are given to the <code>&motifs</code> and/or <code>&searchdb</code> options: if no <code>&searchdb</code> is given then the input motifs are searched against themselves. (This can be useful if clouding goes a bit wrong.)</p>
<p>To pass the output of one server to another, use the format: <code>&cmd=jobid:XXXXXX:OUTFMT</code>, where <code>XXXXXX</code> is the Job ID and <code>OUTFMT</code> is the desired output format. E.g.:</p>
<pre><code>comparimotif&motifs=jobid:15120800001:main&searchdb=LIG_PCNA_PIPBox_1
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900004"><code>15120900004</code></a></p>
<p>The server is currently in development so output is not sorted usefully yet. This is more of a problem if searching against many SLiMs:</p>
<pre><code>comparimotif&motifs=jobid:15120800001:main&searchdb=elm
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900005"><code>15120900005</code></a></p>
<p>The best advice is to save the <code>compare</code> output table (<code>retrieve&jobid=15120900005&outfmt=compare</code>), open it up in Excel and sort on <code>Score</code>. Alternatively, use the CompariMotif server at <a href="http://bioware.ucd.ie">http://bioware.ucd.ie</a>.</p>
<hr width="80%">
<h3>Task 6: SLiM prediction with conservation masking (SLiMFinder)</h3>
<p>Masking is important as it reduces the search space. It can also reduce the signal if it incorrectly masks some true positives but for larger datasets the reduction in "noise" can be more important. As well as <code>dismask=T/F</code> there are several other masking options in SLiMSuite:</p>
<ul>
<li>low complexity masking (<code>ON</code> by default)</li>
<li>N-terminal methionines (<code>ON</code> by default)</li>
<li>conservation-based masking (<code>OFF</code> by default)</li>
<li>Uniprot feature masking (<code>OFF</code> by default)</li>
<li>Motif masking (<code>OFF</code> by default)</li>
</ul>
<p>For custom sequence input, there is also the option for custom masking based on upper/lower case. For now, we will just look at conservation masking, as this has been shown to improve sensitivity in PPI data. For example, a 2013 compilation of CTBP1 interactors does not yield a significant motif:</p>
<pre><code>slimfinder&uniprotid=CTBP1&dismask=T&runid=CtBP1-DisMask
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900002"><code>15120900002</code></a></p>
<p>But if <code>consmask=T</code> is also switched on:</p>
<pre><code>slimfinder&uniprotid=CTBP1&dismask=T&consmask=T&runid=CtBP1-ConsMask
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900003"><code>15120900003</code></a></p>
<h4>The importance of correcting for evolutionary relationships</h4>
<p>The UPC correction can be switched off with <code>efilter=F</code>. Many motif prediction tools calculate estimated expectations without such correction. This can result is massive biases due to shared evolutionary history, which swamp any convergent SLiM evolution signal, for example with the <code>LIG_CtBP_PxDLS_1</code> ELM proteins:</p>
<pre><code>slimfinder&uniprotid=LIG_CtBP_PxDLS_1&dismask=T&runid=CtBP-NoEFilter&efilter=F
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120800036"><code>15120800036</code></a></p>
<hr width="80%">
<h3>Task 7: Look for enrichment or depletion of motifs in a set of proteins (SLiMProb)</h3>
<p>We can investigate why the PxDLS motif did not come back with just disorder masking by looking at its enrichment using SLiMProb. When given multiple proteins, SLiMProb will use the same UPC correction as SLiMFinder but also return statistics without UPC correction and simply treating all the sequences as one giant sequence. It can, for example, be used to investigate different definitions of a motif:</p>
<pre><code>slimprob&uniprotid=CTBP1&dismask=T&runid=CtBP1-DisMask&motifs=PxDLS,P[LVIPME][DENS][LM][VASTRG],Px[DE][LM][ST]
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900016"><code>15120900016</code></a></p>
<p>In this case, we can see that even though the "true" motif has the most support, it is also expected to occur more by chance. It is enriched, but not enough to survive the multiple testing correction of SLiMChance.</p>
<p>Though not of interest here, the <code>pUnd</code> statistics can be used to look for depletion/avoidance of a particular motif in a dataset.</p>
<hr width="80%">
<h3>Task 8: Find novel motifs from a conservation pattern (SLiMPrints)</h3>
<p>Patterns of evolutionary conservation can also be used to directly identify regions of proteins that look like motifs. The tool we have developed for this is called <a href="http://edwardslab.blogspot.com.au/2012/09/slimprints-conservation-based-discovery.html">SLiMPrints</a>, which can be run at the <a href="http://bioware.ucd.ie/~compass/biowareweb/Server_pages/slimprints.php">Bioware SLiMPrints server</a>. For example, we can look for motif-like regions in one of the CtBP PPI partners, FOG1_HUMAN (Q8IX07): <a href="http://bioware.ucd.ie/~compass/biowareweb/cgi-bin/PHP_helper_files/slimprintsInfo.php?jobId=e7GZLf">http://bioware.ucd.ie/~compass/biowareweb/cgi-bin/PHP_helper_files/slimprintsInfo.php?jobId=e7GZLf</a></p>
<p>This protein has a bunch of significant motif-like regions, including the PxDLS motif region at rank 7: <a href="http://bioware.ucd.ie/~proviz/ProViz/alignmentViewer/drawer.php?uniprotid=Q8IX07&slim=GPIDL&slimpos=793&column=794.5&width=80&collapse=false">http://bioware.ucd.ie/~proviz/ProViz/alignmentViewer/drawer.php?uniprotid=Q8IX07&slim=GPIDL&slimpos=793&column=794.5&width=80&collapse=false</a></p>
<p>(Note how the precise motif is rarely returned by <em>de novo</em> predictors.)</p>
<hr width="80%">
<h3>Task 9: Using the SLiMScape app to visualise a server job</h3>
<p>We're now going to fire up <a href="http://cytoscape.org/">Cytoscape</a> and have a quick look at the <a href="http://apps.cytoscape.org/apps/slimscape">SLiMScape app</a>. This is fairly well described <a href="https://f1000research.com/articles/4-477/v1/pdf">in the paper</a>, so we will just look at the main ways to run the server. If you've not used Cytoscape before, you'll want to visit the <a href="http://cytoscape.org/">Cytoscape website</a> and watch the introduction video, before installing it.</p>
<p>The simplest is to retrieve an existing run:</p>
<ol>
<li>In the SLiMFinder tab, enter <code>15120900003</code> in the Run ID box and hit Retrieve.</li>
<li>Apply the default layout.</li>
<li>Explore the results. Connections are UPC relationships in the data.</li>
</ol>
<hr width="80%">
<h3>Task 10: Running QSLiMFinder through SLiMScape</h3>
<p>Now let's imagine we had seen the SLiMPrints results from above for FOG1_HUMAN and knew that it interacted with CtBP1. We could ask the specific question if any motifs in FOG1_HUMAN were enriched in the rest of the PPI dataset. We do this by using <strong>QSLiMFinder</strong> and giving <code>Q8IX07</code> as the query. (<code>&query=Q8IX07</code> on the server.)</p>
<p>First, add a node to the network and change its name to <code>Q8IX07</code>. Enter this in the <strong>Query Sequence</strong> box then highlight all of the nodes before hitting <code>Run QSLiMFinder</code>:</p>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900007"><code>15120900007</code></a></p>
<p>This is the essence of molecular mimicry and we could use the same approach to see if E1A_ADE02 shares any motifs by adding <code>P03254</code> and using it as a query:</p>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900008"><code>15120900008</code></a></p>
<hr width="80%">
<h3>Task 11: Building PPI networks for analysis</h3>
<p>The most useful thing of having access to SLiMSuite through Cytoscape is to be able to use it to explore PPI networks and select nodes for analysis. There are in-built tools to get PPI data into Cytoscape. For SLiMSuite, the ID must be a Uniprot ID or accession number, or a Node must have "Uniprot" attribute.</p>
<p>The SLiMSuite REST server also provides some methods for getting PPI data into Cytoscape (and/or for use on the server), using the <a href="http://rest.slimsuite.unsw.edu.au/pingu">PINGU</a> server. This is still under development and so the documentation of the available PPI data is currently limited, but just get in touch if you want to use it. (Currently human only.)</p>
<p>PPI data is retrieved by entering one or more gene symbols as a <code>&hublist</code>, optionally along with a <code>&ppisource</code> (see the <a href="http://rest.slimsuite.unsw.edu.au/alias&ppisource">ppisource alias</a>):</p>
<pre><code>pingu&hublist=CTBP1,CTBP2&ppisource=intact
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900009"><code>15120900009</code></a></p>
<p>This can be used directly for <code>&uniprotid</code> input using the <code>&rest=uniprot</code> output:</p>
<pre><code>slimfinder&uniprotid=jobid:15120900009:uniprot&dismask=T&consmask=T&runid=CtBP1and2
</code></pre>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900011"><code>15120900011</code></a></p>
<p>Alternatively, the PPI data can be imported into Cytoscape using the <code>pairwise</code> table:</p>
<ol>
<li>Start a new session. (Later you can workout how to import and merge networks.)</li>
<li>Import network from URL: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900009&rest=pairwise">http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900009&rest=pairwise</a></li>
<li>Rename the <code>HubUni</code> and <code>SpokeUni</code> fields to <code>name</code> and attribute them to <code>Source Node</code> and <code>Target Node</code> attributes. Make <code>Hub</code> the <code>Source</code>, <code>Spoke</code> the <code>Target</code> and <code>Evidence</code> the <code>Interaction Type</code> then import.</li>
<li>Select the nodes that are shared interactors of both CtBP proteins.</li>
<li>Modify the masking settings to include disorder, conservation and feature masking.</li>
<li>Hit <strong>Run</strong>:</li>
</ol>
<p>JobID: <a href="http://rest.slimsuite.unsw.edu.au/retrieve&jobid=15120900013"><code>15120900013</code></a></p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com2tag:blogger.com,1999:blog-8061067497593584060.post-88047766529382397362015-12-07T12:36:00.000+11:002015-12-07T12:37:08.294+11:00New SLiMSuite REST Servers<p><a href="http://www.slimsuite.unsw.edu.au/servers.php" ><img border="0" src="http://3.bp.blogspot.com/-X_dfhrjkbAI/VWv3eXO670I/AAAAAAAAVsI/-6sUORw6uEs/s150/button-software.jpg" align="right" style="margin-left:10px"/></a>Since the move to UNSW in 2013, the <a href="http://bioware.ucd.ie">Bioware SLiMSuite servers</a> and <a href="http://bioware.ucd.ie/~compass/biowareweb/Server_pages/api.php">REST servers</a> have been undergoing some much needed TLC. As part of this process, a new set of <a href="http://rest.slimsuite.unsw.edu.au/">UNSW REST servers</a> were introduced and online with the <a href="http://slimsuite.blogspot.com.au/2015/06/slimsuite-release-2015-06-01-now.html">2015-06-01 SLiMSuite release</a>.</p>
<p>An overview of how the REST servers work is given on the <a href="http://rest.slimsuite.unsw.edu.au/restcmd">REST Homepage</a>. The available tools are listed at the <a href="http://rest.slimsuite.unsw.edu.au/tools">REST Tools page</a>. The main ones - accessible through the <a href="http://edwardslab.blogspot.co.uk/2015/08/slimscape-3x-cytoscape-3-app-for.html">SLiMScape app for Cytoscape</a> are (or support):</p>
<ul>
<li><a href="http://rest.slimsuite.unsw.edu.au/slimfinder">SLiMFinder</a> <em>de novo</em> SLiM discovery.</li>
<li><a href="http://rest.slimsuite.unsw.edu.au/qslimfinder">QSLiMFinder</a> query-focused <em>de novo</em> SLiM discovery.</li>
<li><a href="http://rest.slimsuite.unsw.edu.au/slimprob">SLiMProb</a> defined/known SLiM prediction.</li>
<li><a href="http://rest.slimsuite.unsw.edu.au/slimmaker">SLiMMaker</a> Simple Regex SLiM generation from peptides.</li>
</ul>
<p>The primary focus has been setting up new servers to be accessed via a RESTful-style interface whereby a URL can be directly given to the server and used to either download results directly (if accessing programmatically) or view in a web browser. As with the main programs, these servers use plain text inputs and outputs wherever. Whilst this probably makes proper computer scientists very unhappy, it should make it very easy to <a href="http://rest.slimsuite.unsw.edu.au/docs&page=API">incorporate SLiMSuite REST functions into your own scripts</a> - you only need to learn how to parse text. (It also makes it easy for me to swap input sources.) If you don’t want to write your own, <a href="http://rest.slimsuite.unsw.edu.au/slimparser">SLiMParser</a> is provided in the <a href="http://slimsuite.blogspot.com.au/2015/05/slimsuite-downloads.html">SLiMSuite download</a> to do this for you.</p>
<p>The other design consideration that has gone into the REST servers is to make them run as much like the commandline versions as possible: (1) they use the same code; (2) they use the same <a href="http://slimsuite.blogspot.com.au/2013/08/command-line-options.html">commandline options</a>, parsed from the URL. This means that (a) you should easily be able to reproduce server results on your own system, and (b) new functions (and bug fixes) should become quickly available via the REST servers.</p>
<p>To save the need for constructing complex URLs, there is a simple on-size-fits-all form at the <a href="http://www.slimsuite.unsw.edu.au/servers.php">EdwardsLab server page</a>. Over time, tool-specific forms will be established. Currently, this only exists for <a href="http://www.slimsuite.unsw.edu.au/servers/slimmaker.php">SLiMMaker</a>.</p>
<a href="http://www.slimsuite.unsw.edu.au/servers.php" imageanchor="1" ><img border="0" src="http://4.bp.blogspot.com/-Ag6RExtS1lA/VmTiHpQbmAI/AAAAAAAAWO4/6cOkmI5DsHA/s600/EdwardsLab.Servers.png" /></a>
<p>As ever, if something about the new servers misbehaves or does not make sense - or you really want some new functions - please get in touch.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-60839209191401354762015-11-30T11:52:00.000+11:002015-12-07T11:52:37.860+11:00SLiMSuite release v1.1.0 (2015-11-30) online<p>The November 2015 release of SLiMSuite <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.1.0"><code>v1.1.0</code></a> (<code>2015-11-30</code>) in <a href="https://github.com/slimsuite/SLiMSuite/releases/tag/v1.1.0">now on GitHub</a>. This is intermediate release in preparation for the BioInfoSummer 2015 SLiMSuite workshop and contains a few minor modifications to SLiMSuite programs. The main updates are preliminary versions of some tools for PacBio genomics, notably <code>PAGSAT</code> and <code>SMRTSCAPE</code>. These are still in development and need further documentation and testing before use is advised.</p>
<p>The <code>SeqSuite</code> <code>Genbank</code> parser has some bug fixes for reverse complemented protein sequences with introns, and initial capacity for different codon tables. (This has been implemented for yeast, so only NCBI transl_tables 1-3 currently implemented: please get in touch if you want to use this program with other codon tables.)</p>
<h2>SLiMSuite updates in this release</h2>
<h3>Updates in libraries/:</h3>
<p><b>• rje:</b> <i>Updated from Version 4.14.0.</i>
<br>→ Version 4.14.1: Fixed matchExp method to be able to handline multilines. (Shame re.DOTALL doesn’t work!)
<br>→ Version 4.14.2: Modified integer commands to read/convert floats.
<br>→ Version 4.15.0: Added intList() and numList() functions.
</p>
<p><b>• rje_db:</b> <i>Updated from Version 1.7.5.</i>
<br>→ Version 1.7.6: Added table.opt[‘Formatted’] = Whether table data has been successfully formatted using self.dataFormat()
<br>→ Version 1.7.7: Added option to constrain table splitting to certain field values.
<br>→ Version 1.8.0: Added option to store keys as tuples for correct sorting. (Make default at some point.)
</p>
<p><b>• rje_genbank:</b> <i>Updated from Version 1.3.1.</i>
<br>→ Version 1.3.2: Fixed bug in reverse complement sequences with introns.
</p>
<p><b>• rje_iridis:</b> <i>Updated from Version 1.10.</i>
<br>→ Version 1.10.1: Attempted to fix SLiMFarmer batch run problem. (Should not be setting irun=batch!)
<br>→ Version 1.10.2: Trying to clean up unknown 30s pause. Might be freemem issue?
</p>
<p><b>• rje_obj:</b> <i>Updated from Version 2.1.2.</i>
<br>→ Version 2.1.3: Modified integer commands to read/convert floats.
</p>
<p><b>• rje_qsub:</b> <i>Updated from Version 1.6.2.</i>
<br>→ Version 1.6.3: Tweaked the showstart command for katana.
</p>
<p><b>• rje_samtools:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 0.1.0: Modified version to handle multiple loci per file. (Original was for single bacterial chromosomes.)
</p>
<p><b>• rje_seqlist:</b> <i>Updated from Version 1.11.0.</i>
<br>→ Version 1.12.0: Added peptides/qregion reformatting and region=X,Y.
<br>→ Version 1.13.0: Added summarise=T option for generating some summary statistics for sequence data. Added minlen & maxlen.
<br>→ Version 1.14.0: Added splitseq=X split output sequence file according to X (gene/species) [None]
<br>→ Version 1.15.0: Added names() method.
<br>→ Version 1.15.1: Fixed bug with storage and return of summary stats.
<br>→ Version 1.15.2: Fixed dna2prot reformatting.
<br>→ Version 1.15.3: Fixed summarise bug (n=1).
</p>
<p><b>• rje_sequence:</b> <i>Updated from Version 2.4.1.</i>
<br>→ Version 2.5.0: Added yeast genome renaming.
<br>→ Version 2.5.1: Modified reverse complement code.
<br>→ Version 2.5.2: Tried to speed up dna2prot code.
</p>
<p><b>• rje_slimcalc:</b> <i>Updated from Version 0.9.</i>
<br>→ Version 0.9.1: Modified combining of motif stats to handle expectString format for individual values.
<br>→ Version 0.9.2: Changed default conscore in docstring to RLC.
</p>
<p><b>• rje_slimcore:</b> <i>Updated from Version 2.7.3.</i>
<br>→ Version 2.7.4: Fixed walltime server bug.
<br>→ Version 2.7.5: Fixed feature masking.
</p>
<p><b>• rje_slimlist:</b> <i>Updated from Version 1.7.2.</i>
<br>→ Version 1.7.3: Fixed bug that could not accept variable length motifs from commandline. Improved error message.
</p>
<p><b>• rje_taxonomy:</b> <i>Updated from Version 1.0.</i>
<br>→ Version 1.1.0: Added parsing of yeast strains.
</p>
<p><b>• rje_tree:</b> <i>Updated from Version 2.11.2.</i>
<br>→ Version 2.12.0: Added treeLen() method.
<br>→ Version 2.13.0: Updated PNG saving with R to use newer code.
</p>
<p><b>• rje_uniprot:</b> <i>Updated from Version 3.21.3.</i>
<br>→ Version 3.21.4: Fixed Feature masking. Should this be switched off by default?
</p>
<p><b>• rje_xref:</b> <i>Updated from Version 1.6.0.</i>
<br>→ Version 1.7.0: Added comments=LIST ist of comment line prefixes marking lines to ignore (throughout file) [‘//’,’%’]
<br>→ Version 1.7.1: Added xreformat=T/F : Whether to apply field reformatting to input xrefdata (True) or just xrefs to map (False) [False]
<br>→ Version 1.8.0: Added recognition and parsing of yeast.txt XRef file from Uniprot (http://www.uniprot.org/docs/yeast.txt)
</p>
<p><b>• snp_mapper:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation. Batch mode for mapping SNPs needs updating.
<br>→ Version 0.1: SNP mapping against a GenBank file.
<br>→ Version 0.2: Fixed complement strand bug.
<br>→ Version 0.3.0: Updated to work with RATT(/Mummer?) snp output file. Improved docs.
<br>→ Version 0.4.0: Major reworking for easier updates and added functionality. (Convert to 1.0.0 when complete.)
</p>
<h3>Updates in tools/:</h3>
<p><b>• gablam:</b> <i>Updated from Version 2.19.2.</i>
<br>→ Version 2.20.0: Added SNP Table output.
</p>
<p><b>• gopher:</b> <i>Updated from Version 3.4.1.</i>
<br>→ Version 3.4.2: Removed GOPHER System Exit on IOError to prevent breaking of REST server.
</p>
<p><b>• pagsat:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 1.0.0: Initial working version for based on rje_pacbio assessment=T.
<br>→ Version 1.1.0: Fixed bug with gene and protein summary data. Removed gene/protein reciprocal searches. Added compare mode.
<br>→ Version 1.1.1: Added PAGSAT output directory for tidiness!
<br>→ Version 1.1.2: Renamed the PacBio class PAGSAT.
<br>→ Version 1.2.0: Tidied up output directories. Added QV filter and Top Gene/Protein hits output.
<br>→ Version 1.2.1: Added casefilter=T/F : Whether to filter leading/trailing lower case (low QV) sequences [True]
<br>→ Version 1.3.0: Added tophitbuffer=X and initial synteny analysis for keeping best reference hits.
<br>→ Version 1.4.0: Added chrom-v-contig alignment files along with *.ordered.fas.
<br>→ Version 1.4.1: Made default chromalign=T.
<br>→ Version 1.4.2: Fixed casefilter=F.
<br>→ Version 1.5.0: diploid=T/F : Whether to treat assembly as a diploid [False]
<br>→ Version 1.6.0: mincontiglen=X : Minimum contig length to retain in assembly [1000]
<br>→ Version 1.6.1: Added diploid=T/F to R PNG call.
</p>
<p><b>• peptcluster:</b> <i>Updated from Version 1.5.1.</i>
<br>→ Version 1.5.2: Improved clarity of warning message.
</p>
<p><b>• pingu_V4:</b> <i>Updated from Version 4.5.0.</i>
<br>→ Version 4.5.1: Debugging missing identifiers and indexing speed. Added good and bad DB.
<br>→ Version 4.5.2: Fixed SIF output and changed names to sif-* for opening in browser.
<br>→ Version 4.5.3: Updated REST output.
</p>
<p><b>• seqsuite:</b> <i>Updated from Version 1.8.0.</i>
<br>→ Version 1.9.0: Added PAGSAT and SMRTSCAPE.
<br>→ Version 1.9.1: Fixed HAQESAC setobjects=True error.
<br>→ Version 1.10.0: Added batchrun=FILELIST batcharg=X batch running mode.
<br>→ Version 1.11.0: Added SAMTools and Snapper/SNP_Mapper.
</p>
<p><b>• slimbench:</b> <i>Updated from Version 2.10.0.</i>
<br>→ Version 2.10.1: Updated ELM Source URLs.
</p>
<p><b>• slimfarmer:</b> <i>Updated from Version 1.4.2.</i>
<br>→ Version 1.4.3: Added recognition of missing slimsuite programs and switching to slimsuite=F.
</p>
<p><b>• slimfinder:</b> <i>Updated from Version 5.2.0.</i>
<br>→ Version 5.2.1: Fixed ambocc<1 and minocc<1 issue. (Using integers rather than floats.) Fixed OccRes Sig output format.
</p>
<p><b>• slimparser:</b> <i>Updated from Version 0.3.1.</i>
<br>→ Version 0.3.2: Fixed issue reading files for full output.
<br>→ Version 0.3.3: Tidied output names when restbase=jobid.
</p>
<p><b>• slimprob:</b> <i>Updated from Version 2.2.3.</i>
<br>→ Version 2.2.4: Improved slimcalc output (s.f.).
</p>
<p><b>• slimsuite:</b> <i>Updated from Version 1.5.0.</i>
<br>→ Version 1.5.1: Changed disorder to iuscore to avoid module conflict.
</p>
<p><b>• smrtscape:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 1.0.0: Initial working version for server.
<br>→ Version 1.1.0: Added xnlist=LIST : Additional columns giving % sites with coverage >= Xn [10,25,50,100].
<br>→ Version 1.2.0: Added assessment -> now PAGSAT.
<br>→ Version 1.3.0: Added seed and anchor read coverage generator (calculate=T).
<br>→ Version 1.3.1: Deleted assessment function. (Now handled by PAGSAT.)
<br>→ Version 1.4.0: Added new coverage=T function that incorporates seed and anchor subreads.
<br>→ Version 1.5.0: Added parseparam=FILES with paramlist=LIST to parse restricted sets of parameters.
<br>→ Version 1.6.0: New SMRTSCAPE program building on PacBio v1.5.0. Added predict=T/F option.
<br>→ Version 1.6.1: Updated parameters=T to incorporate that the seed read counts as X=1.
<br>→ Version 1.7.0: Added *.summary.tdt output from subread summary analysis. Added minreadlen.
<br>→ Version 1.8.0: preassembly=FILE: Preassembly fasta file to assess/correct over-fragmentation (use seqin=FILE for subreads)
</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-27270466963494955092015-10-07T22:58:00.000+11:002015-12-07T22:59:26.462+11:00File format: FASTA [SEQFILE, FASFILE]<p>One of the most common input and output formats for <code>SLiMSuite</code> is <a href="https://en.wikipedia.org/wiki/FASTA_format">FASTA format</a>, which is a very simple, human-readable sequence format. Despite the simplicity of FASTA, there are many sub-format variants in which the sequence name is formatted with specific information. Many of these will work and be recognised by <code>SLiMSuite</code> programs, but it also has its own favoured subformat, which is preferentially used for input/output.</p>
<p><code>SLiMSuite FASTA</code> format is:</p>
<pre><code>>Gene_SPCODE__AccNum [Description]
SEQUENCE</code></pre>
<p>Where:</p>
<ul>
<li><code>Gene</code> is not used for anything and is purely for easy visual identification.</li>
<li><code>SPCODE</code> is the species code. Where possible, <a href="http://www.uniprot.org/taxonomy/">Uniprot species mnemonics</a> should be used but any short code can be used as long as (a) it contains uppercase letter and numbers only (no symbols), and (b) it is consistently used within a species/database. (i.e. you can make it up as long as all sequences from the same species use the same code.) </li>
<li><code>AccNum</code> is the accession number, which is what is used as the <strong>unique</strong> sequence identifier.</li>
<li><code>Description</code> is optional and can contain any other text.</li>
<li><code>SEQUENCE</code> can be on one or more lines and contain spaces. However, it is best to have a single <code>SEQUENCE</code> line with no whitespace. (Some programs may enforce this.)</li>
</ul>
<p><a href="http://rest.slimsuite.unsw.edu.au/seqsuite"><code>Seqsuite</code></a> can be used to rename and reformat sequences, using the <a href="http://rest.slimsuite.unsw.edu.au/rje_seq"><code>seq</code></a> and <a href="http://rest.slimsuite.unsw.edu.au/seqlist"><code>seqlist</code></a> programs.</p>
<p>Uniprot downloads should be automatically recognised and converted where needed. Genbank files can be converted using the <a href="http://rest.slimsuite.unsw.edu.au/genbank"><code>genbank</code></a> tool of <a href="http://rest.slimsuite.unsw.edu.au/seqsuite"><code>Seqsuite</code></a>. (NB. `V1.3.2` currently only supports the standard Genetic Code.)</p>
<p>Commands of the type <code>cmd=FASFILE</code> and <code>cmd=SEQFILE</code> will recognised FASTA format input. Some other commands (where documented) will also expect FASTA files.</p>
<p>Most <code>SLiMSuite</code> programs (unless otherwise stated) will assume protein sequences are being used. The <code>dna=T</code> flag should be used for DNA or RNA sequences where this will affect behaviour (<em>e.g.</em> the alphabet is important). </p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-18643366093147328942015-10-01T11:11:00.000+10:002017-01-10T15:59:47.866+11:00SLiMSuite data types and file formats<p>SLiMSuite is designed to be a suite of programs that enable you to navigate your way through most of the main motif discovery tasks. Well, I say <i>designed</i> but it would probably be more accurate to say <i>evolved</i>. All the programs within SLiMSuite arose from research needs within the lab. As a result, they are heavily biased to the kind of data that we analyse and data sources that we use. However, it should be fairly easy to get data from other formats and sources into SLiMSuite.</p>
<p>From a computer science perspective, input and output for SLiMSuite is just plain ASCII text. This makes it easy to plug SLiMSuite into existing scripts and pipelines - and manually view/edit any input or output files if required. However, “plain text” is not very informative, and SLiMSuite actually deals with a lot of different formats of plain text (from a “human formatting” rather than “file type” point of view). The documentation is currently in the process of being updated to better reflect these formats but some commandline options will still simply list <code>FILE</code>, <code>FILES</code> or <code>FILELIST</code> as input parameters: see the accompanying descriptions to see what format these should be. Ask if it’s not clear! (File format documentation will also be added to the SLiMSuite blog, so check there.)</p>
<p>Within SLiMSuite, each file type has a distinct “file extension” that denotes the file type. Note that these are not enforced for input, although some programs may not always recognise the right format if a different extension is used. If you get odd input behaviour/errors that you do not understand, see if changing the file extensions helps. If you want a common file extension to be auto-recognised, let me know and I might be able to add it. SLiMSuite file extensions will not necessarily be recognised by other programs. <strong>NOTE:</strong> Operating systems will sometimes hide file extensions by default. If you are getting very confused, or have problems of extra <code>*.txt</code> extensions on everything, try changing the system settings. (And/or becoming familiar with command-line file manipulation.)</p>
<p>The main file types used by SLiMSuite are:</p>
<ul>
<li><code>MOTIFS</code> = A list of SLiM motif patterns. SLiMSuite has its own motif format but a number of other formats will also work when given as input. This includes a plain list of regex patterns, and results tables from other SLiMSuite programs. [<code>*.motifs</code>]</li>
<li><code>ACCLIST</code> = A list of Uniprot accession numbers. [<code>*.acc</code>]</li>
<li><code>SEQFILE</code> = A file containing biological sequences - usually protein sequences. (Some of the non-SLiM programs will use nucleotides sequences.) These can either be in fasta format (see <code>FASFILE</code>) or Uniprot plain text format (see DATFILE). [<code>*.fas</code>, <code>*.dat</code>]</li>
<li><code>FASFILE</code> = A fasta file of (unaligned) protein sequences. [<code>*.fas</code>]</li>
<li><code>DATFILE</code> = Uniprot plain text format [<code>*.dat</code>]</li>
<li><code>ALNFILE</code> = Aligned fasta file [<code>*.aln.fas</code>]</li>
<li><code>DSVFILE</code> = Delimiter separated value text file. The delimiter will be auto-recognised if possible as a tab [<code>*.tdt</code>, <code>*.tsv</code>], comma [<code>*.csv</code>] or whitespace [<code>*.txt</code>], or can be set with <code>delimit=X</code> if not recognised. Note: <code>delimit=X</code> input may not work with every program, so it is safest to use a consistent files name. The <code>delimit=X</code> parameter is more commonly used to control output format.</li>
<li><code>TDTFILE</code> = Tab delimited text file [<code>*.tdt</code>, <code>*.tsv</code>]</li>
<li><code>CSVFILE</code> = Comma separated text file [<code>*.csv</code>]</li>
<li><code>PPIFILE</code> = Delimited text file with <code>Hub</code> and <code>Spoke</code> (gene symbol) fields and preferably also <code>HubUni</code> (uniprot), <code>SpokeUni</code> (uniprot) and <code>Evidence</code> fields.</li>
<li><code>GENELIST</code> = Plain text list of gene symbols.</li>
<li><code>XREFDATA</code> = Delimited text file that links gene symbols to identifiers from other databases.</li>
</ul>
<p>See also:</p>
<ul>
<li><a href="http://slimsuite.blogspot.com.au/2015/10/file-format-fasta-seqfile-fasfile.html">File format: FASTA [SEQFILE, FASFILE]</a></li>
</ul>
<h2 id="slimdiscovery">SLiM discovery</h2>
<p>The main input formats for SLiM discovery are:</p>
<ul>
<li>A source of protein sequence data. This could be a protein <a href="http://slimsuite.blogspot.com.au/2015/10/file-format-fasta-seqfile-fasfile.html">FASTA file</a>, a <a href="http://web.expasy.org/docs/userman.html#entrystruc">Uniprot plain text</a> file, or a list of <a href="http://www.uniprot.org/help/accession_numbers">Uniprot accession numbers</a> to download. For some tools, a single Uniprot accession number will work.</li>
<li>A source of motif (regular expression) definitions. This is only required if looking for known (or other pre-defined) motifs and/or wanting to compare a set of de novo predictions with known motifs. A number of different formats are accepted for motif input, including SLiMFinder (summary) results and ELM downloads. The simplest/easiest is a plain text file of regular expressions. For more on motif regular expression formats, please see <a href="http://docs.slimsuite.unsw.edu.au/papers/edwards_palopoli_2015.pdf">Edwards and Palopoli 2015</a>.</li>
</ul>
<p>The main output formats are delimited text files.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-89930757650270306862015-06-17T11:28:00.000+10:002015-12-10T10:25:01.381+11:00Sequence names and species codes for GOPHER<p><a href="http://rest.slimsuite.unsw.edu.au/gopher"><code>GOPHER</code></a> (and any tools using orthologue alignments produced by <code>GOPHER</code>) needs sequence names to be formatted in a particular way so that the species information can be corrected parsed. This “SLiMSuite fasta” format is the only sequence format fully supported by SLiMSuite. If you are getting an unexpected error, sequence formatting and naming is one of the first things to check. It should not break any other programs that I know about.</p>
<p>This format is:</p>
<pre><code>>Gene_SPCODE__AccNum [Description]
SEQUENCE</code></pre>
<p>Where:</p>
<ul>
<li><code>Gene</code> is not used for anything and is purely for easy visual identification.</li>
<li><code>SPCODE</code> is the species code. Where possible, <a href="http://www.uniprot.org/taxonomy/">Uniprot species mnemonics</a> should be used but any short code can be used as long as (a) it contains uppercase letter and numbers only (no symbols), and (b) it is consistently used within a species/database. (i.e. you can make it up as long as all sequences from the same species use the same code.) </li>
<li><code>AccNum</code> is the accession number, which is what is used as the <strong>unique</strong> sequence identifier.</li>
<li><code>Description</code> is optional and can contain any other text.</li>
<li><code>SEQUENCE</code> can be on one or more lines and contain spaces. However, it is best to have a single <code>SEQUENCE</code> line with no whitespace. (Some programs may enforce this.)</li>
</ul>
<p><a href="http://rest.slimsuite.unsw.edu.au/seqsuite"><code>Seqsuite</code></a> can be used to rename and reformat sequences, using the <a href="http://rest.slimsuite.unsw.edu.au/rje_seq"><code>seq</code></a> and <a href="http://rest.slimsuite.unsw.edu.au/seqlist"><code>seqlist</code></a> programs.</p>
<p>Uniprot downloads should be automatically recognised and converted where needed.</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-78106688826789725972015-06-01T16:19:00.000+10:002015-06-01T16:44:41.192+10:00SLiMSuite release 2015-06-01 now available<p><a href="https://github.com/slimsuite/SLiMSuite/releases/tag/2015-06-01" ><img border="0" src="http://4.bp.blogspot.com/-eLZ0VySlhPE/VWv71trxyBI/AAAAAAAAVsY/eo25D9xx3q0/s150/button-github.jpg" align="left" style="margin-right:10px"/></a>A <a href="http://slimsuite.blogspot.com.au/2015/05/slimsuite-downloads.html">new download</a> of <code>SLiMSuite</code> (release <code>2015-06-01</code>) is now available. This is the first release in the new <code>git</code> repository at <a href="https://github.com/slimsuite/SLiMSuite">https://github.com/slimsuite/SLiMSuite</a>. A tarball <a href="https://github.com/slimsuite/SLiMSuite/releases/download/2015-06-01/slimsuite.2015-06-01.tgz"><code>slimsuite.2015-06-01.tgz</code></a> is also available, containing the same code. Once unpacked, it should be possible to pull down additional updates with <code>git</code>. (This release corresponds to the UCD svn repo r895.)</p>
<p>The major change since the last release is a general tidying of the repository in preparation for going on <a href="https://github.com/slimsuite/SLiMSuite">GitHub</a> and tidying <a href="http://slimsuite.blogspot.com.au/p/documentation.html">documentation</a> for the <a href="http://rest.slimsuite.unsw.edu.au/docs&page=sitemap">new online help</a> via the <a href="http://rest.slimsuite.unsw.edu.au/restcmd">SLiMSuite REST Server</a>:</p>
<a href="http://www.slimsuite.unsw.edu.au/software.php" ><img border="0" src="http://3.bp.blogspot.com/-X_dfhrjkbAI/VWv3eXO670I/AAAAAAAAVsI/-6sUORw6uEs/s150/button-software.jpg" align="left" style="margin-right:10px"/></a><FORM METHOD="POST" target="_blank" NAME="REST" ACTION="http://www.slimsuite.unsw.edu.au/cgi-bin/rest-cgi.py" enctype="multipart/form-data">
<p><INPUT TYPE="SUBMIT" VALUE="View Documentation"> for: <input type="text" name="prog" size=20 value="sitemap"></p>
</FORM>
<p>To try out the new documentation for a given program, replace <code>sitemap</code> in the box and click <code>View Documentation</code>. Leaving <code>sitemap</code> in the box will list all modules, which can then be clicked on.</p>
<p>The old PDF Manuals are still included in the release and can be accessed from the <a href="http://www.slimsuite.unsw.edu.au/software.php">EdwardsLab Software page</a>. These will be updated eventually but the focus is currently on getting module docstrings and the online help up-to-date. As ever, please get in touch if you have any questions.</p>
<p>This release also sees the addition of a new tool, <a href="http://rest.slimsuite.unsw.edu.au/slimparser"><code>SLiMParser</code></a> for running/parsing the new REST servers. <a href="http://rest.slimsuite.unsw.edu.au/slimmaker"><code>SLiMMaker</code></a> has also undergone some improvements and now features: (1) basic peptide alignment prior to motif generation; (2) extension of degenerate sites using an “equivalence” list of similar amino acids.</p>
<p>A full list of updates is given below.</p>
<h3>Updates since previous release</h3>
<h2>Updates in tools/:</h2>
<p><b>• gablam:</b> <i>Updated from Version 2.16.1.</i>
<br>→ Version 2.17.0: Added localalnfas=T/F : Whether to output local alignments to *.local.fas fasta file (if local=T) [False]
<br>→ Version 2.17.1: Fixed bug where query and hit lengths were not being output for fullblast.
<br>→ Version 2.18.0: Added blaste filtering to be applied to existing BLAST results.
<br>→ Version 2.19.0: Added maxall=X limits to all-by-all analyses. Added qassemble=T.
<br>→ Version 2.19.1: Fixed handling of basefile and results generation for blastres=FILE.
<br>→ Version 2.19.2: Modified output to be in rank order.
</p>
<p><b>• gopher:</b> <i>Updated from Version 3.4.</i>
<br>→ Version 3.4.1: Fixed stripXGap issue. (Why was this being implemented anyway?). Added REST output.
</p>
<p><b>• haqesac:</b> <i>Updated from Version 1.10.</i>
<br>→ Version 1.10.1: Tweaked QryVar interactivity.
<br>→ Version 1.10.2: Corrected typos and disabled buggy post-HAQESAC data reduction.
</p>
<p><b>• multihaq:</b> <i>Updated from Version 1.2.</i>
<br>→ Version 1.2.1: Updated documentation to include the HAQESAC reference.
<br>→ Version 1.2.2: Switched default to keepblast=T. Added forking blasta=X command to BLAST.
</p>
<p><b>• peptcluster:</b> <i>Updated from Version 1.4.</i>
<br>→ Version 1.5.0: Added peptalign=T/F/X function for aligning peptides using regex or minimal gap addition. Added REST.
<br>→ Version 1.5.1: Updated REST output. Removed peptide redundancy.
</p>
<p><b>• pingu_V4:</b> <i>Updated from Version 4.3.</i>
<br>→ Version 4.4.0: Converted ppicompile=T to ppicompile=LIST.
<br>→ Version 4.5.0: Added hublist=LIST : List of hub genes to restrict pairwise PPI to, and pairwise parsing.
</p>
<p><b>• qslimfinder:</b> <i>Updated from Version 2.0.</i>
<br>→ Version 2.1.0: Added PTMData and PTMList options.
</p>
<p><b>• seqsuite:</b> <i>Updated from Version 1.4.0.</i>
<br>→ Version 1.5.0: Added extatic.ExTATIC and revert.REVERT. NOTE: Dev only.
<br>→ Version 1.5.1: Added 'seq' as alias for 'rje_seq' - want to avoid rje_ prefix requirements.
<br>→ Version 1.6.0: Added mitab and rje_mitab for MITAB parsing.
<br>→ Version 1.6.1: Added extra error messages.
<br>→ Version 1.7.0: Added pingu_V4.PINGU.
<br>→ Version 1.8.0: Added rje_pacbio.PacBio.
</p>
<p><b>• slimbench:</b> <i>Updated from Version 2.8.0.</i>
<br>→ Version 2.8.1: Removed use of Protein name for ELM Uniprot entries due to problems mapping old IDs.
<br>→ Version 2.9.0: Added SLiMMaker ELM reduction table and output.
<br>→ Version 2.9.1: Enabled download only with generate=F benchmark=F.
<br>→ Version 2.10.0: Add generation of table mapping PPIBench dataset generation.
</p>
<p><b>• slimfarmer:</b> <i>Updated from Version 1.4.1.</i>
<br>→ Version 1.4.2: Fixed log transfer issues due to new #VIO line. Better handling of crashed runs.
</p>
<p><b>• slimfinder:</b> <i>Updated from Version 5.1.</i>
<br>→ Version 5.1.1: Modified alphabet handling and fixed musthave bug.
<br>→ Version 5.2.0: Added PTMList and PTMData modes (dev only).
</p>
<p><b>• slimmaker:</b> <i>Updated from Version 1.2.0.</i>
<br>→ Version 1.3.0: Added varlength option to identify gaps in aligned peptides and generate variable length motif.
<br>→ Version 1.3.1: Fixed varlength option to work with end of peptide gaps. (Gaps ignored completely - should not be there!)
<br>→ Version 1.4.0: Add iteration REST output.
<br>→ Version 1.4.1: Add unmatched peptides REST output.
<br>→ Version 1.4.2: Fixed bug with variable length wildcards at start of sequence.
<br>→ Version 1.5.0: Added peptalign=X functionality, using PeptCluster peptide alignment.
<br>→ Version 1.6.0: Added equiv=LIST : List (or file) of TEIRESIAS-style ambiguities to use [AGS,ILMVF,FYW,FYH,KRH,DE,ST]
<br>→ Version 1.6.1: Fixed peptide case bug.
</p>
<p><b>• slimparser:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.0.1: Fixed RestKeys bug.
<br>→ Version 0.1.0: Added retrieval and parsing of existing server job. Added password.
<br>→ Version 0.2.0: Added API access to REST server if restin is REST call (i.e. starts with http:)
<br>→ Version 0.2.1: Added PureAPI output of API REST call returned text.
<br>→ Version 0.3.0: Added parsing of input files to give to rest calls.
<br>→ Version 0.3.1: Fixed issue that had broken REST server full output.
</p>
<p><b>• slimprob:</b> <i>Updated from Version 2.2.0.</i>
<br>→ Version 2.2.1: Updated REST output.
<br>→ Version 2.2.2: Modified input to allow motif=X in addition to motifs=X.
<br>→ Version 2.2.3: Tweaked basefile setting and citation.
</p>
<p><b>• slimsuite:</b> <i>Updated from Version 1.3.0.</i>
<br>→ Version 1.4.0: Added RLC and Disorder progs to call SLiMCore. Added CompariMotif.
<br>→ Version 1.5.0: Added peptcluster and peptalign calls.
</p>
<h2>Updates in extras/:</h2>
<p><b>• file_monster:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 1.0: Initial Working version
<br>→ Version 1.1: Broadened away from strict extension-based scavenging to whole file names with wildcards
<br>→ Version 1.2: Added DirSum function and updated FileMonster slightly.
<br>→ Version 1.3: Added redundant file cleanup
<br>→ Version 1.4: Added skiplist and purgelist
<br>→ Version 1.5: Added rename function (to replace rename.pl Perl module)
<br>→ Version 1.6: Minor bug fix.
<br>→ Version 2.0: Major reworking with new object making use of rje_db tables etc. Old functions to be ported with time.
<br>→ Version 2.1: Added dirsum function.
<br>→ Version 2.2: Added fixendings=FILELIST to convert Mac \\r into UNIX \\n
</p>
<p><b>• prodigis:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 0.1: Added probability calculations based on hydrophobicity, serine and cysteine.
<br>→ Version 0.2: Added cysteine count and cysteine weighting.
</p>
<p><b>• rje_glossary:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 1.0: Working version, including text setup for webserver.
<br>→ Version 1.1: Added href=T option to add external hyperlinks for <url> and <url>[text] in descriptions [True]
<br>→ Version 1.2: Added recognition of _italics_ markup.
<br>→ Version 1.3: Fixed minor italicising bug.
<br>→ Version 1.4: Added keeporder=T/F to maintain input order (e.g. for MapTime).
</p>
<p><b>• rje_itunes:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 0.1: Added Plays/Track, default Album Artist and topHTML() method.
</p>
<p><b>• rje_phos:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation. Basic pELM parsing done.
<br>→ Version 0.1: Added phosBLAST method.
</p>
<p><b>• rje_pydocs:</b> <i>Updated from Version 2.14.0.</i>
<br>→ Version 2.15.0: Added parsing and generation of "pages" for new rest server docs functions.
<br>→ Version 2.15.1: Tweaked formatting of outfmt and docstring documentation.
<br>→ Version 2.15.2: Tweaked formatting of docstring documentation.
<br>→ Version 2.15.3: Fixed URL formatting of docstring documentation.
<br>→ Version 2.16.0: Added Webserver tab to doc parsing from settings/*.form.
<br>→ Version 2.16.1: Added parsing of imports within a try/except block. (Cannot be on same line as try: or except:)
<br>→ Version 2.16.2: Tweaked makePages() output.
</p>
<p><b>• rje_seqplot:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
</p>
<p><b>• rje_ssds:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
</p>
<p><b>• rje_yeast:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
</p>
<p><b>• wormpump:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
</p>
<h2>Updates in libraries/:</h2>
<p><b>• rje:</b> <i>Updated from Version 4.13.1.</i>
<br>→ Version 4.13.2: Removed excess REST HTML methods.
<br>→ Version 4.13.3: Added uselower=False to dataDict() method.
<br>→ Version 4.13.4: Added maxrep=X to listCombos() method.
<br>→ Version 4.14.0: Added listToDict() method.
<br>→ Version 4.15.1: Fixed matchExp method to be able to handline multilines. (Shame re.DOTALL doesn't work!)
</p>
<p><b>• rje_blast_V2:</b> <i>Updated from Version 2.7.</i>
<br>→ Version 2.7.1: Added capacity to keep alignments following GABLAM calculations.
<br>→ Version 2.7.2: Fixed bug with hitToSeq fasta output for rje_seqlist.SeqList objects.
<br>→ Version 2.8.0: A more significant BLAST e-value setting will filter read results.
<br>→ Version 2.9.0: Added qassemble=T/F : Whether to fully assemble query stats from all hits [False].
<br>→ Version 2.9.1: Updated default BLAST and BLAST+ paths to '' for added modules.
</p>
<p><b>• rje_db:</b> <i>Updated from Version 1.7.1.</i>
<br>→ Version 1.7.2: Fixed numerical join issue during Table.compress().
<br>→ Version 1.7.3: Added lower case enforcement of headers for reading tables from file.
<br>→ Version 1.7.4: Added optional restricted Field set for output.
<br>→ Version 1.7.5: Added more error messages and tableNames() method.
</p>
<p><b>• rje_ensembl:</b> <i>Updated from Version 2.14.</i>
<br>→ Version 2.15.0: Added capacity to download/process a section of Ensembl with speclist=LIST.
<br>→ Version 2.15.1: Improved error handling for too many FTP connections: still need to fix problem!
<br>→ Version 2.15.2: Trying to improve speed of Uniprot parsing for EnsLoci.
</p>
<p><b>• rje_genbank:</b> <i>Updated from Version 1.2.2.</i>
<br>→ Version 1.3.0: Added split viral output.
<br>→ Version 1.3.1: Fixed bug in split viral output.
</p>
<p><b>• rje_html:</b> <i>Updated from Version 0.1.</i>
<br>→ Version 0.2.0: Added delimited text to HTML table conversion.
<br>→ Version 0.2.1: Updated default CSS to http://www.slimsuite.unsw.edu.au/stylesheets/slimhtml.css.
</p>
<p><b>• rje_mitab:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0.0: Initial Compilation.
<br>→ Version 0.1.0: Added complex=LIST : Complex identifier prefixes to expand from mapped PPI [complex]
<br>→ Version 0.1.1: Fixed Evidence/IType parsing bug for BioGrid/Intact.
<br>→ Version 0.2.0: Added splicevar=T/F option.
</p>
<p><b>• rje_obj:</b> <i>Updated from Version 2.1.0.</i>
<br>→ Version 2.1.1: Removed excess REST HTML methods.
<br>→ Version 2.1.2: Tweaked glist cmdRead warnings.
</p>
<p><b>• rje_qsub:</b> <i>Updated from Version 1.6.1.</i>
<br>→ Version 1.6.2: Updated module list: blast+/2.2.30,clustalw,clustalo,fsa,mafft,muscle,pagan,R/3.1.1
</p>
<p><b>• rje_scoring:</b> <i>Updated from Version -.</i>
</p>
<p><b>• rje_seq:</b> <i>Updated from Version 3.21.0.</i>
<br>→ Version 3.22.0: Added loading sequences from provided sequence files contents directly, bypassing file reading.
<br>→ Version 3.22.1: Fixed problem if seqin is blank, triggering odd Uniprot download.
<br>→ Version 3.23.0: Add speclist to reformat options.
</p>
<p><b>• rje_seqlist:</b> <i>Updated from Version 1.10.0.</i>
<br>→ Version 1.11.0: Added more dna2prot reformatting options.
</p>
</p>
<p><b>• rje_slim:</b> <i>Updated from Version 1.9.</i>
<br>→ Version 1.10.0: Added varlength option to makeSlim() method.
<br>→ Version 1.10.1: Fixed varlength and terminal position compatibility.
<br>→ Version 1.10.2: Fixed issue of [] returns.
<br>→ Version 1.10.3: Fixed makeSlim bug with variable length wildcards at start of sequence.
<br>→ Version 1.11.0: Added splitMotif() function.
<br>→ Version 1.12.0: Added equiv to makeSlim() function.
</p>
<p><b>• rje_slimcore:</b> <i>Updated from Version 2.6.1.</i>
<br>→ Version 2.7.0: Updating MegaSLiM function to work with REST server. Allow megaslim=seqin. Added iuscoredir=PATH and protscores=T/F.
<br>→ Version 2.7.1: Modified iuscoredir=PATH and protscores=T/F to work without megaslim. Fixed UPC/SLiMdb issue for GOPHER.
<br>→ Version 2.7.2: Fixed iuscoredir=PATH to stop raising errors when file not previously made.
<br>→ Version 2.7.3: Fixed serverend message error.
</p>
<p><b>• rje_slimhtml:</b> <i>Created/Renamed/moved.</i>
<br>→ Version 0.0: Initial Compilation.
<br>→ Version 0.3: Added code for making Random Dataset pages
<br>→ Version 0.4: Updated UPC pages and added additional front pages.
<br>→ Version 0.5: Split front page into front and full. Added GO tabs/pages.
<br>→ Version 0.6: Added XGMML output.
<br>→ Version 0.7: Modified output for HumSF10 and HAPPI analysis.
<br>→ Version 0.8: Added SVG output. Integrated better with HAPPI code.
<br>→ Version 0.9: Added SLiM Descriptions.
</p>
<p><b>• rje_slimlist:</b> <i>Updated from Version 1.6.</i>
<br>→ Version 1.7.0: Added direct feeding of motif file content for loading (for REST servers).
<br>→ Version 1.7.1: Modified input to allow motif=X in additon to motifs=X.
<br>→ Version 1.7.2: Fixed bug that could not accept variable length motifs from commandline. Improved error message.
</p>
<p><b>• rje_specificity:</b> <i>Updated from Version -.</i>
</p>
<p><b>• rje_tree:</b> <i>Updated from Version 2.11.0.</i>
<br>→ Version 2.11.1: Tweaked QryVar interactivity.
<br>→ Version 2.11.2: Updated tree paths.
</p>
<p><b>• rje_tree_group:</b> <i>Updated from Version -.</i>
</p>
<p><b>• rje_uniprot:</b> <i>Updated from Version 3.20.3.</i>
<br>→ Version 3.20.4: Fixed bug introduced by REST access modifications.
<br>→ Version 3.20.5: Improved handling of downloads for uniprot IDs that have been updated (i.e. no direct mapping).
<br>→ Version 3.20.6: Improved handling of zero accession numbers for extraction.
<br>→ Version 3.20.7: Fixed uniformat default error.
<br>→ Version 3.21.0: Added uparse=LIST option to try and accelerate parsing of large datasets for limited information.
<br>→ Version 3.21.1: FullText is no longer stored in Uniprot object. Will need special handling if required.
<br>→ Version 3.21.2: Fixed single uniprot extraction bug.
<br>→ Version 3.21.3: Added REST datout to proteomes extraction.
</p>
<p><b>• rje_xref:</b> <i>Updated from Version 1.3.0.</i>
<br>→ Version 1.3.1: Fixed xref list bug.
<br>→ Version 1.4.0: Added optional Mapping dictionary for speeding up recurring mapping (should avoid if memsaver=F).
<br>→ Version 1.5.0: Added stripvar=CDICT removal of variants using Field:Char list, e.g. Uniprot:-,GenPept:. []
<br>→ Version 1.6.0: Added mapxref=LIST List of identifiers to map to KeyIDs using mapfields []
</p>
<p><b>• rje_zen:</b> <i>Updated from Version 1.3.0.</i>
<br>→ Version 1.3.1: Added some more words.
</p>Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0tag:blogger.com,1999:blog-8061067497593584060.post-57077068205415803312015-05-28T14:36:00.000+10:002018-07-02T21:22:50.470+10:00How to Cite SLiMSuite programs<p>Most programs in the SLiMSuite package have citation instructions in their docstring. Either run with the <code>help</code> or <code>help</code> option (or if running through <code>SLiMSuite</code> or <code>SeqSuite</code>, use <code>help=T</code>) to bring up that information. Alternatively, the <a href="http://slimsuite.blogspot.com.au/p/documentation.html">online documentation</a> should show the papers to cite.</p>
<p>You can retrieve documentation for a given program by replacing <code>slimsuite</code> in the box below and clicking <code>View Documentation</code>.</p>
<FORM METHOD="POST" target="_blank" NAME="REST" ACTION="http://www.slimsuite.unsw.edu.au/cgi-bin/rest-cgi.py" enctype="multipart/form-data">
<p><INPUT TYPE="SUBMIT" VALUE="View Documentation"> for: <input type="text" name="prog" size=20 value="slimsuite"></p>
</FORM>
<p>If a program does not have its own citation, please cite SLiMSuite using: Edwards RJ & Palopoli N (2015): <a href="http://edwardslab.blogspot.com.au/2015/01/computational-prediction-of-short.html">Computational Prediction of Short Linear Motifs from Protein Sequences</a>. <em>Methods Mol Biol.</em> <strong>1268:</strong>89-141.</p>
<p>For general use or reuse of code, please cite the Zenodo DOI for the GitHub release: <a href="https://zenodo.org/badge/latestdoi/36636777"><img src="https://zenodo.org/badge/36636777.svg" alt="DOI"></a></p>
<h2 id="externalprograms">External programs</h2>
<p>See <a href="http://slimsuite.blogspot.com.au/2013/08/external-components-of-seqsuite.html">External Components of SLiMSuite</a> for citing programs that SLiMSuite uses.</p>
Richard Edwardshttp://www.blogger.com/profile/16115218690707131186noreply@blogger.com0