CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • Description
  • Notes and Limitations
  • Input
  • Output
  • Common Parameters
  • Interpreting Diagnostic Plots
  • Common Next Steps
  • Citations
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. Particle Picking

Job: Filament Tracer

Particle picking for filaments.

PreviousJob: Template PickerNextJob: Blob Picker Tuner

Last updated 1 year ago

Description

Pick particles from micrographs of filaments, with or without using templates. The filament tracer uses the same procedure as the template/blob pickers, but during post-processing it attempts to join filament contours together via image skeletonization, similar in concept to the helix tracing functionality from SPRING [1]. In contrast to the template picker, this allows for increased density of picks along the helical axis, the identification of individual filaments, and the pruning of particles that are picked from highly bent filaments. For an example of using the filament tracer in a full helical processing workflow, including subsequent processing using the Inspect Particle Picks job, you may want to view the .

Notes and Limitations

The filament tracer assumes that filaments are roughly cylindrical, and have constant contrast along the helical axis. For some filaments (particularly amyloid fibrils with oblong cross-sections), this assumption may be incorrect. In cases like these, the standard Template Picker or any of the methods may be preferable. Note that all jobs can work with particles obtained from any of CryoSPARC's particle pickers, as well as imported particles.

Input

  • Aligned and CTF-estimated micrographs

  • Optionally, one or more templates (generated in CryoSPARC or elsewhere)

    • Generally, results improve significantly if multiple templates are used, which cover a diversity of views along the helical axis

    • If templates are not provided, the Minimum/Maximum filament diameter (A) parameters must be set

Output

  • Particles

  • Micrographs

Common Parameters

Note that many parameters with units of length are defined relative to the filament diameter, in order for default values to scale well with differently sized filaments.

  • Filament diameter (A):

    • Diameter of the filaments in Angstroms.

  • Separation distance between segments (diameters):

    • Distance between picked particles along the helical axis, as a multiple of the filament diameter. Ideally, this should be close to a multiple of the helical rise, in angstroms.

  • Minimum filament length to consider (diameters):

    • Reject all picks that are associated with filaments that are less than this length.

  • Lowpass filter to apply (A):

    • Lowpass filter corner resolution, to apply to the input micrographs.

  • Produce diagnostic plots:

    • Whether or not to produce diagnostic plots showing the cross-correlation figure of merit at various stages in the processing. This is helpful if the default parameters do not produce ideal results, and can help inform which parameters are best to tweak.

  • Standard deviation of gaussian blur (diameters):

    • Standard deviation of the gaussian blur on the cross-correlation map prior to filament detection, in multiples of the filament diameter. The gaussian blur is used to remove sharp changes in the cross-correlation, which helps to improve ridge detection. It is recommended to keep this between 0 and 0.3. For larger filaments (diameters over ~200 A), values lower than the default of 0.1 may produce better results.

  • Hysteresis thresholds:

    • Low and high threshold values, in percentile, used on the ridge-enhanced cross correlation map. These define percentile values for the hysteresis thresholding algorithm, which is used to detect filament contours. In general, the default values of 93 and 98 may work well for a large variety of datasets.

    • To increase the number of detected filaments, both thresholds can be decreased

    • To decrease the number of detected filaments, both thresholds can be increased

    • Note that if the thresholds are too low, many false crossings may be detected, which will result in many false negatives; alternatively, if the thresholds are too high, the detected contours may be too conservative and hence there also may be many false negatives. For this reason, it is recommended to keep these thresholds at the default value

  • Radius around crossings to ignore (diameters)

    • Radius around each filament crossing to avoid picking from, in multiples of the filament diameter. A "crossing" is defined as the point where two detected filament contours overlap. Around these points, a circle of the specified radius will be used to remove all picked particles, as picks with overlapping filaments are usually undesirable. Increasing this value from the default of 1 will result in more conservative picks

  • Distance to trim from end points (diameters):

    • The distance to trim from the ends of traced contours, in multiples of the filament diameter.

    • Trimming may be desirable for both:

      • removing picks from the very end of traced contours (thus ensuring all picks are in the interior of a filament), and

      • reducing the number of spurious cross-overs detected (i.e. pruning the skeleton of "hairs", which would otherwise be detected as cross-overs)

    • Note that this done prior to the removal of filament cross-overs, so it may reduce the number of crossings that are detected and removed; this may or may not be desirable. Good values are between 0 and 2 filament diameters. A value of 0 means that no trimming is done.

Template-free tracing

As a substitute to providing templates, both of these parameters can be set to automatically generate filament templates for picking (in a similar way as to the blob picker).

  • Minimum filament diameter (A): Minimum filament diameter for reference-free picking

  • Maximum filament diameter (A): Maximum filament diameter for reference-free picking

Note: If you choose to use template-free tracing by activating the minimum and maximum diameters, better results are often obtained with decreased values for the hysteresis threshold parameters. Thus, when template-free tracing is used, the defaults are lowered by 3 to (90,95).

Interpreting Diagnostic Plots

Shown above are two example templates. On the left is a low quality template generated using manual picking of 70 particles. On the right is a high quality template generated after one round of filament tracing and 2D classification.

There are four diagnostic plots produced, each of them detailed below.

1. Raw cross correlation (top left)

This is the raw figure-of-merit between the templates and the input micrograph, shown in the top left of the diagnostic plot image. Ideal results have clear filament contours visible as bright streaks across the plot.

The quality of the cross correlation depends solely on the template, input micrographs, and the lowpass filter applied. If streaks appear low-contrast, or are fragmented (have significantly varying intensity along the helical axis), the following may improve results:

  • Increasing the number of templates used – ideally, templates should cover the full set of views that exist along the helical axis

  • Increasing the quality of templates used – in most workflows, the first set of templates are generated by using the Manual Picker followed by 2D classification, and these are used to do one round of filament picking, extraction, and 2D classification. Similar to the template picker, improved results may be obtained by using templates generated after one round of filament picking for the next round of filament picking

2. Ridge-enhanced cross correlation (top right)

This is the cross correlation after the gaussian blur, and the ridge filter are applied in order to increase the prominence of the filament contours. This stage of the processing depends only on the Standard deviation of gaussian blur parameter. Ideally, ridges appear as bright connected streaks, and all non-filament regions appear dark. If streaks appear faint or excessively wide, the gaussian blur should be decreased; if streaks appear too narrow or have many "hairs", the gaussian blur should be increased to decrease sensitivity to noise.

3. Thresholded cross correlation (bottom left)

This is a binarized map, obtained after applying the hysteresis threshold to the previous map. This stage of the processing depends only on the Hysteresis thresholds. Ideally, the contours should be thin and surround each ridge, with every "T" or "X" intersection representing a true crossover point.

4. Pruned skeleton (bottom right)

This is the "skeletonized" binary map, obtained by applying a morphological thinning procedure to the previous map. It represents the final locations of the traced contours, after trimming from the skeleton end points and removing cross-overs. It also has filaments of length less than the Minimum filament length to consider removed.

Lastly, we show an example of picks detected on the same micrograph, using two templates of differing quality. On the left are picks obtained using a low quality template generated using manual picking of 70 particles; on the right are picks obtained using a high quality template generated after one round of filament tracing and 2D classification. In many cases, more filaments can be picked using a larger number of higher quality templates, that cover a diversity of views along the helical axis.

Common Next Steps

  • Inspect Particle Picks

    • After filament tracing, it is strongly recommended to run an Inspect Picks job to remove false positives. In addition to the NCC and Power thresholds, picks can also be pruned based on their estimated local curvature, and entire filaments can be pruned based on their estimated sinuosity

Citations

Diagnostic plots can provide insight as to which inputs and/or parameters should be tweaked to produce ideal results. Below is a description of each of the diagnostic plots, examples of ideal results for each plot, and tips on choosing better parameter values to improve the results at each stage of the processing. For this section, we will use the (Mitochondrial AntiViral-Signaling protein filaments, or MAVS) as an example dataset. An example micrograph is shown below, as well as an example template generated from manual picking and 2D classification.

[1] Stefan T. Huber, Tanja Kuhm, Carsten Sachse. Automated tracing of helical assemblies from electron cryo-micrographs. Journal of Structural Biology, Volume 202, Issue 1, 2018, Pages 1-12, ISSN 1047-8477. [ ]

EMPIAR-10031 case study
Deep Picking
helical reconstruction
EMPIAR-10031
https://doi.org/10.1016/j.jsb.2017.11.013
Example micrograph from EMPIAR-10031