CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Discrete and Continuous Heterogeneity in FaNaC1 (EMPIAR-11631 and -11632)
      • Case Study: Picking-induced Orientation Bias in HA Trimer (EMPIAR-10096 and -10097)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • At a Glance
  • Description
  • Inputs
  • Particle stacks
  • Commonly Adjusted Parameters
  • 3D Parameters
  • 2D Parameters
  • Outputs
  • Selected Particles
  • Excluded Particles
  • Recommended Alternatives
  • At a Glance
  • Description
  • Inputs
  • Particle stacks
  • Commonly Adjusted Parameters
  • 3D Parameters
  • 2D Parameters
  • Outputs
  • Selected Particles
  • Excluded Particles
  • Recommended Alternatives
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. Particle Curation

Job: Class Probability Filter (Legacy)

Select a subset of extracted particles.

PreviousJob: Rebalance 2D ClassesNextJob: Rebalance Orientations

Last updated 1 month ago

At a Glance

Keep particles which have a high probability of belonging to selected 2D or 3D classes.

Description

In most particle curation pipelines, 2D and 3D classification are used to group particles into good and bad classes (that is, classes which do and do not look like the target). Particles can then be retained for downstream analysis if they belong to a good class and discarded if they belong to a bad class. In other words, particles are selected using a binary filter — they either are or are not in a good class.

Most classification jobs in CryoSPARC assign classes a probability of belonging to a class, rather than a binary in or out classification. When using class membership to filter particles, particles are considered to be members of the class for which they have the highest probability. Good particles ideally have a high probability of belonging to one class and a low probability of belonging to all others.

For example, the top two particles images in the figure at the top of this article have much higher probability of belonging to the cone or cube (respectively) than any other class. Filtering particles by their best class is often sufficient for high-quality data.

Consider, on the other hand, a junk particle (the third particle image in the figure at the top of this article). Since it is random noise, it has a relatively low probability of belonging to any class. If it happens by random chance to have the highest probability of belonging to a good class it will still be selected, despite the fact that its probability in that class may be much lower than particles which truly belong to that class. In this example, the junk particle has a probability of 0.26 of belonging to the cube class, which is greater than its probability of belonging to any other class so if we took all particles in the cube class we would also take this junk particle.

The Class Probability Filter job filters particles by their probability of belonging to a given class or set of classes, rather than simply by whether they are more likely to belong to a good class than a bad class. Considering the example above again, if we designate the cube and cone as good classes and only keep particles with a 75% or greater chance of belonging to one of those two classes, the good particles will be kept and the junk pick will correctly be discarded.

Inputs

Particle stacks

Commonly Adjusted Parameters

This job acts on either 2D or 3D class probabilities. Because of how jobs work under the hood in CryoSPARC, either 3D or 2D parameters must be set. Setting both or the wrong parameter will cause the job to fail when it looks for data which is not there.

3D Parameters

3D Class Indexes

Indexes of good classes. These can be found in several places, including the output panel. For instance, if the good volumes are labeled “Volume class 0” and “Volume class 2” in the output panel, entering 0,2 for this parameter would select those classes as good and the rest as bad.

3D Class Threshold

Class Probability Filter will keep only particles which have a total probability, across all input classes, of this value or greater.

For instance, say we have classified three particles into four classes. Classes 1 and 2 are good classes, and we want to keep any particle that has a total probability of being in a good class of 0.6 or better. If we only look at individual probabilities, no particles meet this threshold:

However, if we consider the sum of the probability of all good classes (provided by 3D Class Indexes), then particles 2 and 3 both clear the threshold of 0.6:

2D Parameters

2D Class Threshold

Class Probability Filter will keep only particles which have a probability in their best class of at least this value.

For instance, if the input particles are classified into four classes A, B, C, and D and this parameter was set to 0.9, a particle would be kept if its probabilities were 0.95, 0.01, 0.01, 0.00 but not 0.4, 0.3, 0.2, 0.0. Note that there is no way to know whether this high probability comes from a good or bad class. Class Probability Filter selects particles based on the confidence of their assignment, not the quality of the class they are assigned to.

To select particles confidently assigned to good classes, first select good classes using Select 2D Classes, then feed the selected particles into Class Probability Filter.

Outputs

Selected Particles

Particles with a total probability greater than or equal to the threshold are in this output group, otherwise unchanged.

Excluded Particles

Particles with a total probability less than the threshold are in this output group, otherwise unchanged.

Recommended Alternatives

At a Glance

Keep particles which have a high probability of belonging to selected 2D or 3D classes.

Description

In cryoSPARC v4.7, Class Probability Filter’s functionality was moved to the more-flexible Subset Particles by Statistic. See Recommended Alternatives for more information.

In most particle curation pipelines, 2D and 3D classification are used to group particles into good and bad classes (that is, classes which do and do not look like the target). Particles can then be retained for downstream analysis if they belong to a good class and discarded if they belong to a bad class. In other words, particles are selected using a binary filter — they either are or are not in a good class.

Most classification jobs in CryoSPARC assign classes a probability of belonging to a class, rather than a binary in or out classification. When using class membership to filter particles, particles are considered to be members of the class for which they have the highest probability. Good particles ideally have a high probability of belonging to one class and a low probability of belonging to all others.

For example, the top two particles images in the figure at the top of this article have much higher probability of belonging to the cone or cube (respectively) than any other class. Filtering particles by their best class is often sufficient for high-quality data.

Consider, on the other hand, a junk particle (the third particle image in the figure at the top of this article). Since it is random noise, it has a relatively low probability of belonging to any class. If it happens by random chance to have the highest probability of belonging to a good class it will still be selected, despite the fact that its probability in that class may be much lower than particles which truly belong to that class. In this example, the junk particle has a probability of 0.26 of belonging to the cube class, which is greater than its probability of belonging to any other class so if we took all particles in the cube class we would also take this junk particle.

The Class Probability Filter job filters particles by their probability of belonging to a given class or set of classes, rather than simply by whether they are more likely to belong to a good class than a bad class. Considering the example above again, if we designate the cube and cone as good classes and only keep particles with a 75% or greater chance of belonging to one of those two classes, the good particles will be kept and the junk pick will correctly be discarded.

Inputs

Particle stacks

Commonly Adjusted Parameters

This job acts on either 2D or 3D class probabilities. Because of how jobs work under the hood in CryoSPARC, either 3D or 2D parameters must be set. Setting both or the wrong parameter will cause the job to fail when it looks for data which is not there.

3D Parameters

3D Class Indexes

Indexes of good classes. These can be found in several places, including the output panel. For instance, if the good volumes are labeled “Volume class 0” and “Volume class 2” in the output panel, entering 0,2 for this parameter would select those classes as good and the rest as bad.

3D Class Threshold

Class Probability Filter will keep only particles which have a total probability, across all input classes, of this value or greater.

For instance, say we have classified three particles into four classes. Classes 1 and 2 are good classes, and we want to keep any particle that has a total probability of being in a good class of 0.6 or better. If we only look at individual probabilities, no particles meet this threshold:

However, if we consider the sum of the probability of all good classes (provided by 3D Class Indexes), then particles 2 and 3 both clear the threshold of 0.6:

2D Parameters

2D Class Threshold

Class Probability Filter will keep only particles which have a probability in their best class of at least this value.

For instance, if the input particles are classified into four classes A, B, C, and D and this parameter was set to 0.9, a particle would be kept if its probabilities were 0.95, 0.01, 0.01, 0.00 but not 0.4, 0.3, 0.2, 0.0. Note that there is no way to know whether this high probability comes from a good or bad class. Class Probability Filter selects particles based on the confidence of their assignment, not the quality of the class they are assigned to.

To select particles confidently assigned to good classes, first select good classes using Select 2D Classes, then feed the selected particles into Class Probability Filter.

Outputs

Selected Particles

Particles with a total probability greater than or equal to the threshold are in this output group, otherwise unchanged.

Excluded Particles

Particles with a total probability less than the threshold are in this output group, otherwise unchanged.

Recommended Alternatives

Subset Particles by Statistic, released in CryoSPARC v4.7, performs this analysis when Subset by is set to Class probability - 2D or Class probability - 3D. It can operate with a single threshold (like Class Probability Filter does), or with multiple thresholds. Additionally, it can cluster particles by their class probability with a Gaussian mixture model. As such, Class Probability Filter is a legacy job in v4.7, and this type of analysis should be performed with Subset Particles by Statistic instead.

In CryoSPARC v4.7, Class Probability Filter’s functionality was moved to the more-flexible . See for more information.

This job accepts particles which have been classified either in , , or . If particles come from a 2D Classification, it is generally best to select good classes in Select 2D Classes first.

, released in CryoSPARC v4.7, performs this analysis when Subset by is set to Class probability - 2D or Class probability - 3D. It can operate with a single threshold (like Class Probability Filter does), or with multiple thresholds. Additionally, it can cluster particles by their class probability with a Gaussian mixture model. As such, Class Probability Filter is a legacy job in v4.7, and this type of analysis should be performed with Subset Particles by Statistic instead.

This job accepts particles which have been classified either in , , or . If particles come from a 2D Classification, it is generally best to select good classes in Select 2D Classes first.

2D Classification
Ab-Initio Reconstruction
Heterogeneous Refinement
2D Classification
Ab-Initio Reconstruction
Heterogeneous Refinement
Subset Particles by Statistic
Recommended Alternatives
Subset Particles by Statistic