CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • At a Glance
  • Description
  • Inputs
  • Particles
  • Commonly Adjusted Parameters
  • Number of orientation bins
  • Rebalance percentile
  • Intra-bin exclusion criterion
  • Outputs
  • Rebalanced particles
  • Excluded particles
  • Plots
  • Common Next Steps
  • References
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. Particle Curation

Job: Rebalance Orientations

PreviousJob: Class Probability Filter (Legacy)NextJob: Subset Particles by Statistic

Last updated 1 year ago

At a Glance

Remove particles from over-represented viewing directions.

Description

Rebalance Orientations sorts particles into two sets: ‘rebalanced’ and ‘excluded’. The rebalanced particle set will have a more uniform viewing direction distribution (as compared to the input particles) which can help improve downstream refinements.

Excluded particles are taken from over-populated viewing direction bins. Viewing direction bins are defined by a set of direction vectors on the unit sphere (generated via Fibonacci sampling). Each particle is sorted into the bin nearest to the particle’s viewing direction. Once the bins are populated, they are sorted by particle count and all bins with a population above the Kth percentile are deemed overpopulated. Each overpopulated bin has particles excluded until it reaches the population of the Kth percentile bin.

N.B., the Rebalance Orientations job is idempotent, in the sense that if two Rebalance Orientations jobs are run in sequence (with the same parameters), the second job will make no change to its inputs.

Inputs

Particles

Commonly Adjusted Parameters

Number of orientation bins

Particles will be grouped into this number of bins. When views are rebalanced, they are considered per-bin. Put another way, Rebalance Orientations does not consider a single view as overrepresented, but rather a bin of similar views.

In general we have found the default setting to be sufficient. If orientation bias is focused on a single, narrow region of orientation space, using more bins may focus Rebalance Orientations on only particles in that view.

Rebalance percentile

This number (between 0 and 100) sets the percentile above which bins are rebalanced.

Note that this parameter operates on bins, not particles. Put another way, setting this parameter to 80 will result in bins in the 80th percentile and higher (that is, bins with more particles in them than the bottom 80 percent) having particles removed until they have the same number as the 80th percentile. Note that setting this parameter to 80 does not mean that precisely 20% of particles would be removed by this operation; the number of particles removed depends on the orientation distribution of the particles.

Intra-bin exclusion criterion

Once a bin is marked as overrepresented, particles in that bin must be discarded. This parameter provides several choices of how particles are to be selected for exclusion.

Random

Particles are selected at random and discarded until the bin is at the threshold.

pick_stats/ncc_score

Particles with the worst Normalized Cross Correlation score are removed. The Normalized Cross Correlation is calculated during particle picking and measures how well the particle image matches the template, blob, or ring used to select the particle.

alignments3D/error

Particles with the greatest error between the volume projection and the particle image, computed during upstream refinement, are removed. Note that if the volume is highly anisotropic due to orientation bias, the error value may be unreliable.

alignments3D/alpha

Particles with the lowest per-particle scale are discarded. Per-particle scale accounts for local variations in greyscale and is typically taken as a proxy for ice thickness, but would also be affected by overall particle quality and other factors. Note that if the volume is highly anisotropic due to orientation bias, the per-particle scale may be unreliable.

alignments2D/error

Particles with the greatest error between the 2D class average and the particle image are discarded. Note that this error value will capture a combination of pose error and residual error in the refinement of the class average itself. If relatively few classes were requested during 2D classification, good particles may have high error if their true pose is far from the nearest available class average.

Outputs

Rebalanced particles

Particles that fell in bins which were below the threshold and particles that fell in overpopulated bins but were selected by the Intra-bin exclusion criterion are collected together in this output. They are otherwise unchanged from the input.

Excluded particles

Particles that fell in overpopulated bins and were excluded by the Intra-bin exclusion criterion are collected in this output. They are otherwise unchanged from the input.

Plots

Rebalance Orientations also produces similar plots showing the bin locations and particle counts before and after the rebalancing operation.

Finally, a plot of the rebalancing operation itself is produced. Bins are arranged in increasing order of initial particle count. Bins with a number of particles less than or equal to the threshold are marked with a blue point. Bins with particles in excess of the threshold are represented with two points: a blue point at the threshold, and a red point indicating the number of particles removed from that bin.

Note that each position along the X-axis in this plot represents the number of particles in an individual bin, not the cumulative sum of particles in that number of bins.

Common Next Steps

References

  1. Campbell, M. G., Veesler, D., Cheng, A., Potter, C. S. & Carragher, B. 2.8 Å resolution reconstruction of the Thermoplasma acidophilum 20S proteasome using cryo-electron microscopy. eLife 4, e06380 (2015).

Particles to be rebalanced. These particles must have 3D pose estimates, and so should come from a 3D refinement such as or .

Rebalance Orientations produces plots from before and after the rebalancing operation is performed. These plots are simple heatmaps of particle viewing directions, explained more in the Common Plots guide page.

Removal of overrepresented views may help reduce map anisotropy in some cases. However, the overall quality of the map may also be degraded when removing good information in any orientation. Thus, a potentially useful workflow involves using this job and a subsequent refinement to produce a more isotropic map, then using this map to repeat particle picking (e.g., using and the jobs, or in a neural-network particle picker such as ) to attempt to find more of the rare views in the existing data.

Homogeneous
Non-Uniform Refinement
Create Templates
Template Picker
TOPAZ
Maps in this figure were produced from EMPIAR 10025 (Campbell et al. 2015)
Viewing Direction Distribution