CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • Input
  • Common Parameters
  • Output
  • Common Next Steps
  • More details about cFAR, SCF*, and Relative Signal
  • cFSC Weighted Area-under-Curve (wAuC)
  • cFSC Area Ratio (cFAR)
  • Sampling Compensation Factor (SCF*) (Baldwin and Lyumkis, 2020)
  • Relative Signal
  • Plot Explanations
  • Summary of cFSC curves
  • Relative signal
  • Relative signal in azimuth / elevation regions
  • 3DFSC volume
  • Fourier Sampling
  • Particle scale factor vs. viewing direction
  • References
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. Utilities

Job: Orientation Diagnostics

A new job in CryoSPARC v4.4+ to diagnose the presence of preferred orientation

PreviousJob: Split Volumes GroupNextSimulations

Last updated 11 months ago

Description

Orientation Diagnostics is a job (new in CryoSPARC v4.4, updated in v4.5) that can aid in diagnosing the presence of preferred orientation. It includes and builds upon 3DFSC (Tan et al., 2017) and Fourier Sampling (Baldwin & Lyumkis, 2020).

By default, Orientation Diagnostics reports the conical FSC area ratio, or cFAR (v4.4+) and Relative signal (v4.5+). cFAR values below 0.5 generally indicate the presence of preferred orientation. cFAR accounts for both the viewing direction distribution and the signal content present within each particle by quantifying the variance of directional half-map Fourier correlations across the viewing sphere.

Relative signal captures FSC variation as a function of viewing direction. Regions of low relative signal can help identify missing views whose absence has a deleterious effect on map anisotropy.

If particles are supplied, the job will also report the Sampling Compensation Factor or SCF* (Baldwin & Lyumkis, 2020 — see below for more information about the significance of the star). SCF* values below 0.81 generally indicate the presence of preferred orientation. SCF* characterizes the sampling of Fourier shells by considering the viewing directions of all particles, without accounting for the signal content contained therein. A junk particle is given equal weight to a real particle.

We provide a short summary of the two metrics below. Please see the detailed definitions at the end of this job guide or the for more information.

cFAR and SCF* at a glance...

Range
Anisotropy Threshold
A function of…

cFAR

[0, 1] higher is better

0.5

alignments & particle images

SCF*

[0, 1] higher is better

0.81

alignments only

cFAR
SCF*
Conclusion

↑

↑

No orientation bias

↑

↓

? (inconclusive, perhaps a pathological alignment distribution)

↓

↑

Anisotropy due to junk or other contaminants

↓

↓

Anisotropy due to junk and/or preferred orientation

Input

  • Volume or Volumes (all classes)

    • New in v4.5: If Volumes (all classes) are supplied from an upstream classification job, orientation diagnostics will be computed for each class volume. Note that this input is a input.

  • [Optional] Particles

    • If supplied, Fourier sampling (and its associated metric, SCF*) will be computed along with other per-particle diagnostics

  • [Optional] Mask

    • If supplied, half-maps will be masked prior to the computation of conical FSCs

NOTE: The cFSC plot produced during the final iteration of all refinement jobs uses the auto-tightened mask (mask_fsc_auto). This mask is a low-level output of all refinements and will be automatically used by Orientation Diagnostics:

  • when connecting a refined volume group as an input to Orientation Diagnostics

  • when using the 'Build Orientation Diagnostics' quick action

To use a custom mask, connect the input mask group. Note that if a custom mask is connected, the results may differ from the output of an upstream refinement.

Common Parameters

Conical FSC

  • Number of Directions

    • The conical FSC Area Ratio (cFAR) metric is relatively robust to number of conical axis directions. However, reducing this number can speed up the job for volumes with large box sizes. Increasing this number will create denser spherical plots.

Sampling Compensation Factor

  • Symmetry

    • Particle viewing directions will be expanded to account for symmetry. This parameter should be set to the symmetry applied in the upstream refinement.

Output

  • 3DFSC volume

    • A volume of radial cFSC curves interpolated at each 3D voxel location

Common Next Steps

  • Particle picking (to find missing views)

More details about cFAR, SCF*, and Relative Signal

cFSC Weighted Area-under-Curve (wAuC)

\begin{align}\text{wAuC}(\hat{v}) &\overset{\Delta}{=} \sum_r w_r C_r(\hat{v}) \\ &= \sum_r 4 \pi r^2 C_r(\hat{v}). \end{align}

cFSC Area Ratio (cFAR)

Sampling Compensation Factor (SCF*) (Baldwin and Lyumkis, 2020)

SCF* measures orientation bias in particle viewing directions — it allows CryoSPARC to convert a potentially difficult-to-parse viewing distribution into a single metric.

SCF* is computed from the statistics of ‘Fourier sampling’. Given a single particle, Fourier sampling is a binary function that indicates which ‘slab’ (i.e., a stack of slices) of Fourier voxels are affected when the particle is used in back-projection. Summing this sampling over many particles allows one to see if large chunks of Fourier space are poorly sampled or missing completely. The degree to which this occurs is measured by the Sampling Compensation Factor—a single number that quantifies the extent to which anisotropic viewing direction distributions attenuate the global FSC value.

Mathematical Definition (expandable section)

Relative Signal

The conical sections used to compute cFSCs cannot be easily mapped to viewing directions. To map FSC values to viewing directions, we use a toroidal section. We define a toroidal section to be the volume swept out by a cone, whose axis is orthogonal to the viewing direction, as it spins about the viewing direction. A toroidal section contains the Fourier components that would be populated by a particle with the same viewing direction, dilated to account for some error (or 'wiggle') in the pose estimate. We set the toroidal half-angle such that its volume is approximately equal to a cone of the same half-angle.

Using these toroidal sections, we compute a set of FSC curves. This set then allows to define a number, which we call relative signal, for each viewing direction. Relative signal is the wAuC of each curve, normalized with respect to the maximum within the set. The curve with the greatest wAuC in the set has a relative signal of 1.0, while a theoretical curve with a wAuC that is 0 at every frequency would have a relative signal of 0.0.

Plot Explanations

v4.4 only plots

cFSC wAuC vs. conical axis

The wAuC of a cFSC curve is a proxy for directional signal content. If wAuC is relatively constant when the conical axis is varied, then the signal is isotropic in viewing direction. This plot helps illustrate the variation in cFSC wAuC and can aid in diagnosing the ‘structure’ of anisotropy.

cFSC resolution vs. conical axis

This plot is similar to the plot above, but visualizes the 0.143 crossing, rather than wAuC, of each cFSC curve.

cFSC summaries within azimuth/elevation regions

To add back in a coarse notion of directionality to the above plot, we reproduce the same statistics for twelve different regions of axis space. This plot can help identify differences in cFSC variance to further elucidate the source of anisotropy.

Summary of cFSC curves

Updated in v4.5. We summarize all cFSC curves in this plot, visualizing statistics as a function of spatial frequency rather than conical axis. As of v4.5, this plot also displays the cFAR score.

Relative signal

New in v4.5. Relative signal visualized in a 2D azimuth-elevation chart (left), and in a 3D coloured scatter plot (right) with a low-pass-filtered volume embedded within. Low relative signal (i.e., darker colours) indicates a region with under-represented views.

Relative signal in azimuth / elevation regions

New in v4.5. Relative signal within twelve regions of the viewing sphere, defined by different limits on azimuth and elevation. For each region, we show the projection of the structure from the central viewing direction, as well as the mean relative signal withing that region. Regions with low relative signal represent missing or underrepresented views in the data.

3DFSC volume

The 3DFSC volume (Tan et. al, 2017) is another way to summarize cFSC curves by storing them in a volume whose voxels are interpolated from cFSC values at the nearest conical axis. In this plot, we visualize the 3DFSC volume via central slices. The ‘sphericity’ of the volume (which is output by the job) is a proxy for anisotropy.

Fourier Sampling

Particle scale factor vs. viewing direction

(Only generated if particles are connected and per-particle scales are not all 1.0). This figure visualizes the average particle scale for a set of viewing directions (uniformly sampled on the viewing sphere).

References

Tan et al. (2017), Addressing preferred specimen orientation in single-particle cryo-EM through tilting. Nat Methods 14(8), 793-796.

Baldwin, P. R., & Lyumkis, D. (2020). Non-uniformity of projection distributions attenuates resolution in Cryo-EM. Progress in biophysics and molecular biology 150, 160-183.

Given a conical Fourier shell correlation, Cr(v^)C_r (\hat{v})Cr​(v^), (where rrr is the Fourier radius in wave number and v^\hat{v}v^ is the conical axis), we define the wAuC as

In this weighted sum, the Fourier radius, rrr, ranges from the DC component to the radius at which Cr(v^)C_r(\hat{v})Cr​(v^) first crosses 0.143. Intuitively, for each Fourier radius rrr, the correlation between the half maps is multiplied by the surface area of the Fourier shell at rrr. The final result is proportional to the ‘mass’ of the cone in units of correlation.

We define the cFSC as the ratio of the minimum to the maximum wAuC(v^)\text{wAuC}(\hat{v})wAuC(v^) over v^\hat{v}v^, or

cFAR=Δmin⁡v^wAuC(v^)max⁡v^wAuC(v^).\text{cFAR} \overset{\Delta}{=} \frac{\min_{\hat{v}} \text{wAuC}(\hat{v})}{\max_{\hat{v}} \text{wAuC}(\hat{v})}. cFAR=Δmaxv^​wAuC(v^)minv^​wAuC(v^)​.

To compute the SCF, we consider the sampling of Fourier bins at a particular radius, RRR. In total there are ~2πR22 \pi R^22πR2 unique bins in Fourier space. For each particle viewing direction v^\hat{v}v^, we compute its associated sampling via the slab condition (Baldwin and Lyumkis, 2020):

Sp(k^,v^,R)=Δ1(k^⋅v^≤12R),\text{Sp}(\hat{k}, \hat{v}, R) \overset{\Delta}{=} \boldsymbol{1} ( \hat{k} \cdot \hat{v}\leq \frac{1}{2 R} ),Sp(k^,v^,R)=Δ1(k^⋅v^≤2R1​),

where k^\hat{k}k^ is a unit vector that defines a Fourier voxel on the shell of radius RRR, and 1(⋅)\boldsymbol{1}(\cdot)1(⋅) is the indicator function. Intuitively, this function returns 1 for all Fourier voxels that belong to a ring of radius RRR, within a plane orthogonal to v^\hat{v}v^ (and 0 otherwise). Next, we sum Sp(k^,v^,R)\text{Sp}(\hat{k}, \hat{v}, R)Sp(k^,v^,R) for all particle viewing directions to produce Sp\text{Sp}Sp, a single set of values that indicate the number of times each bin was sampled. The SCF can then be computed as

SCF=(<Sp><1Sp>)−1,\text{SCF} = \left( <\text{Sp}> <\frac{1}{\text{Sp}}> \right)^{-1},SCF=(<Sp><Sp1​>)−1,

where 1SP\frac{1}{\text{SP}}SP1​ denotes element-wise reciprocals, and <⋅><\cdot><⋅> is the arithmetic mean. This value is positive and always less than or equal to 1. Higher numbers indicate more uniform sampling distributions. If there are zeros amongst the sampling set, the above will be not defined. To account for this potential we report

SCF*=(<Sp∗>p(p<1Sp∗>+q))−1,\text{SCF*} = \left(\frac{<\text{Sp}^*>}{p} \left(p <\frac{1}{\text{Sp}^*}> + q \right) \right)^{-1},SCF*=(p<Sp∗>​(p<Sp∗1​>+q))−1,

where qqq is the fraction of zero sampling bins, p=1−qp = 1 - qp=1−q, and Sp∗\text{Sp}^*Sp∗ are the non-zero sampling values. Note that if q=0q=0q=0, then SCF=SCF*\text{SCF} = \text{SCF*}SCF=SCF*. Please refer to (Baldwin and Lyumkis, 2021) for more details.

(Only generated if particles are connected). These plots visualize the Fourier sampling accumulated over a random subset of the particle viewing directions (default: 10000) — Fourier sampling is anti-podally symmetric (and hence only has ~ 2πR22 \pi R^22πR2 bins) so we visualize only the z>0z>0z>0 hemisphere, following the original publication (Baldwin, P. R., & Lyumkis, D., 2020). N.B., the elevation / azimuth plot on the left should be visually similar to the Posterior Precision plot as posterior precision measures Fourier sampling modulated by the CTF.

Orientation Diagnostics tutorial
volumes group
Conical vs. toroidal sections and their relation to the Fourier Slice Theorem.
FSC curves computed within a toroidal section. Each curve is coloured by its relative signal, which we define to be the wAuC of each curve, normalized with respect to the maximum. We visualize each curve as a single number on an azimuth-elevation chart, and a 3D viewing sphere that encompasses a low-pass-filtered 3D volume.
In blue: statistics over cFSC curves: mean, min, max, +/- one standard deviation plotted against spatial frequency. In green: histogram over 0.143 crossings of the same curves.
Relative signal vs. viewing direction (left: azimuth/elevation, right: 3D coloured scatter plot with structure embedded inside).
Relative signal within 12 azimuth/elevation regions.
Central slices of the 3DFSC volume (Tan et. al, 2017) composed of interpolated cFSC values. This volume can be inspected via Chimera(X).
The Fourier sampling Sp\text{Sp}Sp (see equation in mathematical definition) visualized in 3D (right) and via an azimuth / elevation parameterization of the hemisphere (left).
(top) particle scale factors visualized by colour as function of particle viewing direction. (bottom) particle scale factor histogram (reproduced in other refinement jobs).