CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • At a Glance
  • Description
  • Inputs
  • Particles
  • Volumes
  • Reference volume
  • Commonly Adjusted Parameters
  • Select Mode
  • Resolution threshold (relative to best)
  • Exclude classes worse than resolution (A)
  • Thresholds
  • Lowpass filter resolution (A)
  • Outputs
  • Particles selected
  • Volumes selected
  • Particles excluded
  • Volumes excluded
  • Diagnostic plots
  • Common Next Steps
  • References
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. Conformational Variability

Job: Reference Based Auto Select 3D (BETA)

PreviousJob: Regroup 3D ClassesNextJob: 3D Flexible Refinement (3DFlex) (BETA)

Last updated 2 months ago

At a Glance

Select 3D volumes based on their similarity to a reference.

Description

Reference Based Auto Select 3D uses an existing 3D reference to select volumes which are similar to the reference, and reject volumes which are dissimilar. If particles are included with the job, particles will be assigned to a selected or excluded output according to the status of the volume they belong to.

Similarity of the input volumes to the reference volume is assessed by calculating two correlations: an average FSC and the Pearson correlation coefficient. In both cases, a higher number means the volumes are more similar, with the value for identical volumes being 1.0.

The average FSC calculated by Reference Based Auto Select 3D is the average correlation between the reference volume and the input volume over all resolution shells, thereby yielding a single value. Note that this is different from the GSFSC used to assess resolution in most refinement jobs, which is calculated between independent half-maps of the same refinement.

The Pearson correlation coefficient measures the similarity in real space of each voxel of the input and reference volumes, and is calculated over the entire 3D box.

Inputs

Particles

This input is optional. If provided, particles which belong to a volume selected by Reference Based Auto Select 3D will be selected, while particles belonging to a rejected volume will be excluded. Particle poses will not be changed in the output of this job.

Note that particles should come from the same job as the input volumes.

Volumes

Reference volume

The volume to which the input volumes will be compared. This volume will be lowpass filtered before the Volumes are aligned and compared to it. The reference volume does not need to come from the same dataset as the input volumes.

Commonly Adjusted Parameters

Select Mode

Select by Resolution Only was added in CryoSPARC v4.7. In older versions, Select Mode does not exist and the job always uses a reference.

Reference Based Auto Select 3D can select volumes in two ways: by resolution only, or by comparing to a reference. The mode is selected by this parameter.

Resolution threshold (relative to best)

This parameter is the only parameter required by Reference Based Auto Select 3D when using the Select by Resolution Only select mode.

All of the input volumes' FSC resolutions are compared to that of the best input volume. For each volume, if the reciprocal of the FSC resolution divided by the reciprocal of the best FSC resolution, the volume is selected.

For example, consider a job with the Resolution threshold set to 0.75 and input volumes with FSC resolutions of 2.8, 3.2, 5, and 8 Å. The best resolution is 2.8 Å. The reiprocal ratios of the other volumes' FSC ratios are 0.875, 0.560, and 0.350 respectively. Only the first and second volumes have ratios greater than 0.75, so those volumes are selected and the others are rejected.

Exclude classes worse than resolution (A)

Classes with an FSC resolution worse (i.e., higher numeric value) than this number are excluded regardless of the correlations with the reference volume.

Thresholds

Volumes with a volume-to-reference FSC worse than the FSC threshold and volumes with a Pearson correlation coefficient worse than the Pearson threshold are excluded. Note that volumes are excluded if either one of their correlation coefficients are worse than the respective threshold.

Lowpass filter resolution (A)

Before volumes are aligned and correlations are calculated, the reference volume is lowpass filtered. If this parameter is left blank, the reference will be filtered to the best (i.e., lowest numeric value) GSFSC resolution of the input Volumes. If this parameter is set, the reference volume will be filtered to this resolution instead. Note that if this parameter is set, the Average FSC value for a given input volume is calculated only up to this resolution.

Outputs

Particles selected

Particles belonging to selected volumes are in this output. Note that even though the input volumes are aligned to the reference during the Reference Based Auto Select 3D, the particles’ poses are unchanged. This output is not present if particles were not provided.

Volumes selected

Particles excluded

Particles belonging to excluded volumes are in this output. This output is not present if particles were not provided.

Volumes excluded

Diagnostic plots

In addition to slices through the aligned input volumes, Reference Based Auto Select 3D produces a plot of each volume’s FSC and Pearson correlation coefficient, the thresholds, and whether each volume as accepted or rejected.

Common Next Steps

Reference Based Auto Select 3D is typically run manually once per sample type to determine useful parameters for future automated use.

References

  1. Kumar, K. et al. Structure of a Signaling Cannabinoid Receptor 1-G Protein Complex. Cell 176, 448-458.e12 (2019).

Volumes which will be compared with the reference. Note that volumes will be aligned to the reference before comparison. Note that this is a input.

Although, in general, good volumes should have better correlation scores than bad volumes at any resolution level, the relative numeric value of the correlation scores depends on the filter resolution. Thus, for unsupervised selection of volumes (for instance, as part of a ), we recommend that this parameter is set to a specific value while searching for the appropriate threshold values, and then is later set to the same value in the workflow.

Volumes for which both correlation scores were better than the respective threshold are output here. Note that this is a output and includes a series result containing a of all volumes.

Volumes for which either correlation score was better than the respective threshold are output here. Note that this is a output and includes a series result containing a of all volumes.

Once useful thresholds for a given target have been determined, Reference Based Auto Select 3D can play an important role in automated processing using . For instance, this job can be included in an automated pipeline after jobs which generate several 3D volumes of unknown quality (such as , , or ) and before a downstream or . In this way, the Workflow can proceed from particle and volume curation to a high-quality consensus refinement without any user intervention, providing a degree of automation for known samples.

Since Reference Based Auto Select 3D outputs a number of selected volumes that is unknown at the time of building the job, it is not possible to know which of the output volumes to use for a downstream refinement when setting up an automated workflow. In this case, a single, average volume for refinement can be created by connecting the selected volumes to a job and setting Number of super classes to 1.

volumes group
Workflow
volumes group
downloadable zip file
volumes group
downloadable zip file
Workflows
Ab Initio Reconstruction
Heterogeneous Refinement
3D Classification
Homogeneous
Nonuniform Refinement
Regroup 3D Classes
Volumes in this image produced using data from EMPIAR 10288 (Kumar et al. 2019)