CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • Overview
  • When to use this job
  • Build and launch job
  • Overview mode: visualize and create plots for all micrographs
  • Individual mode: visualize plots for one micrograph at a time
  • View outputs and continue processing
  1. Guides for v3

Tutorial: Manually Curate Exposures (v3)

Manually Curate Exposures is an interactive job in CryoSPARC that enables a user to visually inspect and curate a set of micrographs or movies. This tutorial refers to CryoSPARC v3.3 and earlier.

PreviousGet Started with CryoSPARC: Introductory Tutorial (v3)NextQuestions and Support

Last updated 2 years ago

The information in this section applies to CryoSPARC ≤v3.3. For CryoSPARC v4.0+, please see: Interactive Jobs

Overview

Manually Curate Exposures is an interactive job in CryoSPARC that enables a user to visually inspect and curate a set of micrographs or movies, using either population-level statistics and adjustable thresholds, or individual inspection of diagnostic plots.

This interactive job allows you to:

  • Load a stack of (i) micrographs, (ii) movies or (iii) micrographs and particles

  • View and sort the stack by certain metrics associated with the data you loaded, e.g., average defocus, astigmatism, CTF fit, motion trajectories and power scores relating to picked particles

  • Create and visualize interactive plots to view the distribution of micrographs/movies over different parameters, and identify outliers

  • Adjust thresholds to bulk-exclude micrographs based on the statistic of interest

  • View available CTF diagram (to inspect Thon rings), CTF fit, and rigid and local motion trajectory plots associated with an individual micrograph, all in one place

  • Accept or reject micrographs/movies from a stack, for further processing

When to use this job

The overall goal of this interactive job is to aid in cleaning up your data so that low-quality micrographs, and their associated particles, do not detract from achieving the highest possible resolution refined structures.

After pre-processing: After Patch Motion Correction and Patch CTF estimation, you can use Manually Curate Exposures to help you identify and exclude micrographs with sub-optimal characteristics, e.g., broken or thick ice, carbon edges, too much motion, etc.

After particle picking and local motion correction: Once you have picked particles and estimated location motion trajectories, you can use this information in Manually Curate Exposures to identify and exclude micrographs associated with those picks whose local motion trajectories deviate from the norm for your dataset. In this case, the job will output a filtered set of micrographs as well as particles.

Build and launch job

  • Select Manually Curate Exposures from the Job Builder:

  • Drag and drop the desired inputs from previous jobs. You can connect (a) micrographs only, (b) movies only, or (c) micrographs/movies and particles.

  • There are no parameters to adjust for this interactive job, so simply click Queue to launch the job.

Overview mode: visualize and create plots for all micrographs

Overview and Individual mode: The default view is Overview. An explanation of the Individual view can be found below.

Table of exposures: On the left, exposures are listed in a table with index values, and summary statistics are available at the top of the table. In this case, we are looking at a total of 1536 micrographs.

Selected: At the start of the job, all loaded micrographs are 'Selected', as indicated at the top of the table and their values in blue in the table. Once we begin adjusting the interactive plot and thresholds, micrographs whose statistics do not fall within the selected thresholds will become un-selected, and their values will turn grey in the table.

Available columns: A number of columns are displayed depending on the type of input. For example, because we loaded micrographs and particles with local motion trajectories, we see columns displaying not only those statistics associated with micrographs (e.g., average defocus, astigmatism, CTF fit, etc.) but also those corresponding to the picks and local motion trajectories (pick CC, pick power, local motion distribution, etc.) Click on a statistic to sort the table.

Create plots: The remainder of the window is dedicated to an interactive plot. All micrographs in the table are displayed in the plot. The X-Axis and Y-Axis drop-down menus directly below allow you to select different statistics by which to plot the micrographs. Selecting a different value from the drop-down will automatically refresh the plot. Common plots include:

X-Axis

Y-Axis

Notes

Average defocus (A)

Astigmatism (A)

General range of CTF parameters in the dataset

CTF Fit resolution (A)

Total full-frame motion distance (pixels)

Two most common metrics for filtering bad data - large motions or poor CTF resolution indicate problems during exposure

Index

Phase Shift (deg)

Plot showing change of phase shift over time during data collection (NB: micrographs should be imported in chronological order for this to be correct)

Interact with plots: Hover over the plot area and a toolbar will appear at the top. These tools allow you to: download the plot as a PNG file, zoom, pan, and reset the axes. Note: Selections in the plot currently do NOT affect selection or acception/rejection of micrographs. Use the threshold sliders below the plot to make a selection and then the buttons above the plot to accept/reject/invert your selection.

Adjust thresholds to select micrographs: Once you have explored the distribution of micrographs on one or more plots and have identified outliers, you can adjust the various thresholds below the plot to filter the micrographs. The corresponding values in the table will turn grey. (Note: The plot does not currently reflect your selection - all micrographs will be shown on the plot.) For example, here we plotted CTF fit resolution (A) on both the x-axis and y-axis, and then adjusted the CTF fit resolution (A) slider to keep only those micrographs with a value of less than 8.48 A. In the table, 3 micrographs are greyed out, indicating they do not fall within the threshold values.

Accept selection: To keep all micrographs with CTF values falling within the desired range, click 'Accept Selection' at the top of the plot. Corresponding micrographs will then be highlighted green in the table.

Reject selection: Alternatively, you can reject micrographs with statistics falling within a certain range, following the same process as above, but click 'Reject selection' above the plot. Rejected micrographs will turn red in the table.

When you have finished inspecting and curating exposures, click Done to exit and complete the job.

Note that all micrographs in green will be included in the micrographs_accepted output of the job, micrographs in red will be included in the micrographs_rejected output, but a selection (blue highlight) will not affect the output unless the selection is accepted or rejected.

Individual mode: visualize plots for one micrograph at a time

To switch to `Individual' mode, click on the button at the top, or by clicking on an individual row in the table:

Select a row to view details for that micrograph:

You can then view CTF plots, motion trajectories and other available plots corresponding to the selected exposure. It is also possible to move to the next exposure in the table (using the left/right arrows), as well as Accept or Reject the individual micrograph from this view. You can also click on any individual plot to enlarge it.

When you have finished inspecting and curating exposures, click Done to exit and complete the job. Note that all micrographs in green will be included in the micrographs_accepted output of the job, micrographs in red will be included in the micrographs_rejected output, but a selection (blue highlight) will not affect the output unless the selection is accepted or rejected.

View outputs and continue processing

After clicking Done, the job will finish running and a list of outputs will become available. These can be used for further processing as required.

Common next steps include:

  • Runningparticles_accepted through a 2D Classification job, and/or starting an Ab-Initio Reconstruction using only these particles, followed by Refinement

  • Using micrographs_accepted to continue processing particle picking and local motion correction using only the good data