CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • 1. Deep Picker Train
  • Parameters
  • Interpreting Training Results
  • Recovering from Training Failure
  • 2. Deep Picker Inference
  • Parameters
  • Interpreting Training Results from Deep Picker Inference
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. Deep Picking
  4. Deep Network Particle Picker

Job: Deep Picker Train and Job: Deep Picker Inference

Deep picking job types.

1. Deep Picker Train

To perform particle picking using the deep picker, a model must first be trained using the Deep Picker Train job. Both of these jobs require the same inputs and produce the same outputs as listed below:

Inputs

  • Particle Picks

  • Micrographs

  • Deep Picker Model (Optional)

Outputs

  • Deep Picker Model

  • Micrographs

Parameters

The Deep Picker Train job features various parameters. The training parameters are detailed below:

  • Particle Diameter (A)

    • Diameter of particles in Angstroms

  • Initial Learning Rate and Final Learning Rate

    • The values that determine the extent by which model weights are updated. Higher values will result with training approaching an optimum faster but may prevent the model from reaching the optimum itself, resulting with potentially worse final accuracy. The learning rate is split into two values as deep picker training has been found to benefit from learning rate decay. The training will begin by using the value provided in the initial learning rate parameter and with each epoch, steadily change until it becomes the value provided in the final learning rate parameter by the final epoch.

  • Minibatch Size

    • The number of examples that are used within each batch during training. Lower values may improve model accuracy at the cost of increased training time. The learning rate will have to be tuned based on the minibatch size.

  • Number of Epochs

    • The number of iterations through the entire dataset the training performs. Higher number of epochs will naturally lead to longer training times.

  • Validation Set Fraction

    • The fraction of the dataset to use for validation. For example, a value of 0.2 will use 80% of the input micrographs for training and the remaining 20% for testing. The validation loss and accuracy will be provided at each epoch. It is highly recommended to use a fraction greater than 0.

  • Test Set Fraction

    • The fraction of the dataset to use for testing. The test loss and accuracy will only be provided at the end of training as a means of confirming that the model did not overfit.

  • Shape of Split Micrographs

    • The deep picker will split input micrographs into patches to be input into the model. The value input into this parameter will determine the shape of these patches. For example, if the default value of 256 is used, then the shape of the patches will be 256x256 pixels.

The preprocessing parameters are detailed below:

  • Number of Parallel Threads

    • Number of threads to distribute preprocessing over. This parameter decreases the preprocessing time by a factor approximately equal to the input value. It is recommended to set this value to at least 4 as the processing time is often a bottleneck in the time performance of the job. Values less than 2 will default to a single thread.

  • Desired Pixels per Angstrom

    • The pixels per Angstrom to normalize the input micrographs to before training.

  • Degree of Lowpass Filtering

    • The degree by which to lowpass filter the micrographs before training. Lower values will result with increased lowpass filtering. Values must be greater than 0.

  • Use Denoised Micrographs

    • Determines whether to use denoised or original micrographs if denoised micrographs are input into the training job. This parameter has no impact if the input micrographs were not denoised.

Interpreting Training Results

Once training using the Deep Picker Train job is complete, it will output two plots indicating the performance on the training and validation sets over each epoch. The first plot presents the training and validation losses, while the second plot presents the training and validation accuracies. The x-axis for both plots indicates the epoch and the y-axis indicates the data that the corresponding plot is presenting. Successfully trained models will have losses that decrease overtime and accuracies that increase overtime. It should be noted that losses and accuracies may change in an undesirable fashion and then correct itself with more training.

The validation loss and accuracy should ideally trail slightly behind the training loss and accuracy or have a negligible difference.

Below is an example of plots from a well-performing deep picking model.

Recovering from Training Failure

In the case that the Deep Picker Train job fails during training, the job will still output a Deep Picker Model. This model will be the model at the epoch with the lowest validation loss prior to failure. The training on this model can be resumed by passing this output as the Deep Picker Model input of another Deep Picker Train job then setting the "resume training" parameter on. The job will then continue training from the point that it saved. Otherwise, the job will begin training anew using the input model parameters as an initialization.

2. Deep Picker Inference

Once the Deep Picker Train job has been used to train a deep particle picking model it can be used to pick particles from micrographs using the Deep Picker Inference job. This job has the following inputs and outputs:

Inputs

  • Deep Picker Model

  • Micrographs

Outputs

  • Particle Picks

  • Micrographs

Parameters

The Deep Picker Inference job features various parameters. The parameters are detailed below:

  • Use Pretrained Model

    • Use cryoSPARC-included pretrained model for inference. If a model is input and this parameter is selected, the job will use the pretrained model instead of the input model.

  • Inference Pixel Threshold

    • Minimum number of pixels required for an output to be considered a particle.

  • Specific Device to Use

    • Index of device to use for training. -1 will force CPU usage.

  • Number of Parallel Threads

    • Number of threads to distribute preprocessing over. This parameter decreases the preprocessing time by a factor approximately equal to the input value. It is recommended to set this value to at least 4 as the processing time is often a bottleneck in the time performance of the job. Values less than 2 will default to a single thread.

  • Show Plots

    • Show one micrograph input, and its corresponding model outputs and particle locations.

Interpreting Training Results from Deep Picker Inference

The particle picks from the Deep Picker Inference job can be observed and have a threshold applied using the Inspect Particle Picks job. This job interacts with particle picks from Deep Picker Inference differently in that it enable a user to apply a threshold based on Topaz model performance rather than power score. To do so, vary the power score threshold in the Inspect Particle Picks job. This number is the a percentage indicating how confident the model is with its prediction.

All particles outputted from Deep Picker Inference must be processed using the Extract from Micrographs job in CryoSPARC. This updates the CTF information within the particle picks and makes the picks compatible with other CryoSPARC jobs such as Ab-Initio Reconstruction.

PreviousT20S Proteasome: Deep Particle Picking TutorialNextTopaz (Bepler, et al)

Last updated 2 years ago

Loss and Accuracy Plots for a Deep Picker Training job
Picked particles observed in the Inspect Particle Picks job