CryoSPARC Guide
  • About CryoSPARC
  • Current Version
  • Licensing
    • Non-commercial license agreement
  • Setup, Configuration and Management
    • CryoSPARC Architecture and System Requirements
    • CryoSPARC Installation Prerequisites
    • How to Download, Install and Configure
      • Obtaining A License ID
      • Downloading and Installing CryoSPARC
      • CryoSPARC Cluster Integration Script Examples
      • Accessing the CryoSPARC User Interface
    • Deploying CryoSPARC on AWS
      • Performance Benchmarks
    • Using CryoSPARC with Cluster Management Software
    • Software Updates and Patches
    • Management and Monitoring
      • Environment variables
      • (Optional) Hosting CryoSPARC Through a Reverse Proxy
      • cryosparcm reference
      • cryosparcm cli reference
      • cryosparcw reference
    • Software System Guides
      • Guide: Updating to CryoSPARC v4
      • Guide: Installation Testing with cryosparcm test
      • Guide: Verify CryoSPARC Installation with the Extensive Validation Job (v4.3+)
      • Guide: Verify CryoSPARC Installation with the Extensive Workflow (≤v4.2)
      • Guide: Performance Benchmarking (v4.3+)
      • Guide: Download Error Reports
      • Guide: Maintenance Mode and Configurable User Facing Messages
      • Guide: User Management
      • Guide: Multi-user Unix Permissions and Data Access Control
      • Guide: Lane Assignments and Restrictions
      • Guide: Queuing Directly to a GPU
      • Guide: Priority Job Queuing
      • Guide: Configuring Custom Variables for Cluster Job Submission Scripts
      • Guide: SSD Particle Caching in CryoSPARC
      • Guide: Data Management in CryoSPARC (v4.0+)
      • Guide: Data Cleanup (v4.3+)
      • Guide: Reduce Database Size (v4.3+)
      • Guide: Data Management in CryoSPARC (≤v3.3)
      • Guide: CryoSPARC Live Session Data Management
      • Guide: Manipulating .cs Files Created By CryoSPARC
      • Guide: Migrating your CryoSPARC Instance
      • Guide: EMDB-friendly XML file for FSC plots
    • Troubleshooting
  • Application Guide (v4.0+)
    • A Tour of the CryoSPARC Interface
    • Browsing the CryoSPARC Instance
    • Projects, Workspaces and Live Sessions
    • Jobs
    • Job Views: Cards, Tree, and Table
    • Creating and Running Jobs
    • Low Level Results Interface
    • Filters and Sorting
    • View Options
    • Tags
    • Flat vs Hierarchical Navigation
    • File Browser
    • Blueprints
    • Workflows
    • Inspecting Data
    • Managing Jobs
    • Interactive Jobs
    • Upload Local Files
    • Managing Data
    • Downloading and Exporting Data
    • Instance Management
    • Admin Panel
  • Cryo-EM Foundations
    • Image Formation
      • Contrast in Cryo-EM
      • Waves as Vectors
      • Aliasing
  • Expectation Maximization in Cryo-EM
  • Processing Data in cryoSPARC
    • Get Started with CryoSPARC: Introductory Tutorial (v4.0+)
    • Tutorial Videos
    • All Job Types in CryoSPARC
      • Import
        • Job: Import Movies
        • Job: Import Micrographs
        • Job: Import Particle Stack
        • Job: Import 3D Volumes
        • Job: Import Templates
        • Job: Import Result Group
        • Job: Import Beam Shift
      • Motion Correction
        • Job: Patch Motion Correction
        • Job: Full-Frame Motion Correction
        • Job: Local Motion Correction
        • Job: MotionCor2 (Wrapper) (BETA)
        • Job: Reference Based Motion Correction (BETA)
      • CTF Estimation
        • Job: Patch CTF Estimation
        • Job: Patch CTF Extraction
        • Job: CTFFIND4 (Wrapper)
        • Job: Gctf (Wrapper) (Legacy)
      • Exposure Curation
        • Job: Micrograph Denoiser (BETA)
        • Job: Micrograph Junk Detector (BETA)
        • Interactive Job: Manually Curate Exposures
      • Particle Picking
        • Interactive Job: Manual Picker
        • Job: Blob Picker
        • Job: Template Picker
        • Job: Filament Tracer
        • Job: Blob Picker Tuner
        • Interactive Job: Inspect Particle Picks
        • Job: Create Templates
      • Extraction
        • Job: Extract from Micrographs
        • Job: Downsample Particles
        • Job: Restack Particles
      • Deep Picking
        • Guideline for Supervised Particle Picking using Deep Learning Models
        • Deep Network Particle Picker
          • T20S Proteasome: Deep Particle Picking Tutorial
          • Job: Deep Picker Train and Job: Deep Picker Inference
        • Topaz (Bepler, et al)
          • T20S Proteasome: Topaz Particle Picking Tutorial
          • T20S Proteasome: Topaz Micrograph Denoising Tutorial
          • Job: Topaz Train and Job: Topaz Cross Validation
          • Job: Topaz Extract
          • Job: Topaz Denoise
      • Particle Curation
        • Job: 2D Classification
        • Interactive Job: Select 2D Classes
        • Job: Reference Based Auto Select 2D (BETA)
        • Job: Reconstruct 2D Classes
        • Job: Rebalance 2D Classes
        • Job: Class Probability Filter (Legacy)
        • Job: Rebalance Orientations
        • Job: Subset Particles by Statistic
      • 3D Reconstruction
        • Job: Ab-Initio Reconstruction
      • 3D Refinement
        • Job: Homogeneous Refinement
        • Job: Heterogeneous Refinement
        • Job: Non-Uniform Refinement
        • Job: Homogeneous Reconstruction Only
        • Job: Heterogeneous Reconstruction Only
        • Job: Homogeneous Refinement (Legacy)
        • Job: Non-uniform Refinement (Legacy)
      • CTF Refinement
        • Job: Global CTF Refinement
        • Job: Local CTF Refinement
        • Job: Exposure Group Utilities
      • Conformational Variability
        • Job: 3D Variability
        • Job: 3D Variability Display
        • Job: 3D Classification
        • Job: Regroup 3D Classes
        • Job: Reference Based Auto Select 3D (BETA)
        • Job: 3D Flexible Refinement (3DFlex) (BETA)
      • Postprocessing
        • Job: Sharpening Tools
        • Job: DeepEMhancer (Wrapper)
        • Job: Validation (FSC)
        • Job: Local Resolution Estimation
        • Job: Local Filtering
        • Job: ResLog Analysis
        • Job: ThreeDFSC (Wrapper) (Legacy)
      • Local Refinement
        • Job: Local Refinement
        • Job: Particle Subtraction
        • Job: Local Refinement (Legacy)
      • Helical Reconstruction
        • Helical symmetry in CryoSPARC
        • Job: Helical Refinement
        • Job: Symmetry search utility
        • Job: Average Power Spectra
      • Utilities
        • Job: Exposure Sets Tool
        • Job: Exposure Tools
        • Job: Generate Micrograph Thumbnails
        • Job: Cache Particles on SSD
        • Job: Check for Corrupt Particles
        • Job: Particle Sets Tool
        • Job: Reassign Particles to Micrographs
        • Job: Remove Duplicate Particles
        • Job: Symmetry Expansion
        • Job: Volume Tools
        • Job: Volume Alignment Tools
        • Job: Align 3D maps
        • Job: Split Volumes Group
        • Job: Orientation Diagnostics
      • Simulations
        • Job: Simulate Data (GPU)
        • Job: Simulate Data (Legacy)
    • CryoSPARC Tools
    • Data Processing Tutorials
      • Case study: End-to-end processing of a ligand-bound GPCR (EMPIAR-10853)
      • Case Study: DkTx-bound TRPV1 (EMPIAR-10059)
      • Case Study: Pseudosymmetry in TRPV5 and Calmodulin (EMPIAR-10256)
      • Case Study: End-to-end processing of an inactive GPCR (EMPIAR-10668)
      • Case Study: End-to-end processing of encapsulated ferritin (EMPIAR-10716)
      • Case Study: Exploratory data processing by Oliver Clarke
      • Tutorial: Tips for Membrane Protein Structures
      • Tutorial: Common CryoSPARC Plots
      • Tutorial: Negative Stain Data
      • Tutorial: Phase Plate Data
      • Tutorial: EER File Support
      • Tutorial: EPU AFIS Beam Shift Import
      • Tutorial: Patch Motion and Patch CTF
      • Tutorial: Float16 Support
      • Tutorial: Particle Picking Calibration
      • Tutorial: Blob Picker Tuner
      • Tutorial: Helical Processing using EMPIAR-10031 (MAVS)
      • Tutorial: Maximum Box Sizes for Refinement
      • Tutorial: CTF Refinement
      • Tutorial: Ewald Sphere Correction
      • Tutorial: Symmetry Relaxation
      • Tutorial: Orientation Diagnostics
      • Tutorial: BILD files in CryoSPARC v4.4+
      • Tutorial: Mask Creation
      • Case Study: Yeast U4/U6.U5 tri-snRNP
      • Tutorial: 3D Classification
      • Tutorial: 3D Variability Analysis (Part One)
      • Tutorial: 3D Variability Analysis (Part Two)
      • Tutorial: 3D Flexible Refinement
        • Installing 3DFlex Dependencies (v4.1–v4.3)
      • Tutorial: 3D Flex Mesh Preparation
    • Webinar Recordings
  • Real-time processing in cryoSPARC Live
    • About CryoSPARC Live
    • Prerequisites and Compute Resources Setup
    • How to Access cryoSPARC Live
    • UI Overview
    • New Live Session: Start to Finish Guide
    • CryoSPARC Live Tutorial Videos
    • Live Jobs and Session-Level Functions
    • Performance Metrics
    • Managing a CryoSPARC Live Session from the CLI
    • FAQs and Troubleshooting
  • Guides for v3
    • v3 User Interface Guide
      • Dashboard
      • Project and Workspace Management
      • Create and Build Jobs
      • Queue Job, Inspect Job and Other Job Actions
      • View and Download Results
      • Job Relationships
      • Resource Manager
      • User Management
    • Tutorial: Job Builder
    • Get Started with CryoSPARC: Introductory Tutorial (v3)
    • Tutorial: Manually Curate Exposures (v3)
  • Resources
    • Questions and Support
Powered by GitBook
On this page
  • At a Glance
  • Description
  • Inputs
  • Micrographs
  • Commonly Adjusted Parameters
  • Outputs
  • Micrographs processed
  • Micrographs incomplete
  • Diagnostic plots
  • Ice thickness
  • Common Next Steps
  • Implementation Details
  • References
  1. Processing Data in cryoSPARC
  2. All Job Types in CryoSPARC
  3. CTF Estimation

Job: Patch CTF Estimation

Patch-based CTF estimation.

PreviousCTF EstimationNextJob: Patch CTF Extraction

Last updated 5 months ago

At a Glance

Estimate the Contrast Transfer Function for micrographs, accounting for the fact that the sample may not be perfectly flat.

Description

Patch-based CTF estimation automatically estimates a defocus landscape for tilted, bent, deformed samples and is accurate for all particle sizes and types including flexible and membrane proteins. This is accomplished by a fast GPU implementation that usually takes 1 - 2 seconds per micrograph. No prior knowledge about particle locations is needed.

Inputs

Micrographs

Patch CTF Estimation requires motion-corrected micrographs, typically straight from a job.

Commonly Adjusted Parameters

The default parameters for this job are often sufficient for high-quality results.

Outputs

Micrographs processed

Micrographs with CTF estimates. During particle extraction, these estimates are used to calculate a local CTF at a particle’s precise location.

Micrographs incomplete

Micrographs which were not successfully corrected are output in this group. Typically this is due to some error specific to the micrograph file — the Event Log should contain more information on why a particular micrograph failed.

Diagnostic plots

Several diagnostic plots are also produced for each of a number of micrographs.

1D search plot

This plot indicates the quality of fit for a 1D search over defocus. Higher values indicate a better fit between the idealized CTF at that defocus and the data. Ideally, a single sharp peak is observed, indicating that there is one defocus that matches much better than the others.

2D defocus landscape

The defocus landscape displays the modeled defocus over the entire micrograph. Typically, this landscape should display some variation that captures the shape of the ice layer.

CTF Fit

The CTF fit helps you assess the quality of your data, and the quality of the CTF fit to that data. There is a lot of information in this plot, so we will build it up piece by piece.

First, the black line is the radial average of the power spectrum of the image. The Thon rings (used to fit the CTF) are present as oscillations between 0 and 1 in this image. This plot accounts for astigmatism using equi-phase averaging (e.g., similar to GCTF [1]).

The red line is the ideal CTF which has been found by Patch CTF Estimation. Note that this is the ideal CTF at the average defocus across the micrograph — each patch will have a slightly different function fitted to it. Ideally, this red line perfectly coincides with the black line.

We can measure how well the power spectrum and the ideal CTF match by calculating the correlation between the two. This is plotted in blue. The point at which this line crosses 0.3 is typically called the CTF fit resolution, and is marked in the plot with a green vertical line. Note that this is not necessarily a hard limit on the quality of your data, and the images are not filtered to this resolution — it simply gives you an estimate of what quality to expect from this image.

The final image, with all three of these lines, is displayed below. Note that the plot title also contains some useful information

  • The defoci on the major and minor axes are reported in Å (DF1 and DF2, respectively)

  • The astigmatism angle, in radians, is given (ANGAST)

  • The phase shift (if any) is reported (PHASE)

  • The fit resolution is reported in Å (FIT)

Ice thickness

The relative ice thickness is measured by comparing the background signal in a band centered on 0.265 Å-1 (indicated by a blue fill) to a wider band which includes this region (indicated by the green bars). If this band has high background, it means there is more ice in the image which, assuming ice takes up approximately the same proportion of each image, means the ice is thicker.

This plot does not directly report anything about data quality or CTF fit quality, although it is generally taken to be true that thinner ice results in higher quality reconstructions.

Common Next Steps

Implementation Details

For an initial, coarse estimate of the CTF, it is assumed that there is no astigmatism. A simple correlation with the radially-averaged power spectrum is used to find the best-fitting defocus.

A new envelope function is then calculated using this coarse defocus estimate, after which the 2D CTF is estimated for the entire micrograph including astigmatism. The estimated defocus is refined for each patch.

References

  1. Zhang, K. Gctf: Real-time CTF determination and correction. J. Struct. Biol. 193, 1–12 (2016).

Micrographs with CTF estimates are ready for particle extraction — a common workflow is performing and at first, then using the initial results for more advanced particle picking jobs.

After a high-quality map is achieved, data may benefit from to improve defocus estimates and account for higher-order aberrations.

The overall implementation of Patch CTF follows a similar pathway to . First, a coarse estimate of the CTF is modeled for the entire micrograph. Then, patches are used to estimate a function which returns the modeled defocus for a given micrograph coordinate.

These patch CTF estimates are used to fit a spline function which provides the estimated defocus at a given (x, y) coordinate on the micrograph. Ultimately, particle defocus estimates come from this spline function. The Override knots y and Override knots X parameters control the degrees of freedom of this spline function. Note that changing the number of knots does not change the number of patches used by Patch CTF Estimation. See the job for a more detailed explanation of these parameters.

Tegunov, D. & Cramer, P. Real-time cryo-EM data pre-processing with Warp. bioRxiv (2018) doi:.

Patch Motion Correction
Blob Picking
Particle Extraction
CTF Refinement
Patch Motion Correction
Patch Motion Correction
10.1038/s41592-019-0580-y
A plot of the quality of fit with various defoci. A clear peak is visible just over 2 microns.
A plane is graphed in 3D space. The X and Y coordinates are in pixels, while the height of the surface (in Z) represents the defocus.
A graph of the power spectrum of a micrograph. It oscillates between positive and negative numbers as the frequency increases.
The CTF fit to the previous power spectrum is plotted in red.
A cyan line plots the correlation between the power spectrum and CTF
The power spectrum, CTF, and correlation are plotted in black, red, and cyan respectively.
A plot with an unlabeled y-axis showing a peak around 1/4 Å. This peak is associated with amorphous ice and is used to approximate ice thickness.