0:06

Given that the contrast transfer function is like a very complicated

band pass filter, it's clear that EM images do not exactly

reproduce the density distributions present in the sample.

Instead, the images are blurred somewhat by missing and

damped and sometimes inverted Fourier components.

A term that we use to describe this blurring

effect is the Point [SOUND] spread [SOUND]

function [SOUND] or I'll abbreviate it as PSF.

What the point spread functions means,

is that if you had a single point in the sample.

And you imaged it, in an electron microscope.

What would the picture of that single point look like?

You'd like it, to look exactly like the original point,

that would be a perfect microscope.

But in fact, because of the problems inherent in any kind,

any real microscope, that point gets blurred a little bit and

it can sometimes even be surrounded by some halos, some fringes.

If we were to draw a cross section through that, and

plot it instead of looking like a delta function.

If we took an image of a delta function and

instead of looking like the delta function.

Instead it would look like a point with some spread, and

it might even have some fringes around it.

And, so that's, the shape of that is what we mean by the point spread function.

Just to show you what an actual point spread function looks like

in an electron microscope image.

I'm showing here,

a single slice from a Three-dimensional cryotomagram of a bacterial cell.

So here's the bacterial cell.

And as we'll talk about later,

to produce these cryotomagrams we often add to the sample gold beads.

This one, this gold bead, this gold bead.

These, these dark spots are the images of

gold beads that we've added to the sample that serve as fiducial markers.

And when you look carefully at this gold bead, you see a dark spot in the middle.

But it's surrounded by a white halo, and actually white streaks on either side.

This illustrates the point spread function,

in fact it was a single spherical gold ball with sharp edges.

But here in the image, it appears as a dark spot that's a little wider than

it should be with a white halo surrounding it and white streaks beyond that.

And this is the point spread function of this particular cryotomagram.

3:46

The question is, what will it look like in our image?

[SOUND] And we can make a little chart that compares

the CTF of the microscope that produces this image,

to the point spread function that will result.

And so in the first case, let's suppose that

the contrast transfer function is perfect,

meaning that all spatial frequencies are delivered.

4:22

All the spatial frequencies present in the object are delivered into the image.

Well, then the image that we'll get will look just like a delta function.

In other words, if the contrast transfer function is perfect,

delivering all the spatial frequencies at their full strength.

Then the image will look just like the original object.

And so if we start with the delta function,

the image will be a delta function.

4:50

Now in fact, the fourier transform of a delta function

is a straight line and vice versa.

The fourier transform of a straight line is a delta function.

So we see that the relationship between the contrast transfer function and

the point spread function, is that they are the fourier transform of each other.

What if our contrast transfer function wasn't perfect?

What if instead, it was gradually attenuated at high spatial frequencies.

6:24

And again, if this contrast transfer function is a gaussian,

then its point spread function will also look like a gaussian.

But a, sharply attenuated gaussian in, as a contrast transfer

function leads to a very broad, wide point spread function.

Finally, if our contrast transfer function is very complicated,

6:51

like in the case of an electron microscope.

The Point spread function will also be complicated.

It'll be a smearing with ripples around the peak,

meaning that every dense object in the sample will appear

as a somewhat broadened density peak in the image surrounded by some ripples.

The first minimum will look like a white halo and

then there may be additional maxima and minima beyond that that are visible.

And that's of course exactly what you see over here in this image.

The dark gold bead which is somewhat

representative of a sharp delta function kind of an object.

7:45

The other idea about the Point spread function, is that there's a single

point spread function in general across the entire image.

So every sharp peak in the object like this gold bead and that one and

that one, as well as this one and this one and all the.

All of the densities, in fact,

in the image will be blurred by the same point spread function.

And we call this convulsion.

[NOISE] We would say that this image is equal

to the object convolved with the point spread function,

and this is the symbol that we used to mean convolution.

What this means is that every density in the original sample appears

blurred by the same pattern and the same point spread function.

So convolution applies the same blurring effect to every density present.

So if the image is equal to the object convolved with a point spread function,

then the Fourier transform of that

image will be equal to the Fourier transform

12:01

Now we've talked already how the physical process of scattering

reveals the Fourier transform of the sample because on the back

focal plane of the objective lens is present a wave function

that represents the Fourier transform of the object.

In a perfect microscope, all of these Fourier components would be transferred

into the image forming a perfect image, but as we've discussed, in real

electron microscopes that's not the case because of the contrast transfer function.

13:33

Of what?

Of the wave function that exists here, and that is the Fourier

transform of the object as we've described times the CTF.

And so you see this equation just tells us that the image that is formed

is the inverse transform not of just the object but

the object times the contrast transfer function.

Now building from this equation, let's take another step,

and let's try to solve this equation for the object because

what we'd really like to know is the structure of the object.

14:55

And this gives us an idea of how we can improve

the images that we get from the electron microscope.

We record an image, but

unfortunately the image is degraded by the point spread function.

The fact that the contrast transfer function wasn't perfect

means that all the features are a little bit blurred.

This equation teaches us that if we take the Fourier transform of our image and

we divide that in reciprocal space by the contrast transfer function,

15:46

Now lets look more carefully at how this process might work.

Suppose that we're trying to take an image of an object, and just for fun,

let's suppose it looks something like a tree.

And we put that in our microscope, and we try to record an image.

And we've already talked that.

On the back focal plane of the electron microscope will

be a wave function that represents the Fourier transform of that object.

So we'll say Fourier transform of the object.

However, because of the contrast transfer function,

it may be that we will lose all of the high spatial frequencies.

18:16

And what it means to CTF correct the image

is that in the Fourier transform of the image, we consider each pixel.

And remember, each pixel represents one Fourier component of the image,

and it has an amplitude and sign.

So, if we were to make a little chart,

we might include let's suppose that this pixel

in the true Fourier transform of the real object,

let's suppose it should have had an amplitude

with a value of 10, in some arbitrary units.

Now, the CTF at that same spatial frequency.

Now we're considering a spatial frequency that's very close to the origin.

So maybe it's, it's here.

19:19

That's what the CTF is.

And because of that the amplitude that we observe in

the Fourier transform of the image [NOISE] will not be 10,

but rather 10 times negative 0.2, or

negative 2 is what we'll actually observe as the amplitude in this position.

What it means to CTF correct, is to take this value, and

divide it by the value of the CTF at that location.

19:53

And so in the CTF corrected [NOISE]

version of the Fourier transform of the image.

We will put a value of minus 2, the observed divided by the contrast transfer

function at that spatial frequency, and this of course will give us

an amplitude of 10, which is the original that we were looking for.

So now, divide by the CTF to produce

another version of this transform.

And we'll call this the CTF corrected [NOISE]

version of the Fourier transform of the image.

And in this case [NOISE] the value of this particular pixel,

its amplitude, instead of the minus 2 that was present here,

we'll replace it with a value of 10.

Now let's look at another example pixel.

Let's suppose that this pixel, at a higher spatial frequency,

let's suppose it's over here, and in the actual transform of the object,

let's suppose that it should have had an amplitude of 5.

21:18

And let's say that this pixel is at a spatial frequency right here

where the contrast transfer function has a value of 0.3.

The CTF then is 0.3 at that position, so the value that we'll actually

observe in the Fourier transform of the image will be 1.5.

CTF correction, in this case, will take that amplitude of 1.5,

and if we divide it by 0.3, [NOISE] we'll recover

the original amplitude that it should've been of 5.

And so we'll replace the amplitude here with the number 5.

One more example.

22:02

Suppose, we'll next consider a pixel here.

Of course we do this process for

every pixel in the Fourier transform of the image.

But if we consider another pixel over here, let's suppose that in the Fourier

transform of the actual object that should have had an amplitude of, let's say 2.

And this pixel, the CTF at that pixel, may have been over here.

Let's suppose that the value of the CTF at that position is also,

is a negative 0.3.

[SOUND] Then the amplitude that we actually

observe here is going to be a negative 0.6.

And so we'll replace that value in the CTF corrected version of the Fourier

transform of the image with a negative 0.6 divided by negative 0.3,

or in other words, the value 2, the original value.

And okay, so we continue this process for all the pixels in this transform.

And then finally the last step of CTF

correction is to calculate the Fourier

transform of this CTF corrected version and

produce what we'll call a CTF corrected image.

And I'm going to draw as more nearly like the original tree

that we were trying to image in the first place.

So this is the process of CTF correction, and it can work very well.

Except you might ask what do we do in those spatial

frequencies at which the CTF is actually 0.

23:53

For instance at this 0 of the CTF, and

this spatial frequency and this spatial frequency,

the value of the CTF is actually 0, and we can't divide by 0.

And so, in fact, what's commonly done, there's a number of

ways to handle this problem with different advantages and disadvantages.

As one example of a way to handle this problem,

is to simply exclude the spatial frequencies anywhere near 0 and

just exclude them from the process, and zero them out.

And if you do this, what you'll do is CTF correct

those regions that you can and restore the effective

contrast transfer function back up to the value of one.

And then you'll be missing the values here around CTF zeroes.

And you'll get a final CTF that looks like this,

25:08

Etc.

Now there's recovering those regions of the CTF where it's significantly non 0,

and in order to prevent division by numbers close to 0.

Just ignoring, or multiplying by 0, the values near any zeroes of the CTF.

A second way that this has been handled is by,

instead of dividing by the actual value of the CTF.

Simply phase flipping.

26:42

the information at true zeroes of the CTF because

that information simply was not delivered into the actual image.

That was lost in the microscope and

it cannot be recovered from this particular image.

And we, as we talk about the different modalities of Cryolium, we'll talk

about one way to handle this problem is to take pictures at different defocus values.

So if you can take pictures of the same object with different defocus values,

one image may give you this CTF.

27:53

As an example, here is, again, an image we recorded of graphite.

And a, a enlarged version where you can actually see the lines of graphite here.

In order to CTF correct this image,

we would first calculate its fourier transform.

And when viewed as a power spectrum, it looks like this,

which we've looked at before, showing all of the tong rings of the CTF.

Now if we take this power spectrum and

we calculate a radial average as a function of position from the origin.

This is a screen shot of a program called CTF in the software package Bsoft,

28:38

which we used to look at the pattern of tong rings in this power spectrum.

And so it's a plot, here's the vertical axis.

And it's a plot along spatial frequency, in one over Angstroms.

And, the blue lines here, are a plot of

the power in this power spectrum is a function of radius from the center.

And you can see it oscillate in each of the tong rings.

29:59

And this allows one to calculate the CTF at any

particular spatial frequency, allowing one to do a precise CTF correction.

So in summary, CTF correction proceeds by taking the image

produced by the microscope, calculating its Fourier transform.

Given that Fourier transform, one first fits

a theoretical CTF curve to the patterns that's observed.

And this allows one to calculate the CTF at any particular spatial frequency.

30:36

Using that curve, you then divide the amplitude in each pixel of this

Fourier transform of the image by the theoretical CTF value at that position.

Excluding the areas around zeroes to avoid division by zero to

produce a CTF corrected version of the transform.

And then through an inverse Fourier transform, you recover a CTF corrected

image which is closer to the object than the image that you first recorded.