U.S. FOOD AND DRUG ADMINISTRATION
+ + + + +
CENTER FOR BIOLOGICS EVALUATION AND RESEARCH
ALLERGENIC PRODUCTS ADVISORY COMMITTEE
+ + + + +
MEETING
+ + + + +
THURSDAY,
APRIL 7, 2005
+ + + + +
The
Advisory Committee met at 8:30 a.m. in the Versailles Ballroom of the Holiday
Inn Select, 8120 Wisconsin Avenue, Bethesda, Maryland, Dr. Melvin Berger,
Chairman, presiding.
PRESENT:
MELVIN BERGER, M..D, Ph.D., Chairman
LYNELLE C. GRANADY, M.D., Member
PETER R. HAUCK, Non-Voting Industry
Representative
SUSAN MacDONALD, M.D., Member
HAROLD S. NELSON, M.D., Member
CHRISTY OLSON, R.N., Consumer Representative
JAY M. PORTNOY, M.D., Temporary Voting Member
MICHAEL E. WEISS, M.D., Member
MARSHA WILLS-KARP, Ph.D., Temporary Voting Member
GAIL DAPOLITO, Executive Secretary
FDA PARTICIPANTS:
NORMAN BAYLOR, Ph.D.
KATHRYN M. CARBONE, M.D.
MARY A. FOULKES, Ph.D.
RONALD RABIN, M.D.
JAY E. SLATER, M.D.
A-G-E-N-D-A
Welcome and Administrative Remarks................... 3
Melvin
Berger, M.D., Ph.D., Chair
Meeting Statement.................................... 6
Executive
Secretary
FDA Perspective
Introduction
and Overview...................... 8
Jay Slater, M.D.,
Division of Bacterial, Parasitic and Allergenic Products, CBER, FDA
Cockroach
Allergen Standardization............ 11
Jay
Slater, M.D.
Q&A........................................... 32
Research
Overview............................. 41
Ronald Rabin, M.D.,
Division of Bacterial, Parasitic and Allergenic Products, CBER, FDA
Q&A........................................... 58
Reclassification
of IIIA Allergenic
Products...................................... 62
Jay
Slater, M.D.
Q&A........................................... 84
Open Public Hearing................................. 88
(no
speakers)
Committee Discussion................................ 90
FDA Critical Path Initiative Update
Kathryn
Carbone, M.D......................... 105
Office
of the Director, CBER, FDA
Mary
Foulkes, Ph.D........................... 114
Office of Biostatistics and
Epidemiology, CBER, FDA
Committee Discussion............................... 120
P-R-O-C-E-E-D-I-N-G-S
8:37
a.m.
DR.
BERGER: Good morning. I'd like to welcome everyone to the FDA CBER
Allergenic Products Advisory Committee Meeting. My name is Mel Berger. I'm a Professor of Pediatrics and
Pathology in the Allergy/Immunology Division at Case Western Reserve University
in Cleveland. I think our first step
will be to go around the table and have everyone introduce themselves, and I
guess we start with Marsha.
Oh,
sorry. The microphones, you push to
turn the microphone on, and then you have to push it to turn it off.
DR.
WILLS-KARP: Good morning. Marsha Wills-Karp, Professor of Pediatrics
at Children's Hospital in Cincinnati.
My area of interest is the immunobiology of asthma and allergies.
MR.
HAUCK: Peter Hauck, Alk Abello. I'm the industry rep for the panel.
DR.
WEISS: I'm Michael Weiss, Dr. Michael
Weiss, Clinical Professor of Medicine, University of Washington in Seattle.
DR.
GRANADY: Dr. Lynelle Granady. I am in private practice in New York, and
affiliated with Mt. Sinai Medical Center.
MS.
DAPOLITO: Gail Dapolito, acting executive
secretary for the committee.
DR.
MACDONALD: Susan MacDonald, Professor
of Medicine, Johns Hopkins Division of Allergy and Clinical Immunology, and
Associate Chair of the Department of Medicine.
DR.
NELSON: Harold Nelson, allergist,
National Jewish Medical Research Center in Denver.
MS.
OLSON: Christy Olson. I'm the nurse educator for the Allergy &
Asthma Network, Mothers of Asthmatics.
And I'm a consumer representative.
DR.
PORTNOY: Jay Portnoy, Professor of
Pediatrics at the University of Missouri, Kansas City School of Medicine, and
the Children's Mercy Hospital. And I'm
also the director, the Chief of Allergy.
DR.
BERGER: I think I'll ask Jay and Ron to
introduce themselves also, please.
DR.
RABIN: Ron Rabin, senior staff fellow
in the Laboratory of Immunobiochemistry in CBER.
DR.
SLATER: Jay Slater. I'm the chief of the Laboratory of
Immunobiochemistry at CBER.
DR.
BERGER: Hopefully you've all seen the
proposed agenda, and perhaps looked at some of the materials. We'll have several presentations by Drs.
Slater and Rabin. We will have an
overview of this issue of reclassification of allergenic products which had
previously been classified as IIIA.
This
will be an informational presentation to give a context to what the committee
-- to what Jay and his colleagues at the FDA will be doing, and what the
committee will have to consider in the future.
But this is not for the purpose of actually making any formal
recommendations at this time. So I
don't think there will be any formal recommendations or motions to propose nor
to vote on. I would remind you that if
the committee wants to make a recommendation, then that is a very formal
process, and so we don't normally have motions and things that follow sort of
Robert's Rules of Order. Either we have discussion or we have a formal
recommendation process. And again,
there doesn't seem to be any action item which would require the latter at this
meeting.
As
you know, an important part of the meeting is to allow time for public
discussion. We have set aside an hour
for that. We do have a peanut gallery
here for members of the public. No one
has formally requested to appear, but if someone appears then we will give them
a chance to have their concerns entered into the record and addressed.
I
think now I'll turn it over to Gail who has some housekeeping details.
MS.
DAPOLITO: Thank you, Dr. Berger. I'd like to read the conflict of interest
statement for the meeting.
The
following announcement addresses conflict of interest issues associated with
this meeting of the Allergenic Products Advisory Committee on April 7,
2005. Pursuant to the authority granted
under the committee charter, the director of FDA's Center for Biologics Evaluation
and Research appointed the following individuals as temporary voting members
for the committee discussions: Drs. Jay Portnoy and Marsha Wills-Karp.
The
Food and Drug Administration has prepared general matters waivers for the
following special government employees:
Dr. Harold Nelson and Dr. Jay Portnoy, who are participating in today's
meeting of the Allergenic Products Advisory Committee for the discussion of a
proposed strategy for the reclassification of Category IIIA allergenic products
being held by the Center for Biologics Evaluation and Research.
Unlike
issues before a committee in which a particular product is discussed, issues of
broader applicability such as the topic of today's meeting, involve many
industrial sponsors and academic institutions.
The committee members have been screened for their financial interests
as they may apply to the general topic at hand. Because general topics impact on so many institutions, it is not
practical to recite all potential conflicts of interest as they apply to each
member. FDA acknowledges that there may
be potential conflicts of interest, but because of the general nature of the
discussion before the committee, these potential conflicts are mitigated.
Mr.
Peter Hauck will be participating as the non-voting industry representative
acting on behalf of regulated industry for this meeting. Mr. Hauck's appointment is not subject to 18
U.S.C. ? 208. He is employed by Alk Abello, and thus has a
financial interest in his employer. FDA
participants are aware of the need to exclude themselves from the discussions
involving specific products or firms for which they have not been screened for
conflicts of interest. Their exclusion
will be noted for the public record.
With
respect to all other meeting participants, we ask in the interest of fairness
that you state your name, affiliation, and address any current or previous
financial involvement with any firm whose products you wish to comment
upon. The waivers are available by
written request under the Freedom of Information Act. Thank you, Dr. Berger.
DR.
BERGER: Sorry. Again, push the button to speak and push the
button when you're done. And Dr. Slater
will begin with an introduction to the FDA and the laboratory.
DR.
SLATER: Thank you, Dr. Berger, and
thank you all for coming. I think we
have an interesting day in store for you today. We're going to be covering a lot of different topics. As Dr. Berger indicated, the core we think
of the discussion is going to be the discussion later on this morning and early
this afternoon about the reclassification of the IIIA products. But we do have other items of interest that
we are going to cover today. And this
is sort of an overview of the agenda.
We will be giving a very brief lab overview. That'll take about five to 10 minutes. Then I will give the committee an update on the Cockroach Allergen
Standardization Project, which is ongoing.
Ron Rabin will talk to you for about a half hour, giving you an overview
of our research activities in the lab.
Then we'll talk about the reclassification of the IIIA products. Then finally this afternoon, after our
discussions, Drs. Carbone and Foulkes will join us to give us a brief
discussion of the Critical Path research activities in the Center for
Biologics.
So
let's talk about the lab overview.
We'll talk about staffing, lot release, and reference maintenance. This is just an introduction to the people
in the lab. And those of you who are
here from my lab, when I mention your name just stand up and wave, please. I'm Jay Slater. I've been the lab chief now for six years. Ron Rabin, whom you'll be hearing from a
little bit later, has been with us for four years. Our postdoctoral fellows, Bo Chi, Jinsong Zhang, and Nicki deVore
have been with us for three years, two years, and two years respectively. Our research technicians in the lab are Mona
Febus, Marc Alston, Cherry Valerio, and Katia Dobrovolskaia.
This
is a cartoon or a graph that I've been showing since I came here. And the basic message is that after a few
years of instability at the beginning, we've really had a fairly stable
staffing of LIB. The only people
counted on this graph are the research technicians. And the reason for that is that they're the ones who really bear
almost the full brunt of the ongoing regulatory activity, the lot release, the
reference maintenance activities. And
we're really at a level now -- we lost Al Gam this past summer. He retired.
But we really are at a level in which I think we're in very good shape
in terms of handling the manufacturer's workloads. And I think our performance has reflected that.
What
are our routine regulatory activities?
Well, lot release is the main regulatory activity, but we also spent a
lot of time on reference distribution and reference maintenance. And the reference maintenance includes
semiannual checks to make sure that our references are maintaining their
potency and their complexity. And in
addition, when references either run out or clearly are not being maintained,
we replace them.
Lot
release activities. This past year we
reviewed 417 protocols that were submitted by our manufacturers. In terms of reference distribution we sent
out over 1400 vials and 83 separate shipments to our manufacturers this past
year. Just to give you some context,
over the last five years these are the lot release protocols that have been
submitted to us. And you can see that
417 is really very much consistent with the previous submissions. And so we neither seem to be on an upswing
nor a downswing in that. In terms of
reference distribution, these are the number of shipments and these are the
number of vials shipped. You can see
that there was a significant drop-off between 2002 and 2003. In 2002 I made an appeal to the
manufacturers to be more economical in their use of the references that we sent
them. And they've obviously heeded my
request. We're dispensing much less in
the way of references than we had before.
I'd be happy to take any questions. If not, then I'd like to proceed to the next
item of business, which is an update on our German cockroach standardization
activities. Now, I spoke to you last
year about our initial in vitro activities with German roach. I've given you in past years the rationale
for standardizing German cockroaches.
By the way, for those of you who are wondering and haven't seen these
pictures before, these are Madagascar Hissing Cockroaches, in fact as large as
this piece of birthday cake. And we are
not working with them, thank goodness.
These are the more standard American, German, Oriental roaches.
I
gave you the rationale behind doing this.
We've actually discussed this at length in previous advisory committee
meetings. Just in a nutshell, roaches
appear to be associated with inner-city asthma. A review that we did of available commercial German roach
extracts indicated that they tended to be of very low potency, and of variable
quality. And we decided to proceed with
the next stage in this, which was to make a concerted effort to determine the
biological potency of several German roach extracts using the ideal testing
method. And I'm actually going to spend
a good portion of this presentation reviewing the ideal testing method with you
because it's not something that people are typically very familiar with. This is the method that was used in the
1990s and earlier to standardize grass pollen allergenic extracts. It is a method that utilizes highly allergic
individuals. It is a quantitative
method using serial three-fold dilutions in which the major effort is to
establish the dilution at which the erythema response is 50 millimeters. And that dilution is called the D50.
When
you do an intradermal skin test, you get both a wheal and a flare. For statistical reasons, this method uses
the erythema response rather than the wheal response. The sigma E that we're measuring is the sum of the longest
diameter, indicated here as Diameter A, and the midpoint orthogonal diameter,
which is indicated as B. If you add
those two up, you get the sigma E and those are the data that are utilized.
So
the testing approach in this first of all is to identify those highly allergic
individuals. And in order to do that
you do a screening test, a straightforward puncture test using a bifurcated
needle with a concentrate. You then go ahead
and do the serial threefold dilutions, record the wheal and the erythema size,
and calculate the sigma E at each concentration. What you get then is a plot, and this is a plot from a paper from
the 1970s using histamine. You plot the
mean sum of the erythema diameters of the sigma E on the ordinate. These are the serial threefold
dilutions. The shorthand that is used
here is that these are actually in negative log units. So a dilution of 4 is a 3-4 dilution,
and so on down the line. You plot them
out. Then going from the ordinate at
the 50 millimeter line. You then figure
out what the D50 was, and in this case the D50 was 5.56. Which means that a dilution of 3-5.56 this
individual tested would have been predicted to have a sigma E of 50
millimeters.
Just
to wrap up the background discussion on this.
When testing was done previously, the normative response to highly
potent extracts was found to be a D50 of 14.
Therefore, a D50 of 14 was defined as 100,000 BAUs per ml. Working from that you can calculate the BAUs
per ml by this simple formula from the D50.
So when you do this method, you generate a D50 for the extract, and then
you calculate the BAUs per ml based on this empiric relationship and the
consequent formula.
Some
of the rules that you follow when you do this, and I'm going to take you
through a highly idealized set of D50 testing, and then we'll actually look at
the real data and you'll see why you need rules to help you work this through. The skin test response, the sigma E, should
fall within the limits of 0 and 125 millimeters. Each more concentrated dilution should produce a graded erythema
response. In other words, as you give
more and more concentrated extract, you should get larger responses. And the dilutions, at a minimum we want to
have two dilutions on either side of 50 millimeters. In other words, we want to bracket the 50-millimeter point.
So
I'm actually going to walk you through a theoretical set of skin tests at this
point. Typically we start with a dilution
of 3-17 or what's called the 17 vial. And in this study subject, we're testing three allergen
extracts. One is the yellow one. The other is the blue one, and the last one
is pink. The first series of tests
indicated by the green arrow are five tests, one for each of the extracts, one
for histamine, and one for saline. And
what we see here is that the saline and histamine responses confirm that the
subject is neither dermagraphic nor hyporesponsive. None of the three extracts appears to be eliciting any
response. We plot it out here at the
-17 log dilution. All of them are at
zero. Therefore, in our protocol, in
order to be economical in terms of the number of injections that we do for
these study subjects who undergo a very large number of injections, we then if
we get no response we skip three log dilutions rather than just one log
dilution. So the next one for all three
of these will be at -14. And here are
the responses that we get. Both the
yellow and the blue extracts continue to yield minimal or no response. But we can see with the pink one that we
have a small response developing, which we can plot out on our graph. Therefore, the next injection for the pink
one will be at 10-13 and the next injection for the yellow and blue
will be at -11.
And
here are those responses. Well, things
are going well for both the blue and the pink extracts. The next injections for both of these will
be at single dilution increases, going from 11 to 10 for blue, and from 13 to
12 for pink. However, as we plot out
the yellow response, we see that we've made a mistake with yellow in that we
now are already above the 50 millimeter point for the yellow extract. Since we need to bracket, we need to have at
least two on each side of 50 millimeters, we're actually going to backtrack
next with the yellow extract and go to dilution of -12.
And
here's the next series of responses.
Now we seem to be on track for all three of the extracts. We will now proceed with a single dilution
increase for both the blue and the pink.
However, the yellow one, if we went up a single dilution we would just
cover ground we've already covered. So
we can go to the next dilution for the yellow one. Here are the responses that we get for that. The good news is that we're now above 50
millimeters for all three of these extracts.
However, we want to have at least two valid data points on either side
of the 50 millimeters, so we're going to do another higher dilution. Which we can plot out this way.
Examining
the data, we conclude that we now have clearly sufficient data for the pink
extract. However, we have problems with
both the yellow and the blue extracts, both of which are rectifiable. Blue for some reason, the next
concentration, we seem to have plateaued.
Therefore we're not getting a uniformly increasing curve, and we really
need to go at least one concentration higher to get more valid data. With the yellow, looking back on the data,
we see that we really only have one data point below 50 millimeters. And so we're going to go back and do one of
these more dilute concentrations for the yellow. And what we can now see is that we actually have valid data for
all three of them. And we can proceed
to calculate the D50s for these.
Now
the purpose of this exercise was to take you through an ideal case. I'm now going to take you into the project
itself. We'll show you some of the
data, how we tried to analyze it, how we decided alternative methods of
analyzing it that might be better.
Let's look at what our objectives were here. Our objectives were to take three commercially available
allergenic extracts for German cockroach and really check in a good
statistically designed study what the potency would be biologically. It was in our interest in doing this to pick
three extracts that were different from each other, so we would get some idea
of the spread of potency and try to relate this to some of the in vitro
measures. So we picked three, and these
are readily commercially available extracts from manufacturers A, B and C. They in fact were from two different
sources. The source material
preparation methods are outlined here.
And the extraction methods are outlined here. Basically, there were no really great differences between
these. They all started from German
roaches. Some of them were used in a
source material that was ground to powder before they extracted it. Others were ground in a blender during the
extraction process. But fundamentally they
were starting with the same materials and using very similar methods for
extraction.
There
are certain things that it's easy to do with allergen extracts and that is to
try to measure known allergens, and to try to measure the relative
potencies. That's what we did. INDOOR Biotech has a two-side ELISA method
for measuring both Bla g 1, Bla g 2, and Bla g 5. We also used our standard competition ELISA technology to
determine the relative potency of these three extracts compared to a highly
potent extract that we had from some years back. We did this using pooled human serum, as well as rabbit sera that
we made by injecting rabbits either with German roach or with recombinant Bla
g's 1, 2, 4, and 5.
The
specific allergen data are indicated here.
E2CG is the reference standard that we have been using provisionally for
some years in the lab that was made especially for CBER in the 1990s. As you can see here, all three of the
commercial extracts contained Bla g 1.
All three of them contained detectible Bla g 2, although there were some
variations. Notably, only extract B
contained Bla g 5. The other two really
had almost non-measurable amounts of Bla g 5.
When
we measured the potency using the three methods, RP1, relative potency 1, is
the one using pooled monospecific rabbit sera against Bla g's 1, 2, 4, and
5. RP2 using rabbit anti-German roach
serum. And RP3 using the human serum
pool which we've called S1CR. Again,
you can see that extract B appears to be the most potent by all three methods. This is consistent with the Bla g 1, 2, and
5 data that we had. Lots A and C appear
to be somewhat equivalent in potency by using the pooled monospecific
anti-sera. But when we use the human
serum pool, Lot A appears to be almost devoid of specific activity, whereas
Lots B and C have some detectible potency.
The
clinical study to determine the potency of these three extracts could not have
been done without the very active interest of the Division of Allergy,
Immunology and Transplantation at NIAID.
This was an IND that they put together.
There were four sites. This is
through the Inner-City Asthma Consortium.
The four sites were in Baltimore, Washington, D.C., Chicago and
Denver. And people often save thanks
for the end of talks. I think the
thanks here should go smack in the middle of this talk. This study really could not have been done
without the real interest and commitment of the Inner-City Asthma
Consortium. Individuals who were
extremely helpful included Robert James and Herman Mitchell at Rho, which is a
company that does the organizational work as well as the statistical analyses
for the Inner-City Asthma Consortium.
Peyton Eggleston was the PI in Baltimore, Andy Liu the PI in Denver,
Jacqueline Pongracic in Chicago, and Sampson Sarpong in Washington, D.C. These folks all worked very hard to make
this project work.
The
purpose of the IND was to determine the biological potency of three
commercially available German roach extracts and to test their
bio-equivalents. The patient population
was the patient population of the Inner-City Asthma Consortium: adults with a
history of allergenic disease or asthma and a demonstrated sensitivity to
German roach allergen. It was a
multi-center open label trial. We planned
to enroll 61 study subjects. We
actually enrolled 62. This was an adult
group. This was not a pediatric trial. It was predominantly female, and the ethnic
background of the study subjects is precisely what you would expect from the
Inner-City Asthma Consortium.
Once
we accumulated the data, which actually this group completed patient enrollment
and data collection within five months.
It was really quite impressive how quickly it happened. We then were confronted with how to go about
analyzing the data. Now, linear
regression is the standard method that was really included in the
protocol. This is what was used in the
ideal protocol in the 1990s and before.
The idea here is to draw a best-fit line through the data, determine the
D50 in that manner. And the problem
was, as we looked at the data, it was quite clear there were a number of study
subjects for whom there would be extremely poor correlation coefficients. This was not surprising. In previous studies using this protocol,
poor correlation coefficients were a major source of data invalidation. And in the current study it was clear that
several of our study subjects were non-linear.
And this is just data from eight study subjects. What you're looking at here in the black is
the actual data points, either a solid line or a dotted line or a dashed
line. Each of those is one of the
allergen extracts, and each panel is one study subject. And you can see that in spite of the fact
that all of these study subjects were screened with puncture skin tests, some
of them were essentially flat lines.
They really never got above the 50-millimeter point at all. They were hyporesponsive. And obviously, regardless of the analytical
method you use, you can't include these study subjects in your analysis.
Some
study subjects had curves that were -- it seemed pretty reasonable to do linear
regression analyses. But others it
seemed almost impossible to attempt. So
Dr. James, the statistician at Rho, thought up another approach, and that was
just a linear interpolation approach.
In the linear interpolation approach, rather than assuming a
mathematical relationship, the simpler method would be simply to take the
serial dilution at which the plots cross the 50-millimeter line. And basically what you're working with in
that situation is two points: the point below 50 millimeters and the point
above 50 millimeters. And you use that
to determine your D50. Now, if you
remember some of the images of the actual data, you can see that that can be
problematic as well. And so we
established a set of rules by which one could use this method in an organized
way. And then we applied it to the data
to see how the data would look.
The
first rule is that you use the first crossing of the 50-millimeter line. So study subjects that would go up and down,
you would look at the first crossing that was followed by at least two
consecutive non-missing dilutions above.
So, if you went up and down, you would use the first crossing that was
followed by a consistent staying above the line. Now, if the above criterion doesn't apply, and the data's most
concentrated dilution is above 50 millimeters, we assume that any more
concentrated dilutions, had they been collected, would have remained above 50 millimeters. In that case, we would be using the last
crossing as the actual crossing that we would record for the D50 purpose. And if the extract for a subject does not
cross the 50-millimeter line at any serial dilution tested, or whenever the
line is crossed the first two criteria don't apply, then the D50 simply can't
be calculated. And that makes intuitive
sense.
So
in this case, I've taken the same eight study subjects and we've simply
plotted. And I know it's very hard to
see, but maybe you can see it on your handouts, the points that were actually
chosen, these are indicated in blue spots.
Obviously, this one, there is no crossing, and so there are no D50 to
determine. But what you can see here,
and just by a direct comparison of the regression versus the interpolation
method for two study subjects, you can easily see how the regression method
generates a result that doesn't make nearly as much sense as the interpolation
method does. Now, even in this study
subject whose data is very hard to interpret, the interpolation method gives
you something that certainly makes more intuitive sense than a projected value
out here, or this value back here.
But
there is another method that can be used, and I'm sorry, this is the one slide
that didn't quite come out in translation to a different computer, and that's
the four-parameter logistic model. The
four parameters being the minimum, the maximum, the EC50 and the D or Hill
slope. And this is also known as a
sigmoidal calculation. You can see back
here under these words the sigmoidal curve calculating the D50 in that
manner. This has the intuitive advantage
of using the most data. Remember, the
linear regression uses all of the data, but the data at the extremes tends to
dominate the calculations more than the data in the middle. The linear interpolation method uses the
data right around the D50 the most and kind of ignores the data elsewhere. The four-parameter model is the most
intuitively attractive because it uses all of the data. And you can either plot it out, or you can
do it algebraically. When you're doing
it algebraically you calculate the concentration at which a 50-millimeter point
occurs. The D50 is then the log of this
concentration divided by the log of three.
So,
needless to say, what we did in this case, and you can see here again that
several of the curves really look sigmoidal, and the projected or calculated
curves which are in color really look very close to the actual curves
themselves. So needless to say we did
the data all three ways, and compared them.
And this is the D50 data from manufacturers A, B and C by the interpolation
method, the linear regression method, and the four-parameter fit method.
Looking
very quickly at it, you can see that the data are not all that different in D50
values. But remember, when we turn them
into BAUs they will be somewhat different.
What also you can see is that the interpolation and the regression
method have the advantage of using more study subjects data. Out of the 62 study subjects, you can see
that nowhere near all of them had analyze-able data. If you're below the 50-millimeter line, the data can't be used no
matter what you've done. But using the
four-parameter method, we could only use between 42 and 43 study subjects,
whereas by both the interpolation and regression methods, we could use between
48 and 55 study subjects. So that gives
us an advantage for those two methods.
Looking
over at the standard deviations, you can see that the interpolation and the
four-parameter fit methods had substantially smaller standard deviations than
the regression method. Which gives an
advantage to the interpolation and the four-parameter fit over the linear
regression. We went back and forth
about this a number of different times, and came to the conclusion that the
interpolation method really had the advantage over the other two. But I'm going to show you all three of the
data.
So
again, the potency data, calculated BAUs straight from the D50s by that
calculation that I gave you before. You
can see that by the interpolation method, the BAUs were 1,700 to 8,500. The regression method 2,100 up to
12,000. Four-parameter fit, 1,300 up to
5,000 or so. And these are the 95
percent upper and lower limits.
So
the conclusions were that the D50s calculated using the interpolation of
four-parameter fits had slightly tighter standard deviations than the
regression method. The interpolation
and regression methods maximized the number of study subjects whose data could
be analyzed. Interestingly,
bioequivalence which we had set at the beginning of the study as a delta of
less than 20 percent among all three of the D50s, using all the methods, the
three extracts were essentially bioequivalent.
But, there were statistically significant differences between A and B,
and between B and C. In other words, B
was from a statistical point of view the most potent of the three, although by
our preconceived bioequivalence limit they were all bioequivalent. And A and C were not statistically different
from each other.
So
the next relevant question is what in vitro test best reflects in vivo potency. Now, we are not there yet. We have not determined this yet. But we do have enough data to begin to try
to address these issues. And what I'm
putting here is all of the data put together in one place. These are extracts A, B and C. This is the Bla g 1 content, Bla g 2, Bla g
5. These are the relative potencies by
three methods. And these are the BAUs,
and we just used the interpolation data here.
One
way to look at this in the aggregate is to simply normalize all of the data to
product B, which was the most potent.
So in this analysis you just take product B and you set it as 1, and
then product A and C for each of these is just a ratio of that value to product
B. And just by looking at this you can
see that on first blush the BAUs and the Bla g 2 level seem to be the most
closely related in aggregate. And this
is an important caveat here. In the
aggregate, the Bla g 2 data appear to best reflect the overall potency, but in
order to do this we actually need to look at this study subject by study
subject. And that's what we're going to
do. We will be examining the IgE
specificities of each of the individual 62 subject sera and correlated to their
D50s.
But
even though we're not finished with the process, we can start to look at German
roach extracts and see where this fits in the constellation of other extracts
that we know about their potencies. And
just for review, the grass pollen extracts, with the exception of Bermuda
grass, are 100,000 BAUs per ml. Ragweed
extracts, based on an estimate of 350 Amb a 1 units per ml, equaling 100,000
BAUs per ml, are typically somewhere between 30,000 and 100,000 per ml. Bermuda grass, 10,000. Cat, between 5,000 and 10,000. And the geometric mean of those three
extracts that we tested was about 3,300 BAUs per ml. So you can see here that when tested in a highly allergic
population, the potency of the German roach extract is clearly lower than the
others. Then the question is well it's
lower, but is it still going to be useful.
And the answer is probably yes.
Skin testing doses -- this is from a practice parameter from 1995 --
have been estimated to be certainly 100 to 1,000 BAUs per ml. This can certainly be achieved with most of
the German roach extracts.
Immunotherapy doses are a little hard to find. This is from a review that Paul Turkeltaub did in 1999. This is from another practice
parameter. If in fact we're shooting
for 2,000 to 4,000 BAUs for dosing, that's going to be difficult to achieve
with these existing extracts, and in fact will probably not be readily
achievable with most of them. However,
if we can get away with lower doses, then we probably can achieve that. This is something that will need to be the
subject of future studies.
Another
aspect in which it's ? it's just
interesting to look at where this fits.
I don't have to tell the people on this committee what my thinking is
about the value of using major allergens on allergen extracts. But it is useful to look at where this fits
in the context of major allergens. And
also perhaps gives us some insight into what the important allergens are in Bla
g 1. If you re-analyze the data that
Dr. Nelson presented in 2004, looking at some common standardized extracts in
the United States, and you recalculate the data as major allergen content per
10,000 BAUs, what you find is that the range in these extracts: cat, Timothy
looking at Phl p 5, fescue looking at Fes p 5, D. farinae and D. pteronyssinus
looking at the group 1 allergens, you find a range of between 15 and 172
micrograms per 10,000 BAUs of extract.
When we look at the data that we have from the roach extracts, first of
all we can't really compare the Bla g 1 data to these data because Bla g 1 is
in arbitrary units. It's not in
micrograms. But looking at the two
allergens that we've measured in these extracts using the same ratio,
micrograms per 10,000 BAUs, we see that the Bla g 2 content is right dead set
in the middle of this range from Dr. Nelson's work. So this is actually I think a little bit more of an argument that
Bla g 2 may in fact be a good surrogate for the skin testing. What we also see here is pretty good
evidence that Bla g 5 will probably not be, at least in most study
subjects. But again, I have to warn you
that our aggregate data are not necessarily going to guide us. If, for instance, we find that for three
quarters of the study subjects Bla g 2 is the major determinant, but for
another quarter Bla g 1 is, we will have to account for the content of both of
those in our standardized extracts when that happens.
So
the next steps. We do in fact have sera
from all of these study subjects. We
will be determining their IgE specificities using Westerns, ELISAs and ELISA
inhibition. Based on both the aggregate
data and the individual data, we need to determine the appropriate surrogate
test for standardization. And finally
we will need to determine an appropriate set of reference standards for this.
And
I'm happy to take questions about German roach. Yes, Dr. Nelson.
DR.
NELSON: It used to be that the skin
tests were done in triplicate. Were
these done in triplicate?
DR.
SLATER: Actually they were not done in
triplicate. We were faced with that
decision, but -- and in fact, when they -- occasionally the skin test would be
repeated. About five percent of the
time, a skin test at an individual dose had to be repeated. When that happened we actually analyzed the
data completely separately for first skin test doses and second skin test
doses. We found that there was no real
difference between repeated doses, at least in those that we could look
at. But we did not have it worked into
our protocol to do it in triplicate.
Our problem was that we really needed to get data on at least three
extracts in order to try and do the analyses that we were hoping to do. And I suspect had we done it in triplicate,
we probably would have gotten -- been able to use more of the study subjects. Fortunately, the data that we got was
significant. Dr. Portnoy.
DR.
PORTNOY: Yes, two questions. First of all, what happened if you ran out
of space on the back? I mean, did you
ever do so many that there wasn't enough room, and how far apart did these have
to be so that one test did not interfere with another? And the last question I have is were there
difficulties in interpreting the results based on the degree of pigmentation in
different people's skin making it difficult to actually see the results?
DR.
SLATER: Three very good questions. No, we never ran out of space on anyone's
back. But think about the reason for
that. Basically, you started a dilution
of 3-17 . At maximum you get
to 3-5. We never went above
3-5 on anybody. So if you
get no reaction, which is the subject in which you're going to get the maximum
number of injections, you go from 17 to 14 to 11 to 8 and to 5 and that's
it. And there's certainly more than
enough room to do that on any adult's back.
The
distance between each of the injections had to be 2.5 to 3 centimeters between
each of them. And we did not run into
trouble with overlapping. I think it's
an indication of the low potency of these extracts that we didn't run into
trouble. I think had we done this test
with grasses we probably would have had to space them more widely.
Pigmentation
was actually -- it was an exclusion criterion.
If either from very deep pigmentation or from other skin conditions we
felt that we would not be able to read erythema, that patient would be
excluded. The fact is, you can read
erythema on people even with fairly deep pigmentation. It really can be done. So I'm not aware that we actually excluded
anybody for that reason.
DR.
PORTNOY: And one additional
question. Were there differences in
skin reactivity with different races?
Or different degrees of pigmentation?
DR.
SLATER: We haven't analyzed that
yet. I thought you were going to ask if
there were differences among the four centers geographically. And we haven't
answered that yet either. We haven't
looked at that. We may not be able
to. We may not get -- you know, with
only 15 study subjects at each site, we may actually not be able to learn that
yet.
DR.
NELSON: You always start at the top and
work down. Has it been looked to be
sure there's not a gradient over the back and erythema?
DR.
SLATER: We actually didn't always start
at the top. In the example that I
showed, just for simplicity of showing it, we started at the top. The actual protocol called for sort of going
back and forth starting. We always
started on one end and worked to the other.
But we didn't always start on the top.
That was randomized. Dr.
Granady?
DR.
GRANADY: Can you comment on using the
erythema versus the wheal size?
DR.
SLATER: I can. It's for statistical reasons. The line that you get -- and you can think
this through sort of intuitively. The
line that you tend to get with the wheal size tends to be much flatter. And therefore, smaller errors in measurement
lead to greater errors in the calculation of the D50. So when these studies were initially done I understand. The original papers on this were from the
1970s. When this was originally done,
they did both with sigma E and sigma W for wheal size. And you can get valid data both ways. But the error of the measurement is greater
with the wheal than it is with the erythema.
Dr. Weiss?
DR.
WEISS: Do you recall back 20 or 30
years ago when Paul Turkeltaub sort of designed this protocol for the
measurements, did he have some of these unusual sort of curves that you showed
where it goes up and down?
DR.
SLATER: Oh yes. But when these original studies were done,
those study subjects were excluded out of hand because they didn't actually
meet the -- we were trying to look for a way to include as many subjects as we
could. Those individuals, for instance
Dr. Eggleston had been part of an earlier study in the 1990s, an ideal
study. And one of the things that he
said was they ended up excluding more than half of the subjects after they were
skin tested because of just this. And
we were looking for ways, statistically valid ways that we could include as
many of the subjects as possible.
Remember
those rules that I gave you before, that it had to be uniformly increasing skin
test responses, two on either side of 50 millimeters. Many of those subjects would have just been excluded out of hand. And using the regression analysis was not
very satisfying either, because the regression curves that you would get, while
they would be valid best fit linear regression curves, didn't seem to make much
sense in terms of what was going on.
You're absolutely right. Mr.
Hauck.
MR.
HAUCK: Jay, did you analyze the
puncture testing results? Were there
any subjects that you included that were skin test, puncture test positive to
one extract and negative to the other two?
Did they, all three, puncture test positive?
DR.
SLATER: We did have a preconceived
notion from our prior testing that extract B was going to be the most potent,
and extract A was going to be the least potent, simply from our in vitro
testing. So we picked extract C, the
intermediate potency one, as our screening test. We did not screen for all three.
We only screened for one of them.
I was afraid that if we screened for the most potent one, we would have
a lot of flat lines for the other two.
So we picked the intermediate one.
We
also went back and analyzed at great length how we could have done the puncture
testing better so that we wouldn't get hyporesponsive study subjects. And we had several of them who just had no
responses at all. And we went back, we
looked over their puncture tests. There
was no way we could have picked these people out. It was almost as though the screen test was unrelated to how they
ultimately did on the IV testing. It
was very surprising.
DR.
MACDONALD: Jay, in general, what is the
incidence of a puncture positive/skin test negative in other extracts? Do you know?
DR.
SLATER: I don't know the answer. Dr. Portnoy?
DR.
PORTNOY: Did you ever in any of these
patients who had the strange up and down pattern, did you ever repeat that to
see how reproducible the curves were in individual patients? I mean, are these reproducible or are they
just different each time they happen?
DR.
SLATER: That's a great idea. I don't think anybody in the study even
conceived of the notion of asking somebody to come back and do this again. But it would be a very good thing to
do. We just didn't do it.
DR.
PORTNOY: And any idea why there were
differences in the potencies of these extracts? Is it the way they were manufactured, or do you have any clue
about specific processes that are used to produce extracts that affect the
potency?
DR.
SLATER: Well, extract B was started
with a different source material. And
so that's one thing that we are looking into.
But aside from that, I don't really see much in the way of clues. I do think that source material, you know
it's an obvious statement, but I think source material is very important. And I think that it's one of the things that
we need to look at as we move along with this.
Dr. Berger?
DR.
BERGER: So, in keeping with Jay's last
question and your answer, do you think that the presence of glycerol in extract
B made a difference? Do you have any
way to look at that?
DR.
SLATER: So you picked up on that? Yes, what Dr. Berger's referring to is that
in extract B the glycerol was actually in the extracting solution, whereas in
extracts A and C the glycerol was added after the extraction was
completed. It may in fact be a real
difference for this particular extract.
I don't know that it's been shown to make a difference for other
extracts.
DR.
BERGER: Another question, which you
could determine with the same kind of assays, which may have implications for
the use of these subsequently in immunotherapy. Have you done any studies of concentrating the extract, say by
ultra-filtration or lyopholization, or something like that?
DR.
SLATER: We have not. We have not done that.
DR.
BERGER: So it would be very interesting
to take a concentrated extract tenfold.
DR.
SLATER: Yes.
DR.
BERGER: And then see if you got a
tenfold higher reading from your method.
That would also be a --
DR.
SLATER: Yes. It would be very interesting.
You should remember, though, that cockroach is one of the extracts that
is fairly protease-rich. And so it's
certainly possible that as we concentrate it, we're going to cause more
degradation to occur. I don't know how
to handle that.
DR.
BERGER: If you would come to the
microphone and identify yourself, please.