Small-molecule inhibitors of PD-1/PD-L1 immune checkpoint alleviate the PD-L1-induced exhaustion of T-cells
Metrics: PDF 1639 views | HTML 3370 views | ?
Lukasz Skalniak1,*, Krzysztof M. Zak2,3,*, Katarzyna Guzik1, Katarzyna Magiera1, Bogdan Musielak1, Magdalena Pachota2,3, Bozena Szelazek2,3, Justyna Kocik1, Przemyslaw Grudnik2,3, Marcin Tomala1, Sylwia Krzanik2,3, Krzysztof Pyrc2,3, Alexander Dömling4, Grzegorz Dubin2,3 and Tad A. Holak1
1Department of Organic Chemistry, Faculty of Chemistry, Jagiellonian University, 30-060 Krakow, Poland
2Malopolska Centre of Biotechnology, Jagiellonian University, 30-387 Krakow, Poland
3Faculty of Biochemistry, Biophysics and Biotechnology, Jagiellonian University, 30-387 Krakow, Poland
4Department of Drug Design, University of Groningen, 9713 AV Groningen, The Netherlands
*These authors contributed equally to this work
Tad A. Holak, email: email@example.com
Grzegorz Dubin, email: firstname.lastname@example.org
Keywords: PD-1, PD-L1, small-molecules, immune checkpoint blockade, inhibitor
Received: June 14, 2017 Accepted: July 25, 2017 Published: August 07, 2017
Antibodies targeting the PD-1/PD-L1 immune checkpoint achieved spectacular success in anticancer therapy in the recent years. In contrast, no small molecules with cellular activity have been reported so far. Here we provide evidence that small molecules are capable of alleviating the PD-1/PD-L1 immune checkpoint-mediated exhaustion of Jurkat T-lymphocytes. The two optimized small-molecule inhibitors of the PD-1/PD-L1 interaction, BMS-1001 and BMS-1166, developed by Bristol-Myers Squibb, bind to human PD-L1 and block its interaction with PD-1, when tested on isolated proteins. The compounds present low toxicity towards tested cell lines and block the interaction of soluble PD-L1 with the cell surface-expressed PD-1. As a result, BMS-1001 and BMS-1166 alleviate the inhibitory effect of the soluble PD-L1 on the T-cell receptor-mediated activation of T-lymphocytes. Moreover, the compounds were effective in attenuating the inhibitory effect of the cell surface-associated PD-L1. We also determined the X-ray structures of the complexes of BMS-1001 and BMS-1166 with PD-L1, which revealed features that may be responsible for increased potency of the compounds compared to their predecessors. Further development may lead to the design of an anticancer therapy based on the orally delivered immune checkpoint inhibition.
Anticancer therapies targeting immune checkpoint receptors have witnessed a spectacular success in the last years. Antibodies blocking CTLA4 interaction with CD80, and, to even more extent, PD-1/PD-L1 interaction, provided unprecedented results. This merited accelerated approvals by regulatory agencies, offering a real cure to certain formerly lethal cancers [1–5].
PD-1 is expressed on activated T cells  and transduces inhibitory signal which antagonizes the activating T-cell receptor (TCR) and CD28 axis . The inhibitory signal is provided by PD-L1, the ligand of PD-1, which is naturally expressed on the antigen-presenting cells (APCs) and in a variety of tissues . In normal conditions this mitigates T-cell response, best demonstrated in PD-L1-deficient mice where T-cell responses are markedly enhanced . The immunosuppressive function of PD-L1 is utilized by cancer cells to avoid being killed by the T cells recognizing neoantigens at their surface [7, 10]. Prolonged exposure to PD-L1 leads to T cell exhaustion characterized by a sustained poor effector function [11, 12]. This is a common histological picture in which tumor tissue is infiltrated by immune cells which recognize, but are unable to eradicate the cancer cells [13, 14].
Recent data demonstrate that PD-L1 not only is overexpressed on the surface of cancer cells, but the level of soluble PD-L1 (sPD-L1) is elevated in the plasma of some cancer patients [15, 16]. It is unclear if this is related to shedding from the cancer cells or other mechanisms, but the elevated level of sPD-L1 correlates with poor prognosis [17, 18]. Of note, like the membrane-bound PD-L1, sPD-L1 has also been shown to be a negative regulator of activated T cells [17–19].
Antagonizing the PD-1/PD-L1 interaction reverts the exhausted phenotype of T cells and allows efficient killing of cancer cells [20, 21]. The utility of this approach has been demonstrated in clinics and has become a spectacular success in the recent years [1–3, 22]. In just 3 years the U.S. Food and Drug Administration (FDA) has approved two anti PD-1 antibodies: nivolumab (Opdivo, Bristol-Myers Squibb) and pembrolizumab (Keytruda, Merck), and three anti-PD-L1 antibodies, atezolizumab (Tecentriq, Genentech/Roche), durvalumab (Imfinzi, AstraZeneca) and avelumab (Bavencio, EMD Serono, Inc.), rising hope in patients suffering from cancers, which were deadly prior to the introduction of checkpoint inhibitors.
The development of small-molecular weight inhibitors is expected to bring a number of profits in the field of the PD-1/PD-L1 immune checkpoint blockade (ICB). This is due to several advantages of small molecules over therapeutic antibodies, which are: lower production costs, higher stability, improved tumor penetration, amenability for oral administration and elimination of immunogenicity issues . However, development of small-molecule antagonists is lagging behind that of antibodies primarily due to the challenge of targeting a relatively flat and highly hydrophobic PD-1/PD-L1 interaction surface . Only a single class of small molecules has been convincingly shown to directly antagonize this interaction . These are the compounds designed and patented by Bristol-Myers Squibb (BMS) [24, 25]. We have recently demonstrated that these BMS compounds bind to human PD-L1 and block its interaction with human PD-1 . Here we show that these small-molecule compounds are indeed capable of restoring the activity of T cells by disrupting the PD-1/PD-L1 interaction. We also present structural details of the interaction between PD-L1 and two improved BMS compounds, BMS-1001 and BMS-1166. This opens exciting possibilities for future development of orally bioavailable anticancer ICB therapies using small-molecule inhibitors.
Based on the two recent Bristol-Myers Squibb patents [24, 25], the selection of the BMS compounds was done to obtain high diversity of the chemical structures along all modifications of distal, flexible moieties exposed to the solvent (Figure 1A). The compounds were synthesized as described previously  with modifications. All compounds were tested for the interaction with PD-L1 using the 1H-15N HMQC NMR titration experiment with positive results, as reported elsewhere  and in this manuscript (see below). In order to verify the blockade of the PD-1/PD-L1 interaction by the compounds an NMR-based AIDA was performed [27, 28]. Upon the PD-L1 binding the broadening of 1H-15N resonance signals of the 15N labeled PD-1 is observed due to an increased transverse relaxation rate of the higher molecular weight entities [27, 28]. This results in disappearance of the HMQC resonance signals in the spectrum (Figure 1B). All the compounds efficiently disrupted the complex formed by human PD-1 and PD-L1 proteins, as visualized by the restoration of narrow 1H-15N signals of PD-1 ( and (Figure 1B)).
Figure 1: Structures and the PD-1/PD-L1 blocking potential of BMS compounds. (A) The structures of BMS compounds tested in this study. The original numbering found in the patents [24, 25] is used. (B) BMS-1166 dissociates a preformed PD-1/PD-L1 complex, as shown by the NMR-based Antagonist Induced Dissociation Assay (AIDA). 1H-15N HMQC spectra are shown for the 15N labeled PD-1 (left) and the complex of the 15N labeled PD-1 and unlabeled PD-L1 alone (center) and after addition of BMS-1166 (right). Linewidth broadening, observed as loss of resonance signals in the central panel, indicates increased transverse relaxation rates associated with the complex formation. At the PD-L1:BMS-1166 molar ratio of 4:1, BMS-1166 efficiently disrupted the PD-1/PD-L1 complex, as visualized by the restoration of the 1H-15N signals of PD-1.
Analysis of unspecific toxicity of the BMS compounds
To define the maximum admissible concentrations of BMS compounds for the use in the cell-based assays, the toxicity of the compounds was evaluated with the use of metabolic activity assay. For this, modified Jurkat T cells (ECs) used in all further assays were exposed to the increasing concentration of the tested compounds for 48 h. Considerable differences in the toxicity of the tested compounds were noted. The most toxic compounds (BMS-37 and -242) showed EC50 between 3 and 6 μM. BMS-1001 and BMS-1166 were significantly less toxic, with EC50 values of 33.4 and 40.5 μM. Other two compounds (BMS-8 and -200) showed moderate toxicity (Figure 2A). Low toxicity of BMS-1001 and -1166 compounds was confirmed using modified CHO-K1 cells (aAPCs; Supplementary Figure 1). These two compounds were considered the most suitable for the cell-based experiments and used as references in all further analyses.
Figure 2: Cytotoxicity and activity of BMS compounds in PD-1/PD-L1 checkpoint assay. (A) Cytotoxicity of BMS compounds against the PD-1 Effector Cells was tested using metabolic activity assay following the 48 h treatment of the cells with the indicated compounds. The presented EC50 values (right panel) are means ± SEM from the three independent experiments (left panel shows a representative result). (B, C) Activities of reference antibodies (B) and BMS compounds (C) in alleviating the effect of PD1/PD-L1 checkpoint on TCR-mediated T cell activation are expressed as the level of luciferase activity (for details see Materials and Methods). The graphs present relative luminescence normalized to the DMSO-treated controls and are representative of the three independent experiments. (D) The result of the fitting of Hill model to experimental data presented on panels B and C. EC50 values represent half maximal effective concentrations, and RLUmax values represent maximal relative luminescence values, and illustrate the potency of the listed molecules in restoring the activity of ECs in the assay.
BMS-1001 and BMS-1166 antagonize the inhibitory effect of PD-1/PD-L1 immune checkpoint on T cell activation
A T lymphocyte-like cell line (Jurkat) modified to constitutively express PD-1 and carrying a luciferase reporter gene driven by TCR-inducible NFAT response element (Effector Cells, ECs) was used in T cell activation experiments. When antigen-presenting surrogate CHO cells, constitutively expressing the TCR agonist and PD-L1 (aAPCs) are presented to these ECs in co-culture, TCR signaling is repressed by PD-1 and the reporter remains silenced. Agents efficiently interfering with the PD-1/PD-L1 interaction activate the expression of the reporter gene resulting in the increase in luminescence intensity. Clinically relevant PD-1-antagonizing antibodies (nivolumab and pembrolizumab) and the PD-L1-blocking antibodies (atezolizumab and durvalumab) release TCR signaling with EC50 values in range of 0.333–1.15 nM (Figure 2B, 2D). Both BMS-1001 and BMS-1166 dose-dependently induced the activity of luciferase, demonstrating the antagonizing potential towards the PD-1/PD-L1 immune checkpoint at the cell interface (Figure 2C). Nevertheless, the effect of BMS compounds was significantly less pronounced compared to the tested antibodies, with EC50 values in three-digit nanomolar range and lower maximal cell activation levels, represented by lower RLUmax values (Figure 2D). BMS-200 did not affect the reporter expression at the concentrations below the cytotoxic level.
BMS-1001 and BMS-1166 antagonize the inhibitory effect of soluble PD-L1 on T cells
Increased level of sPD-L1 is thought to negatively affect the T cell anticancer response [17–19]. This is because sPD-L1 provides the same inhibitory signal as the cell surface PD-L1. This is evident when ECs are simultaneously treated with anti-CD3 and sPD-L1. Anti-CD3 induced the activation of ECs, manifested in increased reporter expression (Figure 3A). Concurrent presence of sPD-L1 decreased reporter expression to about half of that observed for the anti-CD3 antibody alone (Figure 3A). The two sPD-L1 muteins, bearing mutations of the key residues at the interaction surface, PD-L1(A121Q) and PD-L1(Y56A, M115A), failed to bind to PD-1 in NMR-monitored direct titration and AIDA-NMR (Supplementary Figure 2A–2E), and did not inhibit the anti-CD3 mediated activation of ECs (Supplementary Figure 2F). This proves that the modulatory effect of sPD-L1 towards the activation of ECs is mediated specifically through the engagement of PD-1. Moreover, the anti-PD-1 antibody nivolumab abrogated the effect of sPD-L1, further supporting the involvement of the PD-1 immune checkpoint receptor (Figure 3A).
Figure 3: BMS compounds restore the sPD-L1-supressed activation of Jurkat T-cells. (A) Effector Cells were activated for 24 h with the anti-CD3 antibody alone or in the presence of sPD-L1, pre-incubated with nivolumab (nivol.), DMSO or the BMS compounds. The activity of luciferase, expressed in response to TCR-mediated induction of NFAT-responsive promoter, was determined as an indicator of cell activation. BMS compounds dose-dependently restored the activation, pre-blocked by the presence of sPD-L1. The graphs present mean ± SEM from at least three independent experiments. Statistical significance was evaluated using a one-way ANOVA with the Tukey’s post-hoc test: *p < 0.05, **p < 0.01, ***p < 0.001. (B, C) The binding of the fluorescently-labeled sPD-L1 (PD-L1-Atto) to PD-1 expressing cells determined using flow cytometry. PD-L1-Atto was pre-incubated with tested compounds prior to staining. Cell staining is blocked in the presence of the anti-PD-L1 antibody (durvalumab, durva. or atezolizumab, atezo.) and BMS compounds. MFI – Geo Mean Fluorescence Intensity values. The bar graphs present mean ± SEM from three independent experiments. For the statistics, t-test was used: **p < 0.01, ***p < 0.001.
To evaluate the potential of BMS compounds in abrogating the inhibitory effect of sPD-L1 on the activation of T cells, sPD-L1 was pre-incubated with tested compounds and presented to ECs together with the anti-CD3-activating antibody. BMS-1001 and -1166 dose-dependently abolished the inhibition of ECs stimulation by sPD-L1 (Figure 3A). Importantly, at the highest concentrations (2- and 5-fold molar excess over sPD-L1) the compounds completely restored cell activation back to the level observed for anti-CD3 alone. Other tested compounds showed intermediate activities. The two most cytotoxic compounds (BMS-37 and BMS-242) presented unspecific decrease in the readout level at the highest concentrations used (Figure 3A).
To test if the observed effect of BMS compounds was directly associated with the decreased sPD-L1 recruitment to the cell surface of the PD-1-expressing cells, a His-tagged sPD-L1 was labeled with the Ni-NTA-conjugated fluorescent dye and flow cytometry analysis was performed. When ECs were contacted with labeled sPD-L1, a clear staining was observed (Figure 3B). Pre-incubation of labeled sPD-L1 with PD-L1-blocking antibody durvalumab or atezolizumab significantly decreased the staining of ECs contrary to the control, non-specific antibody (Figure 3B). Additionally, the two PD-L1 mutants, PD-L1(A121Q) and PD-L1(Y56A/M115A), demonstrated reduced binding to ECs as evidenced by weaker cell staining compared to PD-L1(wt) (Supplementary Figure 2G). This demonstrates that the labeled sPD-L1 utilizes the canonical interaction surface to bind PD-1 receptor. Pre-incubation of sPD-L1 with BMS-1001 or BMS-1166 significantly decreased the intensity of staining (Figure 3B), again demonstrating that both compounds interfere with sPD-L1 interaction with PD-1 receptor exposed at the cell surface.
Structural basis of the interaction of BMS-1001 and BMS-1166 with hPD-L1
To decipher the structural details of the interaction of improved BMS compounds with PD-L1, we crystallized and solved the structure of BMS-1166 in complex with the Ig-like V-type domain of human PD-L1 at the resolution of 2.2 Å (Table 1). The asymmetric unit contains four protein molecules organized in two dimers, and each dimer harbors a single inhibitor molecule in a cylindrical tunnel at the interface of two monomers. Such organization of the dimer is similar to that we previously observed for BMS-202 . The deep hydrophobic pocket harboring BMS-202 is transformed into a tunnel in the PD-L1/BMS-1166 structure by rotation of the ATyr56 sidechain (the monomer molecules are annotated by subscripts A, B according to their chain arrangement in the crystal structure of the dimer) by 40 degrees (Figure 4). Not only this removes the steric hindrance, but provides additional interactions between ATyr56 and the 2,3-dihydro-1,4-benzodioxine moiety of the inhibitor.
Table 1: Data collection and refinement statistics (molecular replacement)
P 21 21 21
P 21 21 21
a, b, c (Å)
39.88 84.67 164.41
40.53 84.61 164.12
α, β, γ (°)
90 90 90
90 90 90
I / σI
Rwork / Rfree
Ramachandran favored (%)
Ramachandran allowed (%)
Ramachandran outliers (%)
Bond lengths (Å)
Bond angles (°)
*Values in parentheses are for the highest-resolution shell.
Figure 4: BMS-1166 induces binding cleft opening. (A) Arrangement of the molecules in the crystal structure – two PD-L1 molecules form a single pocket accommodating BMS compound. A close-up presents the position of the side-chain of the Tyr56 in BMS-8 (gray) and BMS-1166 (yellow/blue) containing structures. (B) The 2,3-dihydro-1,4-benzodioxine moiety of BMS-1001 and BMS-1166 induces the previously absent side-chain movement that triggers transformation of the binding pocket into the binding tunnel across the transverse vertical axis of the dimer. The panel visualizes surface representation of the dimer with the visible binding cleft (left, BMS-8/PD-L1 complex) and the binding tunnel (center and right for the BMS-1001/PD-L1 and BMS-1166/PD-L1 complexes, respectively). PD-L1 molecules forming the dimer are colored blue and green for chains A and B, respectively. Compounds are shown as yellow sticks.
Induced pockets are attractive targets for inhibitor design. To confirm the binding mode and vulnerability of the Tyr56 sidechain to ligand-induced changes, we solved the crystal structure of BMS-1001 in complex with sPD-L1 (Table 1; Supplementary Figure 3). The arrangement of ATyr56 sidechain and a resulting tunnel shaped binding pocket are identical in both structures (Figure 4).
At the other side of the tunnel the 3-cyanobenzyl substituent of BMS-1166 is stabilized through the ring π-stacking with BTyr123. Additionally, hydrogen bonds are formed between the cyan group and Nε atom of the side chain of BArg125. The (2R, 4R)-4-hydroxypyrrolidine-2-carboxylic acid substituent is stabilized through hydrogen bond with NH2 group of BLys124 side chain (Figure 4 and Supplementary Figure 4). In BMS-1001, the (2R)-2-amino-3-hydroxypropanoic acid moiety forms hydrogen bonds with the carbonyl of AAsp122 sidechain and additional water-mediated hydrogen bond with the NH2 group of ALys124 and mainchain carbonyl of ATyr123. The 3-cyanobenzyl substituent provides additional hydrophobic contacts with ATyr123 aromatic ring and AArg125 sidechain (Figure 4 and Supplementary Figure 4).
Defining the minimal BMS-1166 fragment with the PD-L1 binding ability
For further compound development it is of high importance to define the minimal fragments essential for the binding to the target protein. For this, BMS-1166 and its fragments were tested for interaction with PD-L1 using NMR method. From the six decomposition fragments tested, four retained PD-L1 binding potential (Figure 5). The analysis revealed that a two aromatic ring system (compound 4, Figure 5) is the minimal fragment of BMS-1166 responsible for the PD-L1 binding.
Figure 5: Decomposition of BMS-1166. BMS-1166 (1) or its fragments (2-6) were tested for the interaction with PD-L1 (blue) using 1H-15N HMQC NMR method. The spectra determined in presence of compounds (1)-(4) display line-broadening (red), indicative of compound-induced formation of a higher molecular weight PD-L1 complex. Compounds (5) and (6) induced no changes in the spectra even at molar excess, indicating the lack of interaction.
BMS-1001 and BMS-1166 induce PD-L1 dimerization in solution
The formation of solution-stable PD-L1 dimers in the presence of BMS compounds was characterized previously for BMS-202 . The crystal structures of BMS-1001 and -1166 bound to PD-L1 indicated similar properties of the compounds, but this required verification by in-solution assays. Initial clues were provided by direct NMR titration of 15N labeled PD-L1 where both BMS-1001 and BMS-1166 induced linewidth broadening indicative of significant increase in molecular weight of the analyzed species upon compound addition (Figure 5). This was verified by a crosslinking experiment. sPD-L1 preincubated in the presence of a cross-linking agent (bis(sulfosuccinimidyl)suberate, BS3) migrated in SDS-PAGE as a single band corresponding to monomeric protein. Preincubation in the same conditions with the addition of BMS-1001 resulted in two bands in SDS-PAGE analysis, corresponding to sPD-L1 monomer and a dimer (Supplementary Figure 5A). sPD-L1 dimerization in the presence of BMS was further confirmed by a size exclusion chromatography, where the retention time of sPD-L1 was significantly shortened in the presence of BMS-1001 and the change in retention time was indicative of dimer formation (Supplementary Figure 5B).
Model of BMS-induced dimerization of PD-L1
Our structural and biochemical results suggest that BMS compounds induce the formation of PD-L1 dimers. Inside the dimer a single BMS molecule interacts with two distinct sites on PD-L1, within PD-1 interaction surfaces of both protomers. Further optimization of BMS compounds, especially towards the molecules which action would not require the engagement of two PD-L1 entities, requires defining the energetically favorable binding mode of BMS at the PD-L1 surface. Docking simulations of BMS-1001 and -1166 at separate protomers consistently show a single energetically favorable binding mode identical to that observed in the crystal structure of APD-L1, but not BPD-L1 (Figure 6). This suggests a model where BMS compounds transiently bind PD-L1 in a mode characteristic for APD-L1 protomer, and such a preformed complex recruits the second PD-L1 molecule. Such model, if confirmed experimentally, would direct the development of BMS compound towards monomeric binders.
Figure 6: The prediction of BMS-1001 and -1166 binding sites on PD-L1 surface. Molecular docking simulations were performed to predict the favored binding sites of BMS compounds to PD-L1 protein. APD-L1 and BPD-L1 protomers were extracted from the co-crystal structures of BMS-1001/PD-L1 and BMS-1166/PD-L1 and used as templates (receptors) for the docking of appropriate BMS compound (ligand). The best docking results (represented by the purple compounds) are compared with crystallographic arrangements (represented by the green compounds). (A, D) For both BMS compounds, when APD-L1 protomer was investigated, the preferred molecular docking results corresponded well to the binding modes determined from crystallographic data. (B, E) When BPD-L1 protomer was selected, molecular docking simulations suggested an opposite orientation of the compounds to the one defined by crystal structure analysis (among the 10 best results not a single resembled the BMS orientation determined from crystal structures of BMS/BPD-L1). (C, F) The alignment of BPD-L1 protomer to the APD-L1 protomer revealed a significant resemblance of the binding mode of BMS compounds docked to BPD-L1 and the ones revealed from the crystals for APD-L1 protomer.
According to recent reports and clinical data, targeting the PD-1/PD-L1 immune checkpoint is an important and effective strategy for the treatment of diverse cancer types [1–3]. The use of monoclonal antibodies have evidenced the therapeutic potential of PD-1/PD-L1 blockade, but further development of clinical strategies targeting this immune checkpoint would be much facilitated by the introduction of other molecule types, devoid of the known drawbacks of monoclonal antibodies.
Several classes of non-antibody molecules have been patented in the recent years, including one group of small-molecule inhibitors, disclosed by Bristol-Myers Squibb in the two consecutive patents [24, 25], but very little data on activity was provided. In order to verify the activity of these disclosed groups of small molecules, we have selected and synthesized six representative compounds with one of the best Kd values measured by Homogenous Time-Resolved Fluorescence (HTRF) in vitro binding assay [24, 25]. Our study shows the biological activity of some of these small molecules at the cellular level and provides the background for their evaluation in further pre-clinical studies. At the same time issues and limitations of these particular compounds are highlighted, necessitating further improvement.
We have shown previously that the compounds BMS-8, BMS-37 and BMS-242 bind to PD-L1 and efficiently dissociate the human PD-1/PD-L1 complex in vitro . Here we demonstrate that the two optimized BMS compounds, BMS-1001 and BMS-1166, present significantly improved cytotoxic properties, allowing the use of higher concentrations. In addition, unlike the three compounds described earlier, BMS-1001 and -1166 present the potential of restoring the activation of effector Jurkat T cells, attenuated by both soluble and membrane-bound PD-L1 presented by antigen-presenting cells. Although the potential of the compounds in restoring the activation of effector cells is significantly lower than that observed for the therapeutic antibodies, further optimization based on our structural data may lead to the development of more potent molecules.
Both structural and biochemical data suggest the formation of dimers of sPD-L1 in the presence of BMS compounds. This unique formation of PD-L1 dimers may facilitate the inhibition of PD-1/PD-L1 interaction, as the dimerization engages PD-1-binding surfaces of both PD-L1 protomers. Since the level of soluble PD-L1 is increased in the serum of cancer patients and correlates with poor prognosis [15, 16], and sPD-L1 is able to interfere with the activation of blood T cells [17–19], the functional elimination of sPD-L1 could provide a positive therapeutic role by increasing the immune competence of T cells circulating in the blood. Additionally, this might have a meaning in cancer lesions, where cancer-derived sPD-L1 would block membrane-bound PD-L1 molecules in the presence of the compounds evaluated in this study, or membrane-bound PD-L1 molecules would reciprocally block each other at the cell-cell interface of cancer cells. Nevertheless, these potential mechanisms require further experimental verification.
Our structural results show that the tested BMS compounds force the conformational changes at the surface of PD-L1 molecule upon binding. Both conformational changes and additional interaction sub-sites absent in previously published structures result in improved interaction between the characterized compounds and the target protein (Figure 4). These results prove that although the targeting of PD-1/PD-L1 interaction with small molecules was considered challenging due to relatively flat interface of PD-1/PD-L1 interaction, it is not unfeasible. The plasticity of PD-L1 surface seems to be instrumental in designing the new compounds. The structures of BMS compounds reported here and in our previous studies  and the structure of PD-1/PD-L1 complex  may serve as starting points for the design of new molecular scaffolds based on molecular docking strategies. On top of that, our binding model suggests the more favorable BMS binding pose to start with.
Collectively, our results advocate for PD-1/PD-L1-blocking potential of the evaluated BMS compounds and present a likely mode of this inhibition by forcing the dimerization of PD-L1 molecules.
MATERIALS AND METHODS
Following antibodies were used: anti-PD-1 antibody nivolumab (MDX-1106, trade name: Opdivo, Bristol-Myers Squibb), anti-PD-1 antibody pembrolizumab (MK-3475, trade name: Keytruda, Merck & Co., Inc.), anti-PD-L1 antibody atezolizumab (MPDL3280A, trade name: Tecentriq, Genentech/Roche) and anti-PD-L1 antibody durvalumab (MEDI4736, trade name: Imfinzi, AstraZeneca Pharmaceuticals LP).
Synthesis of Bristol-Myers Squibb compounds
Six small-molecule compounds disclosed by Bristol-Myers Squibb were tested in respect to their biological activities in disrupting of the PD-1/PD-L1 interaction. The compounds were synthesized according to procedures described in BMS patents [24, 25] with minor modifications as described elsewhere . The identity and purity of all compounds was evaluated by 1H NMR, 13C NMR, high-resolution mass spectrometry (HRMS) and UPLC/MS.
Protein expression and purification
Expression and purification of human PD-L1 (residues 18–134, C-terminal His-tag) and human PD-1 (residues 33–150, Cys93 exchanged to serine) was carried out as described previously . A single residue A121Q hPD-L1 mutant and double mutant Y56A, M115A were prepared using site-directed mutagenesis. The constructs were verified by sequencing. The mutants were purified using the same protocol as the wild-type protein. The purity of the proteins was evaluated by SDS-PAGE and folding was examined using NMR spectroscopy.
Uniform 15N labelling was obtained by expressing proteins in the M9 minimal medium containing 15NH4Cl as the sole nitrogen source. For NMR measurements the buffer was exchanged by gel filtration to PBS pH 7.4 (PD-L1) or 25 mM sodium phosphate containing 100 mM NaCl pH 6.4 (PD-1). 10% (v/v) of D2O was added to the samples to provide the lock signal. All spectra were recorded at 300K using a Bruker Avance III 600 MHz spectrometer. The interaction of the compounds with PD-L1 was evaluated by monitoring the perturbations in chemical shifts of NMR resonances in the 1H-15N 2D HMQC upon titration with the compound. The ability of tested compounds to dissociate PD-L1/PD-1 was evaluated using the Antagonist Induced Dissociation Assay (AIDA) [27, 28]. In brief, 15N-labeled PD-1 (0.2 mM) was slightly overtitrated with the unlabeled PD-L1. The compounds were aliquoted into the resulting mixture. During the experiment the 1H-15N signals were monitored by the HMQC.
To verify the potency of BMS compounds in the inhibition of the PD-1/PD-L1 interactions, a cell-based model of the PD-1/PD-L1 immune checkpoint blockade was used. In the assay, two model cell lines are utilized: the artificial Antigen-Presenting Cells (PD-L1+ aAPC/CHO-K1 cells, called aAPCs) overexpressing TCR ligand and PD-L1, and T cell surrogate, a modified Jurkat T cell line overexpressing PD-1 and carrying a luciferase reporter under the control of NFAT promoter (PD-1 Effector Cells, called ECs) . The cells were obtained from Promega and cultured in the RPMI 1640 medium (Lonza) supplemented with 10% Fetal Bovine Serum (BioWest), 100 U/ml Penicillin and 100 U/ml Streptomycin. Additionally, the cells were propagated in a constant presence of Hygromycin B (50 μg/ml) and G418 (250 μg/ml) to provide a stable expression of the introduced genetic constructs. The two latter antibiotics were omitted in the experiments. Overexpression of PD-1 on ECs and PD-L1 on aAPCs was verified by flow cytometry (not shown) and the presence of the luciferase-expressing gene was verified by monitoring luciferase activity following anti-CD3 antibody stimulation. Antibiotic selection, flow cytometry and reporter expression served as cell line authentication method. The cells were periodically tested and found negative for Mycoplasma contamination using PCR-based method .
5 000 ECs were seeded on transparent 96-well plates and cultured for 48 h in the presence of increasing concentrations of the BMS compounds or DMSO as a control (the concentration of DMSO was kept constant in all samples). Following the treatment, a metabolic activity test was performed with the use of Biolog Redox Dye Mix MB (BioLog), according to the manufacturer’s instructions.
PD1/PD-L1 checkpoint assay
The aAPCs were seeded in white 96-well plates at the density of 10 000 per well in the culture medium 24 h prior to the assay. On the day of the assay, 3.5x serial dilutions of the antibodies were prepared in the RPMI 1640-containing 1% FBS. Serial dilutions of BMS compounds were prepared in DMSO and formulated in RPMI 1640-containing 1% FBS. By this, the concentration of DMSO was kept constant in all samples. 95 μl of the medium was removed from the wells and the cells were overlaid with 40 μl of the compound dilutions. 20 000 of ECs were added to each well in 40 μl RPMI 1640 containing 1% FBS. Following 6 h incubation at 37°C, the plates were equilibrated at room temperature for 10 min and 80 μl of the Bio-Glo reagent (Promega) was added to each well. After incubation for 10 min, luminescence was quantified using FlexStation 3 (Molecular Devices). Half maximal effective concentrations (EC50) and maximal luminescence values (RLUmax) were determined by fitting the Hill equation to the experimental data.
PD-1/sPD-L1 effector assay
For the evaluation of the BMS impact on T cell inhibition by soluble PD-L1, the ECs were stimulated with the anti-CD3 antibody in the presence of the recombinant human sPD-L1. For this, the 96-well white flat bottom plates were coated overnight at 4°C with 5 μg/ml of the anti-CD3 antibody or the isotype control solution in PBS. The antibody solution was removed and the plates were washed 3 times with PBS and dried. sPD-L1 (aa 18–134) was diluted in PBS supplemented with the penicillin/streptomycin solution (100 U/ml final concentration each) in the presence of the BMS compounds or a corresponding volume of DMSO. Then, 15 μl of the solution was added to each well of the antibody-coated plate. ECs were centrifuged and diluted to 50 000 per ml, and 60 μl of the cell solution was added to each well. The final concentration of sPD-L1 was 10 μg/ml (0.6 μM). The final concentrations of the BMS compounds were: 0.12, 0.3, 1.2 and 3 μM, giving the following BMS:sPD-L1 molar ratios: 1:5, 1:2, 2:1 and 5:1. The cells were cultured for 24 h and the luciferase activity assay was performed using the Bio-Glo Luciferase Assay System (Promega) according to the manufacturer’s instructions.
Flow cytometry measurements
Binding of sPD-L1 (aa 18–134) to ECs was evaluated by flow cytometry. The His-tagged PD-L1 protein or its mutants were stained with NTA-Atto 647 N fluorescent dye (Sigma Aldrich) for 2 h at 22°C, at 8:1 molar ratio (protein:dye). PD-L1-Atto was formulated in 150 μl PBS with the tested compounds or antibodies. The samples were incubated for 30 min at 4°C in the dark. Meanwhile, ECs were centrifuged, washed with PBS and suspended in fresh PBS at concentration of 1 × 106 cells per ml. 50 μl of ECs was added to each sample and incubated on ice for additional 60 min. The final concentrations of the components were: 25 μg/ml of PD-L1 (1.5 μM), 125 μg/ml the anti-PD-L1 antibodies and control antibodies and 1 μM of the BMS compounds. The samples were analyzed using the BD FACS Verse flow cytometer and BD FACSuite v1.0.6 software.
Crystallization of the hPD-L1/BMS-1001 and hPD-L1/BMS-1166 complexes
Purified proteins in 10 mM Tris (pH 8.0) containing 20 mM NaCl, were concentrated to 5 mg/ml, mixed with the inhibitor in 1:3 molar ratio (protein:compound) and clarified by centrifugation at 15 000 × g for 10 min. Supernatant was used for screening using a sitting-drop vapor diffusion method. Diffraction-quality crystals were obtained at room temperature from 0.1 M Tris pH 8.5 containing 0.2 M magnesium chloride and 30% (w/v) PEG 4000 for the hPD-L1/BMS-1001 complex and from 0.01 M Tris pH 8.4 containing 0.28 M sodium chloride and 27% (w/v) PEG 4000 for hPD-L1/BMS-1166 complex.
Structure solution and refinement
The X-ray diffraction data were collected at the PETRA III P11 beamline at DESY (Hamburg, Germany; ) and on the BL14.1 beamline operated by the Helmholtz-Zentrum Berlin (HZB) at the BESSY II (Berlin-Adlershof, Germany; ) for hPD-L1/BMS-1001 and hPD-L1/BMS-1166, respectively. The data were indexed and integrated using XDS [34, 35]. Scaling and merging was performed using Aimless . Molecular replacement was calculated using Phaser  and PDB 5C3T as a search model. The model building was performed using Coot  and refinement was performed in Phenix . Water molecules were added automatically and inspected manually Model validation was performed using Molprobity .
Complex analysis by gel filtration
Superdex S75 10/30 HR column was equilibrated with 10 mM Tris pH 8.0 containing 20 mM NaCl. The column was calibrated with globular protein standards. The retention time of hPD-L1 (4 mg/ml) was determined. hPD-L1/inhibitor complexes were formed at 3:1 (inhibitor:protein) molar ratio, incubated for 15 min at room temperature and clarified by centrifugation for 10 min at 15 000 × g. The samples were analyzed in the same manner as the apo-hPD-L1.
hPD-L1 was concentrated to 10 μM in PBS pH 7.4 and mixed with BMS-1001 or BMS-1166 in the 1:1 molar ratio, followed by the addition of the BS3 cross-linking reagent at 0.25, 0.5 or 1mM final concentration (Thermo Scientific). After 30-min incubation at room temperature, the reaction was quenched by the addition of Tris pH 7.5 to the final concentration of 25 mM. Control sample contained hPD-L1 and 1 mM BS3 reagent. The samples were analyzed by SDS-PAGE.
Docking of BMS compounds at the surface of PD-L1 was performed using Hex 8.0.0 with default parameters . APD-L1 and BPD-L1 protomers were extracted from co-crystal structures with BMS-1001 or -1166, described in this manuscript, and used as receptors. BMS compounds were also extracted from the co-crystal structures, served as ligands and treated as rigid.
Coordinates and structure factors were deposited in the Protein Data Bank with accession numbers 5NIU (BMS-1001) and 5NIX (BMS-1166).
TCR, T-cell receptor; aAPCs, artificial antigen-presenting cells; sPD-L1, soluble PD-L1; FDA, Food and Drug Administration; BMS, Bristol-Myers Squibb; ECs, PD-1 Effector Cells; AIDA, Antagonist Induced Dissociation Assay; HTRF, Homogenous Time-Resolved Fluorescence.
L.S., K.M.Z., G.D. and T.A.H designed the research. L.S., K.M.Z, M.P., B.S., J.K. and S.K. performed the experiments and analyzed data. K.G. synthesized the compounds. K.M.Z. and K.M. performed protein purification. B.M. performed NMR experiments. P.G. collected X-ray data, solved and refined the structures. M.T. performed molecular docking analysis. B.S. prepared PD-L1 mutants. L.S., K.M.Z., K.P., A.D., G.D., and T.A.H. wrote the manuscript. All authors discussed the experiments and commented on the manuscript.
We thank dr Krystyna Stalinska from the Jagiellonian University, Krakow, Poland for the selection and characterization of stable ECs and aAPCs.
CONFLICTS OF INTEREST
The authors declare no conflicts of interests.
This research has been supported by the Marie Curie FP7-Reintegration-Grant within the 7th European Community Framework Programme and by the UMO-2012/06/A/ST5/00224 and UMO-2014/12/W/NZ1/00457 grants (to TAH), and by the UMO-2011/01/D/NZ1/01169 (to GD) from the National Science Centre, Poland. KG and KMZ received financial support from the National Science Centre, Poland (grants UMO-2015/19/N/ST5/00347 to KG UMO-2016/20/T/NZ1/00519 to KZ). PG and GD were supported by the National Science Centre, Poland (grants UMO-2015/19/D/-NZ1/02009 and UMO-2012/07/E/NZ1/01907, respectively).
GD was the beneficent of the European Union’s Horizon 2020 research and innovation programme under MSC ITN “Accelerated Early stage drug dIScovery” (AEGIS), grant agreement No 675555. The research has been carried out with the equipment purchased thanks to the financial support of the European Union structural funds (grants POIG.02.01.00-12-064/08 and POIG.02.01.00-12-167/08).
1. Sharma P, Allison JP. Immune checkpoint targeting in cancer therapy: toward combination strategies with curative potential. Cell. 2015; 161:205–14. https://doi.org/10.1016/j.cell.2015.03.030.
2. Hoos A. Development of immuno-oncology drugs–from CTLA4 to PD1 to the next generations. Nat Rev Drug Discov. 2016; 15:235–47. https://doi.org/10.1038/nrd.2015.35.
3. Topalian SL, Drake CG, Pardoll DM. Immune checkpoint blockade: a common denominator approach to cancer therapy. Cancer Cell. 2015; 27:450–61. https://doi.org/10.1016/j.ccell.2015.03.001.
4. Mahoney KM, Rennert PD, Freeman GJ. Combination cancer immunotherapy and new immunomodulatory targets. Nat Rev Drug Discov. 2015; 14:561–84. https://doi.org/10.1038/nrd4591.
5. Khalil DN, Smith EL, Brentjens RJ, Wolchok JD. The future of cancer treatment: immunomodulation, CARs and combination immunotherapy. Nat Rev Clin Oncol. 2016; 13:273–90. https://doi.org/10.1038/nrclinonc.2016.25.
6. Ishida Y, Agata Y, Shibahara K, Honjo T. Induced expression of PD-1, a novel member of the immunoglobulin gene superfamily, upon programmed cell death. EMBO J. 1992; 11:3887–95.
7. Ostrand-Rosenberg S, Horn LA, Haile ST. The programmed death-1 immune-suppressive pathway: barrier to antitumor immunity. J Immunol. 2014; 193:3835–41. https://doi.org/10.4049/jimmunol.1401572.
8. Riella LV, Paterson AM, Sharpe AH, Chandraker A. Role of the PD-1 pathway in the immune response. Am J Transplant. 2012; 12:2575–87. https://doi.org/10.1111/j.1600-6143.2012.04224.x.
9. Latchman YE, Liang SC, Wu Y, Chernova T, Sobel RA, Klemm M, Kuchroo VK, Freeman GJ, Sharpe AH. PD-L1-deficient mice show that PD-L1 on T cells, antigen-presenting cells, and host tissues negatively regulates T cells. Proc Natl Acad Sci U S A. 2004; 101:10691–6. https://doi.org/10.1073/pnas.0307252101.
10. Wang X, Teng F, Kong L, Yu J. PD-L1 expression in human cancers and its association with clinical outcomes. Onco Targets Ther. 2016; 9:5023–39. https://doi.org/10.2147/OTT.S105862.
11. Barber DL, Wherry EJ, Masopust D, Zhu B, Allison JP, Sharpe AH, Freeman GJ, Ahmed R. Restoring function in exhausted CD8 T cells during chronic viral infection. Nature. 2006; 439:682–7. https://doi.org/10.1038/nature04444.
12. Wherry EJ. T cell exhaustion. Nat Immunol. 2011; 12:492–9. https://doi.org/10.1038/ni.2035.
13. Kim R, Emi M, Tanabe K. Cancer immunoediting from immune surveillance to immune escape. Immunology. 2007; 121:1–14. https://doi.org/10.1111/j.1365-2567.2007.02587.x.
14. Vinay DS, Ryan EP, Pawelec G, Talib WH, Stagg J, Elkord E, Lichtor T, Decker WK, Whelan RL, Kumara HM, Signori E, Honoki K, Georgakilas AG, et al. Immune evasion in cancer: Mechanistic basis and therapeutic strategies. Semin Cancer Biol. 2015; 35:S185–98. https://doi.org/10.1016/j.semcancer.2015.03.004.
15. Wang L, Wang H, Chen H, Wang W, Chen XQ, Geng QR, Xia ZJ, Lu Y. Serum levels of soluble programmed death ligand 1 predict treatment response and progression free survival in multiple myeloma. Oncotarget. 2015; 6:41228–36. https://doi.org/10.18632/oncotarget.5682.
16. Rossille D, Gressier M, Damotte D, Maucort-Boulch D, Pangault C, Semana G, Le Gouill S, Haioun C, Tarte K, Lamy T, Milpied N, Fest T, Groupe Ouest-Est des Leucémies et Autres Maladies du Sang. High level of soluble programmed cell death ligand 1 in blood impacts overall survival in aggressive diffuse large B-Cell lymphoma: results from a French multicenter clinical trial. Leukemia. 2014; 28:2367–75. https://doi.org/10.1038/leu.2014.137.
17. Frigola X, Inman BA, Lohse CM, Krco CJ, Cheville JC, Thompson RH, Leibovich B, Blute ML, Dong H, Kwon ED. Identification of a soluble form of B7-H1 that retains immunosuppressive activity and is associated with aggressive renal cell carcinoma. Clin Cancer Res. 2011; 17:1915–23. https://doi.org/10.1158/1078-0432.CCR-10-0250.
18. Davies LC, Heldring N, Kadri N, Le Blanc K. Mesenchymal Stromal Cell Secretion of Programmed Death-1 Ligands Regulates T Cell Mediated Immunosuppression. Stem Cells. 2017; 35:766–76. https://doi.org/10.1002/stem.2509.
19. Brusa D, Serra S, Coscia M, Rossi D, D’Arena G, Laurenti L, Jaksic O, Fedele G, Inghirami G, Gaidano G, Malavasi F, Deaglio S. The PD-1/PD-L1 axis contributes to T-cell dysfunction in chronic lymphocytic leukemia. Haematologica. 2013; 98:953–63. https://doi.org/10.3324/haematol.2012.077537.
20. Blackburn SD, Shin H, Freeman GJ, Wherry EJ. Selective expansion of a subset of exhausted CD8 T cells by alphaPD-L1 blockade. Proc Natl Acad Sci U S A. 2008; 105:15016–21. https://doi.org/10.1073/pnas.0801497105.
21. Pauken KE, Wherry EJ. Overcoming T cell exhaustion in infection and cancer. Trends Immunol. 2015; 36:265–76. https://doi.org/10.1016/j.it.2015.02.008.
22. Zhan MM, Hu XQ, Liu XX, Ruan BF, Xu J, Liao C. From monoclonal antibodies to small molecules: the development of inhibitors targeting the PD-1/PD-L1 pathway. Drug Discov Today. 2016; 21:1027–36. https://doi.org/10.1016/j.drudis.2016.04.011.
23. Zarganes-Tzitzikas T, Konstantinidou M, Gao Y, Krzemien D, Zak K, Dubin G, Holak TA, Dömling A. Inhibitors of programmed cell death 1 (PD-1): a patent review (2010-2015). Expert Opin Ther Pat. 2016; 26:973–7. https://doi.org/10.1080/13543776.2016.1206527.
24. Chupak LS, Zheng X. Compounds useful as immunomodulators. Bristol-Myers Squibb Co. 2015; WO 2015/034820 A1. WO2015034820 A1.
25. Chupak LS, Ding M, Martin SW, Zheng X, Hewawasam P, Connoly TP, Xu N, Yeung KS, Zhu J, Langley DR, Tenney DJ, Scola PM. Compounds useful as immunomodulators. Bristol-Myers Squibb Co. 2015; WO 2015/160641 A2. WO 2015/160641 A2.
26. Zak KM, Grudnik P, Guzik K, Zieba BJ, Musielak B, Dömling A, Dubin G, Holak TA. Structural basis for small molecule targeting of the programmed death ligand 1 (PD-L1). Oncotarget. 2016; 7:30323–35. https://doi.org/10.18632/oncotarget.8730.
27. Krajewski M, Rothweiler U, D’Silva L, Majumdar S, Klein C, Holak TA. An NMR-based antagonist induced dissociation assay for targeting the ligand-protein and protein-protein interactions in competition binding experiments. J Med Chem. 2007; 50:4382–7. https://doi.org/10.1021/jm070365v.
28. D’Silva L, Ozdowy P, Krajewski M, Rothweiler U, Singh M, Holak TA. Monitoring the effects of antagonists on protein-protein interactions with NMR spectroscopy. J Am Chem Soc. 2005; 127:13220–6. https://doi.org/10.1021/ja052143x.
29. Zak KM, Kitel R, Przetocka S, Golik P, Guzik K, Musielak B, Dömling A, Dubin G, Holak TA. Structure of the Complex of Human Programmed Death 1, PD-1, and Its Ligand PD-L1. Structure. 2015; 23:2341–8. https://doi.org/10.1016/j.str.2015.09.010.
30. Cheng ZJ, Karassina N, Grailer J, Hartnett J, Fan F, Cong M. Abstract 5440: Novel PD-1 blockade bioassay to assess therapeutic antibodies in PD-1 and PD-L1 immunotherapy programs. Cancer Res. 2015; 75:5440–5440. https://doi.org/10.1158/1538-7445.AM2015-5440.
31. van Kuppeveld FJ, van der Logt JT, Angulo AF, van Zoest MJ, Quint WG, Niesters HG, Galama JM, Melchers WJ. Genus- and species-specific identification of mycoplasmas by 16S rRNA amplification. Appl Environ Microbiol. 1992; 58:2606–15.
32. Burkhardt A, Pakendorf T, Reime B, Meyer J, Fischer P, Stübe N, Panneerselvam S, Lorbeer O, Stachnik K, Warmer M, Rödig P, Göries D, Meents A. Status of the crystallography beamlines at PETRA III. Eur Phys J Plus. 2016; 131:56. https://doi.org/10.1140/epjp/i2016-16056-0.
33. Mueller U, Förster R, Hellmig M, Huschmann FU, Kastner A, Malecki P, Pühringer S, Röwer M, Sparta K, Steffien M, Ühlein M, Wilk P, Weiss MS. The macromolecular crystallography beamlines at BESSY II of the Helmholtz-Zentrum Berlin: Current status and perspectives. Eur Phys J Plus. 2015; 130:141. https://doi.org/10.1140/epjp/i2015-15141-2.
34. Krug M, Weiss MS, Heinemann U, Mueller U. XDSAPP: a graphical user interface for the convenient processing of diffraction data using XDS. J Appl Crystallogr. 2012; 45:568–72. https://doi.org/10.1107/S0021889812011715.
35. Kabsch W. XDS. Acta Crystallogr D Biol Crystallogr. 2010; 66:125–32. https://doi.org/10.1107/S0907444909047337.
36. Evans PR, Murshudov GN. How good are my data and what is the resolution? Acta Crystallogr D Biol Crystallogr. 2013; 69:1204–14. https://doi.org/10.1107/S0907444913000061.
37. McCoy AJ, Grosse-Kunstleve RW, Adams PD, Winn MD, Storoni LC, Read RJ. Phaser crystallographic software. J Appl Crystallogr. 2007; 40:658–74. https://doi.org/10.1107/S0021889807021206.
38. Emsley P, Lohkamp B, Scott WG, Cowtan K. Features and development of Coot. Acta Crystallogr D Biol Crystallogr. 2010; 66:486–501. https://doi.org/10.1107/S0907444910007493.
39. Adams PD, Afonine PV, Bunkóczi G, Chen VB, Davis IW, Echols N, Headd JJ, Hung LW, Kapral GJ, Grosse-Kunstleve RW, McCoy AJ, Moriarty NW, Oeffner R, et al. PHENIX: a comprehensive Python-based system for macromolecular structure solution. Acta Crystallogr D Biol Crystallogr. 2010; 66:213–21. https://doi.org/10.1107/S0907444909052925.
40. Chen VB, Arendall WB, Headd JJ, Keedy DA, Immormino RM, Kapral GJ, Murray LW, Richardson JS, Richardson DC. MolProbity: all-atom structure validation for macromolecular crystallography. Acta Crystallogr D Biol Crystallogr. 2010; 66:12–21. https://doi.org/10.1107/S0907444909042073.
41. Mustard D, Ritchie DW. Docking essential dynamics eigenstructures. Proteins Struct Funct Genet. 2005; 60:269–74. https://doi.org/10.1002/prot.20569.
All site content, except where otherwise noted, is licensed under a Creative Commons Attribution 3.0 License.