← All research

Molecular AI & Methods / 2024

MolFeSCue: enhancing molecular property prediction in data-limited and imbalanced contexts using few-shot and contrastive learning

Few-shot and contrastive learning for scarce and imbalanced molecular property labels.

Bioinformatics · 40(4), btae118

Major author · confirmed by Richard

First author

01 / Research question

Can a molecular property predictor adapt when labels are scarce and class frequencies are uneven?

02 / Innovation

Combine a pretrained molecular graph encoder with few-shot adaptation and a dynamic contrastive objective that emphasizes difficult examples.

03 / Mechanism

A pretrained HuGIN or ChemBERTa encoder adapts through few-shot learning. Cross-entropy is combined with contrastive separation of classes; an exponential schedule gradually reduces emphasis on hard negatives.

Zhang et al. (2024), MolFeSCue, Figure 2. Complete original image, unchanged.
Zhang et al. (2024), MolFeSCue, Figure 2. Complete original image, unchanged. Figure source ↗ · CC BY 4.0

04 / Experimental setup

Table 1 lists Tox21 8,014 compounds (9/3 train/test tasks), SIDER 1,427 (21/6), MUV 93,127 (12/5), and ToxCast 8,615 (450/167). Tox21/SIDER/MUV use established task splits; ToxCast tasks are randomly partitioned. Table 3 reports query-set ROC-AUC across ten seeds, comparing ten baseline methods whose values are cited from prior work.

Published article · 2024 · Table 3 · Source ↗

05 / Results

10-shot AUC exceeds Pre-PAR on all four datasets; 1-shot results trail Pre-PAR on Tox21 and SIDER.

10-shot AUC (%) · mean ± SD, 10 runs · Published article · 2024 · Table 3 · Data source ↗

Scale: 0 → 100

Tox21
85.93 ± 0.10%
SIDER
79.08 ± 0.14%
MUV
72.96 ± 1.18%
ToxCast
76.39 ± 1.52%
10-shot AUC (%) · mean ± SD, 10 runs
ConditionMetric / seriesReported value
Tox2110-shot AUC (%) · mean ± SD, 10 runs85.93 ± 0.10%
SIDER10-shot AUC (%) · mean ± SD, 10 runs79.08 ± 0.14%
MUV10-shot AUC (%) · mean ± SD, 10 runs72.96 ± 1.18%
ToxCast10-shot AUC (%) · mean ± SD, 10 runs76.39 ± 1.52%

Values refer to the stated version and experimental conditions; different metrics do not form a common ranking.

Few-shot comparisons against Pre-PAR

ROC-AUC %, mean ± SD across 10 seeds; Pre-PAR values cited by the paper.

Swipe horizontally, or focus and use arrow keys to see all columns →

DatasetPre-PAR 10-shotMolFeSCue 10-shotPre-PAR 1-shotMolFeSCue 1-shot
Tox2184.93 ± 0.1185.93 ± 0.1083.01 ± 0.0982.05 ± 0.11
SIDER78.08 ± 0.1679.08 ± 0.1474.46 ± 0.2973.13 ± 0.56
MUV69.96 ± 1.3772.96 ± 1.1866.94 ± 1.1267.32 ± 1.08
ToxCast75.12 ± 0.8476.39 ± 1.5273.63 ± 1.0074.82 ± 1.39

Published article · Table 3 · Primary source ↗

06 / Ablation & limitations

Figures 3–4 remove pretrained initialization, contrastive loss or its dynamic schedule. The SIDER value in Figure 3 prose differs from Table 3, so it is not combined with the main comparison. Task transfer and ROC-AUC on imbalanced data do not establish prospective screening yield.

Improvements depend on the support size and dataset; the model does not lead every 1-shot comparison.

07 / My contribution

First author.

08 / Paper & code

Cite this research

MolFeSCue: enhancing molecular property prediction in data-limited and imbalanced contexts using few-shot and contrastive learning. Bioinformatics · 40(4), btae118, 2024. https://academic.oup.com/bioinformatics/article/40/4/btae118/7616990