FWPRec Experiments
All experiments
Efficiency benchmark · one RTX 4080 SUPER · updated 2026-09-25 02:26 UTC

What each model costs

The same measurements efficiency-focused recommender papers publish — trainable parameters, peak GPU memory, training time per epoch, and inference time per batch — taken on one idle GPU with each model in its exact published main-table configuration. Timings are medians over repeated, synchronized steps; the last column is the real wall-clock of the published three-seed runs.

Takeaway

The notepad's inference cost sits between the light recurrent models and the attention stack, with the smallest inference memory of any adaptive model — its per-user state is bounded, so serving memory stays flat while attention models grow with history. Training is mid-pack: the write loop makes epochs slower than GRU4Rec's but comparable to the state-space and contrastive baselines. The fastest trainer everywhere is GRU4Rec; the slowest is Mamba4Rec's unfused scan.

Trainable parameters · cheapest first · FWPRec in blue

Within each dataset, bars run cheapest to costliest left to right, and heights are on a log scale — values span up to three orders of magnitude, so a linear axis would hide every smaller model. The tallest bar in a group is always full height. Hover any bar for its exact value.

PopKNNGRUHSTMamFWPLRUSASDuoBPR
MIND-large
PopKNNGRUHSTMamFWPLRUSASDuoBPR
EB-NeRD
PopKNNGRUHSTMamFWPLRUSASDuoBPR
Amazon Video Games
PopKNNGRUHSTMamFWPLRUSASDuoBPR
MovieLens-1M
PopKNNGRUHSTMamFWPLRUSASDuoBPR
KuaiRand-Pure (IDs)
PopKNNGRUHSTMamFWPBPRLRUSASDuo
KuaiRec

Training time per epoch (s) · cheapest first · FWPRec in blue

Within each dataset, bars run cheapest to costliest left to right, and heights are on a log scale — values span up to three orders of magnitude, so a linear axis would hide every smaller model. The tallest bar in a group is always full height. Hover any bar for its exact value.

GRUBPRSASHSTDuoFWPLRUMam
MIND-large
BPRGRUSASHSTFWPDuoLRUMam
EB-NeRD
BPRGRUSASHSTFWPDuoLRUMam
Amazon Video Games
BPRGRUSASHSTDuoLRUFWPMam
MovieLens-1M
BPRGRUSASFWPHSTDuoMamLRU
KuaiRand-Pure (IDs)
BPRGRUSASHSTDuoFWPLRUMam
KuaiRec

Peak training memory (GB) · cheapest first · FWPRec in blue

Within each dataset, bars run cheapest to costliest left to right, and heights are on a log scale — values span up to three orders of magnitude, so a linear axis would hide every smaller model. The tallest bar in a group is always full height. Hover any bar for its exact value.

GRUSASHSTBPRLRUFWPDuoMam
MIND-large
BPRGRUSASHSTLRUFWPDuoMam
EB-NeRD
GRUBPRSASFWPHSTLRUMamDuo
Amazon Video Games
BPRGRUSASHSTLRUFWPDuoMam
MovieLens-1M
BPRGRUSASFWPHSTLRUMamDuo
KuaiRand-Pure (IDs)
BPRGRUSASFWPHSTLRUMamDuo
KuaiRec

Inference time per batch (ms) · cheapest first · FWPRec in blue

Within each dataset, bars run cheapest to costliest left to right, and heights are on a log scale — values span up to three orders of magnitude, so a linear axis would hide every smaller model. The tallest bar in a group is always full height. Hover any bar for its exact value.

PopBPRGRUHSTDuoSASLRUMamFWPKNN
MIND-large
PopBPRGRUHSTDuoSASLRUMamFWPKNN
EB-NeRD
PopBPRGRUDuoSASHSTFWPLRUMamKNN
Amazon Video Games
PopBPRDuoSASHSTGRUFWPLRUMamKNN
MovieLens-1M
PopBPRGRUFWPDuoSASHSTLRUMamKNN
KuaiRand-Pure (IDs)
PopBPRDuoSASHSTGRUFWPLRUMamKNN
KuaiRec

Average inference memory (GB) · cheapest first · FWPRec in blue

Within each dataset, bars run cheapest to costliest left to right, and heights are on a log scale — values span up to three orders of magnitude, so a linear axis would hide every smaller model. The tallest bar in a group is always full height. Hover any bar for its exact value.

PopKNNGRUSASMamHSTFWPLRUBPRDuo
MIND-large
PopKNNGRUBPRMamHSTFWPSASLRUDuo
EB-NeRD
PopKNNGRUMamHSTFWPSASLRUBPRDuo
Amazon Video Games
PopKNNGRUBPRSASLRUMamHSTFWPDuo
MovieLens-1M
PopKNNGRUBPRMamHSTSASLRUFWPDuo
KuaiRand-Pure (IDs)
PopKNNBPRGRUSASMamHSTFWPLRUDuo
KuaiRec

Peak inference memory (GB) · cheapest first · FWPRec in blue

Within each dataset, bars run cheapest to costliest left to right, and heights are on a log scale — values span up to three orders of magnitude, so a linear axis would hide every smaller model. The tallest bar in a group is always full height. Hover any bar for its exact value.

KNNPopGRUSASFWPLRUHSTMamBPRDuo
MIND-large
PopKNNBPRGRUSASFWPLRUHSTMamDuo
EB-NeRD
PopKNNGRUBPRFWPLRUSASMamHSTDuo
Amazon Video Games
PopKNNBPRGRUSASFWPLRUHSTMamDuo
MovieLens-1M
PopKNNBPRGRUFWPLRUSASMamHSTDuo
KuaiRand-Pure (IDs)
PopKNNBPRGRUFWPLRUSASMamHSTDuo
KuaiRec

MIND-large · batch 1024

ModelTrainable paramsTrain s/epoch Peak train GBInfer ms/batchAvg infer GBPeak infer GB Total train min†
Popularity0··0.050.0020.0043.7
ItemKNN0··956.560.0020.00315.7
BPRMF48.03M13.320.9210.120.3850.40912.1
GRU4Rec25K9.050.4472.460.0270.07810.6
SASRec103K22.40.6214.180.0440.18111.2
DuoRec103K50.111.6534.010.5570.69314.9
LRURec101K87.721.2654.860.0450.24222.9
Mamba4Rec66K101.071.7186.630.0440.28218.7
HSTU62K28.950.6633.660.0440.2739.5
FWPRec (Ours)83K50.581.50910.870.0440.19116.1

EB-NeRD · batch 1024

ModelTrainable paramsTrain s/epoch Peak train GBInfer ms/batchAvg infer GBPeak infer GB Total train min†
Popularity0··0.040.0020.0030.9
ItemKNN0··1030.210.0020.0034.4
BPRMF1.20M0.230.0710.120.0140.0391.5
GRU4Rec25K0.990.081.770.0050.0741.3
SASRec103K2.180.5993.910.0230.1591.4
DuoRec103K5.161.6313.90.5350.6711.2
LRURec101K8.881.2434.460.0230.221.7
Mamba4Rec66K10.351.6966.450.0220.261.7
HSTU62K2.890.6423.390.0220.2511.3
FWPRec (Ours)83K5.151.48710.740.0220.1692.2

Amazon Video Games · batch 256

ModelTrainable paramsTrain s/epoch Peak train GBInfer ms/batchAvg infer GBPeak infer GB Total train min†
Popularity0··0.030.0010.0020.6
ItemKNN0··437.870.0010.0021.2
BPRMF6.06M1.160.1210.090.0520.0651.2
GRU4Rec25K3.870.0921.580.0070.0281.3
SASRec106K6.110.3322.330.0250.1241.5
DuoRec106K14.610.8742.30.2990.3982.6
LRURec101K24.140.6535.240.0250.1234.1
Mamba4Rec66K32.330.8598.220.0240.1386.1
HSTU65K10.840.412.390.0240.1732.3
FWPRec (Ours)83K14.240.3993.360.0240.0692.6

MovieLens-1M · batch 256

ModelTrainable paramsTrain s/epoch Peak train GBInfer ms/batchAvg infer GBPeak infer GB Total train min†
Popularity0··0.040.0010.0011.2
ItemKNN0··520.930.0010.0014.4
BPRMF387K2.060.0530.10.0040.0172.9
GRU4Rec25K8.640.0532.570.0020.0243.2
SASRec103K8.90.1641.450.0190.0534.0
DuoRec103K22.650.421.390.150.1844.7
LRURec101K31.190.3283.650.0190.0697.0
Mamba4Rec66K45.640.4384.210.0190.0788.2
HSTU62K10.150.1741.60.0190.0763.5
FWPRec (Ours)83K32.160.393.540.0190.067.2

KuaiRand-Pure (IDs) · batch 512

ModelTrainable paramsTrain s/epoch Peak train GBInfer ms/batchAvg infer GBPeak infer GB Total train min†
Popularity0··0.040.0010.0032.5
ItemKNN0··563.870.0010.0032.8
BPRMF2.22M1.340.0530.140.0180.033.9
GRU4Rec516K5.310.0692.470.0050.0474.9
SASRec597K11.60.644.230.0230.2215.5
DuoRec597K27.211.7214.060.5660.7656.2
LRURec592K71.781.2795.620.0230.2219.4
Mamba4Rec557K68.721.6997.450.0220.24920.0
HSTU556K20.580.7984.620.0220.328.6
FWPRec (Ours)567K13.130.7633.360.0230.1026.0

KuaiRec · batch 256

ModelTrainable paramsTrain s/epoch Peak train GBInfer ms/batchAvg infer GBPeak infer GB Total train min†
Popularity0··0.040.0010.0024.8
ItemKNN0··615.740.0010.00227.1
BPRMF90K5.240.0490.110.0020.0156.5
GRU4Rec25K26.950.0572.880.0020.0297.8
SASRec106K31.580.3262.380.0190.1199.0
DuoRec106K76.420.8692.320.2940.39314.0
LRURec101K144.440.6485.840.020.11826.0
Mamba4Rec66K244.440.8548.070.0190.13235.7
HSTU65K46.810.4052.380.0190.1689.3
FWPRec (Ours)83K98.740.3933.330.0190.06412.4

Fine print

† mean wall-clock of the three published final seeds, including per-epoch validation and early stopping — so it reflects what the runs actually cost, not epochs × epoch-time. Trainable parameters exclude the frozen Qwen table (identical for every model on content columns); on KuaiRand all item tables are learned, so counts include them. Popularity and ItemKNN involve no gradient training; their fit happens at construction. Batch sizes are each column's published training batch size. Average inference memory is the steady-state allocation sampled after each timed batch (resident weights and buffers); the peak is the transient forward-pass high-water mark.

Paper figures

Publication versions of this page's charts, as PDF. Each series or cell is encoded twice (colour plus pattern, marker or printed value), so they read in greyscale and under colour-vision deficiency. Click a preview to open the PDF.

Trainable parameters (paper figure)
Trainable parameters — Log scale; bars ascending within each dataset. PDF
Train time per epoch (paper figure)
Train time per epoch — Seconds, log scale. PDF
Peak train memory (paper figure)
Peak train memory — GB, log scale. PDF
Inference time per batch (paper figure)
Inference time per batch — Milliseconds, log scale. PDF
Average inference memory (paper figure)
Average inference memory — GB, log scale. PDF
Peak inference memory (paper figure)
Peak inference memory — GB, log scale. PDF