CoAtNet-7 backbone (Dai et al., 2021).
Widest mixed-stage variant. Spec from paper §A.2 / Table 12:
- S0 conv stem: D=192, L=2
- S1 MBConv: L=2, D=256
- S2 MBConv: L=4, D=512
- S3 mixed: MBConv L=8 D=1024 → expand→2048 → TFMRel L=42 D=2048
- S4 TFMRel: L=2, D=3072
Approximately 2.4B parameters — paper's strongest published CoAtNet, only usable with JFT-3B pretraining. Not buildable on a 16 GB host (param footprint alone is ≈ 9.7 GB before activations).