mlboydaisuke commited on
Commit
efa0ecd
·
verified ·
1 Parent(s): 5f5f32c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +15 -6
README.md CHANGED
@@ -26,12 +26,21 @@ decoder once per click.
26
  The encoder ships in fp32 only, and that is not an omission. Its backbone is RepViT,
27
  which is convolutional, and XNNPACK serializes convolution weights as fp32 whatever
28
  dtype the graph carries, so fp16 came out at 19.8 MB (100.5%) and buys nothing.
29
- Dynamic int8 is a different matter: it annotates `aten.linear` and this graph has
30
- none all 50 nn.Linear in EdgeTAM sit in the mask decoder, not on the
31
- image-embedding pathso it leaves the encoder at the same 19.7 MB. Static int8 is
32
- the recipe that would reach convolution weights, and it has not been run here. At
33
- 19.7 MB the fp32 encoder is already smaller than SAM 2.1 hiera-tiny's *fp16* encoder
34
- (55.6 MB).
 
 
 
 
 
 
 
 
 
35
 
36
  EdgeTAM is Meta's on-device SAM 2 (CVPR 2025). Its encoder is **5.5× smaller than
37
  SAM 2.1 hiera-tiny's** (19.7 MB vs 109.2 MB) for the same output contract, so an
 
26
  The encoder ships in fp32 only, and that is not an omission. Its backbone is RepViT,
27
  which is convolutional, and XNNPACK serializes convolution weights as fp32 whatever
28
  dtype the graph carries, so fp16 came out at 19.8 MB (100.5%) and buys nothing.
29
+
30
+ Both int8 recipes were measured. Dynamic int8 annotates `aten.linear` and this graph
31
+ has noneall 50 nn.Linear in EdgeTAM sit in the mask decoder, not on the
32
+ image-embedding path so it leaves the encoder at the same 19.7 MB. Static int8 does
33
+ reach convolution weights, and on paper it is the build you would want: **5.4 MB and
34
+ 24.7 ms** against fp32's 19.7 MB and 31.0 ms on the same machine. It is the masks that
35
+ stop it. Feeding its embeddings to the same fp32 decoder, over 37 clicks the fp32 arm
36
+ answered, the worst decoded mask comes back at **0.0185 IoU** against the fp32
37
+ encoder's — the median holds at 0.887, but a build that loses the mask outright on
38
+ some clicks is not one to publish. Measured with a global per-channel static
39
+ configuration calibrated on ten photographs; a narrower annotation might do better and
40
+ has not been tried.
41
+
42
+ At 19.7 MB the fp32 encoder is already smaller than SAM 2.1 hiera-tiny's *fp16*
43
+ encoder (55.6 MB).
44
 
45
  EdgeTAM is Meta's on-device SAM 2 (CVPR 2025). Its encoder is **5.5× smaller than
46
  SAM 2.1 hiera-tiny's** (19.7 MB vs 109.2 MB) for the same output contract, so an