Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -26,12 +26,21 @@ decoder once per click.
|
|
| 26 |
The encoder ships in fp32 only, and that is not an omission. Its backbone is RepViT,
|
| 27 |
which is convolutional, and XNNPACK serializes convolution weights as fp32 whatever
|
| 28 |
dtype the graph carries, so fp16 came out at 19.8 MB (100.5%) and buys nothing.
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
|
| 36 |
EdgeTAM is Meta's on-device SAM 2 (CVPR 2025). Its encoder is **5.5× smaller than
|
| 37 |
SAM 2.1 hiera-tiny's** (19.7 MB vs 109.2 MB) for the same output contract, so an
|
|
|
|
| 26 |
The encoder ships in fp32 only, and that is not an omission. Its backbone is RepViT,
|
| 27 |
which is convolutional, and XNNPACK serializes convolution weights as fp32 whatever
|
| 28 |
dtype the graph carries, so fp16 came out at 19.8 MB (100.5%) and buys nothing.
|
| 29 |
+
|
| 30 |
+
Both int8 recipes were measured. Dynamic int8 annotates `aten.linear` and this graph
|
| 31 |
+
has none — all 50 nn.Linear in EdgeTAM sit in the mask decoder, not on the
|
| 32 |
+
image-embedding path — so it leaves the encoder at the same 19.7 MB. Static int8 does
|
| 33 |
+
reach convolution weights, and on paper it is the build you would want: **5.4 MB and
|
| 34 |
+
24.7 ms** against fp32's 19.7 MB and 31.0 ms on the same machine. It is the masks that
|
| 35 |
+
stop it. Feeding its embeddings to the same fp32 decoder, over 37 clicks the fp32 arm
|
| 36 |
+
answered, the worst decoded mask comes back at **0.0185 IoU** against the fp32
|
| 37 |
+
encoder's — the median holds at 0.887, but a build that loses the mask outright on
|
| 38 |
+
some clicks is not one to publish. Measured with a global per-channel static
|
| 39 |
+
configuration calibrated on ten photographs; a narrower annotation might do better and
|
| 40 |
+
has not been tried.
|
| 41 |
+
|
| 42 |
+
At 19.7 MB the fp32 encoder is already smaller than SAM 2.1 hiera-tiny's *fp16*
|
| 43 |
+
encoder (55.6 MB).
|
| 44 |
|
| 45 |
EdgeTAM is Meta's on-device SAM 2 (CVPR 2025). Its encoder is **5.5× smaller than
|
| 46 |
SAM 2.1 hiera-tiny's** (19.7 MB vs 109.2 MB) for the same output contract, so an
|