privacy-filter-openai

This repository hosts the privacy-filter-openai models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Variants

Path Backend Precision
mlx/privacy_filter_openai_mlx_int4.pte mlx int4
xnnpack/privacy_filter_openai_xnnpack_8da4w.pte xnnpack 8da4w

Repository structure

config.json                                      43 B
mlx/config.json                                  962 B
mlx/privacy_filter_openai_mlx_int4.pte           835 MB
tokenizer.json                                   26.6 MB
tokenizer_config.json                            234 B
viterbi_calibration.json                         372 B
xnnpack/config.json                              972 B
xnnpack/privacy_filter_openai_xnnpack_8da4w.pte  1.2 GB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.

Downloads last month
384
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for software-mansion/react-native-executorch-privacy-filter-openai

Quantized
(8)
this model

Collection including software-mansion/react-native-executorch-privacy-filter-openai