Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org : transformers : 4.39.0

State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow

Registry - Documentation - Download - JSON
Integrity: sha256-7801785b1f016d667467... -
purl: pkg:pypi/[email protected]
Published:
Indexed:
Related tag: v4.39.0 - compare

    Loading...
    Readme
    Loading...
    Dependencies
    • accelerate >=0.21.0 extra == "accelerate" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "agents" (optional)
    • accelerate >=0.21.0 extra == "agents" (optional)
    • datasets !=2.5.0 extra == "agents" (optional)
    • diffusers * extra == "agents" (optional)
    • opencv-python * extra == "agents" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "agents" (optional)
    • torch * extra == "agents" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "all" (optional)
    • accelerate >=0.21.0 extra == "all" (optional)
    • av ==9.2.0 extra == "all" (optional)
    • codecarbon ==1.2.0 extra == "all" (optional)
    • decord ==0.6.0 extra == "all" (optional)
    • flax <=0.7.0,>=0.4.1 extra == "all" (optional)
    • jax <=0.4.13,>=0.4.1 extra == "all" (optional)
    • jaxlib <=0.4.13,>=0.4.1 extra == "all" (optional)
    • kenlm * extra == "all" (optional)
    • keras-nlp >=0.3.1 extra == "all" (optional)
    • librosa * extra == "all" (optional)
    • onnxconverter-common * extra == "all" (optional)
    • optax <=0.1.4,>=0.0.8 extra == "all" (optional)
    • optuna * extra == "all" (optional)
    • phonemizer * extra == "all" (optional)
    • protobuf * extra == "all" (optional)
    • pyctcdecode >=0.4.0 extra == "all" (optional)
    • ray[tune] >=2.7.0 extra == "all" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "all" (optional)
    • sigopt * extra == "all" (optional)
    • tensorflow <2.16,>=2.6 extra == "all" (optional)
    • tensorflow-text <2.16 extra == "all" (optional)
    • tf2onnx * extra == "all" (optional)
    • timm * extra == "all" (optional)
    • tokenizers <0.19,>=0.14 extra == "all" (optional)
    • torch * extra == "all" (optional)
    • torchaudio * extra == "all" (optional)
    • torchvision * extra == "all" (optional)
    • kenlm * extra == "audio" (optional)
    • librosa * extra == "audio" (optional)
    • phonemizer * extra == "audio" (optional)
    • pyctcdecode >=0.4.0 extra == "audio" (optional)
    • codecarbon ==1.2.0 extra == "codecarbon" (optional)
    • accelerate >=0.21.0 extra == "deepspeed" (optional)
    • deepspeed >=0.9.3 extra == "deepspeed" (optional)
    • GitPython <3.1.19 extra == "deepspeed-testing" (optional)
    • accelerate >=0.21.0 extra == "deepspeed-testing" (optional)
    • beautifulsoup4 * extra == "deepspeed-testing" (optional)
    • cookiecutter ==1.7.3 extra == "deepspeed-testing" (optional)
    • datasets !=2.5.0 extra == "deepspeed-testing" (optional)
    • deepspeed >=0.9.3 extra == "deepspeed-testing" (optional)
    • dill <0.3.5 extra == "deepspeed-testing" (optional)
    • evaluate >=0.2.0 extra == "deepspeed-testing" (optional)
    • faiss-cpu * extra == "deepspeed-testing" (optional)
    • hf-doc-builder >=0.3.0 extra == "deepspeed-testing" (optional)
    • nltk * extra == "deepspeed-testing" (optional)
    • optuna * extra == "deepspeed-testing" (optional)
    • parameterized * extra == "deepspeed-testing" (optional)
    • protobuf * extra == "deepspeed-testing" (optional)
    • psutil * extra == "deepspeed-testing" (optional)
    • pydantic * extra == "deepspeed-testing" (optional)
    • pytest <8.0.0,>=7.2.0 extra == "deepspeed-testing" (optional)
    • pytest-timeout * extra == "deepspeed-testing" (optional)
    • pytest-xdist * extra == "deepspeed-testing" (optional)
    • rjieba * extra == "deepspeed-testing" (optional)
    • rouge-score !=0.0.7,!=0.0.8,!=0.1,!=0.1.1 extra == "deepspeed-testing" (optional)
    • ruff ==0.1.5 extra == "deepspeed-testing" (optional)
    • sacrebleu <2.0.0,>=1.4.12 extra == "deepspeed-testing" (optional)
    • sacremoses * extra == "deepspeed-testing" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "deepspeed-testing" (optional)
    • tensorboard * extra == "deepspeed-testing" (optional)
    • timeout-decorator * extra == "deepspeed-testing" (optional)
    • GitPython <3.1.19 extra == "dev" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "dev" (optional)
    • accelerate >=0.21.0 extra == "dev" (optional)
    • av ==9.2.0 extra == "dev" (optional)
    • beautifulsoup4 * extra == "dev" (optional)
    • codecarbon ==1.2.0 extra == "dev" (optional)
    • cookiecutter ==1.7.3 extra == "dev" (optional)
    • datasets !=2.5.0 extra == "dev" (optional)
    • decord ==0.6.0 extra == "dev" (optional)
    • dill <0.3.5 extra == "dev" (optional)
    • evaluate >=0.2.0 extra == "dev" (optional)
    • faiss-cpu * extra == "dev" (optional)
    • flax <=0.7.0,>=0.4.1 extra == "dev" (optional)
    • fugashi >=1.0 extra == "dev" (optional)
    • hf-doc-builder >=0.3.0 extra == "dev" (optional)
    • hf-doc-builder * extra == "dev" (optional)
    • ipadic <2.0,>=1.0.0 extra == "dev" (optional)
    • isort >=5.5.4 extra == "dev" (optional)
    • jax <=0.4.13,>=0.4.1 extra == "dev" (optional)
    • jaxlib <=0.4.13,>=0.4.1 extra == "dev" (optional)
    • kenlm * extra == "dev" (optional)
    • keras-nlp >=0.3.1 extra == "dev" (optional)
    • librosa * extra == "dev" (optional)
    • nltk * extra == "dev" (optional)
    • onnxconverter-common * extra == "dev" (optional)
    • optax <=0.1.4,>=0.0.8 extra == "dev" (optional)
    • optuna * extra == "dev" (optional)
    • parameterized * extra == "dev" (optional)
    • phonemizer * extra == "dev" (optional)
    • protobuf * extra == "dev" (optional)
    • psutil * extra == "dev" (optional)
    • pyctcdecode >=0.4.0 extra == "dev" (optional)
    • pydantic * extra == "dev" (optional)
    • pytest <8.0.0,>=7.2.0 extra == "dev" (optional)
    • pytest-timeout * extra == "dev" (optional)
    • pytest-xdist * extra == "dev" (optional)
    • ray[tune] >=2.7.0 extra == "dev" (optional)
    • rhoknp <1.3.1,>=1.1.0 extra == "dev" (optional)
    • rjieba * extra == "dev" (optional)
    • rouge-score !=0.0.7,!=0.0.8,!=0.1,!=0.1.1 extra == "dev" (optional)
    • ruff ==0.1.5 extra == "dev" (optional)
    • sacrebleu <2.0.0,>=1.4.12 extra == "dev" (optional)
    • sacremoses * extra == "dev" (optional)
    • scikit-learn * extra == "dev" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "dev" (optional)
    • sigopt * extra == "dev" (optional)
    • sudachidict-core >=20220729 extra == "dev" (optional)
    • sudachipy >=0.6.6 extra == "dev" (optional)
    • tensorboard * extra == "dev" (optional)
    • tensorflow <2.16,>=2.6 extra == "dev" (optional)
    • tensorflow-text <2.16 extra == "dev" (optional)
    • tf2onnx * extra == "dev" (optional)
    • timeout-decorator * extra == "dev" (optional)
    • timm * extra == "dev" (optional)
    • tokenizers <0.19,>=0.14 extra == "dev" (optional)
    • torch * extra == "dev" (optional)
    • torchaudio * extra == "dev" (optional)
    • torchvision * extra == "dev" (optional)
    • unidic >=1.0.2 extra == "dev" (optional)
    • unidic-lite >=1.0.7 extra == "dev" (optional)
    • urllib3 <2.0.0 extra == "dev" (optional)
    • GitPython <3.1.19 extra == "dev-tensorflow" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "dev-tensorflow" (optional)
    • beautifulsoup4 * extra == "dev-tensorflow" (optional)
    • cookiecutter ==1.7.3 extra == "dev-tensorflow" (optional)
    • datasets !=2.5.0 extra == "dev-tensorflow" (optional)
    • dill <0.3.5 extra == "dev-tensorflow" (optional)
    • evaluate >=0.2.0 extra == "dev-tensorflow" (optional)
    • faiss-cpu * extra == "dev-tensorflow" (optional)
    • hf-doc-builder * extra == "dev-tensorflow" (optional)
    • hf-doc-builder >=0.3.0 extra == "dev-tensorflow" (optional)
    • isort >=5.5.4 extra == "dev-tensorflow" (optional)
    • kenlm * extra == "dev-tensorflow" (optional)
    • keras-nlp >=0.3.1 extra == "dev-tensorflow" (optional)
    • librosa * extra == "dev-tensorflow" (optional)
    • nltk * extra == "dev-tensorflow" (optional)
    • onnxconverter-common * extra == "dev-tensorflow" (optional)
    • onnxruntime >=1.4.0 extra == "dev-tensorflow" (optional)
    • onnxruntime-tools >=1.4.2 extra == "dev-tensorflow" (optional)
    • parameterized * extra == "dev-tensorflow" (optional)
    • phonemizer * extra == "dev-tensorflow" (optional)
    • protobuf * extra == "dev-tensorflow" (optional)
    • psutil * extra == "dev-tensorflow" (optional)
    • pyctcdecode >=0.4.0 extra == "dev-tensorflow" (optional)
    • pydantic * extra == "dev-tensorflow" (optional)
    • pytest <8.0.0,>=7.2.0 extra == "dev-tensorflow" (optional)
    • pytest-timeout * extra == "dev-tensorflow" (optional)
    • pytest-xdist * extra == "dev-tensorflow" (optional)
    • rjieba * extra == "dev-tensorflow" (optional)
    • rouge-score !=0.0.7,!=0.0.8,!=0.1,!=0.1.1 extra == "dev-tensorflow" (optional)
    • ruff ==0.1.5 extra == "dev-tensorflow" (optional)
    • sacrebleu <2.0.0,>=1.4.12 extra == "dev-tensorflow" (optional)
    • sacremoses * extra == "dev-tensorflow" (optional)
    • scikit-learn * extra == "dev-tensorflow" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "dev-tensorflow" (optional)
    • tensorboard * extra == "dev-tensorflow" (optional)
    • tensorflow <2.16,>=2.6 extra == "dev-tensorflow" (optional)
    • tensorflow-text <2.16 extra == "dev-tensorflow" (optional)
    • tf2onnx * extra == "dev-tensorflow" (optional)
    • timeout-decorator * extra == "dev-tensorflow" (optional)
    • tokenizers <0.19,>=0.14 extra == "dev-tensorflow" (optional)
    • urllib3 <2.0.0 extra == "dev-tensorflow" (optional)
    • GitPython <3.1.19 extra == "dev-torch" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "dev-torch" (optional)
    • accelerate >=0.21.0 extra == "dev-torch" (optional)
    • beautifulsoup4 * extra == "dev-torch" (optional)
    • codecarbon ==1.2.0 extra == "dev-torch" (optional)
    • cookiecutter ==1.7.3 extra == "dev-torch" (optional)
    • datasets !=2.5.0 extra == "dev-torch" (optional)
    • dill <0.3.5 extra == "dev-torch" (optional)
    • evaluate >=0.2.0 extra == "dev-torch" (optional)
    • faiss-cpu * extra == "dev-torch" (optional)
    • fugashi >=1.0 extra == "dev-torch" (optional)
    • hf-doc-builder >=0.3.0 extra == "dev-torch" (optional)
    • hf-doc-builder * extra == "dev-torch" (optional)
    • ipadic <2.0,>=1.0.0 extra == "dev-torch" (optional)
    • isort >=5.5.4 extra == "dev-torch" (optional)
    • kenlm * extra == "dev-torch" (optional)
    • librosa * extra == "dev-torch" (optional)
    • nltk * extra == "dev-torch" (optional)
    • onnxruntime >=1.4.0 extra == "dev-torch" (optional)
    • onnxruntime-tools >=1.4.2 extra == "dev-torch" (optional)
    • optuna * extra == "dev-torch" (optional)
    • parameterized * extra == "dev-torch" (optional)
    • phonemizer * extra == "dev-torch" (optional)
    • protobuf * extra == "dev-torch" (optional)
    • psutil * extra == "dev-torch" (optional)
    • pyctcdecode >=0.4.0 extra == "dev-torch" (optional)
    • pydantic * extra == "dev-torch" (optional)
    • pytest <8.0.0,>=7.2.0 extra == "dev-torch" (optional)
    • pytest-timeout * extra == "dev-torch" (optional)
    • pytest-xdist * extra == "dev-torch" (optional)
    • ray[tune] >=2.7.0 extra == "dev-torch" (optional)
    • rhoknp <1.3.1,>=1.1.0 extra == "dev-torch" (optional)
    • rjieba * extra == "dev-torch" (optional)
    • rouge-score !=0.0.7,!=0.0.8,!=0.1,!=0.1.1 extra == "dev-torch" (optional)
    • ruff ==0.1.5 extra == "dev-torch" (optional)
    • sacrebleu <2.0.0,>=1.4.12 extra == "dev-torch" (optional)
    • sacremoses * extra == "dev-torch" (optional)
    • scikit-learn * extra == "dev-torch" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "dev-torch" (optional)
    • sigopt * extra == "dev-torch" (optional)
    • sudachidict-core >=20220729 extra == "dev-torch" (optional)
    • sudachipy >=0.6.6 extra == "dev-torch" (optional)
    • tensorboard * extra == "dev-torch" (optional)
    • timeout-decorator * extra == "dev-torch" (optional)
    • timm * extra == "dev-torch" (optional)
    • tokenizers <0.19,>=0.14 extra == "dev-torch" (optional)
    • torch * extra == "dev-torch" (optional)
    • torchaudio * extra == "dev-torch" (optional)
    • torchvision * extra == "dev-torch" (optional)
    • unidic >=1.0.2 extra == "dev-torch" (optional)
    • unidic-lite >=1.0.7 extra == "dev-torch" (optional)
    • urllib3 <2.0.0 extra == "dev-torch" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "docs" (optional)
    • accelerate >=0.21.0 extra == "docs" (optional)
    • av ==9.2.0 extra == "docs" (optional)
    • codecarbon ==1.2.0 extra == "docs" (optional)
    • decord ==0.6.0 extra == "docs" (optional)
    • flax <=0.7.0,>=0.4.1 extra == "docs" (optional)
    • hf-doc-builder * extra == "docs" (optional)
    • jax <=0.4.13,>=0.4.1 extra == "docs" (optional)
    • jaxlib <=0.4.13,>=0.4.1 extra == "docs" (optional)
    • kenlm * extra == "docs" (optional)
    • keras-nlp >=0.3.1 extra == "docs" (optional)
    • librosa * extra == "docs" (optional)
    • onnxconverter-common * extra == "docs" (optional)
    • optax <=0.1.4,>=0.0.8 extra == "docs" (optional)
    • optuna * extra == "docs" (optional)
    • phonemizer * extra == "docs" (optional)
    • protobuf * extra == "docs" (optional)
    • pyctcdecode >=0.4.0 extra == "docs" (optional)
    • ray[tune] >=2.7.0 extra == "docs" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "docs" (optional)
    • sigopt * extra == "docs" (optional)
    • tensorflow <2.16,>=2.6 extra == "docs" (optional)
    • tensorflow-text <2.16 extra == "docs" (optional)
    • tf2onnx * extra == "docs" (optional)
    • timm * extra == "docs" (optional)
    • tokenizers <0.19,>=0.14 extra == "docs" (optional)
    • torch * extra == "docs" (optional)
    • torchaudio * extra == "docs" (optional)
    • torchvision * extra == "docs" (optional)
    • hf-doc-builder * extra == "docs-specific" (optional)
    • flax <=0.7.0,>=0.4.1 extra == "flax" (optional)
    • jax <=0.4.13,>=0.4.1 extra == "flax" (optional)
    • jaxlib <=0.4.13,>=0.4.1 extra == "flax" (optional)
    • optax <=0.1.4,>=0.0.8 extra == "flax" (optional)
    • kenlm * extra == "flax-speech" (optional)
    • librosa * extra == "flax-speech" (optional)
    • phonemizer * extra == "flax-speech" (optional)
    • pyctcdecode >=0.4.0 extra == "flax-speech" (optional)
    • ftfy * extra == "ftfy" (optional)
    • optuna * extra == "integrations" (optional)
    • ray[tune] >=2.7.0 extra == "integrations" (optional)
    • sigopt * extra == "integrations" (optional)
    • fugashi >=1.0 extra == "ja" (optional)
    • ipadic <2.0,>=1.0.0 extra == "ja" (optional)
    • rhoknp <1.3.1,>=1.1.0 extra == "ja" (optional)
    • sudachidict-core >=20220729 extra == "ja" (optional)
    • sudachipy >=0.6.6 extra == "ja" (optional)
    • unidic >=1.0.2 extra == "ja" (optional)
    • unidic-lite >=1.0.7 extra == "ja" (optional)
    • cookiecutter ==1.7.3 extra == "modelcreation" (optional)
    • natten <0.15.0,>=0.14.6 extra == "natten" (optional)
    • onnxconverter-common * extra == "onnx" (optional)
    • onnxruntime >=1.4.0 extra == "onnx" (optional)
    • onnxruntime-tools >=1.4.2 extra == "onnx" (optional)
    • tf2onnx * extra == "onnx" (optional)
    • onnxruntime >=1.4.0 extra == "onnxruntime" (optional)
    • onnxruntime-tools >=1.4.2 extra == "onnxruntime" (optional)
    • optuna * extra == "optuna" (optional)
    • GitPython <3.1.19 extra == "quality" (optional)
    • datasets !=2.5.0 extra == "quality" (optional)
    • hf-doc-builder >=0.3.0 extra == "quality" (optional)
    • isort >=5.5.4 extra == "quality" (optional)
    • ruff ==0.1.5 extra == "quality" (optional)
    • urllib3 <2.0.0 extra == "quality" (optional)
    • ray[tune] >=2.7.0 extra == "ray" (optional)
    • datasets !=2.5.0 extra == "retrieval" (optional)
    • faiss-cpu * extra == "retrieval" (optional)
    • sagemaker >=2.31.0 extra == "sagemaker" (optional)
    • protobuf * extra == "sentencepiece" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "sentencepiece" (optional)
    • fastapi * extra == "serving" (optional)
    • pydantic * extra == "serving" (optional)
    • starlette * extra == "serving" (optional)
    • uvicorn * extra == "serving" (optional)
    • sigopt * extra == "sigopt" (optional)
    • scikit-learn * extra == "sklearn" (optional)
    • kenlm * extra == "speech" (optional)
    • librosa * extra == "speech" (optional)
    • phonemizer * extra == "speech" (optional)
    • pyctcdecode >=0.4.0 extra == "speech" (optional)
    • torchaudio * extra == "speech" (optional)
    • GitPython <3.1.19 extra == "testing" (optional)
    • beautifulsoup4 * extra == "testing" (optional)
    • cookiecutter ==1.7.3 extra == "testing" (optional)
    • datasets !=2.5.0 extra == "testing" (optional)
    • dill <0.3.5 extra == "testing" (optional)
    • evaluate >=0.2.0 extra == "testing" (optional)
    • faiss-cpu * extra == "testing" (optional)
    • hf-doc-builder >=0.3.0 extra == "testing" (optional)
    • nltk * extra == "testing" (optional)
    • parameterized * extra == "testing" (optional)
    • protobuf * extra == "testing" (optional)
    • psutil * extra == "testing" (optional)
    • pydantic * extra == "testing" (optional)
    • pytest <8.0.0,>=7.2.0 extra == "testing" (optional)
    • pytest-timeout * extra == "testing" (optional)
    • pytest-xdist * extra == "testing" (optional)
    • rjieba * extra == "testing" (optional)
    • rouge-score !=0.0.7,!=0.0.8,!=0.1,!=0.1.1 extra == "testing" (optional)
    • ruff ==0.1.5 extra == "testing" (optional)
    • sacrebleu <2.0.0,>=1.4.12 extra == "testing" (optional)
    • sacremoses * extra == "testing" (optional)
    • tensorboard * extra == "testing" (optional)
    • timeout-decorator * extra == "testing" (optional)
    • keras-nlp >=0.3.1 extra == "tf" (optional)
    • onnxconverter-common * extra == "tf" (optional)
    • tensorflow <2.16,>=2.6 extra == "tf" (optional)
    • tensorflow-text <2.16 extra == "tf" (optional)
    • tf2onnx * extra == "tf" (optional)
    • keras-nlp >=0.3.1 extra == "tf-cpu" (optional)
    • onnxconverter-common * extra == "tf-cpu" (optional)
    • tensorflow-cpu <2.16,>=2.6 extra == "tf-cpu" (optional)
    • tensorflow-text <2.16 extra == "tf-cpu" (optional)
    • tf2onnx * extra == "tf-cpu" (optional)
    • kenlm * extra == "tf-speech" (optional)
    • librosa * extra == "tf-speech" (optional)
    • phonemizer * extra == "tf-speech" (optional)
    • pyctcdecode >=0.4.0 extra == "tf-speech" (optional)
    • timm * extra == "timm" (optional)
    • tokenizers <0.19,>=0.14 extra == "tokenizers" (optional)
    • accelerate >=0.21.0 extra == "torch" (optional)
    • torch * extra == "torch" (optional)
    • kenlm * extra == "torch-speech" (optional)
    • librosa * extra == "torch-speech" (optional)
    • phonemizer * extra == "torch-speech" (optional)
    • pyctcdecode >=0.4.0 extra == "torch-speech" (optional)
    • torchaudio * extra == "torch-speech" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "torch-vision" (optional)
    • torchvision * extra == "torch-vision" (optional)
    • filelock * extra == "torchhub" (optional)
    • huggingface-hub <1.0,>=0.19.3 extra == "torchhub" (optional)
    • importlib-metadata * extra == "torchhub" (optional)
    • numpy >=1.17 extra == "torchhub" (optional)
    • packaging >=20.0 extra == "torchhub" (optional)
    • protobuf * extra == "torchhub" (optional)
    • regex !=2019.12.17 extra == "torchhub" (optional)
    • requests * extra == "torchhub" (optional)
    • sentencepiece !=0.1.92,>=0.1.91 extra == "torchhub" (optional)
    • tokenizers <0.19,>=0.14 extra == "torchhub" (optional)
    • torch * extra == "torchhub" (optional)
    • tqdm >=4.27 extra == "torchhub" (optional)
    • av ==9.2.0 extra == "video" (optional)
    • decord ==0.6.0 extra == "video" (optional)
    • Pillow <=15.0,>=10.0.1 extra == "vision" (optional)
    • filelock *
    • huggingface-hub <1.0,>=0.19.3
    • numpy >=1.17
    • packaging >=20.0
    • pyyaml >=5.1
    • regex !=2019.12.17
    • requests *
    • safetensors >=0.4.1
    • tokenizers <0.19,>=0.14
    • tqdm >=4.27