Good Libraries for Python, Rust, Swift, and More


Daily drivers

  • PyTorch [GitHub][pip install torch][Docs] Tensor go brrr

  • openai [GitHub][PyPi]][Docs] OpenAI Python library for accessing various OpenAI models and tools.

  • transformers [GitHub][PyPi][Docs] State-of-the-art natural language processing library for PyTorch and TensorFlow.

  • asyncio [Docs] Concurrency using async/await. It's in the standard python lib, but you should use it more.

  • aiohttp [GitHub][PyPi][Docs] Async HTTP client/server framework for use with asyncio.

  • langchain [GitHub][PyPi][Docs] A Python library for language chain analysis and processing.

Rust-backed Python libraries to try

  • ruff [GitHub][PyPi][Docs] Keep your code clean smh
  • [GitHub][Website][PyPi] Rust-backed DataFrame library for Python. High performance, multi-threaded query engine written in Rust and designed for effective paralellism. Vectorized and columnar processing enable cache-coherent algorithms and high performance on modern processors. Pandas on another level.
  • tokenizers [GitHub][PyPi] - Rust-backed python library for efficient tokenization for natural language processing.

Make your own Rust-backed libraries

  • Pyo3 Maturin [GitHub][PyPi] - Build and publish crates with pyo3, rust-cpython and cffi bindings as well as rust binaries as python packages.