Rust bindings for the Python interpreter
Go to file
Yuji Kanagawa db6c822fa2
Merge pull request #734 from ijl/rm-spin
Use parking_lot::Mutex instead of spin::Mutex
2020-01-17 14:24:54 +09:00
.github Set RUST_BACKTRACE=1 windows tests 2020-01-12 15:33:34 +01:00
benches Address clippy::inconsistent_digit_grouping issues 2019-08-17 14:10:35 +02:00
ci Use `ignore` flag in grcov call instead of `ignore-dirs` 2020-01-12 14:23:36 +01:00
examples Revert "Disable segfaulty subclassing by default" 2020-01-12 01:22:32 +01:00
guide Fix some typos in guide 2020-01-12 14:47:54 +01:00
pyo3-derive-backend Revert "Disable segfaulty subclassing by default" 2020-01-12 01:22:32 +01:00
pyo3cls Revert "Disable segfaulty subclassing by default" 2020-01-12 01:22:32 +01:00
src Merge pull request #734 from ijl/rm-spin 2020-01-17 14:24:54 +09:00
tests Add debug output for flaky test 2020-01-12 15:44:42 +01:00
.gitignore Some api improvements 2019-02-23 18:01:22 +01:00
.travis.yml Only calculate coverage in one job 2020-01-13 23:30:49 +01:00
CHANGELOG.md Use parking_lot::Mutex instead of spin::Mutex 2020-01-16 13:53:54 +00:00
Cargo.toml Use parking_lot::Mutex instead of spin::Mutex 2020-01-16 13:53:54 +00:00
Code-of-Conduct.md Add Code of Conduct 2019-02-07 20:50:09 +01:00
Contributing.md Fixup for Contributing.md 2019-04-23 22:14:27 +02:00
LICENSE Rename LICENSE-APACHE to LICENSE 2017-10-04 08:56:57 -07:00
Makefile Remove ignoring of new_ret_no_self in clippy target 2020-01-12 01:46:33 +01:00
README.md Bump version to 0.8.5 2020-01-05 16:39:18 +09:00
build.rs Remove unnecessary parentheses 2019-11-02 15:18:40 +09:00
codecov.yml Turn off codecov PR comments 2019-08-05 11:36:20 +02:00
pyproject.toml Format examples with black (#590) 2019-09-06 01:16:09 +02:00
tox.ini Drop support for python2 2019-03-29 12:37:26 +00:00

README.md

PyO3

Build Status Actions Status codecov crates.io Join the dev chat

Rust bindings for Python. This includes running and interacting with Python code from a Rust binary, as well as writing native Python modules.

A comparison with rust-cpython can be found in the guide.

Usage

PyO3 supports Python 3.5 and up. The minimum required Rust version is 1.37.0-nightly 2019-07-19.

If you have never used nightly Rust, the official guide has a great section about installing it.

PyPy is also supported (via cpyext) for Python 3.5 only, targeted PyPy version is 7.0.0. Please refer to the guide for installation instruction against PyPy.

You can either write a native Python module in Rust, or use Python from a Rust binary.

However, on some OSs, you need some additional packages. E.g. if you are on Ubuntu 18.04, please run

sudo apt install python3-dev python-dev

Using Rust from Python

PyO3 can be used to generate a native Python module.

Cargo.toml

[package]
name = "string-sum"
version = "0.1.0"
edition = "2018"

[lib]
name = "string_sum"
crate-type = ["cdylib"]

[dependencies.pyo3]
version = "0.8.5"
features = ["extension-module"]

src/lib.rs

use pyo3::prelude::*;
use pyo3::wrap_pyfunction;

#[pyfunction]
/// Formats the sum of two numbers as string
fn sum_as_string(a: usize, b: usize) -> PyResult<String> {
    Ok((a + b).to_string())
}

/// This module is a python module implemented in Rust.
#[pymodule]
fn string_sum(py: Python, m: &PyModule) -> PyResult<()> {
    m.add_wrapped(wrap_pyfunction!(sum_as_string))?;

    Ok(())
}

On Windows and Linux, you can build normally with cargo build --release. On macOS, you need to set additional linker arguments. One option is to compile with cargo rustc --release -- -C link-arg=-undefined -C link-arg=dynamic_lookup, the other is to create a .cargo/config with the following content:

[target.x86_64-apple-darwin]
rustflags = [
  "-C", "link-arg=-undefined",
  "-C", "link-arg=dynamic_lookup",
]

For developing, you can copy and rename the shared library from the target folder: On MacOS, rename libstring_sum.dylib to string_sum.so, on Windows libstring_sum.dll to string_sum.pyd and on Linux libstring_sum.so to string_sum.so. Then open a Python shell in the same folder and you'll be able to import string_sum.

To build, test and publish your crate as a Python module, you can use maturin or setuptools-rust. You can find an example for setuptools-rust in examples/word-count, while maturin should work on your crate without any configuration.

Using Python from Rust

Add pyo3 to your Cargo.toml like this:

[dependencies]
pyo3 = "0.8.5"

Example program displaying the value of sys.version and the current user name:

use pyo3::prelude::*;
use pyo3::types::IntoPyDict;

fn main() -> Result<(), ()> {
    let gil = Python::acquire_gil();
    let py = gil.python();
    main_(py).map_err(|e| {
        // We can't display python error type via ::std::fmt::Display,
        // so print error here manually.
        e.print_and_set_sys_last_vars(py);
    })
}

fn main_(py: Python) -> PyResult<()> {
    let sys = py.import("sys")?;
    let version: String = sys.get("version")?.extract()?;
    let locals = [("os", py.import("os")?)].into_py_dict(py);
    let code = "os.getenv('USER') or os.getenv('USERNAME') or 'Unknown'";
    let user: String = py.eval(code, None, Some(&locals))?.extract()?;
    println!("Hello {}, I'm Python {}", user, version);
    Ok(())
}

Our guide has a section with lots of examples about this topic.

Examples and tooling

  • examples/word-count Counting the occurrences of a word in a text file
  • hyperjson A hyper-fast Python module for reading/writing JSON data using Rust's serde-json
  • rust-numpy Rust binding of NumPy C-API
  • html-py-ever Using html5ever through kuchiki to speed up html parsing and css-selecting.
  • pyo3-built Simple macro to expose metadata obtained with the built crate as a PyDict
  • point-process High level API for pointprocesses as a Python library
  • autopy A simple, cross-platform GUI automation library for Python and Rust.
    • Contains an example of building wheels on TravisCI and appveyor using cibuildwheel
  • orjson Fast Python JSON library
  • inline-python Inline Python code directly in your Rust code
  • Rogue-Gym Customizable rogue-like game for AI experiments
    • Contains an example of building wheels on Azure Pipelines
  • fastuuid Python bindings to Rust's UUID library
  • python-ext-wasm Python library to run WebAssembly binaries
  • dict-derive Derive FromPyObject to automatically transform Python dicts into Rust structs

License

PyO3 is licensed under the Apache-2.0 license. Python is licensed under the Python License.