Current section
Files
Jump to
Current section
Files
lib/zigler.ex
defmodule Zigler do
@moduledoc """
Inline NIF support for [Zig](https://ziglang.org)
### Motivation
> Zig is a general-purpose programming language designed for robustness,
> optimality, and maintainability.
The programming philosophy of Zig matches up nicely with the programming
philosophy of the BEAM VM and in particular its emphasis on simplicity and
structure should very appealing to the practitioners of Elixir.
The following features make Zig extremely amenable to inline language
support in a BEAM language:
- simplicity. Zig's syntax is definable in a simple YACC document and
Zig takes a stance against making its featureset more complex (though
it may evolve somewhat en route to 1.0)
- Composability. Zig is unopinionated about how to go about memory
allocations. Its allocator interface is very easily able to be backed
by the BEAM's, which means that you have access to generic memory
allocation *strategies* through its composable allocator scheme.
- C integration. It's very easy to design C-interop between Zig and C.
In fact, Zig is likely to be an easier glue language for C ABIs than
C.
### Basic usage
In the BEAM, you can define a NIF by consulting the following [document](
https://erlang.org/doc/man/erl_nif.html) and implementing the appropriate
shared object/DLL callbacks. However, Zigler will take care of all of
this for you.
Simply `use Zigler` in your module, providing the app atom in the property
list.
Then, use the `sigil_Z/2` macro and write zig code. Any nifs you define
should be preceded with the `/// nif: function_name/arity` zig docstring.
#### Example
```
defmodule MyModule do
use Zigler
~Z\"""
/// nif: my_func/1
fn my_func(val: i64) i64 {
return val + 1;
}
\"""
end
```
Zigler will *automatically* fill out the appropriate NIF C template, compile
the shared object, and bind it into the module pre-compilation. In the case
of the example, there will be a `MyModule.my_func/1` function call found in
the module.
Zigler will also make sure that your statically-typed Zig data are guarded
when you marshal it from the dynamically-typed BEAM world. However, you may
only pass in and return certain types. As an escape hatch, you may use
the `beam.term` type which is equivalent to the `ERLNIFTERM` type. See
[`erl_nif`](erl_nif.html).
### Nerves Support
Nerves is supported out of the box, and the system should cross-compile
to arm ABI as necessary depening on what your nerves `:target` is. You
may also directly specify a zig target using the
`use Zigler, target: <target>` option.
### Environment
Sometimes, you will need to pass the BEAM environment (which is the code
execution context, including process info, etc.) into the NIF function. In
this case, you should pass it as the first argument, as a `beam.env` type
value.
#### Example
```
defmodule MyModule do
use Zigler
~Z\"""
/// nif: my_func_with_env/1
fn my_func_with_env(env: beam.env, pid: beam.pid) void {
var sendable_term: []u64 = "ping"[0..];
var msg = beam.make_slice(env, sendable_term);
var res = e.enif_send(env, pid, env, msg);
}
\"""
end
```
### External Libraries
If you need to bind static (`*.a`) or dynamic (`*.so`) libraries into your
module, you may link them with the `:libs` argument.
Note that zig statically binds shared libraries into the assets it creates.
This simplifies deployment for you.
#### Example
```
defmodule Blas do
use Zigler,
libs: ["/usr/lib/x86_64-linux-gnu/blas/libblas.so"],
include: ["/usr/include/x86_64-linux-gnu"]
~Z\"""
const blas = @cImport({
@cInclude("cblas.h");
...
```
### Compilation assistance
If something should go wrong, Zigler will translate the Zig compiler error
into an Elixir compiler error, and let you know exactly which line in the
`~Z` block it came from.
### Syntactic Sugar
Some of the erlang nif terms can get unwieldy, especially in Zig, which
prefers terseness. Each of the basic BEAM types is shadowed by a Zig type
in the `beam` module. The `beam` struct is always imported into the header
of the zig file used, so all zig code in the same directory as the module
should have access to the `beam` struct if they `@import("beam.zig")`
### Importing files
If you need to write code outside of the basic module (you will, for anything
non-trivial), just place it in the same directory as your module.
#### Example
```
~Z\"""
const extra_code = @import("extra_code.zig");
/// nif: use_extra_code/1
fn use_extra_code(val: i64) i64 {
return extra_code.extra_fn(val);
}
\"""
```
If you would like to include a custom c header file, create an `include/`
directory inside your path tree and it will be available to zig as a default
search path as follows:
```
~Z\"""
const c = @cImport({
@cInclude("my_c_header.h");
});
// nif: my_nif/1
...
\"""
```
### Documentation
Use the builtin zig `///` docstring to write your documentation. If it's in
front of the nif declaration, it will wind up in the correct place in your
elixir documentation.
See `Zigler.Doc` for more information on how to document in zig and what to
document. See `Mix.Tasks.ZigDoc` for information on how to get your Elixir
project to incorporate zig documentation.
### Tests
Use the builtin zig `test` keyword to write your internal zig unit tests.
These can be imported into an ExUnit module by following this example:
```
defmodule MyTest do
use ExUnit.Case
use Zigler.Unit
zigtest ModuleWithZigCode
end
```
See `Zigler.Unit` for more information.
"""
alias Zigler.Compiler
alias Zigler.Parser
# default release modes.
# you can override these in your `use Zigler` statement.
#@default_release_modes %{prod: :safe, dev: :debug, test: :debug}
#@default_release_mode @default_release_modes[Mix.env()]
@spec __using__(keyword) ::
{:__block__, [],
[{:@, [...], [...]} | {:import, [...], [...]} | {:require, [...], [...]}, ...]}
defmacro __using__(opts) do
#mode = opts[:release_mode] || @default_release_mode
# make sure that we're in the correct operating system.
if match?({:win32, _}, :os.type()) do
raise "non-unix systems not currently supported."
end
# clear out the assembly directory
Mix.env
|> Compiler.assembly_dir(__CALLER__.module)
|> File.rm_rf!
user_opts = Keyword.take(opts, [:libs, :resources, :dry_run, :c_includes, :include_dirs])
zigler = struct(%Zigler.Module{
file: __CALLER__.file,
module: __CALLER__.module,
imports: Zigler.Module.imports(opts[:imports]),
version: get_project_version(),
otp_app: get_app()},
user_opts)
Module.register_attribute(__CALLER__.module, :zigler, persist: true)
Module.put_attribute(__CALLER__.module, :zigler, zigler)
quote do
import Zigler
require Zigler.Compiler
@on_load :__load_nifs__
@before_compile Zigler.Compiler
end
end
@doc """
declares a string block to be included in the module's .zig source
file. At least one of these blocks must define a nif.
"""
defmacro sigil_Z({:<<>>, meta, [zig_code]}, []) do
quoted_code(zig_code, meta, __CALLER__)
end
@doc """
like `sigil_Z/2`, but lets you interpolate values from the outside
elixir context using string interpolation (the `\#{value}` form)
"""
defmacro sigil_z(code = {:<<>>, _, _}, []) do
quoted_code(code, [line: __CALLER__.line], __CALLER__)
end
defp quoted_code(zig_code, meta, caller) do
line = meta[:line]
module = caller.module
file = caller.file
quote bind_quoted: [module: module, zig_code: zig_code, file: file, line: line] do
zigler = Module.get_attribute(module, :zigler)
new_zigler = zig_code
|> Parser.parse(zigler, file, line)
@zigler new_zigler
end
end
defp get_project_version do
Mix.Project.get
|> apply(:project, [])
|> Keyword.get(:version)
|> Version.parse!
end
defp get_app do
Mix.Project.get
|> apply(:project, [])
|> Keyword.get(:app)
end
@doc false
def nif_name(module = %{version: version}, use_suffixes \\ true) do
if use_suffixes do
"lib#{module.module}.so.#{version.major}.#{version.minor}.#{version.patch}"
else
"lib#{module.module}"
end
end
end