Current section

Files

Jump to
croma lib croma struct.ex
Raw

lib/croma/struct.ex

defmodule Croma.Struct do
@moduledoc """
Module to define structs with validation and conversion functions, based on its type information.
Using this module requires to prepare type modules for all struct fields.
Each of per-field type module is expected to provide the following members:
- required: `@type t`
- required: `@spec valid?(term) :: boolean`
- optional: `@spec default() :: t`
- optional: `@spec new(term) :: Croma.Result.t(t)`
Some helpers for defining such per-field type modules are available.
- Wrappers of built-in types such as `Croma.String`, `Croma.Integer`, etc.
- Utility modules such as `Croma.SubtypeOfString` to define "subtypes" of existing types.
- Ad-hoc module generators defined in `Croma.TypeGen`.
- This module, `Croma.Struct` itself for nested structs.
To define a struct, `use` this module with a keyword list where keys are field names and values are type modules:
defmodule S do
use Croma.Struct, fields: [
field1_name: Field1Module,
field2_name: Field2Module,
]
end
Then the above code generates `defstruct`, `@type t` and the following functions:
- `@spec valid?(term) :: boolean`
- `@spec new(term) :: Croma.Result.t(t)`
- `@spec new!(term) :: t`
- `@spec update(t, Dict.t) :: Croma.Result.t(t)`
- `@spec update!(t, Dict.t) :: t`
The functions listed above are all overridable, so you can
for example implement your own validation rule that spans multiple fields.
## Examples
iex> defmodule I do
...> @type t :: integer
...> def valid?(i), do: is_integer(i)
...> def default(), do: 0
...> end
...> defmodule S do
...> use Croma.Struct, fields: [i: I]
...> end
...> S.new(%{i: 5})
{:ok, %S{i: 5}}
...> S.valid?(%S{i: "not_an_integer"})
false
...> {:ok, s} = S.new(%{})
{:ok, %S{i: 0}}
...> S.update(s, [i: 2])
{:ok, %S{i: 2}}
...> S.update(s, %{"i" => "not_an_integer"})
{:error, {:invalid_value, [S, {I, :i}]}}
## Default value of each field
You can specify default value of each struct field by
1. giving `:default` option in per-field options
2. defining `default/0` in the field's type module (which is evaluated at compile-time)
If you specify both, (1) takes precedence over (2).
Additionally, you can tell `Croma.Struct` not to use `default/0` by specifying `no_default?: true`.
If no default value is provided for a field, then the field must be explicitly filled when constructing a new struct.
As an example, suppose you have the following modules.
defmodule I do
use Croma.SubtypeOfInt, min: 0, default: 1
end
defmodule S do
use Croma.Struct, fields: [
a: Croma.Integer,
b: I,
c: {Croma.Integer, [default: 2]},
d: {I , [default: 3]},
e: {Croma.Integer, [no_default?: true]},
f: {I , [no_default?: true]},
]
end
Note that `I` has `default/0` whereas `Croma.Integer` does not export `default/0`.
Then,
- `a`, `e` and `f` have no default values
- Default value of `b` is `1`
- Default value of `c` is `2`
- Default value of `d` is `3`
## `new/1`
`new/1` generated by `Croma.Struct` deserves special attention.
`new/1` can be useful when validating and converting data structure obtained from
e.g. JSON into an Elixir structs.
As with other type modules' `new/1`, `new/1` generated by `Croma.Struct` can accept
value where `valid?/1` evaluates to `false`; it tries to convert that value into a
valid form.
Most notable example of this behaviour is that `new/1` accepts not only atom-keyed
maps but also string-keyed maps, although structs are atom-keyed maps.
### How it works
`new/1` tries to get valid values for all struct fields from the given map or keyword list.
For each field of the struct, a value is computed as follows:
- If a value is not found for a field,
- If the field has default value, that default is taken.
- If a value is found for a field,
- If the module for the field exports `new/1` it is called with the found value.
- If the module for the field does not export `new/1`, the found value is instead
validated with `valid?/1`.
When no valid value can be obtained for any of the struct fields, `new/1` returns an error.
Note that the usage of field modules' `new/1` enables to construct arbitrarily nested
data structure in a recursive manner.
### Naming convention of field names (case of identifiers)
When working with structured data (e.g. JSON) from systems with different naming conventions,
it's convenient to adjust the names to your favorite convention in this layer.
You can specify the acceptable naming schemes of data structures to be converted
by `new/1` and `new!/1` using `:accept_case` option of `use Croma.Struct`.
- `nil` (default): Accepts only the given field names.
- `:lower_camel`: Accepts both the given field names and their lower camel variants.
- `:upper_camel`: Accepts both the given field names and their upper camel variants.
- `:snake`: Accepts both the given field names and their snake cased variants.
- `:capital`: Accepts both the given field names and their variants where all characters are capital.
## Tips
### To distinguish missing field and explict `nil` in `new/1`
Simply using `Croma.TypeGen.nilable/1` for struct fields, we cannot distinguish
whether the value is not given or `nil` is explicitly given, as the resulting
struct contains `nil` for both cases.
By adjusting default value for the field we can distinguish these case.
As an example suppose we have the following `S`.
defmodule S do
use Croma.Struct, fields: [
field: {union([fixed(:unset), fixed(nil), Croma.Integer]), [default: :unset]},
]
end
Then we can distinguish these patterns.
- `S.new(%{}) == %S{field: :unset}`
- `S.new(%{field: nil}) == %S{field: nil}`
- `S.new(%{field: 1}) == %S{field: 1}`
In this example we use `Croma.TypeGen.union/1` and `Croma.TypeGen.fixed/1`, but one can of course
define his/her own type module that accepts these 3 cases.
In a similar manner, by setting default value for field we can implement struct fields that
- accepts missing field but rejects explicit `nil`, or
- accepts explicit `nil` but rejects missing field.
"""
import Croma.Defun
require Croma.Result, as: R
@doc false
def field_default_value_pairs(fields) do
Enum.map(fields, fn {f, {mod, field_opts}} ->
{f, compute_default_value(f, mod, field_opts)}
end)
end
defp compute_default_value(field, mod, field_opts) do
case {Keyword.get(field_opts, :no_default?, false), Keyword.fetch(field_opts, :default)} do
{true , {:ok, _}} -> raise "no_default?: true but :default option is also given for field '#{field}'"
{true , :error } -> :error
{false, {:ok, d}} ->
if !mod.valid?(d), do: raise "invalid default value is given to field '#{field}' with type #{inspect(mod)} : #{inspect(d)}"
{:ok, d}
{false, :error } ->
try do
{:ok, mod.default()}
rescue
UndefinedFunctionError -> :error
end
end
end
@doc false
def field_type_pairs(field_mod_pairs) do
Enum.map(field_mod_pairs, fn {key, mod} ->
{key, quote do: unquote(mod).t}
end)
end
@doc false
def fields_with_accept_case(field_mod_pairs, accept_case) do
f =
case accept_case do
nil -> fn a -> a end
:snake -> &Macro.underscore/1
:lower_camel -> &lower_camelize/1
:upper_camel -> &Macro.camelize/1
:capital -> &String.upcase/1
_ -> raise ":accept_case option must be :lower_camel, :upper_camel, :snake or :capital"
end
fields2 =
Enum.map(field_mod_pairs, fn {key, mod} ->
key2 = Atom.to_string(key) |> f.() |> String.to_atom()
{key, Enum.uniq([key, key2]), mod}
end)
accepted_keys = Enum.flat_map(fields2, fn {_, keys, _} -> keys end)
if length(accepted_keys) != length(Enum.uniq(accepted_keys)) do
raise "field names are not unique"
end
fields2
end
defp lower_camelize(s) do
if byte_size(s) == 0 do
""
else
c = Macro.camelize(s)
String.downcase(String.first(c)) <> String.slice(c, 1..-1//1)
end
end
#
# Kept for ABI backward compatibility; will be removed in a future version.
#
@doc false
def new_impl2(struct_mod, struct_fields_with_defaults, dict, recursive?) when is_list(dict) or is_map(dict) do
Enum.map(struct_fields_with_defaults, fn {field, fields_to_fetch, field_mod, default} ->
case dict_fetch2(dict, fields_to_fetch) do
{:ok, v1} ->
evaluate_existing_field(field_mod, v1, field, recursive?)
|> case do
{:ok, v2} -> {:ok, {field, v2}}
{:error, {reason, [^field_mod | mods]}} -> {:error, {reason, [{field_mod, field} | mods]}}
{:error, reason} -> {:error, reason}
end
:error ->
case default do
{:ok, d} -> {:ok, {field, d}}
:error -> {:error, {:value_missing, [{field_mod, field}]}}
end
end
end)
|> R.sequence()
|> case do
{:ok, kvs} -> {:ok, struct_mod.__struct__(kvs)}
{:error, reason} -> {:error, R.ErrorReason.add_context(reason, struct_mod)}
end
end
def new_impl2(mod, _struct_fields_with_defaults, _not_a_dict, _recursive?) do
{:error, {:invalid_value, [mod]}}
end
defp evaluate_existing_field(mod, value, field, false), do: wrap_if_valid(value, mod, field)
defp evaluate_existing_field(mod, value, field, true ), do: wrap_if_valid(value, mod, field) |> R.or_else(try_new1_with_given_value(value, mod, field))
defp try_new1_with_given_value(value, mod, field) do
try do
mod.new(value)
rescue
_ -> {:error, {:invalid_value, [{mod, field}]}}
end
end
#
# End of functions kept for ABI backward compatibility.
#
@doc false
def new_impl(struct_mod, struct_fields_with_attrs, dict) when is_list(dict) or is_map(dict) do
Enum.map(struct_fields_with_attrs, fn {field, fields_to_fetch, field_mod, default, has_new1?} ->
case dict_fetch2(dict, fields_to_fetch) do
{:ok, v1} ->
case has_new1? do
true -> field_mod.new(v1)
false -> wrap_if_valid(v1, field_mod, field)
end
|> case do
{:ok, v2} -> {:ok, {field, v2}}
{:error, {reason, [^field_mod | mods]}} -> {:error, {reason, [{field_mod, field} | mods]}}
{:error, reason} -> {:error, reason}
end
:error ->
case default do
{:ok, d} -> {:ok, {field, d}}
:error -> {:error, {:value_missing, [{field_mod, field}]}}
end
end
end)
|> R.sequence()
|> case do
{:ok, kvs} -> {:ok, struct_mod.__struct__(kvs)}
{:error, reason} -> {:error, R.ErrorReason.add_context(reason, struct_mod)}
end
end
def new_impl(mod, _struct_fields_with_attrs, _not_a_dict) do
{:error, {:invalid_value, [mod]}}
end
defp wrap_if_valid(value, mod, field) do
case mod.valid?(value) do
true -> {:ok, value}
false -> {:error, {:invalid_value, [{mod, field}]}}
end
end
@doc false
def update_impl(s, mod, struct_fields, dict) when is_list(dict) or is_map(dict) do
Enum.map(struct_fields, fn {field, fields_to_fetch, mod} ->
case dict_fetch2(dict, fields_to_fetch) do
{:ok, v} -> wrap_if_valid(v, mod, field) |> R.map(&{field, &1})
:error -> nil
end
end)
|> Enum.reject(&is_nil/1)
|> R.sequence()
|> case do
{:ok , kvs } -> {:ok, struct(s, kvs)}
{:error, reason} -> {:error, R.ErrorReason.add_context(reason, mod)}
end
end
defp dict_fetch2(dict, keys) do
case keys do
[key] -> dict_fetch2_impl(dict, key)
[key1, key2] ->
case dict_fetch2_impl(dict, key1) do
{:ok, _} = r -> r
:error -> dict_fetch2_impl(dict, key2)
end
end
end
defp dict_fetch2_impl(dict, key) when is_list(dict) do
key_str = Atom.to_string(key)
Enum.find_value(dict, :error, fn
{k, v} when k == key or k == key_str -> {:ok, v}
_ -> nil
end)
end
defp dict_fetch2_impl(dict, key) when is_map(dict) do
case Map.fetch(dict, key) do
{:ok, _} = r -> r
:error -> Map.fetch(dict, Atom.to_string(key))
end
end
defmacro __using__(opts) do
quote bind_quoted: [opts: opts] do
fields =
Keyword.fetch!(opts, :fields)
|> Enum.map(fn
{f, {m, field_opts}} -> {f, {m, field_opts}}
{f, m } -> {f, {m, []}}
end)
field_default_pairs = Croma.Struct.field_default_value_pairs(fields)
@croma_struct_field_mod_pairs Enum.map(fields, fn {f, {m, _}} -> {f, m} end)
@croma_struct_fields Croma.Struct.fields_with_accept_case(@croma_struct_field_mod_pairs, opts[:accept_case])
@croma_struct_fields_with_attrs (
Enum.zip(@croma_struct_fields, field_default_pairs)
|> Enum.map(fn {{f, fs, m}, {f, d}} ->
{f, fs, m, d, Croma.New1Existence.has_new1?(m)}
end)
)
@enforce_keys Enum.filter(field_default_pairs, &match?({_, :error}, &1)) |> Enum.map(fn {f, _} -> f end)
defstruct (
Enum.map(field_default_pairs, fn
{f, {:ok, d}} -> {f, d}
{f, :error } -> {f, nil}
end)
)
@type t :: %__MODULE__{unquote_splicing(Croma.Struct.field_type_pairs(@croma_struct_field_mod_pairs))}
@doc """
Creates a new instance of #{inspect(__MODULE__)} by using the given `dict`.
Values associated with the struct field names are fetched from the given `dict`
and then validated/converted with `valid?/1`/`new/1`.
For missing fields default values (if any) are used.
Returns `{:ok, valid_struct}` when all fields are filled with valid values.
Returns `{:error, reason}` if any error occurs (invalid value or no value is available).
See also moduledoc of `Croma.Struct`.
"""
defun new(dict :: term) :: R.t(t) do
Croma.Struct.new_impl(__MODULE__, @croma_struct_fields_with_attrs, dict)
end
@doc """
A variant of `new/1` which returns `t` or raise if validation fails.
In other words, `new/1` followed by `Croma.Result.get!/1`.
"""
defun new!(dict :: term) :: t do
new(dict) |> R.get!()
end
Enum.each(@croma_struct_field_mod_pairs, fn {name, mod} ->
@doc """
Type-aware getter for #{name}.
"""
@spec unquote(name)(t) :: unquote(mod).t
def unquote(name)(%__MODULE__{unquote(name) => field}) do
field
end
@doc """
Type-aware setter for #{name}.
"""
@spec unquote(name)(t, unquote(mod).t) :: t
def unquote(name)(%__MODULE__{} = s, field) do
%{s | unquote(name) => field}
end
end)
@doc """
Checks if the given value belongs to `t:t/0` or not.
"""
defun valid?(value :: term) :: boolean do
%__MODULE__{} = s ->
Enum.all?(@croma_struct_field_mod_pairs, fn {field, mod} ->
mod.valid?(Map.fetch!(s, field))
end)
_ -> false
end
@doc """
Updates an existing instance of #{inspect(__MODULE__)} with the given `dict`.
The values in the `dict` are validated by each field's `valid?/1` function.
Returns `{:ok, valid_struct}` or `{:error, reason}`.
"""
defun update(%__MODULE__{} = s :: t, dict :: Dict.t) :: R.t(t) do
Croma.Struct.update_impl(s, __MODULE__, @croma_struct_fields, dict)
end
@doc """
A variant of `update/2` which returns `t` or raise if validation fails.
In other words, `update/2` followed by `Croma.Result.get!/1`.
"""
defun update!(s :: t, dict :: Dict.t) :: t do
update(s, dict) |> R.get!()
end
defoverridable [valid?: 1, new: 1, new!: 1, update: 2, update!: 2]
end
end
end