Packages
mdex
0.8.6
0.13.3
0.13.2
0.13.1
0.13.0
0.12.5
retired
0.12.4
0.12.3
0.12.2
0.12.1
0.12.0
0.11.7
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.0
0.9.4
0.9.3
0.9.2
0.9.1
0.9.0
0.8.6
0.8.5
0.8.4
0.8.3
0.8.2
0.8.1
0.8.0
0.7.5
0.7.4
0.7.3
0.7.2
0.7.1
0.7.0
0.6.2
0.6.1
0.6.0
0.5.0
0.4.3
0.4.2
0.4.1
0.4.0
0.3.3
0.3.2
0.3.1
0.3.0
0.2.0
0.1.18
0.1.17
0.1.16
0.1.15
0.1.14
0.1.13
0.1.12
0.1.11
0.1.10
0.1.9
0.1.8
0.1.7
0.1.6
0.1.5
0.1.4
0.1.3
0.1.2
0.1.1
0.1.0
Fast and extensible Markdown for Elixir
Security advisory:
This version has known vulnerabilities.
View advisories
Current section
Files
Jump to
Current section
Files
lib/mdex/sigil.ex
defmodule MDEx.Sigil do
@opts [
extension: [
strikethrough: true,
table: true,
autolink: false,
tasklist: true,
superscript: true,
footnotes: true,
description_lists: true,
# need both multiline block quotes and alerts to enable github/gitlab multiline alerts
multiline_block_quotes: true,
alerts: true,
math_dollars: true,
math_code: true,
shortcodes: true,
underline: true,
spoiler: true
],
parse: [
relaxed_tasklist_matching: true,
relaxed_autolinks: true
],
render: [
unsafe: true,
escape: false,
# github_pre_lang and full_info_string are required to enable code block decorators
github_pre_lang: true,
full_info_string: true
]
]
@moduledoc """
Sigils for parsing and formatting Markdown between different formats.
## Examples
Defaults to parsing a Markdown string into a `MDEx.Document` struct:
iex> import MDEx.Sigil
iex> ~MD|# Hello from `~MD` sigil|
%MDEx.Document{
nodes: [
%MDEx.Heading{
nodes: [
%MDEx.Text{literal: "Hello from "},
%MDEx.Code{num_backticks: 1, literal: "~MD"},
%MDEx.Text{literal: " sigil"}
],
level: 1,
setext: false
}
]
}
You can also convert Markdown to HTML, JSON or XML:
iex> import MDEx.Sigil
iex> ~MD|`~MD` also converts to HTML format|HTML
"<p><code>~MD</code> also converts to HTML format</p>"
iex> import MDEx.Sigil
iex> ~MD|and to XML as well|XML
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\\n<!DOCTYPE document SYSTEM \"CommonMark.dtd\">\\n<document xmlns=\"http://commonmark.org/xml/1.0\">\\n <paragraph>\\n <text xml:space=\"preserve\">and to XML as well</text>\\n </paragraph>\\n</document>"
Assigns in the context can be referenced in the Markdown content using `<%= ... %>` syntax, which is evaluated at runtime:
`~MD` also accepts an `assigns` map to pass variables to the document:
iex> import MDEx.Sigil
iex> assigns = %{lang: "Elixir"}
iex> ~MD|Running <%= @lang %>|HTML
"<p>Running Elixir</p>"
## Modifiers
* `HTML` - converts Markdown or `MDEx.Document` to HTML
Use [EEx.SmartEngine](https://hexdocs.pm/eex/EEx.SmartEngine.html) to the document into HTML. It does support `assigns` but only the old `<%= ... %>` syntax,
and it doesn't support components. It's useful if you want to generate static HTML from Markdown or don't need components or don't want to define an `assigns` variable (it's optional).
* `JSON` - converts Markdown or `MDEx.Document` to JSON
* `XML` - converts Markdown or `MDEx.Document` to XML
* `MD` - converts `MDEx.Document` to Markdown
* `DELTA` - converts Markdown or `MDEx.Document` to Quill Delta format
* No modifier (default) - parses a Markdown string into a `MDEx.Document` struct
Note that you should `import MDEx.Sigil` to use the `~MD` sigil.
## HTML/EEx Format Order
In order to generate the final result, the Markdown string or `MDEx.Document` (initial input) is first converted into a static HTML without escaping
the content, then the HTML is passed to the appropriate engine to generate the final output.
## Assigns and Expressions
Only the `HTML` modifier support assigns, any other modifier will render the assign unmodified.
That's particularly important when generating a `MDEx.Document` which does represent the Markdown AST because it must respect
the Markdown content and also be able to convert back to a Markdown string.
> #### Expressions inside code blocks are preserved {: .warning}
> Expressions as `<%= ... %>` or `{ ... }` inside code blocks are escaped and not evaluated, ie: they are preserved as is:
> ```elixir
> assigns = %{title: "Hello"}
> ~MD\"""
`{@title}`
> \"""HTML
> "<p><code>{@title}</code></p>"
> ```
## Options
All modifiers use these options by default:
```elixir
#{inspect(@opts, pretty: true)}
```
If you need a different set of options, you can call the regular functions in `MDEx` to pass the options you need.
"""
@doc """
The `~MD` sigil converts a Markdown string or a `%MDEx.Document{}` struct to either one of these formats: `MDEx.Document`, Markdown (CommonMark), HTML, JSON or XML.
## Assigns
You can define a variable `assigns` in the context of the sigil to evaluate expressions:
iex> assigns = %{lang: ":elixir"}
iex> ~MD|`lang = <%= @lang %>`|HTML
"<p><code>lang = :elixir</code></p>"
Note that only the `HTML` modifier support assigns.
## Examples
### Markdown to `MDEx.Document`
```elixir
iex> ~MD[`lang = :elixir`]
%MDEx.Document{nodes: [%MDEx.Paragraph{nodes: [%MDEx.Code{num_backticks: 1, literal: "lang = :elixir"}]}]}
```
### Markdown to HTML
```elixir
iex> ~MD[`lang = :elixir`]HTML
"<p><code>lang = :elixir</code></p>\\n"
```
### Markdown to JSON
```elixir
iex> ~MD[`lang = :elixir`]JSON
"{\"nodes\":[{\"nodes\":[{\"literal\":\"lang = :elixir\",\"num_backticks\":1,\"node_type\":\"MDEx.Code\"}],\"node_type\":\"MDEx.Paragraph\"}],\"node_type\":\"MDEx.Document\"}"
```
### Markdown to XML
```elixir
iex> ~MD[`lang = :elixir`]XML
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<!DOCTYPE document SYSTEM \"CommonMark.dtd\">\n<document xmlns=\"http://commonmark.org/xml/1.0\">\n <paragraph>\n <code xml:space=\"preserve\">lang = :elixir</code>\n </paragraph>\n</document>\n"
```
### `MDEx.Document` to Markdown
```elixir
iex> ~MD|%MDEx.Document{nodes: [%MDEx.Paragraph{nodes: [%MDEx.Code{num_backticks: 1, literal: "lang = :elixir"}]}]}|MD
"`lang = :elixir`"
```
### Markdown to Quill Delta
```elixir
iex> ~MD|`lang = :elixir`|DELTA
[%{"insert" => "lang = :elixir", "attributes" => %{"code" => true}}, %{"insert" => "\\n"}]
```
### Elixir Expressions
```elixir
iex> ~MD[## Section <%= 1 + 1 %>]HTML
"<h2>Section 2</h2>"
```
"""
defmacro sigil_MD({:<<>>, _meta, [expr]}, modifiers) do
expr = expr(expr, __CALLER__)
case modifiers do
[] ->
expr
|> MDEx.parse_document!(@opts)
|> Macro.escape()
~c"HTML" ->
expr
|> MDEx.to_html!(@opts)
|> EEx.compile_string(
engine: EEx.SmartEngine,
file: __CALLER__.file,
line: __CALLER__.line + 1,
indentation: 0
)
# ~c"HEEX" ->
# if not Macro.Env.has_var?(__CALLER__, {:assigns, nil}) do
# raise "~MD[...]HEEX requires a variable named \"assigns\" to exist and be set to a map"
# end
#
# expr
# |> MDEx.to_html!(@opts)
# |> EEx.compile_string(
# engine: Phoenix.LiveView.TagEngine,
# file: __CALLER__.file,
# line: __CALLER__.line + 1,
# caller: __CALLER__,
# indentation: 0,
# source: expr,
# tag_handler: Phoenix.LiveView.HTMLEngine
# )
~c"MD" ->
expr
|> MDEx.to_markdown!(@opts)
|> Macro.escape()
~c"JSON" ->
expr
|> MDEx.to_json!(@opts)
|> Macro.escape()
~c"XML" ->
expr
|> MDEx.to_xml!(@opts)
|> Macro.escape()
~c"DELTA" ->
expr
|> MDEx.to_delta!(@opts)
|> Macro.escape()
_ ->
raise "unsupported modifier #{inspect(modifiers)} for sigil_MD"
end
end
@deprecated "Use the ~MD sigil instead"
defmacro sigil_M({:<<>>, _meta, [expr]}, modifiers) do
expr = Macro.unescape_string(expr)
doc = expr(expr, __CALLER__)
doc =
cond do
modifiers == ~c"AST" ->
IO.warn("""
modifier AST is deprecated
This sigil now returns a %MDEx.Document{} by default,
so you can remove the AST suffix.
""")
MDEx.parse_document!(doc, @opts)
modifiers == ~c"HTML" ->
MDEx.to_html!(doc, @opts)
modifiers == ~c"JSON" ->
MDEx.to_json!(doc, @opts)
modifiers == ~c"XML" ->
MDEx.to_xml!(doc, @opts)
modifiers == ~c"MD" ->
MDEx.to_markdown!(doc, @opts)
:default ->
MDEx.parse_document!(doc, @opts)
end
Macro.escape(doc)
end
@deprecated "Use the ~MD sigil instead"
defmacro sigil_m({:<<>>, _, [binary]}, modifiers) when is_binary(binary) do
binary = Macro.unescape_string(binary)
doc = expr(binary, __CALLER__)
doc =
cond do
modifiers == ~c"AST" ->
IO.warn("""
modifier AST is deprecated
This sigil now returns a %MDEx.Document{} by default,
so you can remove the AST suffix.
""")
MDEx.parse_document!(doc, @opts)
modifiers == ~c"HTML" ->
MDEx.to_html!(doc, @opts)
modifiers == ~c"JSON" ->
MDEx.to_json!(doc, @opts)
modifiers == ~c"XML" ->
MDEx.to_xml!(doc, @opts)
modifiers == ~c"MD" ->
MDEx.to_markdown!(doc, @opts)
:default ->
MDEx.parse_document!(doc, @opts)
end
Macro.escape(doc)
end
defmacro sigil_m({:<<>>, meta, pieces}, modifiers) do
binary = {:<<>>, meta, unescape_tokens(pieces)}
cond do
modifiers == ~c"AST" ->
IO.warn("""
modifier AST is deprecated
This sigil now returns a %MDEx.Document{} by default,
so you can remove the AST suffix.
""")
quote do
MDEx.parse_document!(unquote(binary), unquote(@opts))
end
modifiers == ~c"HTML" ->
quote do
MDEx.to_html!(expr(unquote(binary), __ENV__), unquote(@opts))
end
modifiers == ~c"JSON" ->
quote do
MDEx.to_json!(expr(unquote(binary), __ENV__), unquote(@opts))
end
modifiers == ~c"XML" ->
quote do
MDEx.to_xml!(expr(unquote(binary), __ENV__), unquote(@opts))
end
modifiers == ~c"MD" ->
quote do
MDEx.to_markdown!(expr(unquote(binary), __ENV__), unquote(@opts))
end
:default ->
quote do
MDEx.parse_document!(unquote(binary), unquote(@opts))
end
end
end
@doc false
def expr(binary, env) do
with {:ok, {:%, _, _} = quoted} <- Code.string_to_quoted(binary),
quoted = expand_alias(quoted, env),
{doc, _} <- Code.eval_quoted(quoted) do
doc
else
_ -> binary
end
end
defp expand_alias(ast, caller) do
Macro.prewalk(ast, fn
{:__aliases__, _, _} = module -> Macro.expand(module, caller)
other -> other
end)
end
defp unescape_tokens(tokens) do
:lists.map(
fn token ->
case is_binary(token) do
true -> :elixir_interpolation.unescape_string(token)
false -> token
end
end,
tokens
)
end
end