Packages

roboxir

0.1.0
0.1.1 0.1.0

0 dependencies, straightforward Robots.txt parser.

HexDocs

Current section

Files

Jump to
Readme
2 Versions
0 Dependencies
Dependants
Files
Activity
roboxir lib roboxir user_agent.ex
Raw

lib/roboxir/user_agent.ex 

defmodule Roboxir.UserAgent do

  @type t :: %__MODULE__{

          name: String.t(),

          delay: integer(),

          disallowed_urls: [String.t()],

          allowed_urls: [String.t()],

          sitemap_urls: [String.t()]

        }

  defstruct [:name, :delay, disallowed_urls: [], allowed_urls: [], sitemap_urls: []]

end