Packages

scrape

3.1.0
3.1.0 3.0.3 3.0.2 3.0.1 3.0.0 2.0.0 1.2.7 1.2.6 1.2.5 1.2.4 1.2.3 1.2.2 1.2.1 1.0.4 1.0.3 1.0.2 1.0.1 1.0.0 0.2.0 0.1.1 0.1.0 0.0.4 0.0.3 0.0.2 0.0.1

Scrape any website, article or RSS/Atom feed with ease!

HexDocs

Current section

Files

Jump to
Readme
25 Versions
8 Dependencies
Dependants
Files
Activity
scrape lib scrape source http transcode.ex
Raw

lib/scrape/source/http/transcode.ex 

defmodule Scrape.Source.HTTP.Transcode do

  @moduledoc false



  def execute(charset, text) do

    encoding = charset_to_encoding(charset)

    {_status, result} = Codepagex.to_string(text, encoding)

    result

  end



  defp charset_to_encoding(charset) do

    charset

    |> String.replace("-", "_")

    |> String.downcase()

    |> to_charlist

    |> List.to_atom()

  end

end