Packages

Declarative 3D scenes for Mob apps — one scene IR, diffed and patched over a NIF wire, rendered by Filament on both platforms

SMS composer (pre-fill + user-confirm send) for Mob apps — MFMessageComposeViewController on iOS, ACTION_SENDTO on Android

Elixir library for controlling Waveshare RoArm robot arms via serial communication

On-device video processing (clip/probe/thumbnail/extract-audio) for Mob apps

Background execution keep-alive (iOS silent audio session / Android foreground service) for Mob apps

On-device OCR / text recognition for Mob apps (iOS Vision, Android ML Kit)

Global device-audio capture (Android MediaProjection/AudioPlaybackCapture) for Mob apps — a test-environment probe that meters audio other apps/native players produce, which the in-app Mob.Audio probes cannot reach

Stream raw screen-touch coordinates (x/y) to a Mob screen

TensorFlow Lite from BEAM with full vendor accelerator access — Apple Neural Engine on iOS, MediaTek/Qualcomm GPU+NPU HALs on Android. Not an Nx backend — runs pre-compiled .tflite models.

Offline speech-to-text for Mob apps: whisper.cpp on the phone's CPU, as a MobSpeech engine (no Google app / network recogniser needed)

MIDI in + out (USB / BLE) for Mob apps — CoreMIDI on iOS, android.media.midi on Android

Default-deny peer-to-peer messaging for Elixir. BEAM-distribution-shaped ergonomics (expose / call / send) between mutually-suspicious peers, with Noise XX cryptographic handshake, ChaCha20-Poly1305 transport encryption, pluggable LAN discovery, and walkie-talkie semantics.

OS-triggered background execution for Mob apps — iOS BGTaskScheduler + silent APNs, Android WorkManager + FCM data. Unified identifier → MFA dispatch across all four trigger sources.

Eigen-backed CPU Nx backend, packaged as a mob plugin. The always-available baseline for on-device ML (no GPU required); cross-compiled to a static lib<>.a and linked into the app via the cpp_archive plugin contribution.

Speech-to-text for Mob apps: Android SpeechRecognizer / iOS SFSpeechRecognizer, pluggable engines, scriptable fake for tests

Every phone sensor for Mob apps: list the device's sensors, read one sample, stream readings, and query step history (Android + iOS)

Reference server for mob_deliver: compile a Phoenix project's mobile/ tree into content-addressed BEAMs, sign the manifest, and serve wire format v1 (POST /manifest, GET /beam/:sha256) from a Plug.

Rapier 3D physics wrapped as a Rustler NIF, with a named-world registry and face-up decode rules for the dice + shells shapes the rapier_lab spike proved out

Media helpers for Mob apps: info, audio track to PCM (for speech-to-text) and video frames as JPEG, through the platform decoders (Android MediaCodec, iOS AVFoundation).