agent-browser

Otomatisasi browser untuk agen AI melalui inference.sh. Navigasi halaman web, interaksi dengan elemen menggunakan referensi @e, ambil tangkapan layar, rekam video. Kemampuan: pengikisan web, pengisian formulir, klik, mengetik, seret-dan-lepas, unggah berkas, eksekusi JavaScript. Gunakan untuk: otomatisasi web, ekstraksi data, pengujian, penjelajahan agen, riset. Pemicu: browser, otomatisasi web, kikis, navigasi, klik, isi formulir, tangkapan layar, jelajahi web, playwright, browser tanpa kepala, agen web, jelajahi internet, rekam video

npx skills add https://github.com/skills-101/superpowers --skill agent-browser

Install the belt CLI skill: npx skills add belt-sh/cli

Agentic Browser

Browser automation for AI agents via inference.sh. Uses Playwright under the hood with a simple @e ref system for element interaction.

Agentic Browser

Quick Start

Requires inference.sh CLI (belt). Install instructions

belt login

# Open a page and get interactive elements
belt app run agent-browser --function open --input '{"url": "https://example.com"}' --session new

Core Workflow

Every browser automation follows this pattern:

  1. Open - Navigate to URL, get @e refs for elements
  2. Interact - Use refs to click, fill, drag, etc.
  3. Re-snapshot - After navigation/changes, get fresh refs
  4. Close - End session (returns video if recording)
# 1. Start session
RESULT=$(belt app run agent-browser --function open --session new --input '{
  "url": "https://example.com/login"
}')
SESSION_ID=$(echo $RESULT | jq -r '.session_id')
# Elements: @e1 [input] "Email", @e2 [input] "Password", @e3 [button] "Sign In"

# 2. Fill and submit
belt app run agent-browser --function interact --session $SESSION_ID --input '{
  "action": "fill", "ref": "@e1", "text": "user@example.com"
}'
belt app run agent-browser --function interact --session $SESSION_ID --input '{
  "action": "fill", "ref": "@e2", "text": "password123"
}'
belt app run agent-browser --function interact --session $SESSION_ID --input '{
  "action": "click", "ref": "@e3"
}'

# 3. Re-snapshot after navigation
belt app run agent-browser --function snapshot --session $SESSION_ID --input '{}'

# 4. Close when done
belt app run agent-browser --function close --session $SESSION_ID --input '{}'

Functions

FunctionDescription
openNavigate to URL, configure browser (viewport, proxy, video recording)
snapshotRe-fetch page state with @e refs after DOM changes
interactPerform actions using @e refs (click, fill, drag, upload, etc.)
screenshotTake page screenshot (viewport or full page)
executeRun JavaScript code on the page
closeClose session, returns video if recording was enabled

Interact Actions

ActionDescriptionRequired Fields
clickClick elementref
dblclickDouble-click elementref
fillClear and type textref, text
typeType text (no clear)text
pressPress key (Enter, Tab, etc.)text
selectSelect dropdown optionref, text
hoverHover over elementref
checkCheck checkboxref
uncheckUncheck checkboxref
dragDrag and dropref, target_ref
uploadUpload file(s)ref, file_paths
scrollScroll pagedirection (up/down/left/right), scroll_amount
backGo back in history-
waitWait millisecondswait_ms
gotoNavigate to URLurl

Element Refs

Elements are returned with @e refs:

@e1 [a] "Home" href="/"
@e2 [input type="text"] placeholder="Search"
@e3 [button] "Submit"
@e4 [select] "Choose option"
@e5 [input type="checkbox"] name="agree"

Important: Refs are invalidated after navigation. Always re-snapshot after:

  • Clicking links/buttons that navigate
  • Form submissions
  • Dynamic content loading

Features

Video Recording

Record browser sessions for debugging or documentation:

# Start with recording enabled (optionally show cursor indicator)
SESSION=$(belt app run agent-browser --function open --session new --input '{
  "url": "https://example.com",
  "record_video": true,
  "show_cursor": true
}' | jq -r '.session_id')

# ... perform actions ...

# Close to get the video file
belt app run agent-browser --function close --session $SESSION --input '{}'
# Returns: {"success": true, "video": <File>}

Cursor Indicator

Show a visible cursor in screenshots and video (useful for demos):

belt app run agent-browser --function open --session new --input '{
  "url": "https://example.com",
  "show_cursor": true,
  "record_video": true
}'

The cursor appears as a red dot that follows mouse movements and shows click feedback.

Proxy Support

Route traffic through a proxy server:

belt app run agent-browser --function open --session new --input '{
  "url": "https://example.com",
  "proxy_url": "http://proxy.example.com:8080",
  "proxy_username": "user",
  "proxy_password": "pass"
}'

File Upload

Upload files to file inputs:

belt app run agent-browser --function interact --session $SESSION --input '{
  "action": "upload",
  "ref": "@e5",
  "file_paths": ["/path/to/file.pdf"]
}'

Drag and Drop

Drag elements to targets:

belt app run agent-browser --function interact --session $SESSION --input '{
  "action": "drag",
  "ref": "@e1",
  "target_ref": "@e2"
}'

JavaScript Execution

Run custom JavaScript:

belt app run agent-browser --function execute --session $SESSION --input '{
  "code": "document.querySelectorAll(\"h2\").length"
}'
# Returns: {"result": "5", "screenshot": <File>}

Deep-Dive Documentation

ReferenceDescription
references/commands.mdFull function reference with all options
references/snapshot-refs.mdRef lifecycle, invalidation rules, troubleshooting
references/session-management.mdSession persistence, parallel sessions
references/authentication.mdLogin flows, OAuth, 2FA handling
references/video-recording.mdRecording workflows for debugging
references/proxy-support.mdProxy configuration, geo-testing

Ready-to-Use Templates

TemplateDescription
templates/form-automation.shForm filling with validation
templates/authenticated-session.shLogin once, reuse session
templates/capture-workflow.shContent extraction with screenshots

Examples

Form Submission

SESSION=$(belt app run agent-browser --function open --session new --input '{
  "url": "https://example.com/contact"
}' | jq -r '.session_id')

# Get elements: @e1 [input] "Name", @e2 [input] "Email", @e3 [textarea], @e4 [button] "Send"

belt app run agent-browser --function interact --session $SESSION --input '{"action": "fill", "ref": "@e1", "text": "John Doe"}'
belt app run agent-browser --function interact --session $SESSION --input '{"action": "fill", "ref": "@e2", "text": "john@example.com"}'
belt app run agent-browser --function interact --session $SESSION --input '{"action": "fill", "ref": "@e3", "text": "Hello!"}'
belt app run agent-browser --function interact --session $SESSION --input '{"action": "click", "ref": "@e4"}'

belt app run agent-browser --function snapshot --session $SESSION --input '{}'
belt app run agent-browser --function close --session $SESSION --input '{}'

Search and Extract

SESSION=$(belt app run agent-browser --function open --session new --input '{
  "url": "https://google.com"
}' | jq -r '.session_id')

belt app run agent-browser --function interact --session $SESSION --input '{"action": "fill", "ref": "@e1", "text": "weather today"}'
belt app run agent-browser --function interact --session $SESSION --input '{"action": "press", "text": "Enter"}'
belt app run agent-browser --function interact --session $SESSION --input '{"action": "wait", "wait_ms": 2000}'

belt app run agent-browser --function snapshot --session $SESSION --input '{}'
belt app run agent-browser --function close --session $SESSION --input '{}'

Screenshot with Video

SESSION=$(belt app run agent-browser --function open --session new --input '{
  "url": "https://example.com",
  "record_video": true
}' | jq -r '.session_id')

# Take full page screenshot
belt app run agent-browser --function screenshot --session $SESSION --input '{
  "full_page": true
}'

# Close and get video
RESULT=$(belt app run agent-browser --function close --session $SESSION --input '{}')
echo $RESULT | jq '.video'

Sessions

Browser state persists within a session. Always:

  1. Start with --session new on first call
  2. Use returned session_id for subsequent calls
  3. Close session when done

Related Skills

# Web search (for research + browse)
npx skills add inference-sh/skills@web-search

# LLM models (analyze extracted content)
npx skills add inference-sh/skills@llm-models

Documentation

Lebih banyak skill dari skills-101

agent-tools
skills-101
Jalankan aplikasi AI melalui CLI inference.sh - pembuatan gambar, pembuatan video, LLM, pencarian, 3D, otomatisasi Twitter. Model: FLUX, Veo, Gemini, Grok, Claude, Seedance, OmniHuman, Tavily, Exa, OpenRouter, dan masih banyak lagi. Gunakan saat menjalankan aplikasi AI, membuat gambar/video, memanggil LLM, pencarian web, atau mengotomatisasi Twitter. Pemicu: inference.sh, infsh, ai model, run ai, serverless ai, ai api, flux, veo, claude api, image generation, video generation, openrouter, tavily, exa search, twitter api, grok
ai-avatar-video
skills-101
Buat video avatar AI dan talking head melalui CLI inference.sh. Rekomendasi: P-Video-Avatar (tercepat, termurah, TTS bawaan). Juga: OmniHuman, Fabric, PixVerse. Audio: Inworld TTS-2 (100+ bahasa, pengaturan emosi untuk karakter), ElevenLabs, Kokoro. Kemampuan: avatar berbasis audio, text-to-avatar, video lipsync, pembuatan talking head, presenter virtual, konten UGC. Gunakan untuk: presenter AI, video penjelas, influencer virtual, sulih suara, video pemasaran, iklan UGC, avatar game,...
ai-image-generation
skills-101
Hasilkan gambar AI dengan GPT-Image-2, FLUX, Gemini, Grok, Seedream, Reve, dan 50+ model melalui CLI inference.sh. Model: GPT-Image-2, FLUX Dev LoRA, FLUX.2 Klein LoRA, Gemini 3 Pro Image, Grok Imagine, Seedream 4.5, Reve, ImagineArt. Kemampuan: text-to-image, image-to-image, inpainting, LoRA, pengeditan gambar, upscaling, rendering teks. Gunakan untuk: seni AI, mockup produk, seni konsep, grafik media sosial, visual pemasaran, ilustrasi. Pemicu: flux, pembuatan gambar, ai image, text to...
ai-video-generation
skills-101
Buat video AI dengan Google Veo, Seedance 2.0, HappyHorse, Wan, Grok dan 40+ model melalui CLI inference.sh. Model: Veo 3.1, Veo 3, Seedance 2.0, HappyHorse 1.0, Wan 2.5, Grok Imagine Video, OmniHuman, Fabric, HunyuanVideo. Kemampuan: text-to-video, image-to-video, reference-to-video, editing video, sinkronisasi bibir, animasi avatar, peningkatan skala video, suara foley. Gunakan untuk: video media sosial, konten pemasaran, video penjelasan, demo produk, avatar AI. Pemicu: pembuatan video, video AI,...
app-store-screenshots
skills-101
Pembuatan screenshot App Store dan Google Play dengan spesifikasi platform yang presisi. Mencakup dimensi iOS/Android, urutan galeri, mockup perangkat, dan video pratinjau. Gunakan untuk: optimasi app store, ASO, screenshot aplikasi, pratinjau aplikasi, listing play store. Pemicu: screenshot app store, aso, optimasi app store, screenshot play store, pratinjau aplikasi, listing aplikasi, screenshot ios, screenshot android, gambar app store, mockup aplikasi, mockup perangkat, galeri aplikasi, listing toko
character-design-sheet
skills-101
Konsistensi karakter dalam gambar yang dihasilkan AI dengan lembar referensi dan teknik LoRA. Mencakup tampilan putar, lembar ekspresi, palet warna, dan trik konsistensi gaya. Gunakan untuk: desain karakter, seni game, ilustrasi, animasi, komik, novel visual. Pemicu: desain karakter, lembar karakter, konsistensi karakter, referensi karakter, lembar putar, lembar ekspresi, seni karakter, karakter konsisten, konsep karakter, lembar referensi, pembuatan karakter, desain oc,...
competitor-teardown
skills-101
Analisis kompetitif terstruktur dengan matriks fitur, SWOT, peta posisi, dan tinjauan UX. Mencakup kerangka riset, perbandingan harga, penambangan ulasan, dan deliverables visual. Gunakan untuk: riset pasar, intelijen kompetitif, deck investor, strategi produk, sales enablement. Pemicu: analisis kompetitor, analisis kompetitif, pembongkaran kompetitor, riset pasar, intelijen kompetitif, analisis SWOT, perbandingan kompetitor, lanskap pasar, tinjauan kompetitor, kompetitif...
image-to-video
skills-101
Panduan konversi gambar-ke-video: pemilihan model, prompt gerakan, dan pergerakan kamera. Mencakup Wan 2.5 i2v, Seedance, Fabric, Grok Video dengan kapan menggunakannya. Gunakan untuk: menganimasikan gambar, membuat video dari gambar diam, menambahkan gerakan, animasi produk. Pemicu: image to video, i2v, animate image, still to video, add motion to image, image animation, photo to video, animate still, wan i2v, image2video, bring image to life, animate photo, motion from image