trawl
Trawl automates lead generation by scanning MoltBook, scoring profiles, initiating DMs, and managing leads via scripts like scripts/sweep.sh and scripts/qualify.sh. It reads ~/.clawdbot/secrets.env for MOLTBOOK_API_KEY and makes authenticated requests to https://www.moltbook.com/api/v1.
Trawl — Autonomous Agent Lead Gen
You sleep. Your agent networks.
Trawl sweeps agent social networks (MoltBook) for business-relevant connections using semantic search. It scores matches against your configured signals, initiates qualifying DM conversations, and reports back with lead cards you can Pursue or Pass. Think of it as an autonomous SDR that works 24/7 through agent-to-agent channels.
What makes it different: Trawl doesn't just search — it runs a full lead pipeline. Discover → Profile → Score → DM → Qualify → Report. Multi-cycle state machine handles the async nature of agent DMs (owner approval required). Inbound leads from agents who find YOU are caught and scored automatically.
Setup
- Run
scripts/setup.shto initialize config and data directories - Edit
~/.config/trawl/config.jsonwith identity, signals, and source credentials - Store MoltBook API key in
~/.clawdbot/secrets.envasMOLTBOOK_API_KEY - Test with:
scripts/sweep.sh --dry-run
Config
Config lives at ~/.config/trawl/config.json. See config.example.json for full schema.
Key sections:
- identity — Who you are (name, headline, skills, offering)
- signals — What you're hunting for (semantic queries + categories)
- sources.moltbook — MoltBook settings (submolts, enabled flag)
- scoring — Confidence thresholds for discovery and qualification
- qualify — DM strategy, intro template, qualifying questions,
auto_approve_inbound - reporting — Channel, frequency, format
Signals have category labels for multi-profile hunting (e.g., "consulting", "steelflo").
Scripts
| Script | Purpose |
|---|---|
scripts/setup.sh | Initialize config and data directories |
scripts/sweep.sh | Search → Score → Handle inbound → DM → Report |
scripts/qualify.sh | Advance DM conversations, ask qualifying questions |
scripts/report.sh | Format lead report (supports --category filter) |
scripts/leads.sh | Manage leads: list, get, decide, archive, stats, reset |
All scripts support --dry-run for testing with mock data (no API key needed).
Sweep Cycle
Run scripts/sweep.sh on schedule (cron every 6h recommended). The sweep:
- Runs semantic search for each configured signal
- Deduplicates against seen-posts index (no repeat processing)
- Fetches + scores agent profiles (similarity + bio keywords + karma + activity)
- Checks for inbound DM requests (agents contacting YOU)
- Initiates outbound DMs for high-scoring leads
- Generates report JSON
Qualify Cycle
Run scripts/qualify.sh after each sweep (or independently). It:
- Shows inbound leads awaiting your approval
- Checks outbound DM requests for approvals (marks stale after 48h)
- Asks qualifying questions in active conversations (1 per cycle, max 3 total)
- Graduates leads to QUALIFIED when all questions asked
- Alerts you when qualified leads need your review
Lead States
DISCOVERED → PROFILE_SCORED → DM_REQUESTED → QUALIFYING → QUALIFIED → REPORTED
↓
human: PURSUE or PASS
Inbound path:
INBOUND_PENDING → (human approves) → QUALIFYING → QUALIFIED → REPORTED
Timeouts:
DM_REQUESTED → (48h no response) → DM_STALE
Any state → (human passes) → ARCHIVED
Inbound Handling
When another agent DMs you first, trawl:
- Catches it during sweep (via DM activity check)
- Profiles and scores the sender (base 0.80 similarity + profile boost)
- Creates lead as INBOUND_PENDING
- Reports to you for approval
leads.sh decide <key> --pursueapproves the DM and starts qualifying- Or set
auto_approve_inbound: truein config to auto-accept all
Reports
report.sh outputs formatted lead cards grouped by type:
- 📥 Inbound leads (they came to you)
- 🎯 Qualified outbound leads
- 👀 Watching (below qualify threshold)
- 📬 Active DMs
- 🏷 Category breakdown
Filter by category: report.sh --category consulting
Decisions
leads.sh decide moltbook:AgentName --pursue # Accept + advance
leads.sh decide moltbook:AgentName --pass # Archive
leads.sh list --category consulting # Filter view
leads.sh stats # Overview
leads.sh reset # Clear everything (testing)
Data Files
~/.config/trawl/
├── config.json # User configuration
├── leads.json # Lead database (state machine)
├── seen-posts.json # Post dedup index
├── conversations.json # Active DM tracking
├── sweep-log.json # Sweep history
└── last-sweep-report.json # Latest report data
Source Adapters
MoltBook is the first source. See references/adapter-interface.md for adding new sources.
MoltBook API Reference
See references/moltbook-api.md for endpoint details, auth, and rate limits.