All Posts

Runtime Instructions for Clay Scrapes that AI Can Use

Transform your generic data scrapes into a source of actionable GTM intelligence by mastering runtime instructions for Clay. See how Octave's context engine uses this real-time research to qualify leads and generate hyper-personalized outreach at scale.

Runtime Instructions for Clay Scrapes that AI Can Use

Published on

Introduction: The Unfulfilled Promise of Automated Research

Most automated outbound is an exercise in futility. We have been sold a vision of machines doing the tedious work of prospect research, only to find ourselves drowning in a sea of unstructured text. A Clay scrape of a LinkedIn profile or a company website returns data, yes, but it often lacks the one thing that matters: actionable context.

The fault lies not in the tools, but in our commands. We treat scraping like a blunt instrument when it should be a surgical tool. The secret to unlocking its potential lies in crafting precise, intelligent runtime instructions—the prompts that guide the AI to find not just data, but meaning. This is how you turn a noisy data feed into a clear signal for GTM action.

The Problem with Unstructured Scrapes: Data Without Direction

Outbound teams often find themselves in a state of “prompt swamp.” They stitch together countless tools—enrichment providers, scrapers, and LLM prompts within platforms like Clay—in a valiant but fragile attempt to create relevance. This duct-taped stack is a pain to maintain and often produces generic copy that fails to convert.

A simple instruction to “scrape this website” returns a wall of text. It tells you nothing about the company’s key value propositions, its target personas, or the specific use cases it solves. It is information devoid of intelligence. Relying on this is no better than using a static, variable-filled template. The result is always the same: low reply rates, stalled pipeline, and a GTM strategy that can't adapt to market shifts.

This process is not just cumbersome; it burns credits and expensive RevOps time. The core issue is that the critical context—your own ICP, messaging, and positioning—is absent from the workflow. You are asking a generic AI to find specific relevance without giving it the map.

Architecting Actionable Scrapes: The Art of Runtime Instructions

Runtime instructions are specific directives given to a scraping agent at the moment of execution. Instead of asking it to simply “get data,” you command it to “act as a Go-To-Market analyst and extract the top three value propositions from this homepage targeted at FinTech companies.” The difference is profound.

Effective instructions are built on three principles:

  1. Assume a Persona: Instruct the AI to adopt the mindset of a specific role (e.g., an SDR, a PMM, a solutions engineer). This frames its analysis and focuses the output on what is commercially relevant.
  2. Define the Objective: Be explicit about what you want to find. Are you looking for pain points, specific technologies mentioned, evidence of recent funding, or job openings for GTM engineers? A clear objective yields a clear answer.
  3. Constrain the Output: Ask for a summary, a bulleted list of three items, or a true/false determination. Structure prevents the AI from returning verbose, unusable text and makes the output clean enough for downstream automation.

By mastering this art, you transform your scraping tool from a simple data collector into an agentic researcher, capable of delivering precisely the context you need to qualify a lead or personalize a message.

Practical Patterns for Real-Time Research

Theory is useful, but practice is profitable. Here are concrete prompt patterns for turning your Clay scrape workflows into powerful intelligence-gathering operations for both LinkedIn and company websites.

LinkedIn Scraping for Persona-Level Insight

A LinkedIn profile is more than a resume; it is a rich tapestry of professional intent, experience, and priorities. Use targeted LinkedIn scraping to uncover the signals that matter for personalization.

  • To understand their role: “Analyze this person’s ‘About’ section and current job description. Summarize their core responsibilities in three bullet points as they relate to go-to-market strategy.”
  • To identify recent priorities: “Review this person’s recent posts and articles from the last 90 days. Identify and quote one sentence that reveals a key challenge or priority for their team.”
  • To find common ground: “Examine this person’s skills, endorsements, and volunteer experience. Is there any overlap with [Your Company's Mission or Technology]? Answer with a single sentence.”
  • To gauge tech affinity: “Scan this person’s full profile for mentions of tools like Clay, n8n, Cargo, or AirOps. List any tools found that indicate an interest in GTM automation.”

Web Scraping for Company-Level Context

A company's website is its central messaging document. Your job is to deconstruct it to understand how to position your own solution effectively. These runtime instructions help you find the strategic footholds.

  • To distill value props: “Scrape the homepage of this website. Identify the main H1 and H2 headlines and synthesize them into a single sentence that describes the company's primary value proposition.”
  • To find relevant use cases: “Analyze the 'Solutions' or 'Products' page. List up to three use cases that are relevant for a [Target Industry, e.g., 'MarTech'] company.”
  • To uncover strategic signals: “Scrape the company's career page. List any open roles for 'SDRs', 'Growth Marketing', or 'GTM Engineers'. If none, state 'No relevant roles found'.”
  • To source social proof: “Find the case study or customer stories section of the website. Extract the name of one customer in the [Target Industry] and the key result they achieved, formatted as: '[Customer Name]: [Key Result]'.”

From Raw Data to GTM Action: The Clay + Octave Workflow

Running intelligent scrapes is only half the battle. The real power comes from operationalizing that context. This is where the symbiotic relationship between Clay.com and Octave shines. The workflow is simple, elegant, and devastatingly effective.

  1. Build and Enrich in Clay: Use Clay's powerful platform for what it does best—building your lists and enriching them with firmographic, technographic, and intent signals. This is the foundation.
  2. Execute Scrapes with Runtime Instructions: Run your live web and LinkedIn scraping jobs within Clay or Cargo, using the precise runtime instructions we have outlined. You now have targeted, relevant context for each prospect and account.
  3. Pass Context to Octave: This is the crucial handoff. Instead of wrestling with more prompts, you pass the clean output of your scrapes to a single Octave API endpoint.
  4. Let Octave Analyze and Act: Octave serves as the “ICP and product brain” of your stack. Our Enrichment and Qualification Agents take the scraped context and weigh it against your dynamic messaging and ICP library. They apply natural-language qualifiers to produce a transparent fit score and determine the next best action. There are no black-box models here; you define the logic.
  5. Generate and Deploy Copy: Based on the qualification score and the scraped context, our Sequence Agents assemble concept-driven emails from your messaging playbooks. This isn't static template-filling; it’s the intelligent composition of a message designed for that specific prospect's context. The ready-to-send copy is then pushed into your sequencer of choice—Salesloft, Outreach, Instantly, Smartlead, or another.

In this model, Clay provides the raw materials. Octave is the context engine that refines them into high-conversion pipeline.

Octave: Your GTM Context Engine

For too long, B2B GTM teams have been forced to choose between two bad options: static, Mad-Libs templates that fail to resonate, or brittle, complex prompt chains that are impossible to maintain at scale. Neither approach can react to ICP signals or adapt to the constant shifts in your product and market. The result is off-message copy, dipping reply rates, and missed opportunities.

We built Octave to solve this. Octave swaps those static docs and fragile prompts for agentic messaging playbooks and a composable API. At our core is a living library of your GTM DNA—your personas, products, use cases, and value props. This is a strategic asset that ensures every message reflects the actual pains and priorities of your customers.

Our Enrichment and Qualification Agents are the workhorses that make this possible. They consume the real-time signals you source from Clay scrapes, CRM data, and product usage. Then, they apply the natural-language qualifiers you define to surface fit scores and messaging angles you can trust. This allows you to qualify and prioritize the right buyers with confidence.

From there, our platform generates context-aware playbooks and ready-to-send sequences at scale. No manual prompts, no learning curve for SDRs. Just high-quality messages that automate high-conversion outbound and generate replies. We give you the power to go from ICP to copy-ready sequences in one fully automated, hands-off flow.

Conclusion: Instruct, Don't Just Scrape

The quality of your outbound is a direct reflection of the quality of your inputs. Generic scrapes yield generic emails. But by embedding intelligence into the very first step—the scrape itself—you create a ripple effect of relevance throughout your entire GTM motion.

Mastering runtime instructions is the key to unlocking a new level of precision in your research. Combining that precision with the structured workflow of Clay for data acquisition and Octave for context and activation gives you an unfair advantage. You can finally stop duct-taping your stack together and start building a scalable system that turns real-time signals into revenue.

Stop chasing relevance with more columns and more prompts. Build a true GTM context engine. Start building with Octave today.

FAQ

Frequently Asked Questions

Still have questions? Get connected to our support team.

What are runtime instructions in the context of a Clay scrape?

Runtime instructions are specific, detailed prompts given to an AI scraping agent at the moment of execution. Instead of a generic command like 'scrape this page,' you provide a targeted directive, such as 'Analyze this careers page and list all open roles related to Growth Marketing,' to get structured, actionable output.

How does Octave use the data from a Clay scrape?

Octave acts as a context engine. It takes the structured output from a Clay scrape and uses its Enrichment and Qualification Agents to analyze it against your pre-defined ICP and messaging library. This allows it to score leads, determine product fit, and select the right messaging playbook for hyper-personalized outreach.

Why not just build a complex prompt chain within Clay instead of using Octave?

While possible, building complex logic in Clay often leads to 'prompt swamp'—fragile, hard-to-maintain workflows with dozens of columns. Octave replaces this by centralizing your GTM logic in one place. You model your ICP and messaging once, and our agents apply that context, removing prompt engineering overhead and ensuring consistency.

What makes Octave's qualification process different from a 'black-box' AI model?

Octave's Qualification Agents are not a black box. You define the qualification criteria using natural-language qualifiers. This provides full transparency and control over your lead scoring model, allowing you to understand exactly why a lead was scored a certain way and to adjust the logic easily as your strategy evolves.

Can I use these scraping techniques for both LinkedIn profiles and company websites?

Yes. The principles of assuming a persona, defining the objective, and constraining the output apply to any text-based data source. You can create specific runtime instructions tailored to extracting persona-level insights from LinkedIn and company-level context from websites.

How does the Clay + Octave workflow help scale hyper-personalized outbound?

This workflow scales personalization by separating concerns. Clay handles the scalable data acquisition and enrichment, while Octave handles the scalable application of context and logic. By codifying your ICP and messaging in Octave's library, our agents can intelligently generate unique, personalized copy for every single prospect without the manual effort of writing prompts or templates for each segment.