Web & data
Scrape pages, search the web, make HTTP requests, and extract structured data.
import { mindstudio } from '@mindstudio-ai/agent';Getting information from outside the app and out of documents: web search across Google, Perplexity, You.com, and social and video platforms; scraping pages, profiles, and posts into clean text; and pulling text out of uploaded files. Each returns structured results you can feed to a model or store for later. The legacy v1 data-source actions here are superseded by the dataSources API in this SDK, which owns parsing, chunking, embedding, and citations.
32 entries
scrapeUrl
Extract text, HTML, or structured content from one or more web pages.
searchGoogle
Search the web using Google and return structured results.
createDataSource
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. Create a new empty vector data source for the current app.
deleteDataSource
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. Delete a vector data source from the current app.
deleteDataSourceDocument
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. Delete a single document from a data source.
detectChanges
Detect changes between runs by comparing current input against previously stored state. Routes execution based on whether a change occurred.
extractText
Download a file from a URL and extract its text content. Supports PDFs (including scanned/image-based PDFs via OCR), plain text files, and other document formats.
fetchDataSourceDocument
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. Fetch the full extracted text contents of a document in a data source.
hunterApiDomainSearch
Search for email addresses associated with a domain using Hunter.io.
listDataSources
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. List all data sources for the current app.
particlePodcastsSearchCompanies
Search the Particle knowledge graph for companies by name, ticker, domain, CIK, or QID.
particlePodcastsSearchDialogue
Search across podcast dialogue using semantic or keyword search. Returns matched lines grouped by episode.
particlePodcastsSearchPodcasts
Search and list podcasts in the Particle catalog by keyword, topic, or language.
peopleSearch
Search for people matching specific criteria using Apollo.io. Supports natural language queries and advanced filters.
queryDataSource
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. Search a vector data source (RAG) and return relevant document chunks.
scrapeLinkedInCompany
Scrape public company data from a LinkedIn company page.
scrapeLinkedInProfile
Scrape public profile data from a LinkedIn profile page.
scrapeXPost
Scrape data from a single X (Twitter) post by URL.
scrapeXProfile
Scrape public profile data from an X (Twitter) account by URL.
searchGoogleCalendarEvents
Search for events in a Google Calendar by keyword, date range, or both.
searchGoogleDrive
Search for files in Google Drive by keyword.
searchGoogleImages
Search Google Images and return image results with URLs and metadata.
searchGoogleNews
Search Google News for recent news articles matching a query.
searchGoogleTrends
Fetch Google Trends data for a search term.
searchPerplexity
Search the web using the Perplexity API and return structured results.
searchXPosts
Search recent X (Twitter) posts matching a query.
searchYoutube
Search for YouTube videos by keyword.
searchYoutubeTrends
Retrieve trending videos on YouTube by category and region.
uploadDataSourceDocument
Legacy v1 data sources. v2 apps should use `dataSources.defineDataSource()` from @mindstudio-ai/agent instead, which owns parsing, chunking, embedding and citations. Upload a file into an existing data source from a URL or raw text content.
youDotComFinanceResearch
Ask a financial research question using You.com Finance Research and return the sourced response.
youDotComWebResearch
Ask a research question and return a grounded You.com Research API answer with sources.
youDotComWebSearch
Search the web and news using the You.com Search API and return the full structured response.