--- title: Datasets description: Learn about the different datasets available in TheirStack. url: https://theirstack.com/en/docs/datasets --- ![Datasets page](./dataset-page.png) ## What are datasets? Datasets are a way to access to the full database of jobs, technology usage or companies. The raw dataset is ideal for advanced analytics, machine learning or maximum flexibility and control over the data. ## Dataset Access Options TheirStack offers three flexible dataset access options to meet your data needs: * **Historical Access**: Receive a one-time download link containing all available records at the time of purchase. * **Daily Updates**: Get daily download links with new records added to the dataset, including delta files for incremental updates. * **Complete Access**: Combine both historical and daily updates for comprehensive data coverage. ## How to access datasets You can access and manage datasets through the [TheirStack App](https://app.theirstack.com/dataset). The dataset page provides comprehensive information and tools: * Last update date * Total record count * Data dictionary * Sample data download * Dictionary download * Full dataset download (requires access) * Data refresh frequency ![Datasets page](./dataset-page.png) ## How to get lastest dataset link In order to get the latest dataset link to downlaad, you need to do a /GET request to the [dataset endpoint](https://api.theirstack.com/#tag/datasets/GET/v1/datasets). ## Frequently Asked Questions ## How often are files refreshed? The dataset is refreshed daily with new records added to the dataset. Delta files are available for each day. ## How can i validate the quality of the data? The dataset has the same quality as the data in the [app](https://app.theirstack.com) or the API. All the data delivery options comes from the same database. So you can use our app.theirstack.com or the API to validate the data. --- title: Product updates description: Track the latest product updates and feature releases url: https://theirstack.com/en/docs/product-updates --- ## June 16, 2025 * 🐞 \*\* Fixed issue that was auto-revealing companies in when doing job and company searches\*\*. Now, companies will only be revealed when you choose to do so. * 🐞 **Fixed an issue in the webhook form where the "Test event" button kept sending events to the old URL, even after you changed it. Now, it always sends events to the updated URL as expected.** ## June 13, 2025 * 🐞 **Fixed an issue where the save button didn't work during job searches when you filtered by `url_domain_or`.** ## June 12, 2025 * 🆕 **Improvements on [usage page](https://app.theirstack.com/settings/usage)**. * You can now see how long each request takes, and there's a dedicated page to view all your requests where the request table is expanded, making it easier to explore and analyze your data. * We've improved the empty state for all charts to make things clearer when there's no data. * The loading experience is now smoother. * Fixed an issue where the total request count wasn't displaying correctly. ## June 10, 2025 * 🆕 **Unified search experience for job and company searches**. To improve control and prevent accidental queries, searches in job and company pages no longer run automatically. You now need to click the "Search" button after setting your filters. This is especially helpful for complex searches on historical data. * 🐞 Fixed an issue where some job titles weren't displaying special characters correctly. For example, 'Growth Analyst (AI & Search Architecture)' now appears as 'Growth Analyst (AI & Search Architecture)'. This fix applies to all new jobs going forward. ## June 9, 2025 * 🔨 **Better loading experience in the App**. When you search for jobs or companies, you'll now see a loading banner that shows how many jobs or companies are being searched, along with logos from the main job sources. * 🔨 **Database timeout status code change**: The HTTP status code returned for database query timeouts has been changed from `408 (Request Timeout)` to `504 (Gateway Timeout)`. A `504` code indicates a server-side timeout rather than a client-side one, which better reflects what's actually happening when a database query takes too long. If you were handling 408 errors before, you'll have to update your code to handle `504` errors instead. ## June 6, 2025 * 🆕 **New job description filter `contains any` in [Job Search page](https://app.theirstack.com/search/jobs/new) and [Jobs Search endpoint](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search)**. Until now, searching in job descriptions required using regex patterns, which wasn't very user-friendly for non-technical users. We have added `job_description_contains_or` param to our API to allow you to search for whole words in job descriptions. Only finds complete words (e.g., searching 'quality' won't match 'inequality'). More technical information about how this filter works can be found in the [API docs](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search). ![New job description filter](./job-description-contains-any.png) * 🆕 **Profile page**. You can now update your first and last name in your [profile page](https://app.theirstack.com/settings/profile). * 🆕 **No results message** in job and company searches. When your search doesn't return any results, you'll now see a clearer, more helpful message—especially on small screens. ## June 4, 2025 * 🆕 **Jobs are now 3x cheaper**. Read more about it in [this blog post](/en/blog/jobs-are-now-up-to-3x-cheaper). ## June 3, 2025 * **Improved the performance** of job searches and company searches by **up to 30x** when using some of the following filters: * `company_name_partial_match_or` * `company_name_partial_match_not` * `company_location_pattern_or` * `company_description_pattern_or` * `company_description_pattern_not` * `job_title_pattern_or` * `job_title_pattern_not` * `job_location_pattern_not` * `job_description_pattern_not` This will have effect especially when passing large arrays of values in them (of 50+ elements). Queries that before would take \~50 seconds are now taking 2-3 seconds, according to our tests. ## May 29, 2025 * 🆕 **Improved extraction of matching phrases**. Before, when filtering jobs by keywords in the jobs description, even if the keywords or patterns in the description of the jobs, the matching\_phrases and matching\_words were empty. Now, we extract the matching phrases and words from the description of the jobs. ![Improved extraction of matching phrases](./matching_phrases_fixed.png) * 🆕 **Added new tachnologies**. We reparsed our full database to add new technologies. They're now available in company searches, job searches and in our datasets. These are the new technologies added: * Opentofu * MasterControl * BurpSuite * v0 * Lovable * Windsurf * Bolt * WeWeb * ZenQMS * Qualio Life Sciences QMS * ValGenesis * Kneat * ResQ * Sware Res\_Q * Tricentis * Tricentis Tosca * Tricentis Neoload * Tricentis qTest * SAP Cloud ALM * Siemens Polarion ALM * Salesforce Health Cloud * Tropic * Trackingplan * Payhawk * PayEm * ORO * Moss * Devin * Cline * Buck2 * a3innuva * Ramp * Builder * Clio * Yooz * Augment Code * Cursor * Syntess Atrium * Tonkean * Opstream * Flowie * Payflows * Omnea * Spendesk * TheirStack * Bard AI * Apollo.io ## May 27, 2025 * 🆕 **New filters `url_domain_or` and `url_domain_not` in [Jobs Search endpoint](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search)** and [Company Search endpoint](https://api.theirstack.com/#tag/companies/POST/v1/companies/search). This filter allows you to get jobs from specific domains: greenhouse.io, workable.com, linkedin.com, etc. * 📚 **Adding examples for each filter in the API docs**. This is helpful to understand how to use the filters and see some possible values. ![examples for each filter](./examples-filters-api-docs.png) ## May 22, 2025 * 🔨 **API Error Handling**: We've standardized the error experience across all endpoints. The error object now consistently includes `request_id`, `code`, `title`, and `message`. ## May 21, 2025 * 📚 **New guide**: [How to send a slack message for every new job found](/docs/posts/guides/how-to-send-jobs-to-slack) ## May 20, 2025 * 🆕 **Error handling**: We've improved the error handling in the app. Now the notification will show better titles and descriptions so you can understand what went wrong. ![Error handling](./error-handling.png) ## May 16, 2025 * 🆕 **Export data with revealed records**: You can now export all records from already revealed companies. This is useful if you want to export data without consuming credits. ![Export data from only revealed records](./export-only-revealed.png) ## May 7, 2025 * 🆕 **Stable company logo URLs**:\ Previously, when scraping new jobs, we stored direct logo URLs from external sources. These links often broke due to expiration or CORS issues. We've updated our process to copy and host logo images on our own infrastructure. All newly detected companies will now use a permanent URL format: `https://media.theirstack.com/company/logo/xxx`.\ These links are stable and can be used anywhere. * 🆕 **Slow company searches are now 2-6x faster ⚡️**\ Company searches that before took too long or were just impossible to run just take seconds. This would typically happen when adding job or technology filters to the search. Here are examples of such queries: - Companies using Snowflake, with a high confidence score in the usage of that technology, from the US. Now it completes in [less than 5 seconds](https://app.theirstack.com/search/companies/new?query=JTdCJTIycXVlcnklMjIlM0ElN0IlMjJpbmNsdWRlX3RvdGFsX3Jlc3VsdHMlMjIlM0FmYWxzZSUyQyUyMm9yZGVyX2J5JTIyJTNBJTVCJTdCJTIyZGVzYyUyMiUzQXRydWUlMkMlMjJmaWVsZCUyMiUzQSUyMmNvbmZpZGVuY2UlMjIlN0QlMkMlN0IlMjJkZXNjJTIyJTNBdHJ1ZSUyQyUyMmZpZWxkJTIyJTNBJTIyam9icyUyMiU3RCUyQyU3QiUyMmRlc2MlMjIlM0F0cnVlJTJDJTIyZmllbGQlMjIlM0ElMjJudW1fam9icyUyMiU3RCU1RCUyQyUyMmNvbXBhbnlfY291bnRyeV9jb2RlX29yJTIyJTNBJTVCJTIyVVMlMjIlNUQlMkMlMjJjb21wYW55X3RlY2hub2xvZ3lfc2x1Z19vciUyMiUzQSU1QiUyMnNub3dmbGFrZSUyMiU1RCUyQyUyMnRlY2hfZmlsdGVycyUyMiUzQSU3QiUyMmNvbmZpZGVuY2Vfb3IlMjIlM0ElNUIlMjJoaWdoJTIyJTVEJTdEJTJDJTIyZXhwYW5kX3RlY2hub2xvZ3lfc2x1Z3MlMjIlM0ElNUIlNUQlN0QlMkMlMjJhdXRvX3NlYXJjaCUyMiUzQXRydWUlN0Q=) - Companies hiring data engineers in the US, UK or Canada. Now completes [in 3-4 seconds as well](https://app.theirstack.com/search/companies/new?query=JTdCJTIycXVlcnklMjIlM0ElN0IlMjJpbmNsdWRlX3RvdGFsX3Jlc3VsdHMlMjIlM0FmYWxzZSUyQyUyMm9yZGVyX2J5JTIyJTNBJTVCJTdCJTIyZGVzYyUyMiUzQXRydWUlMkMlMjJmaWVsZCUyMiUzQSUyMmNvbmZpZGVuY2UlMjIlN0QlMkMlN0IlMjJkZXNjJTIyJTNBdHJ1ZSUyQyUyMmZpZWxkJTIyJTNBJTIyam9icyUyMiU3RCUyQyU3QiUyMmRlc2MlMjIlM0F0cnVlJTJDJTIyZmllbGQlMjIlM0ElMjJudW1fam9icyUyMiU3RCU1RCUyQyUyMmNvbXBhbnlfY291bnRyeV9jb2RlX29yJTIyJTNBJTVCJTIyR0IlMjIlMkMlMjJVUyUyMiUyQyUyMkNBJTIyJTVEJTJDJTIyam9iX2ZpbHRlcnMlMjIlM0ElN0IlMjJwb3N0ZWRfYXRfbWF4X2FnZV9kYXlzJTIyJTNBNjAlMkMlMjJqb2JfdGl0bGVfb3IlMjIlM0ElNUIlMjJkYXRhJTIwZW5naW5lZXIlMjIlNUQlN0QlMkMlMjJleHBhbmRfdGVjaG5vbG9neV9zbHVncyUyMiUzQSU1QiU1RCU3RCUyQyUyMmF1dG9fc2VhcmNoJTIyJTNBdHJ1ZSU3RA==) These and other slow queries are now 2-6x faster. These is how long queries would take before and after the improvement: | Time before | Time now | Improvement | | -------------------- | -------- | ----------- | | \~16s | \~9s | 1.8x faster | | \~52s | \~13s | 4.0x faster | | \~98s | \~16s | 6.1x faster | | Timeouts (at 2 mins) | 20-35s | \~6x faster | ## May 6, 2025 * 🆕 **New docs**: We have revamped [our docs](https://theirstack.com/en/docs) to make it easier to discover TheirStack and its features. * **Navigation**: Added a new sidebar to the left of the page to help you navigate the docs in a more intuitive way. * **Merge similar pages**: We've merged similar pages to avoid duplication and make it easier to learn about new topics. * **New dataset page**: We've added a new page to the docs to help you learn about our datasets. ## April 15, 2025 * 🆕 **New webhook setting `trigger once per company`**. When enabled, the webhook will fire only once for each company. This is helpful for sales workflows where you want to act on the first job posted (e.g., send an email, add to a CRM) without triggering the workflow for every subsequent job from the same company. * Example: If active, Company A with 5 jobs → 1 event triggered. If deactivated, Company A with 5 jobs → 5 events triggered. * If you turn this on for an existing webhook, it will prevent duplicate companies from triggering events going forward. However, companies already sent before enabling the setting won't be remembered, so their jobs may still trigger events. ![Trigger once per company](./trigger-once-per-company.png) * 🆕 **Webhook usage analytics**: Track individual webhook performance and credit consumption with a detailed breakdown chart. View which webhooks are using the most credits on the [usage page](https://app.theirstack.com/settings/usage). ![Webhook events chart](./webhook-events-chart.png) * 🆕 **Search experience has been improved**: * Cleaned up the header of the search page for jobs and companies. Now the search name is only displayed in the breadcrumb. * New Webhooks button to view the webhooks associated with the current search. It indicates whether the search has an active webhook or not. ## April 4, 2025 * 🆕 **Subscription update process enhancements**: * Fixed issue where subscription updates created new subscriptions instead of modifying existing ones. * Added ability to customize credit allocation when updating your subscription plan. You can select any number of credits you want to be added to your account. ## April 2, 2025 * 🐞 **Resolved two issues affecting app users in [company search](https://app.theirstack.com/search/companies)**: * When filtering by technology category (e.g. "CRM Platforms") not showing a column per technology (e.g. "Salesforce", "Hubspot", "Zoho"...). * When exporting a list of companies filtering by technology category, there was not a column for each technology of the category. * When changing the technology filter, the table was filtering by the new technology, but a column was still showing the old technology. ## April 1, 2025 * 🆕 **Auto recharge**: You can now set when to automatically purchase credits when your balance is low in the [billing page](https://app.theirstack.com/settings/billing). ## March 17, 2025 * 🆕 **Webhooks API is publicly available**: You can now use the webhooks API to integrate this feature in your own system or to automate webhook creations. Check out the [webhooks docs](https://api.theirstack.com/#tag/webhooks) for more information. ## March 14, 2025 * 🆕 **Roles and permissions**: We've added roles and permissions to the team. Admins can now add and remove members and receive billing alerts. * 🆕 **Export limit increased**: You can export CSV files with more than 100,000 records. ## March 12, 2025 * 🆕 *New version of the dataset endpoint* [v1/datasets/technographics](https://api.theirstack.com/#tag/datasets/POST/v1/datasets/technographics) offering technographic dataset in parquet format. * 🆕 *Improvement of the Requests section in the [Usage page](https://app.theirstack.com/usage)*: You can now see UI requests not only API Requests. * 🆕 *New button to open a search from the API request*. You can now open a search from the API request modal by clicking on the "Open search" button. ## March 11, 2025 * 📚 New [webhooks docs](/docs/webhooks) * 📚 Improved [Clay docs](/docs/clay) * 📚 Enhanced [Backfilling job board](/docs/backfill-job-board) post ## March 10, 2025 * 🆕 **Webhooks Observability**: You can now view the response body and status code for each webhook. Additionally, you can filter events by their status (success or failure) and determine if a failure was due to a timeout. * 🆕 **Webhooks Retry Mechanism**: Failed webhooks are now automatically retried every hour for up to 48 hours. * 🆕 **New v2.0.0 for the Technographics dataset**. Includes new columns, and renames some existing ones for consistency. Now includes columns for the 3 current sources of technographics data we have: * Job titles * Job descriptions * Job URLs Here are the columns which name has changed or have been added. The following columns are renamed: * `technology_id` → `keyword_id` * `technology_rank` → `technology_rank_source_jobs` * `technology_rank_180_days` → `technology_rank_180_days_source_jobs` * `rank_1_tie` → `rank_1_tie_source_jobs` * `rank_180_days_tie` → `rank_180_days_tie_source_jobs` * `relative_occurrence_within_category` → `relative_occurrence_within_category_source_jobs` * `jobs_source_final_url` → `jobs_source_url` * `first_date_found_source_final_url` → `first_date_found_source_job_url` * `last_date_found_source_final_url` → `last_date_found_source_job_url` The following columns are added: * `keyword_slug` - Slug identifier for the technology * `subcategory_slug` - Slug identifier for the technology subcategory * `is_recruiting_agency` - Indicates if the company is a recruiting agency * `jobs_source_description_last_180_days` - Number of jobs mentioning this technology in the job description in the last 180 days * `jobs_source_description_last_30_days` - Number of jobs mentioning this technology in the job description in the last 30 days * `jobs_source_description_last_7_days` - Number of jobs mentioning this technology in the job description in the last 7 days * `jobs_source_title` - Number of jobs mentioning this technology in the job title * `jobs_source_title_last_180_days` - Number of jobs mentioning this technology in the job title in the last 180 days * `jobs_source_title_last_30_days` - Number of jobs mentioning this technology in the job title in the last 30 days * `jobs_source_title_last_7_days` - Number of jobs mentioning this technology in the job title in the last 7 days * `jobs_source_url_last_180_days` - Number of jobs mentioning this technology in the ATS URL in the last 180 days * `jobs_source_url_last_30_days` - Number of jobs mentioning this technology in the ATS URL in the last 30 days * `jobs_source_url_last_7_days` - Number of jobs mentioning this technology in the ATS URL in the last 7 days * `first_date_found_source_job_title` - Date when the job title first mentioned the technology * `last_date_found_source_job_title` - Date when the job title last mentioned the technology * `rank_last_date_found_source_job_url` - Rank of the technology within its category based on mentions in job ATS URLs as of the last date found * `relative_occurrence_within_category_180_days_source_jobs` - Measures the relative occurrence of this technology among other technologies in the same category, in jobs by this company over the last 180 days ## March 3, 2025 * 🆕 **Improvements on Dataset page**: You can now download the dictionary of the dataset with all the information about the fields, see the size of the dataset and the number of rows it contains. ## February 26, 2025 * 🆕 **Enhanced ATS URL exists filter**: We've enhanced the ATS URL exists filter to exclude jobs with URLs from 70 major job boards, such as ziprecruiter.com and thehub.io. ## February 25, 2025 * 🆕 **New UI redesign enhancing developer experience**: Managing webhooks, datasets, API keys and reviewing your consumption is now easier than ever. ## February 24, 2025 * 🆕 **Job searches are now \~4x faster** ⚡️ Performance improvements: * **Average response time**: 6.9s → 1.7s (⬇️ 75%) * **90th percentile response time**: 12.2s → 3s (⬇️ 75%) * **95th percentile response time**: 36.7s → 4.9s (⬇️ 87%) * **99th percentile response time**: 120s → 11s (⬇️ 91%) ## February 18, 2025 * 🆕 **New [datasets page](https://app.theirstack.com/datasets)**. You can now view all available datasets, and download a sample for each one. * 🆕 **Track company credits consumption**. You can now track the company credits consumption from the [usage page](https://app.theirstack.com/settings/usage). ## February 17, 2025 * 🆕 **New [invoices page](https://app.theirstack.com/settings/invoices)**. You can now view all your invoices, see the consumption for each invoice, and download them in PDF format. * 🆕 **Webhook executions chart on the [usage page](https://app.theirstack.com/settings/usage)**. You can now monitor the total number of webhook executions across all your webhooks. * 🆕 **Billing consumption alerts**. You will now get an email notification when your billing consumption exceeds 70% or reaches 100%. ## February 12, 2025 * 🆕 **Refresh your API key**. You can now refresh your API key through the [settings page](https://app.theirstack.com/settings/api-key). This is useful if you want to rotate your API key for security reasons. * 🆕 **Remove members from your organization**. You can now remove members from your organization through the [settings page](https://app.theirstack.com/settings/organization). * 🆕 **API Request Observability**. You can now see the status (200 OK, 402 Payment Required, 508 Request Timeout...) of your API request through the [requests page](https://app.theirstack.com/api). ## February 6, 2025 * 🆕 **Webhook Observability**. You can now view a chart displaying the number of webhooks sent and a table detailing each webhook event. ## January 27, 2025 * 🆕 **Webhooks**. You can now subscribe to webhooks to get notified when new jobs are posted. Trigger actions in Make.com, Zapier, Clay or any other tool that supports webhooks when new jobs are posted. ## January 20, 2025 * 🆕 **Export data to Clay.com**. You can now export your list of jobs or companies to Clay through our Webhooks integration. Click on the "Export" button in the top right corner of the table and select Webhooks, paste the Webhook URL provided by Clay, and click on "Export". In a few seconds, you will see the data in your Clay table. ## January 14, 2025 * 🆕 **New filter `job_seniority_or` in our [Jobs API](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search)**. This filter allows you to search for jobs by seniority level. * 🆕 **Shortened URL detection for new jobs and companies**. Our system now identifies shortened URLs (e.g., `bit.ly`, `tinyurl`, etc.) for newly discovered jobs and companies. Instead of storing the shortened URL in our database, we now retrieve and save the original URL. * 🐞 **Fixed an issue causing duplicate job postings**. A job is considered a duplicate if the same company posts the same job title within a 30-day window. Previously, the system identified duplicates by checking job postings from the past 30 days, instead of 30 days before and after the posting date. As a result, jobs posted more than 30 days ago were not flagged as duplicates when found again by our system. * 🐞 **Fixed Make.com button**. The Make.com button, which lets you copy a Make scenario that calls our API, was not authenticating correctly. ## January 10, 2025 * 🆕 **New field and filter `easy_apply` in our [Jobs API](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search)**. This field indicates whether the job application can be submitted directly through the job board (`easy_apply=True`) or requires redirecting to the company's website (`easy_apply=False`). Initially, this field will be populated for new jobs sourced from LinkedIn and Indeed. --- title: Users and Teams description: Learn about users and teams in TheirStack. url: https://theirstack.com/en/docs/teams --- ## What is a team? A team is a group of users who share the same workspace. They will share the same billing plans, saved searches, company lists, and more. We don't charge for the number of users in a team. You can invite as many users as you want. ## Team roles and permissions There are 2 roles in a team: * **Member**: Can do everything except what admins can do. * **Owner**: * Can add and remove team members. * Can change other members' roles. * Receives consumption alerts. Eg: when 75% of the credits are used. ## Faqs ### How do I add a team member? To add a team member: 1. Go to the [team page](https://app.theirstack.com/settings/team). 2. Click on the "Invite member" button. 3. Enter the email address of the person you want to add. 4. Click on the "Invite" button. Your new member will receive an email to join the team. --- title: Webhooks description: Learn how to use webhooks to get notified when events occur (new jobs, tech changes, etc) in TheirStack and trigger actions in your external systems like N8N, Zapier, Make, Airtable, etc url: https://theirstack.com/en/docs/webhooks --- ![Webhooks details page](./webhook-details-page.png) ## What are webhooks? Webhooks allow you to send data when specific events occur (new jobs, tech changes, etc) to external systems like N8N, Zapier, Make, Airtable, your own webhook endpoint, etc. For instance, you can configure a webhook to alert you when a new job is listed in a particular location, company, or technology sector. Webhooks are dependent on a search, which defines the criteria for triggering the webhook. Any type of searches (job, company, technology, etc) can be used to trigger a webhook. ### Webhooks Applications * Initiate a workflow in an automation tool like Zapier, Make, N8N when a new job is posted or a company adopts a new technology (e.g., Snowflake, Hubspot, Python). * Send a Slack notification to your team when a new job is found or a company adopts a new technology (e.g., Snowflake, Hubspot, Python). * Automatically update a Google Sheet with new job or company data. * Trigger an email alert to a specific distribution list when a new job matches certain criteria. * Create a table in Airtable to store job listings. * Integrate with a CRM system to add new company information as leads. ### Webhook types There are three types of webhooks: * **`job.new`**: Triggered when a new job is discovered by TheirsStack matching the search criteria. * **`company.new`**: Triggered when a new company is discovered by TheirsStack matching the search criteria. * **`tech.new`**: Triggered when company adopts a new technology (request access to this) ## Pricing Webhooks and API requests share the same pricing. When an event is triggered, it consumes 1 (`job.new`) or 3 (`company.new`, `tech.new`) API credits based on the type of event. Learn more about our credit system [here](/en/docs/pricing-and-billing/credits). ## How to set up a webhook Follow these steps to set up a webhook: **Open a new job or company search with the criteria you are interested in.**
**Click on the "Save" button to save the search.** The search has to be saved to be used in the webhook. **Click on the "Webhooks" button on the top right corner.** ![Saved search](./webhook-saved-search.png) **Click on the "Create Webhook" button.** **Fill the form** ![New webhook modal](./new-webhook-modal.png) * **`Saved search`**: This search's filters determine which records will trigger the webhook. * **`Trigger once per company`**: When enabled, the webhook will fire only once for each company. This is helpful for sales workflows where you want to act on the first job posted (e.g., send an email, add to a CRM) without triggering the workflow for every subsequent job from the same company. Eg: If active, Company A with 5 jobs → 1 event triggered. If deactivated, Company A with 5 jobs → 5 events triggered. * **`Choose where to start`**: You can choose whether to start listening from this point forward or from the start of the search. If you choose to start from the start of the search, you will receive all events that have occurred since the search was created. * **`Webhook URL`**: The URL of the webhook endpoint you want to send the data to. You can click on "Send test event" to send a sample of the data to your webhook URL and verify that it is working. **Wait for new events to be triggered** ![Webhook details page](./webhook-details-page-no-events.png) * If you choose to start from the start of the search, you will receive all events that have occurred since the search was created in a few seconds. If you choose to start from the current date, you will receive events in real time. * You can click on the button "Send test event" to send a sample of the data to your webhook URL and verify that it is working. ## How to monitor webhook usage You can monitor webhook usage in the [Usage page](https://theirsstack.com/usage). You can break down the usage by event status or webhook. ![Webhook usage](./webhook-usage.png) ## Webhooks API You can manage programmatically your webhooks by using the [Webhooks API](https://api.theirstack.com/#tag/webhooks). This is specially useful if you want to integrate webhooks with your own application. ## Your own webhook endpoint If you are builing your own webhook endpoint, please take into account the following: * Return a 200 status code to indicate that the webhook event was received and processed successfully. Failed webhook events are retried every hour for 48 hours. * Your webhook endpoint has to be prepared to handle at least 2 concurrent requests. * Your webhook endpoint has to be prepared to handle duplicates. Our system is designed to not send the same job twice to your webhook URL. However, this could happen in some edge cases (e.g: you listen to two searches with not exclusive jobs). You can use the `id` field to deduplicate jobs. * When a webhook sends data, it uses an HTTP POST request, with a JSON payload. ## Faqs ## What happens to webhook events when I run out of API credits? When you run out of API credits, webhook event monitoring is temporarily paused. During this period, no new events will appear in your webhook history. Monitoring automatically resumes once you purchase additional API credits. Whether you miss events during the pause depends on your search criteria. For example, if your webhook tracks jobs posted within the last 60 days and you lack credits for 2 days, you won't miss anything - when credits are restored, all jobs discovered during the pause will still trigger your webhook as they match your search parameters. ## What happens if the webhook event fails? If the webhook event fails, it will be automatically retried every hour for 48 hours. ## How much cost to run a webhook? Webhook events are billed at the same rate as API requests. They consume 1 API credit per event. --- title: What is TheirStack description: url: https://theirstack.com/en/docs/what-is-theirstack --- TheirStack is the largest job posting and technographics database. We continuously gather job listings from a variety of job boards, ATSs, and company websites. Our goal isn't to assist individuals in finding jobs or companies in recruiting talent. Instead, we view job postings as a gold mine of information. When a company posts a job, it signals a need to address a problem or seize an opportunity. Job postings reveal the technologies they use, the tasks they need help with, their working methods, and organizational structure - offering the perfect timing to reach out to your lead. We transform job postings into buying intent signals, helping sales and marketing teams make informed decisions for higher ROI. * **Hiring Signals:** Discover companies that are hiring for specific positions. * **Technographic Signals:** Discover companies by the technology they use. * **Painpoint Signals:** Discover companies that have have a specific painpoint: digitalize invoices, automate onboarding, backup data, etc. ## You can consume our data through } href="/en/docs/app" title="App"> Effortlessly explore, search, and analyze our data with an intuitive, user-friendly interface—no coding required. } href="https://api.theirstack.com" title="API"> Instantly integrate our data into your own applications, workflows, or dashboards with flexible, high-performance endpoints. } href="/en/docs/webhooks" title="Wehbooks"> Receive real-time notifications when events occur (eg: new job postings, tech changes, etc.) and trigger actions in your external tools like N8N, Zapier, etc. } href="/en/docs/datasets" title="Dataset"> Access the complete, raw dataset for maximum flexibility—ideal for advanced analytics, machine learning, or custom research. ## Learn more about our data } href="/en/docs/data/job" title="Job data"> Get access to millions of job listings aggregated from multiple global sources, including major job boards like Indeed, Linkedin, Workable, Greenhouse, Lever, Infojobs, Otta, StartupJobs... offering a complete view of the job market across 195 countries. } href="/en/docs/data/technographic" title="Technographic data"> We infer technology usage from millions of jobs worldwide. Our catalog of more than 21,000 technologies and 5M companies is the largest in the world. ## Start for free * [Sign up and get 50 free company credits and 200 free API credits](https://app.theirstack.com/signup) * [Get your API key](https://app.theirstack.com/settings/api-key) --- title: Free count description: Learn how to get the count of records that match your search criteria without consuming API credits. url: https://theirstack.com/en/docs/api/free-count --- Our [Job Search](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search) and [Company Search](https://api.theirstack.com/#tag/companies/POST/v1/companies/search) endpoints include a free count feature that allows you to estimate the number of records that match your search criteria without consuming API credits. ## Steps to use free count To effectively use the Free Count feature, follow these steps: 1. Enable Total Results: Set the `include_total_results` field to `true`. This will ensure that the total number of matching records is included in the response. 2. Blur Company Data: Set the `blur_company_data` field to `true`. This step is necessary to maintain data privacy while using the free count. 3. Limit Results: Set the `limit` field to `1`. This minimizes the data returned and makes the request faster, focusing solely on the count. By following these steps, you can efficiently estimate the number of records that match your search criteria without consuming any API credits. --- title: Preview data mode description: Learn how to preview TheirStack data without consuming API credits. url: https://theirstack.com/en/docs/api/preview-data-mode --- Our [Job Search](https://api.theirstack.com/#tag/jobs/POST/v1/jobs/search) and [Company Search](https://api.theirstack.com/#tag/companies/POST/v1/companies/search) endpoints include a preview mode that return the same data but some fields are blurred. This mode is useful for [sales sofware](/en/docs/guides/sales-software-integration-guide) building products with TheirStack data. It allows you to show a preview of the data to your end users without consuming credits. It's the same we use in our own [app](https://app.theirstack.com). ## How to use preview mode To use preview mode, you need to set the `blur_company_data` field to `true` in the request body. ## Company search preview When doing a company search with preview mode, the response will return all fields but the `company_name`, `company_domain`, `company_linkedin_url` fields will be blurred. ![Preview data mode](./blur-company-search.png) ## Job search preview When doing a job search with preview mode, the response will return all fields but the `job_description`, `job_url`, `company_name`, `company_domain`, `company_linkedin_url` fields will be blurred. ![Preview data mode](./blur-job-search.png) --- title: Company lookup description: Easily search for any company name or website on TheirStack. View their technologies and job listings with a simple click. url: https://theirstack.com/en/docs/app/company-lookup --- There is a search box in the header of TheirStack where you can look for any company or its domain.