API Examples

How can Intoli's APIs help your business? Here we've selected a few example endpoints and the data they return to illustrate what you can achieve using Intoli.

Get Help from Our Data Experts

Looking to implement your own data solution? Our experts are here to help you source and process data from around the web and meet your specific needs. Whether for lead-generation, competitor research, or powering your core product, we have a solution that's right for you.

Get Started Now
The Problem
A company wishes to find mentions of their name online, as well as mentions of their competitor’s names and products.
The Solution
Intoli scrapes popular social portals such as Quora, Glassdoor, and Hacker News comments for mentions of the company, with custom fields extracted from each source, and aggregates the results.
API Call

A GET request to

might produce a response as follows.

Response Data
[
  {
    "site": "https://www.glassdoor.com",
    "post_title": "Fast-Paced company with lots of room for growth!",
    "rating": "5/5",
    "current_employee": true,
    "position": "Assistant Community Manager",
    "employment_status": "full-time",
    "employment_length": "less than a year",
    "user_location": "Los Angeles, CA",
    "recommend": true,
    "outlook": "Neutral",
    "ceo_approval": true,
    "post_time": "2017-05-15",
    "pros": "Lots of smart people on your team who you can learn from. Exposure and
             networking opportunities to a lot of different people and companies",
    "cons": "Pay isn't great and getting promoted takes time",
    "advice_to_management": "",
    "helpful": 1
  },
  {
    "site": "https://www.glassdoor.com",
    "post_title": "Community Associate",
    "rating": "4/5",
    "current_employee": true,
    "position": "Assistant Community Manager",
    "employment_status": "full-time",
    "employment_length": "more than a year",
    "user_location": "San Francisco, CA",
    "recommend": true,
    "outlook": "Positive",
    "ceo_approval": true,
    "post_time": "2017-05-15",
    "pros": "Great team culture, the people here are passionate about what
             they do and it shows. This company is growing and with that
             comes a ton of opportunity to grow with them. Leadership is
             passionate about developing their teams, they work closely with
             you to help you reach your goals. Lots of fun team activities and events!",
    "cons": "Some longer work days but these are usually do to events happening
             outside of standard work hours and are actually fun to attend. There
             is a lot of work to be done so this is not the job for you if you
             want to put in the bare minimum and clock in and clock out. However,
             if you want to be in a challenging and rewarding environment this
             probably won't bother you at all.",
    "advice_to_management": "",
    "helpful": 3
  },
  {
    "site": "https://www.quora.com",
    "type": "question",
    "post_url": "https://www.quora.com/How-much-does-it-cost-to-outfit-the-average-WeWork-with-its-particular-furniture-design",
    "post_title": "How much does it cost to outfit the average WeWork with its particular furniture/design?",
    "post_content": "If you’ve been to WeWork’s co-working/shared office spaces, you
                     may know their specific style. Assume the space is about 20,000 sq.ft.
                     Just a ballpark number of the cost for all the design/furniture aspects
                     that go into a space is what I’m looking for.",
    "post_time": "2017-03-30",
    "answers": 2,
    "tags": [
      "Office Design",
      "WeWork",
      "Furniture Design"
    ]
  },
  {
    "site": "https://news.ycombinator.com",
    "post_title": "CEOs Want Their Offices Back",
    "post_url": "https://news.ycombinator.com/item?id=14393588",
    "comment_url": "https://news.ycombinator.com/item?id=14394918",
    "user_url": "https://news.ycombinator.com/user?id=busterarm",
    "user_name": "busterarm",
    "post_time": "2017-05-22",
    "comment": "Personally, I hated my experience in the glass-door offices of
                WeWork. The cheaper communal areas they had were vastly more
                productive and everyone was was respectful of it being a public
                space for everyone to work (for the most part).\n
                The actual offices on the other hand, had almost no sound
                deadening between them, the hallways way too narrow and it
                was all-party, all-the-time. People from other companies
                getting absolutely smashed on keg beer starting at noon was
                a daily problem. At the one building I went to that had entire
                floors of conference rooms, you could hear everything from 3
                 conference rooms over, making phone calls impossible."
  },
  {
    "site": "https://news.ycombinator.com",
    "post_title": "CEOs Want Their Offices Back",
    "post_url": "https://news.ycombinator.com/item?id=14393588",
    "comment_url": "https://news.ycombinator.com/item?id=14394725",
    "user_url": "https://news.ycombinator.com/user?id=bshudi",
    "user_name": "bshudi",
    "post_time": "2017-05-22",
    "comment": "I am also at a WeWork location, but I find that the noise
                outside of our room is hardly noticed. That being said, I
                agree about the clear glass, I wish more of the glass was
                frosted."
  },
  {
    "site": "https://www.quora.com",
    "type": "answer",
    "post_url": "https://www.quora.com/Do-you-think-co-working-spaces-will-flourish",
    "post_question": "Do you think co-working spaces will flourish?",
    "post_content": "Yes, absolutely, and for pretty clear reasons. I have worked
                     at co-working spaces in Manhattan, Brooklyn, San Francisco,
                     Los Angeles and Portland (Maine). They serve a really valuable
                     purpose in an economy characterized by increasing entrepreneurship:\n\n

                     - very low rent with month-to-month terms, which decreases risk and
                     startup costs for a lot of companies\n- access to other entrepreneurs\n
                     - access (in many companies) to free outside services like lawyers,
                     PR/Comms people, marketing firms, etc\n
                     - programming: members can attend pitch contests, happy hours, meet ups,
                     etc.\n
                     They are growing like crazy not just in NYC and Silicon Valley and LA
                     but also here in Portland, Maine, which just saw one space (Think Tank)
                     expand and another new one (Cloudport) open a few months ago.\n
                     There are **tons** of entrepreneurs and small businesses in America
                     today that have been working for years at home, in garages, or in
                     coffee shops. Now that they have a low-cost, social option, many of them
                     are emerging from those spaces and paying affordable rents to be with
                     others. This makes sense and will continue.",
    "post_time": "2017-01-17",
    "user_name": "Adam Nyhan",
    "user_url": "https://www.quora.com/profile/Adam-Nyhan",
    "user_description": "Business attorney at Opticliff Law",
    "views": 204,
    "upvotes": 4
  },
  ...
]
The Problem
A political organization wishes to monitor the news for all instances of a particular issue they are concerned about. Monitoring articles manually for keywords of interest is not feasible, due to the sheer volume of new posts every day.
The Solution
Intoli continuously scrapes all the major news sites, and provides a WebHook that triggers when a specified keyword is detected.
API Call to Activate WebHook

A POST request to

with the following additional data

{
  "return": "http://<client domain>.com/webhook/",
  "key": "secret",
  "exclude": ["cnn.com"],
  "keywords": ["paris climate deal", "climate change", "global warming"],
  "duration": "7d"
}

starts a WebHook that pushes responses to http://<client domain>.com/webhook/ for 7 days.

Webhook POST Data
[
  {
    "url": "https://www.washingtonpost.com/news/energy-environment/wp/2017/05/31/trump-nearing-a-decision-on-whether-to-pull-u-s-from-paris-climate-deal-breaking-ranks-with-more-than-190-countries/",
    "title": "Trump nearing a decision on whether to pull U.S. from Paris
              climate deal, breaking ranks with more than 190 countries",
    "author": ["Chris Mooney", "Brady Dennis"],
    "datetime": "May 31, 2017 at 4:00 PM",
    "content": "President Trump is nearing a final decision on whether
                to withdraw from the Paris climate agreement, with one
                White House official saying Wednesday that the president
                is leaning toward an exit but three others cautioning
                that he has not reached a verdict.\n\n

                The matter has deeply divided the administration for months.
                Ivanka Trump and Secretary of State Rex Tillerson have urged
                the president to remain in the deal, and White House strategist
                Stephen K. Bannon and Environmental Protection Agency Administrator
                Scott Pruitt have been pushing for a withdrawal.\n\n

                ...",
    "updated": false
  },
  {
    "url": "http://www.latimes.com/politics/essential/la-pol-ca-essential-politics-updates-gov-jerry-brown-and-democrats-say-1496261754-htmlstory.html"
    "title": "Gov. Jerry Brown and Democrats say Trump is going
             'backwards' if he pulls out of Paris climate pact",
    "author": "John Myers",
    "datetime": "May 31, 2017 at 3:18 PM",
    "content": "Gov. Jerry Brown warned Wednesday that a decision by President
                Trump to withdraw the United States from a 2015 global climate
                change agreement could be \"tragic,\" and vowed to keep California's
                ambitious efforts in place and on track.\n\n

                \"Here we are, in 2017, going backwards,\" Brown said in an interview
                with the Los Angeles Times. \"It cannot stand, it's not right and California
                will do everything it can to not only stay the course, but to build more
                support — in other states, in other provinces, in other countries.\"
                ...",
  "updated": false
  }
  ...
]
The Problem
A web development consultancy wishes to have a list of companies using the technologies they specialize in, and doing this on a site-by-site basis is taking too much effort.
The Solution
Intoli performs a broad crawl of millions of web pages, identifying the technologies used via loaded resources on the page.
Delivered Data
[
  {
    "homepage": "https://www.platohq.com/",
    "domain": "platohq.com",
    "technologies": ["Cowboy", "Google Analytics", "Modernizr", "Snap.svg",
                     "Twitter Boostrap", "jQuery 3.2.1", "Erlang", "Intercom"]
  },
  {
    "homepage": "https://www.dripcapital.com/",
    "domain": "dripcapital.com",
    "technologies": ["Google Analytics", "Google Font API", "Nginx 1.10.2", "Twitter Bootstrap",
                     "Intercom", "Mixpanel", "jQuery"]
  },
  {
    "homepage": "",
    "domain": "",
    "technologies": ["Express", "Facebook Widget", "Google Analytics", "Nginx 1.4.6",
                     "Ubuntu", "Node.js", "React", "Mixpanel"]
  },
  ...
]