Diggers

PUT diggers/:id/start

The request sends a command to immediately start the digger, waits for the completion of the execution, and returns the scraped data in the JSON format. You can send arguments to the digger in the body of the request. Digger will use passed values as variables. This functionality is called "data on demand". For example, you can send a specific search string to a specific URL, collect the results found and download them in the dataset. Basically this functionality turning any website to an API.

Reference information about the resource:

API Endpoint	https://www.diggernaut.com/api/diggers/:id/start
Request Format	JSON
Response Format	JSON
Access Level	User with paid subscription
Limits	Yes

Request parameters:

variables

Name-value pairs of parameters that will be used as variables [hashmap[string]string].

Example of request with CURL
Response

                    curl -v -X PUT -H "Content-type: application/json" -H "Authorization: Token 9944b09199c62bcf9418ad846dd0e4bbdfc6ee4b" https://www.diggernaut.com/api/diggers/ -d '{"variables":{"section":"CoolRobot","age":"10"}}'

                    HTTP/1.0 200 OK
Date: Fri, 19 Aug 2016 17:36:48 GMT
Server: WSGIServer/0.1 Python/2.7.12
Vary: Accept, Accept-Language, Cookie
X-Frame-Options: SAMEORIGIN
Content-Type: application/json
Content-Language: en
Allow: GET, PUT, PATCH, HEAD, OPTIONS
                    [
    {
        "incident": {
            "call_number": "EP17192020",
            "time": "8:43am",
            "grid": "5100",
            "disposition": "No Info",
            "address": "715 Aspen Dr SECURITY",
            "date": "12/12/2017",
            "problem": "Harassment Cold"
        },
        "_id": {
            "$oid": "5a301427b6f82c2216f0e869"
        }
    },
    {
        "incident": {
            "call_number": "EP17192017",
            "time": "8:39am",
            "grid": "4607",
            "disposition": "No Info",
            "address": "11520 Eureka Rd PEYTON",
            "date": "12/12/2017",
            "problem": "Suspicious Incident"
        },
        "_id": {
            "$oid": "5a301427b6f82c2216f0e86a"
        }
    }
]