Basic Settings
Proxies
All requests that a digger makes are done through a network of proxy servers. By default we provide you with our network of proxy servers for free use. Free users can use only TOR based proxy network, while users with paid accounts can use our premium proxy network pools.
Users using a paid subscription can take advantage of geographic targeting by country and (or) city. In this case, when starting the digger, only proxies from the specified country or city are selected. If geotargeting is not used, or user is on the free plan, then all proxies from our pool from all countries of the world are selected. Paid users also have access to the residential pool of proxies.
You can use geo parameter to set the geo-zone. You can specify single or multiple countries (separated by comma) and/or cities. You can also specify NOT city/county if you set name with preceding ! character:
# SELECT ONLY USA PROXIES
- config:
geo:
country: US
# SELECT PROXIES ONLY US AND CANADA PROXIES
- config:
geo:
country: 'US,CA'
# SELECT PROXIES FROM ALL COUNTRIES BUT US
- config:
geo:
country: '!US'
# SELECT PROXIES ONLY FROM CHICAGO
- config:
geo:
city: Chicago
# SELECT PROXIES ONLY FROM CHICAGO AND MIAMI
- config:
geo:
city: "Chicago,Miami"
# SELECT PROXIES FROM US, ANY CITY BUT HONOLULU
- config:
geo:
country: US
city: "!Honolulu"
# SELECT PROXIES ONLY FROM MOSCOW, USA
- config:
geo:
country: US
city: Moscow
Note that if no proxy is found for the specified geo-zone, the execution will fail. Currently, the following cities and countries are supported:
Country | Cities |
---|---|
US | Anchorage, Atlanta, Chicago, Dallas, Denver, Des Moines, Honolulu, Los Angeles, Miami, New York City, Omaha, Phoenix, Salem, San Jose, Seattle |
Also, there may be situations when you need to use your own proxy server or a list of proxy servers with rotation inside the digger. To install your proxy server or list of proxy servers, you can use the proxy parameter. Also this parameter can be used to select type of proxy pool you want to use:
# SETTING UP YOUR OWN PROXY SERVER FOR REQUESTS
- config:
proxy: 1.1.1.1:8080
# SETTING UP YOUR OWN SOCKS5 PROXY
- config:
proxy: SOCKS5://1.1.1.1:8085
# SETTING UP YOUR OWN PROXY SERVER WITH BASIC AUTH
- config:
proxy: username:password@1.1.1.1:8080
# SETTING UP LIST OF PROXIES
- config:
proxy:
- 1.1.1.1:8080
- 1.1.1.2:8080
# SELECT PROXY POOL BY TYPE
# Select TOR proxy pool
- config:
proxy:
type: tor
# Select datacenter proxy pool (only for paid subscribers)
- config:
proxy:
type: datacenter
# Select residential proxy pool (only for paid subscribers)
- config:
proxy:
type: residential
# Select IPV6 proxy pool (only for paid subscribers)
- config:
proxy:
type: ipv6
As you can see, your proxies should be written in the IPADDRESS: PORT notation. We do not provide IP addresses of our servers, so if your proxies require authorization, make sure that you can use login and password for authorization, not IP address. You can use HTTP, SOCKS4 or SOCKS5 proxy. For socks proxies you need to specify protocol explicitly, as shown in the example above.
We also integrate with various services for the automated provision of proxy servers. At the moment you can easily use the Luminati service within your diggers, if you have an account in their service. In this case, you should use the proxy parameter as follows:
# USING LUMINATI SERVICE AS PROXY-PROVIDER
- config:
proxy:
provider: luminati
username: your_luminati_login
password: your_luminati_password
zone: geo_zone_you_want_to_use