Python script to grab HTTP, HTTPS, SOCKS4 and SOCKS5 proxies fast. Proxied Browsers.

• Grab Http/Https/Socks4/Socks5 proxies
• Specify number of proxies to save
• Filter proxies by country
• Filter proxies by anonymity
• Open proxied Firefox instances for proxies in file list
• Open proxied Firefox instances after grabbing proxy list
• Check against URL and remove dead proxies automatically (optional)
• Specify time to keep proxied browsers active
• Specify custom url for proxy browsers
• Specify maximum proxy browsers to open
• Browsers in normal or headless mode
• Youtube mode - Auto click video player on load
• Multiple, Single instance or Multi-Pool proxied browser threads
• FreshProxies auto-update check

• Add thread modes for proxy browsers
• More descriptive errors
• Automatic updater update

You need the following python packages installed: argparse, selenium, requests, ptable

You can install all by:

python3 -m pip install -r requirements.txt

pip3 install -r requirements.txt

or

python3-pip install -r requirements.txt

You will need Firefox installed on the system. Gecko driver executable file is provieded for Windows users. Linux users can enjoy without any executables, as long as Firefox is installed.

• Add argument configurations to core folder
• Custom help menu
• Allow single and pool of browser to run at a time
• Add support for other proxy sites
• Automatic logging
• Auto updater update
• Auto backup and update proxy list
• Convert script log to PDF format

Note: For some weird reason, proxy browser after grab is making the proxy servers refuse connections :< But regular command without grab works fine..

Grabbing Proxies

Can be accessed using '-h' or '--help'

 --------------- ---------------- --------------------------------------------------------- 
| Argument Less | Argument Full  |                       Description                       |
 --------------- ---------------- --------------------------------------------------------- 
|       -t      |     --type     |     Enter Proxy Type [HTTP/HTTPS/SOCKS4/SOCKS5/ALL]     |
|       -a      |  --anonymity   |    Enter Anonymity Type [transparent/anonymous/elite]   |
|       -c      |   --country    |         Enter Country ISO Code [US/RU/IN etc..]         |
|       -f      |   --filename   |             Enter Filename [EX: proxies.txt]            |
|       -l      |    --limit     |                Enter max proxies to save                |
|    -nocheck   |   --nocheck    |               Donot check for dead proxies              |
|      -pb      | --proxybrowser |                Opens browser for proxies                |
|      -pu      |   --proxyurl   |         Enter your custom url for proxy browser         |
|      -ts      |   --timesec    |           Time seconds to keep browsers alive           |
|      -mb      | --maxbrowsers  |            Maximum number of browsers to open           |
|      -bm      | --browsermode  |          "normal" or "headless" browser window          |
|      -tm      |  --threadmode  |            "multi" or "single" or "multipool"           |
|      -pn      |  --poolnumber  | Enter a number of browsers to pool for multipool option |
|      -ytv     |   --ytvideo    |          Play YouTube video (for view botting)          |
 --------------- ---------------- --------------------------------------------------------- 

The following command will perform these actions:

• start 5 proxied browsers, with your url for 240 seconds

• start proxies browser in headless mode (specifically). Default is normal mode

python fp.py -pb -pu "https://your_website.com/" -ts 240 -mb 5 -bm headless

The following command will perform these actions:

• grab HTTP proxies

• Do not check for dead proxies: optimal, faster

• Save only 50 proxies to file (limit)

• Save into custom filename (default name = proxies.txt)

python fp.py -t http -l 50 --filename your_filename_without_spaces.txt -nocheck

There are 3 modes available for proxy browser threading.

multi mode is the default mode and starts all the browser threads together. This mode fine for systems with really good specs and when less browsers are opened.

multipool mode is my favorite mode. It divides the threads into pool of threads safely. This allows us to run a a lot of proxied browsers without having to worry about hardware specs. Makes botting efficient for low spec systems.

single mode runs one browser thread at a time. This is for potatoe systems with very low specs or ones that don't want multiple threads running together. This is safer because it only starts new thread once the previous browser thread exits.

No need for extra command because this is default. But anyway:

python fp.py -pb -pu https://yourwebsite.com/ -mb 300 -tm multi -ts 120

Following command will do this:

• Safely divide 300 proxy browser threads into pools of 10 browser threads
• Time to keep each thread open after site load will be 120 seconds

python fp.py -pb -pu https://yourwebsite.com/ -mb 300 -tm multipool -pn 10 -ts 120

This mode is great xD

• Will open one browser at a time. Next browser will open only when the previous thread exits

python fp.py -pb -pu https://yourwebsite.com/ -mb 300 -tm single -ts 120

The following command will perform these actions:

• grab HTTP proxies

• Do not check for dead proxies: optimal, faster

• Save only 50 proxies to file (limit)

• start 5 proxied browsers, with your url for 240 seconds

• start proxies browser in normal mode (specifically). Default is normal mode

python fp.py -t http -l 50 -nocheck -pb -pu https://www.yoursite.com/ -ts 240 -mb 5 -bm normal

More arguments can be found using --help menu

• Thread safety is a really annoying issue in every program that uses multithreading library in python. Currently there is no way to ensure complete thread safety in selenium webdriver with multithreading as explained here: https://stackoverflow.com/questions/55198005/multithreading-with-selenium-using-python-and-telpot/55201772#55201772 . I have posted stackoverflow question regarding the same here: https://stackoverflow.com/questions/57491249/selenium-mutithread-deamons-exit-but-still-run-geckodriver?noredirect=1#comment101464297_57491249

Unfortunately this cannot be fixed because there is no good fix for this, other than using locks, which I tried and to no real improvement. Other option is to use full process for each browser session with multiprocessing instead of thread. Will look into Asyncio as well.

MIT License

Copyright (c) 2019 prohack.tech

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

Please post an issue here: https://github.com/ProHackTech/FreshProxies/issues with appropriate label (optional). You can post feature requests, bugs, performance issues, feedbacks, ask help, your improvements, documentation help or improvements etc.