Link to home
Start Free TrialLog in
Avatar of aideb
aideb

asked on

Any way to speed up Selenium?

Hi

I am running a Python script on my Virtual Private Server which runs Unbuntu. The script uses Selenium to do some web scraping and interactions. As the server is headless, I use xvfb-run to generate a virtual display.

I am finding that the time to load each page is around 15 seconds. This is much slower than I would ultimately like!

Are there any tips to make this run faster?

Any advice would be much appreciated
ASKER CERTIFIED SOLUTION
Avatar of Craig Kehler
Craig Kehler
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of aideb
aideb

ASKER

Hi Craig,
Thats a cracking idea. I will give it a go!

I did as you suggested and see that there are connections out to

bam.nr-data.net
cdn.optimizely.com
connect.facebook.net
*.cloudfront.net
js-agent.newrelic.com
platform.twitter.com
ssl.google-analytics.com
tracker.marinsm.com
use.typekit.net
www.dwin1.com
www.google-analytics.com
www.googletagmanager.com

I will try on my desktop first

Cheers
I've requested that this question be deleted for the following reason:

Not enough information to confirm an answer.
I'm left wondering if that solution actually worked for him. It did for me when I had a similar issue. He did at least find the idea valuable.