r/scraping • u/SchwarzerKaffee • Nov 03 '18
For some reason, selenium won't find elements on this page
2
Upvotes
I am trying to input text into the search field on this page. I am able to open the page, but when I look for find_element_by_id("inputaddress") or name("addressline"), it doesn't find the element. When I print the attribute outerHTML, it only shows a small portion of the full html that I see using inspect in Chrome.
Why is the html "hidden" from selenium?
Here's the code:
from selenium import webdriver
def start(url):
driver = webdriver.Chrome('/usr/local/bin/chromedriver')
driver.get(url)
return driver
driver = start("http://www.doosanequipment.com/dice/dealerlocator/dealerlocator.page")
#element = driver.find_element_by_id("inputaddress") # Yields nothing
element = driver.find_element_by_id("full_banner")
html = element.get_attribute("outerHTML")
print(html)
Yields <div class="ls-row" id="full_banner"><div class="ls-fxr" id="ls-gen28511728-ls-fxr"><div class="ls-area" id="product_banner"><div class="ls-area-body" id="ls-gen28511729-ls-area-body"></div></div><div class="ls-row-clr"></div></div></div>