I am using Node and Puppeteer to scrape some information from webpage I am having issues with selecting the right elements. This describes the exact situation. I want to select only the ‘Hello’ text which is always in the first child. The only difference is that there are like 50 pieces of DOM exactly like this and I want to
Tag: puppeteer
solving recaptcha without a form submit/ button click ( uses callback )
im trying to solve a recaptcha from a website im trying to scrape usually the way it works is , captcha is inside a form , i’ll send the captcha data to a solving captcha api (im using DBC) , they return a token i put the token inside captcha input (#g-recaptcha-response) and even tho the green check doesn’t show
How to Inject Axios in Puppeteer
I want to inject axios in puppeteer in order to open a browser session, but sending requests and receiving responses through axios: So the question is, is it possible? Here’s my attempt, but it is not working since axios doesn’t intercepts the website responses I’m moving my first steps in axios, so I beg you to be patient; Thanks for
How To Get The URL After Redirecting from Current Page To Another Using Puppeteer?
I’m Aadarshvelu! Recently Started Testing My WebApp Code Using Jest With Puppeteer. So I Have Page Which All Credentials Have Been Filled With Puppeteer.But When SummitButton(‘signBtn’) Clicked POST process Starts Is There Any Test That Process POST Request?.. Or How Do I Know Test Has Been Completely Finished? Or How to Get The Redirect Page URL While Test Running? This
How to wait for jquery to be loaded after await page.addScriptTag({url: ‘https://code.jquery.com/jquery-3.2.1.min.js’}) in Puppeteer?
CODE: PROBLEM: I add jquery to the page with the line above so that I can use it to select elements in Puppeteer. Everything works fine for a few pages, until the error “$ is not defined” appears. Edit: To be clear, the first url is loaded and then puppeteer navigates by clicking the “next” button to go to the
How to access current value in a text input field with puppeteer
I’m trying to automate retrieving form values from an already filled out form with puppeteer and xpath. I’ve already automated FILLING a text input field as follows, but doing the reverse with .evaluate() doesn’t work: This is my most recent attempt – still no success… Hopefully someone out there knows how to achieve this! Answer Using evaluate should work:
Why every time that setInterval does a cycle, it throws the every data of all cycles?
I’m doing a Discord Bot and I have a infinite loop with setInterval each 10s but every loop that the setInterval does, it gives me every data of each loop, so I’d like to know how can I do to get only the last data of the last cycle, not every one. This is how the messages are shown: enter
Puppeteer throws “UnhandledPromiseRejectionWarning: TimeoutError: Navigation Timeout Exceeded” sometimes
I’m testing Headless Chrome with Puppeteer, so I’ve reading docs and running this code*: (*Snippet from Docs-Usage). I changed “example.com” because works fine and trying with other sites, but with “github.com” script returns an timeout exception in the await page.goto() line: If I go to github.com with my regular browser, connects in normal timing, so my internet connection is not
page.evaluate wait for ajax to finish loading
I am developing a puppeteer script in nodejs. It has an ajax to a load more button in that script. The thing is that, the script doesn’t wait for the ajax to finish loading thus leaving the page.evaluate to finish the script without waiting for the ajax to be done. I am a bit confused on new promise / await.
login into gmail fails for unknown reason
I am trying to login into my gmail with puppeteer to lower the risk of recaptcha here is my code but i always end up with this message I even tried to just open the login window with puppeteer and fill the login form manually myself, but even that failed. Am I missing something ? When I look into console