How do I return the value I scraped with pupeteer outside of my async function

I am coding a telegram bot using telegraph and I have been running into issues the whole day. What I was trying to do was to make my telegram bot receive the divided held amount and value to print the …

how to launch puppeteer with an already existing profile multiple time

so am trying to launch puppeteer with already existed chrome profile and it works , but what i want to do is to launch the same process multiple time which throw an error (node:12820) …

getting 302 when changing from local host to a proxy in puppeteer + Charles

so am using Charles’s external proxy setting and using puppeteer, the problem is when i put the proxy server in puppeteer as an local host “–proxy-server=127.0.0.1:8888” every thing work …

Puppeter delete node inside element

I want to scrape a page with some news inside. Here it’s an HTML simplified version of what I have : <div class="author&…

How to do a web scraping using Puppeteer and publish it?

I would like to do a web-scraping using Puppeteer. It would be to obtain data from an external URL when the user clicks a button within my application. My application would have to visit an external …

Firebase Functions times out when using puppeteer’s browser.newPage()

I have seen others having relatively minor performance problems with puppeteer running on Firebase Functions. In my case, Firebase times out before I can do anything with puppeteer, even with the …

why can’t puppeteer scrape an element from a iframe even if I add the selector

I have written a small web scraper using puppeteer, but I can’t seem to properly extract the information I want. Could you please help me find the mistake? Background: I want to scrape a website that …

Puppeteer .click hovers instead of clicking

I am using puppeteer to automatically restart my wifi (Linksys Velop) and I can’t seem to click an anchor tag to make the final dialog pop up. await page.waitForSelector(‘.tab-section > #…

solving recaptcha without a form submit/ button click ( uses callback )

im trying to solve a recaptcha from a website im trying to scrape usually the way it works is , captcha is inside a form , i’ll send the captcha data to a solving captcha api (im using DBC) , they …

How to wait for jquery to be loaded after await page.addScriptTag({url: ‘https://code.jquery.com/jquery-3.2.1.min.js’}) in Puppeteer?

CODE: PROBLEM: I add jquery to the page with the line above so that I can use it to select elements in Puppeteer. Everything works fine for a few pages, until the error “$ is not defined” appears. Edit: To be clear, the first url is loaded and then puppeteer navigates by clicking the “next” button to go to the next page, thus opening a new page at a new url. WHAT I TRIED: I have tried the following: 1) 2) 3) Nothing works. What would you suggest ? Answer You can use waitForFunction, It will wait until the windows