I am trying to get some data from this wikipedia page: https://en.wikipedia.org/wiki/List_of_mango_cultivars img src that I need I can get everything that I need except the img src with this code The error I am getting: Evaluation failed: TypeError: Cannot read properties of null (reading ‘src’) A…
Tag: puppeteer
Are v8’s optimizations deterministic? Extracting the sequence of JS functions executed by any given webpage
I am trying to reconstruct the exact sequence of executed Javascript functions (call graph) from log data gathered using the Tracing Profiler, particularly from the category “v8.cpu_profiler”. Unfortunately, the number of nodes (function definitions) and edges (function calls) I obtain fluctuates …
How to access data-state in div id, cheerio node js
I am grateful to everyone who participates and will help a newbie. Task: Access div = client-state, then div = Here-Goes-Some-Div-ID and return json from data-state. I managed to refer to div = client state like this – Unfortunately, I did not find information on how to further access the “Here-Go…
Can’t locate and click on a terms of conditions button
I am new to pupeeteer and first what i am trying to do is loading a page and clicking on a button. However, it can’t locate the element. I assume this is because I need to locate the parent or parent’s parent element. This is the full css selector taken from inspect Here’s my code: It’…
Puppeteer not retrieving JavaScript rendered page
I am trying to load the product page using puppeteer but its not working. If we open this URL it will load the page half and when we scroll down it loads rest of the page. I tried using the scroll as well but it did not work. Scroll function is following Answer When I run this headfully, I don’t
Javascript don’t want to use await
I have an async function like that: When I call this method, I am calling it like that: It works well in this way. But I don’t want to use the await keyword when calling this method. If I remove the await keyword, it waits forever in this line: await page.setRequestInterception(true); It should work on …
im trying to insert data to mysql from puppeteer (async) but I getting “connection.query is not a function”
I just want to store the data I collected in the database but I getting “connection.query is not a function” I’ve checked a lot of options to solve the issue and I can not find anything that works. In some of the ways the variables I collected were null and in the other part the connection.q…
Can I simplify this code to avoid the type error for reading properties?
I am writing this code to scrape a webpage. I need to get specific information from the website and there is a lot of information needed to be scraped. The code that I write works but when do it repeatedly it encounters error on some of the line, e.g. line 20, line 24. Below is the code There are like
Puppeteer in chrome extension, without puppeteer-web
Is it possible to create a chrome extension , containing a puppeteer script to scrape and do some browser automation. I would like to create one where a user would enter a url click a button then a puppeteer script runs, is this possible if so what would be the best way to implement? Seen some answers referri…
Puppeteer , bringing back blank array
I’m trying to grab products from ebay and open them on amazon. So far, I have them being searched on amazon but I’m struggling with getting the products selected from the search results. Currently its outputting a blank array and im not sure why. Have tested in a separate script without the grabTi…