headless-chrome

Rendertron should be configured with an allow-list and behind a reverse proxy, rather than exposed to the open internet.

This should be reflected in the readme as well as the documentation.

Real User-Agent is detectable with <iframe> when using "puppeteer-extra-plugin-stealth". To prevent it use "'--disable-features=site-per-process'" argument for puppeteer.launch(). See explanation: puppeteer/puppeteer#2548

Real screen size is also detectable with iframe, to prevent it I used preload() script.

OS: Windows 10
"puppeteer": 3.0.4
"puppeteer-extra": 3.1

Main examples at Apify SDK webpage, Github repo and CLI templates should demonstrate how to manipulate with DOM and retrieve data from it.

Also add one example of scraping with Apify SDK + jQuery to https://sdk.apify.com/docs/examples/basiccrawler

Feedback from: https://medium.com/better-programming/do-i-need-python-scrapy-to-build-a-web-scraper-7cc7cac2081d

I lost an hour trying to make

A list of hosts may return 404s and other status code nor worthy of creating a blank screenshot.

Can gowitness have a flag to ignore certain stat codes, such as 404 where there is no content to screenshot instead of filling up the screenshot folder with blank images?

Thanks for your time!

Sometimes we have weird issues due to the different environments of our users: #114 #84 #65

Debugging those environments is a real pain. What we could do is provide an official Docker image for PuPHPeteer (in a new repository). There are already some unofficial images but by providing our own image we would ensure to have better control on the fi

I am trying to use this
https://playwright.dev/docs/1.14/api/class-locator

But type Page doesn't have a Locator method. I see many generated structs related to the Locator API but not the locator struct/interface itself.

was this intentionally left out because it's not doable yet or can this be added?