Target page, context or browser has been closed error when scrapping on vercel
Unanswered
American Fuzzy Lop posted this in #help-forum
American Fuzzy LopOP
I am deploying a web scraping language written in Next.js to vercel.
This code works correctly locally.
However, when I deploy it to vercel and test it, the following error occurs.
=================================================
rror during scraping: page.goto: Target page, context or browser has been closed
Call log:
- navigating to "https://prtimes.jp/topics/keywords/%E8%B3%87%E9%87%91%E8%AA%BF%E9%81%94", waiting until "domcontentloaded"
at getHtmlAfterClickingMoreButton (/var/task/.next/server/chunks/93926.js:1:1511)
at async scrapeFromPRTimes (/var/task/.next/server/chunks/93926.js:1:3691)
at /var/task/async /var/task/.next/server/pages/api/kddi/search-startups/private/batches/scrape-startups.js:1:1427
at async handler (/var/task/.next/server/pages/api/kddi/search-startups/private/batches/scrape-startups.js:1:1810)
=================================================
Scraping is using the playwright-aws-lambad library.
This code works correctly locally.
However, when I deploy it to vercel and test it, the following error occurs.
=================================================
rror during scraping: page.goto: Target page, context or browser has been closed
Call log:
- navigating to "https://prtimes.jp/topics/keywords/%E8%B3%87%E9%87%91%E8%AA%BF%E9%81%94", waiting until "domcontentloaded"
at getHtmlAfterClickingMoreButton (/var/task/.next/server/chunks/93926.js:1:1511)
at async scrapeFromPRTimes (/var/task/.next/server/chunks/93926.js:1:3691)
at /var/task/async /var/task/.next/server/pages/api/kddi/search-startups/private/batches/scrape-startups.js:1:1427
at async handler (/var/task/.next/server/pages/api/kddi/search-startups/private/batches/scrape-startups.js:1:1810)
=================================================
Scraping is using the playwright-aws-lambad library.