Help using playwright example

[andreabisello]

Hi
I removed the

class ScriptBased(PlaywrightScriptUser):
    # run a script that you recorded in playwright, exported as Python Async
    script = "playwright-recording.py"

because of i simply need the manual execution.

Loading the script with Locust 2.12.2, nothing happens.

It looks like Locust cannot recognize tasks of the PlaywrightUser class Tasks or there is something wrong creating user

as you can see, the "going on" print never appears in the log, but created user still 0

running without UI

from locust.env import Environment
env = Environment(user_classes=[Manual])
env.create_local_runner()
env.runner.start(1, spawn_rate=1)
env.runner.greenlet.join() 

i got this error

C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\python.exe C:/src/locust-loading-testing/playwright_ex.py
user created
Traceback (most recent call last):
File "src\gevent\greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 558, in
lambda: self._start(user_count, spawn_rate, wait=wait, user_classes=user_classes)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 529, in _start
self.spawn_users(user_classes_spawn_count, wait)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 252, in spawn_users
new_users += spawn(user_class, spawn_count)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 241, in spawn
new_user = self.user_classes_by_nameuser_class
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust_plugins\users\playwright.py", line 250, in init
future = asyncio.run_coroutine_threadsafe(self._pwprep(), loop)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\asyncio\tasks.py", line 885, in run_coroutine_threadsafe
loop.call_soon_threadsafe(callback)
AttributeError: 'NoneType' object has no attribute 'call_soon_threadsafe'
2022-11-09T16:58:43Z <Greenlet at 0x15485526680: > failed with AttributeError

CRITICAL:locust.runners:Unhandled exception in greenlet: <Greenlet at 0x15485526680: >
Traceback (most recent call last):
File "src\gevent\greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 558, in
lambda: self._start(user_count, spawn_rate, wait=wait, user_classes=user_classes)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 529, in _start
self.spawn_users(user_classes_spawn_count, wait)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 252, in spawn_users
new_users += spawn(user_class, spawn_count)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust\runners.py", line 241, in spawn
new_user = self.user_classes_by_nameuser_class
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust_plugins\users\playwright.py", line 250, in init
future = asyncio.run_coroutine_threadsafe(self._pwprep(), loop)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\asyncio\tasks.py", line 885, in run_coroutine_threadsafe
loop.call_soon_threadsafe(callback)
AttributeError: 'NoneType' object has no attribute 'call_soon_threadsafe'

any suggestion please?

thanks

[cyberw]

No real ideas, sorry. I have never run it on windows, maybe that is part of the problem..

[andreabisello]

@cyberw understand.
Only to know, is not related with the latest locust update? the script still working on your machine?

[andreabisello]

@cyberw so i created this little snippet and what i thought, with two users, is to see two browser opened by playwright executing the task ... the problem is that it looks like playwright blocks other users, as the second users still wait for the activity of the first, even there are two users running. any suggestion please?

thanks

[cyberw]

You cant use sync playwright. Follow the example:

  @task
  @pw
  async def mytask(self, page: PageWithRetry):
      …

[andreabisello]

@cyberw yes, but task looks to be never executed.
Manual instance is created (because of built is printed),
but "Running task" never appear

i will try on ubuntu to detect if the problem is windows related

[cyberw]

Are you calling run_single_user anywhere?

[andreabisello]

@cyberw
i'm running the script direcly from pycharm on a single machine
i removed the "if" to be sure that the run_sigle_user was called

[cyberw]

Hi! Sorry I can't be of more help, too busy at the moment. Hopefully you'll be able to trace what is happening by just stepping thru the debugger.

[MarcSkovMadsen]

I was also trying on windows with the below. But when I Start swarming nothing happens.

#locust_playwright.py
from locust import run_single_user, task
from locust_plugins.users.playwright import PageWithRetry, PlaywrightUser, pw, event

class Manual(PlaywrightUser):
    host = "http://localhost:5006"
    multiplier = 10  # run ten concurrent playwright sessions/browsers for each Locust user. This helps improve load generation efficiency.
    headless = False

    @task
    @pw
    async def request(self, page: PageWithRetry):
        print("start")
        try:
            async with event(self, "Load up the app"):  # log this as an event
                print("load page")
                await page.goto("/app")  # load a page
                print("wait")
                page.get_by_role("button", name="Run").wait_for()
  
        except:
            print("except")
            pass


if __name__ == "__main__":
    run_single_user(Manual)

# app.py
import asyncio
import time

import panel as pn
import param

class App(pn.viewable.Viewer):
    run = param.Event()
    runs = param.Integer()
    status = param.String("Click Run")

    load_delay = param.Number(0.5)
    click_delay = param.Number(0.5)
    
    def __init__(self, **params):
        super().__init__(**params)
        
        self.load()
        self._time = time.time()


        self._status_pane = pn.pane.Markdown(self.status, height=33)
        self._view = pn.Column(
            pn.widgets.Button.from_param(self.param.run, align="end"),
            self._status_pane
        )

    def __panel__(self):
        return self._view

    def _start_run(self):
        self.status = f"Running ..."
        self._time = time.time()

    def _stop_run(self):
        now = time.time()
        duration = round(now-self._time,3)
        self._time = now
        self.runs+=1
        self.status=f"Finished run {self.runs} in {duration}sec"

    @pn.depends("run", watch=True)
    def _run(self):
        self._start_run()
        self.handle_click()
        self._stop_run()        

    @pn.depends("status", watch=True)
    def _update_status_pane(self):
        print(self.status)
        self._status_pane.object = self.status

    def load(self):
        time.sleep(self.load_delay)

    def handle_click(self):
        time.sleep(self.click_delay)
    
if __name__.startswith("bokeh"):
    app = App()
    pn.panel(app).servable()

pip install panel locust locust-plugins playwright
playwright install

panel serve app.py

locust --host http://localhost:5006 --locustfile locustfile_playwright.py

[cyberw]

Run it in the debugger or add print statements so you can see exactly where it stops. I havent run it on windows so maybe some issues are to be expected..

[andreabisello]

in my case the problem is this

new_user = self.user_classes_by_name[user_class](https://github.com/SvenskaSpel/locust-plugins/issues/self.environment)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\site-packages\locust_plugins\users\playwright.py", line 250, in init
future = asyncio.run_coroutine_threadsafe(self._pwprep(), loop)
File "C:\Users\andreabisello\AppData\Local\Programs\Python\Python310\lib\asyncio\tasks.py", line 885, in run_coroutine_threadsafe
loop.call_soon_threadsafe(callback)
AttributeError: 'NoneType' object has no attribute 'call_soon_threadsafe'