#12174 Run benchmarks with with PyPy as well

[itamarst]

Scope and purpose

Fixes #12174

Also run benchmarks on PyPy.

[codspeed-hq]

CodSpeed Performance Report

Merging #12175 will improve performances by 35.56%

_{Comparing 12174-expand-benchmarks-to-run-on-pypy-as-well (048ff24) with trunk (fd08b87)}

Summary

⚡ 2 improvements

Benchmarks breakdown

	Benchmark	trunk	12174-expand-benchmarks-to-run-on-pypy-as-well	Change
⚡	test_http_client_small_response	1.7 ms	1.2 ms	+35.56%
⚡	test_http11_server_empty_request	2.1 ms	1.5 ms	+43.28%

[adiroiban]

Is there an official solution for this ?

I guess that we might want to run these tests with python 3.12 and later with 3.13 to see if there are any improvements or regressions

---

What do you say about a helper that injects test functions in module namespace?

It can generate one for pypy and one for cpython ... with different names

---

I don't have experience with pytest... but I am using this trick to generate Selenium tests that are executed with Firefox and Chrome.. so that I get 2 different names

[itamarst]

Currently blocked on upstream support: CodSpeedHQ/pytest-codspeed#34

[glyph]

@itamarst thanks for tracking that