Executing tests that have skip marks

[sashko1988]

Is there a way to run tests with skip and skipif marks without changing tests code.

Example,

@pytest.mark.skip(reason="for fun")
def test_check():
    assert True

And I want pytest to execute it without removing the skip decorator in the code.
Something like

pytest --ignore-skip-marks tests/test_with_skip_mark.py

[RonnyPfannschmidt]

There's no builtin feature for that as typically that's done via xfail/run

[sashko1988]

Do you mean

@pytest.mark.xfail(reason="quite different fun")
def test_check():
    assert False

pytest --runxfail tests/test_with_xfail_mark.py

If yes, that is a different flow.

[sashko1988]

Then, a separate question,
If I want to implement that ability in my runner via conftest.
I suspect I need to create pytest_collection_modifyitems and remove skip marks.
Do I need to call any other hook after that so those tests won't be skipped?

[RonnyPfannschmidt]

I believe that could be sufficient

Id still recommend to use a own marker you fully control instead of a per project change of the builtin skip

[sashko1988]

Also, I can't find anything that allows to remove markers dynamically.
Is there a way to do it somehow?

The only related stuff I found is here - #3324
But it's from 2018 and probably outdated.

[RonnyPfannschmidt]

Oh right

One needs to mess around with item.own_markers

Im currently out of the office and can't write a example entirely from memory

[CoderDeltaLAN]

small follow-up: version that matches Ronny’s advice — opt-in flag, custom marker, no default behavior change. when you pass --run-skipped it strips skip/skipif at collection time and marks those tests as xfail

run normal: pytest
opt-in run: pytest --run-skipped

# conftest.py
import pytest

def pytest_addoption(parser):
    parser.addoption(
        "--run-skipped",
        action="store_true",
        help="turn skip/skipif into xfail at collection time",
    )

def pytest_configure(config):
    config.addinivalue_line(
        "markers",
        "force_run: added when skip/skipif is coerced",
    )

def pytest_collection_modifyitems(config, items):
    if not config.getoption("--run-skipped"):
        return
    for item in items:
        marks = list(getattr(item, "own_markers", []))
        if any(m.name in ("skip", "skipif") for m in marks):
            item.own_markers[:] = [m for m in marks if m.name not in ("skip", "skipif")]
            item.add_marker(pytest.mark.force_run)
            item.add_marker(pytest.mark.xfail(reason="was skip/skipif"))

[CoderDeltaLAN]

Tested on pytest 8.x Python 3.11/3.12.
Runs at collection time in conftest.py so you don’t touch test code it removes skip/skipif and marks those items as xfail.
If you want to just run them normally drop the add_marker line.

# conftest.py
import pytest

def pytest_collection_modifyitems(config, items):
    for item in items:
        marks = [m for m in getattr(item, "own_markers", []) if m.name not in ("skip", "skipif")]
        if len(marks) != len(getattr(item, "own_markers", [])):
            item.own_markers[:] = marks
            item.add_marker(pytest.mark.xfail(reason="was skip or skipif"))  # drop this to run them normally


#should work fine with recent pytest versions