Skip to content

Conversation

@Monstertoaster
Copy link

@Monstertoaster Monstertoaster commented Oct 6, 2025

Context

allure-behave: extend scenario_history_id to use optional environment variable

We have a problem where we want to run the same test-suite in different environments. For example:

  1. Execute Test-Suite for Different Browser: Firefox, Chrome, ... (i.e. 'BROWSER=firefox behave' 'BROWSER=chromium behave' etc.)
  2. Execute Test-Suite for Different Systems: Linux armx64, Linux amd64, Win amd64, ...

If we collect all JSON allure-results and generate an allure report we only see one result for each test-scenario. Other executions are shown only in the "retries" section. We need to change the history ID so that each execution appears as a separate test.

We want to solve this by adding additional information into the historyId. It would have been nice to use additional user-modifiable information from the Scenario object, but this is not possible since scenario_history_id() is called before the before_scenario() hook (environment.py). Therefore not action in the before_scenario hook function (like changing scenario name or adding other information, can impact the historyId.

Thus, we designed a solution that uses an environment variable to pass this information. Our proposal is to the set an environment variable in environment.py that is used to influence the historyId.

In allure-python/allure-behave/src/utils.py:

def scenario_history_id(scenario) -> str: """  Create a historyId for a scenario.  - Always based on feature name and scenario name  - Optional: can append a value from an environment variable  """ parts = [scenario.feature.name, scenario.name] if hasattr(scenario, "_row") and scenario._row: row = scenario._row parts.extend([f"{name}={value}" for name, value in zip(row.headings, row.cells)]) # Optional: append environment variable to differentiate runs history_id = os.getenv("ALLURE_HISTORY_ID") if history_id: parts.append(history_id) return md5(*parts)

To use this feature, add the environment variable in environment.py:

from enum import Enum import os class Option(str, Enum): OPTION_A = "Option A" OPTION_B = "Option B" def before_all(context): os.environ["ALLURE_HISTORY_ID"] = Option.OPTION_B.name
@CLAassistant
Copy link

CLAassistant commented Oct 6, 2025

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants