Using behave¶
The command-line tool behave has a bunch of command-line arguments and is also configurable using configuration files.
Values defined in the configuration files are used as defaults which the command-line arguments may override.
Command-Line Arguments¶
You may see the same information presented below at any time using behave
-h.
- -C, --no-color¶
Disable colored mode.
- --color COLORED¶
Use colored mode or not (default: auto).
- -d, --dry-run¶
Invokes formatters without executing the steps.
- -D NAME=VALUE, --define NAME=VALUE¶
Define user-specific data for the config.userdata dictionary. Example: -D foo=bar to store it in config.userdata[“foo”].
- -e PATTERN, --exclude PATTERN¶
Don’t run feature files matching regular expression PATTERN.
- -i PATTERN, --include PATTERN¶
Only run feature files matching regular expression PATTERN.
- --no-junit¶
Don’t output JUnit-compatible reports.
- --junit¶
Output JUnit-compatible reports. When junit is enabled, all stdout and stderr will be redirected and dumped to the junit report, regardless of the “–capture” and “–no-capture” options.
- --junit-directory PATH¶
Directory in which to store JUnit reports.
- -j NUMBER, --jobs NUMBER, --parallel NUMBER¶
Number of concurrent jobs to use (default: 1). Only supported by test runners that support parallel execution.
- -f FORMATTER, --format FORMATTER¶
Specify a formatter. If none is specified the default formatter is used. Pass “–format help” to get a list of available formatters.
- --steps-catalog¶
Show a catalog of all available step definitions. SAME AS: “– format=steps.catalog –dry-run –no-summary -q”.
- --no-skipped¶
Don’t print skipped steps (due to tags).
- --show-skipped¶
Print skipped steps. This is the default behaviour. This switch is used to override a configuration file setting.
- --no-snippets¶
Don’t print snippets for unimplemented steps.
- --snippets¶
Print snippets for unimplemented steps. This is the default behaviour. This switch is used to override a configuration file setting.
- --no-multiline¶
Don’t print multiline strings and tables under steps.
- --multiline¶
Print multiline strings and tables under steps. This is the default behaviour. This switch is used to override a configuration file setting.
- -n NAME_PATTERN, --name NAME_PATTERN¶
Select feature elements (scenarios, …) to run which match part of the given name (regex pattern). If this option is given more than once, it will match against all the given names.
- --capture¶
Enable capture mode (stdout/stderr/log-output). Any capture output will be printed on a failure/error.
- --no-capture¶
Disable capture mode (stdout/stderr/log-output).
- --capture-stdout¶
Enable capture of stdout.
- --no-capture-stdout¶
Disable capture of stdout.
- --capture-stderr¶
Enable capture of stderr.
- --no-capture-stderr¶
Disable capture of stderr.
- --capture-log, --logcapture¶
Enable capture of logging output.
- --no-capture-log, --no-logcapture¶
Disable capture of logging output.
- --capture-hooks¶
Enable capture of hooks (except: before_all).
- --no-capture-hooks¶
Disable capture of hooks.
- --logging-level LOG_LEVEL¶
Specify a level to capture logging at. The default is INFO - capturing everything.
- --logging-format LOG_FORMAT¶
Specify custom format to print statements. Uses the same format as used by standard logging handlers. The default is “%(levelname)s:%(name)s:%(message)s”.
- --logging-datefmt LOG_DATE_FORMAT¶
Specify custom date/time format to print statements. Uses the same format as used by standard logging handlers.
- --logging-filter LOG_FILTER¶
Specify which statements to filter in/out. By default, everything is captured. If the output is too verbose, use this option to filter out needless output. Example: –logging-filter=foo will capture statements issued ONLY to foo or foo.what.ever.sub but not foobar or other logger. Specify multiple loggers with comma: filter=foo,bar,baz. If any logger name is prefixed with a minus, eg filter=-foo, it will be excluded rather than included.
- --logging-clear-handlers¶
Clear existing logging handlers (during capture-log).
- --no-logging-clear-handlers¶
Keep existing logging handlers (during capture-log).
- --no-summary¶
Don’t display the summary at the end of the run.
- --summary¶
Display the summary at the end of the run.
- -o FILENAME, --outfile FILENAME¶
Write formatter output to output-file (default: stdout).
- -q, --quiet¶
Alias for –no-snippets –no-source.
- -r RUNNER_CLASS, --runner RUNNER_CLASS¶
Use own runner class, like: “behave.runner:Runner”
- --no-source¶
Don’t print the file and line of the step definition with the steps.
- --show-source¶
Print the file and line of the step definition with the steps. This is the default behaviour. This switch is used to override a configuration file setting.
- --stage TEXT¶
Defines the current test stage. The test stage name is used as name prefix for the environment file and the steps directory (instead of default path names).
- --stop¶
Stop running tests at the first failure.
- -t TAG_EXPRESSION, --tags TAG_EXPRESSION¶
Only execute features or scenarios with tags matching TAG_EXPRESSION. Use
--tags-helpoption for more information.
- -T, --no-timings¶
Don’t print the time taken for each step.
- --show-timings¶
Print the time taken, in seconds, of each step after the step has completed. This is the default behaviour. This switch is used to override a configuration file setting.
- -v, --verbose¶
Show the files and features loaded.
- -w, --wip¶
Only run scenarios tagged with “wip”. Additionally: use the “plain” formatter, do not capture stdout or logging output and stop at the first failure.
- --lang LANG¶
Use keywords for a language other than English.
- --lang-list¶
List the languages available for –lang.
- --lang-help LANG¶
List the translations accepted for one language.
- --tags-help¶
Show help for tag expressions.
- --version¶
Show version.
Tag Expression¶
TAG-EXPRESSIONS selects Features/Rules/Scenarios by using their tags. A TAG-EXPRESSION is a boolean expression that references some tags.
EXAMPLES:
–tags=@smoke –tags=”not @xfail” –tags=”@smoke or @wip” –tags=”@smoke and @wip” –tags=”(@slow and not @fixme) or @smoke” –tags=”not (@fixme or @xfail)” –tags=”@smoke and {config.tags}”
NOTES:
The tag-prefix “@” is optional.
An empty tag-expression is “true” (select-anything).
Use “{config.tags}” placeholder on command-line to use tag-expressions from the config-file (from: “tags” or “default_tags”).
TAG-INHERITANCE:
A Rule inherits the tags of its Feature
A Scenario inherits the tags of its Feature or Rule.
A Scenario of a ScenarioOutline/ScenarioTemplate inherit tags from this ScenarioOutline/ScenarioTemplate and its Example table.
Configuration Files¶
Configuration files for behave are called either “.behaverc”, “behave.ini”, “setup.cfg”, “tox.ini”, or “pyproject.toml” (your preference) and are located in one of three places:
the current working directory (good for per-project settings),
your home directory ($HOME), or
on Windows, in the %APPDATA% directory.
If you are wondering where behave is getting its configuration defaults from you can use the “-v” command-line argument and it’ll tell you.
Configuration files must start with the label “[behave]” and are formatted in the Windows INI style, for example:
[behave]
default_format = plain
default_tags = not (@xfail or @not_implemented)
junit = true
junit_directory = build/behave.reports
logging_level = WARNING
Alternatively, if using “pyproject.toml” instead (note the “tool.” prefix):
[tool.behave]
default_format = "plain"
default_tags = "not (@xfail or @not_implemented)"
junit = true
junit_directory = "build/behave.reports"
logging_level = "WARNING"
NOTE: toml does not support ‘%’ interpolations.
Configuration File Parameter Types¶
The following types are supported (and used):
- text
This just assigns whatever text you supply to the configuration setting.
- bool
This assigns a boolean value to the configuration setting. The text describes the functionality when the value is true. True values are “1”, “yes”, “true”, and “on”. False values are “0”, “no”, “false”, and “off”. TOML: toml only accepts its native true
- sequence<text>
These fields accept one or more values on new lines, for example a tag expression might look like:
default_tags= (@foo or not @bar) and @zap
which is the equivalent of the command-line usage:
--tags="(@foo or not @bar) and @zap"
TOML: toml can use arrays natively.
Configuration File Parameters¶
- color : Colored (Enum)¶
Use colored mode or not (default: auto).
- dry_run : bool¶
Invokes formatters without executing the steps.
- exclude_re : text¶
Don’t run feature files matching regular expression PATTERN.
- include_re : text¶
Only run feature files matching regular expression PATTERN.
- junit : bool¶
Output JUnit-compatible reports. When junit is enabled, all stdout and stderr will be redirected and dumped to the junit report, regardless of the “–capture” and “–no-capture” options.
- junit_directory : text¶
Directory in which to store JUnit reports.
- jobs : positive_number¶
Number of concurrent jobs to use (default: 1). Only supported by test runners that support parallel execution.
- default_format : text¶
Specify default formatter (default: pretty).
- format : sequence<text>¶
Specify a formatter. If none is specified the default formatter is used. Pass “–format help” to get a list of available formatters.
- steps_catalog : bool¶
Show a catalog of all available step definitions. SAME AS: “– format=steps.catalog –dry-run –no-summary -q”.
- scenario_outline_annotation_schema : text¶
Specify name annotation schema for scenario outline (default=”{name} – @{row.id} {examples.name}”).
- use_nested_step_modules : bool¶
Use subdirectories of steps directory to import steps (default: false).
- show_skipped : bool¶
Print skipped steps. This is the default behaviour. This switch is used to override a configuration file setting.
- show_snippets : bool¶
Print snippets for unimplemented steps. This is the default behaviour. This switch is used to override a configuration file setting.
- show_multiline : bool¶
Print multiline strings and tables under steps. This is the default behaviour. This switch is used to override a configuration file setting.
- name : sequence<text>¶
Select feature elements (scenarios, …) to run which match part of the given name (regex pattern). If this option is given more than once, it will match against all the given names.
- capture : bool¶
Enable capture mode (stdout/stderr/log-output). Any capture output will be printed on a failure/error.
- capture_stdout : bool¶
Enable capture of stdout.
- capture_stderr : bool¶
Enable capture of stderr.
- capture_log : bool¶
Enable capture of logging output.
- capture_hooks : bool¶
Enable capture of hooks (except: before_all).
- logging_level : text¶
Specify a level to capture logging at. The default is INFO - capturing everything.
- logging_format : text¶
Specify custom format to print statements. Uses the same format as used by standard logging handlers. The default is “%(levelname)s:%(name)s:%(message)s”.
- logging_datefmt : text¶
Specify custom date/time format to print statements. Uses the same format as used by standard logging handlers.
- logging_filter : text¶
Specify which statements to filter in/out. By default, everything is captured. If the output is too verbose, use this option to filter out needless output. Example:
logging_filter = foowill capture statements issued ONLY to “foo” or “foo.what.ever.sub” but not “foobar” or other logger. Specify multiple loggers with comma:logging_filter = foo,bar,baz. If any logger name is prefixed with a minus, eglogging_filter = -foo, it will be excluded rather than included.
- logging_clear_handlers : bool¶
Clear existing logging handlers (during capture-log).
- summary : bool¶
Display the summary at the end of the run.
- outfiles : sequence<text>¶
Write formatter output to output-file (default: stdout).
- paths : sequence<text>¶
Specify default feature paths, used when none are provided.
- tag_expression_protocol : TagExpressionProtocol (Enum)¶
Specify the tag-expression protocol to use (default: v2). Only tag- expressions v2 are supported (since: behave v1.4.0).
- quiet : bool¶
Alias for –no-snippets –no-source.
- runner : text¶
Use own runner class, like: “behave.runner:Runner”
- show_source : bool¶
Print the file and line of the step definition with the steps. This is the default behaviour. This switch is used to override a configuration file setting.
- stage : text¶
Defines the current test stage. The test stage name is used as name prefix for the environment file and the steps directory (instead of default path names).
- stop : bool¶
Stop running tests at the first failure.
- default_tags : text¶
Use default tags when non are provided. Alternative to
tags : text(if missing).
- tags : text¶
Select a subset of features/rules/scenarios to execute based on the tag expression. See below for how to code tag expressions in configuration files.
- show_timings : bool¶
Print the time taken, in seconds, of each step after the step has completed. This is the default behaviour. This switch is used to override a configuration file setting.
- verbose : bool¶
Show the files and features loaded.
- wip : bool¶
Only run scenarios tagged with “wip”. Additionally: use the “plain” formatter, do not capture stdout or logging output and stop at the first failure.
- lang : text¶
Use keywords for a language other than English.
Additional Configuration File Sections¶
Section: behave.userdata¶
This section is used to define user-specific paramters (aka: userdata) for the config.userdata dictionary.
[behave.userdata]
foo = Alice
bar = Bon
Alternatively, if using “pyproject.toml”:
[tool.behave.userdata]
foo = "Alice"
bar = "Bob"
which is the equivalent of the command-line usage:
behave -D foo=Alice -D bar=Bob ...
See Userdata for usage examples, type conversion and advanced use cases.
Section: behave.formatters¶
This configuration file section is used to:
Define aliases for own formatters
Override the mapping of builtin formatters
[behave.formatters]
allure = allure_behave.formatter:AllureFormatter
html = behave_html_formatter:HTMLFormatter
html-pretty = behave_html_pretty_formatter:PrettyHTMLFormatter
[tool.behave.formatters]
allure = "allure_behave.formatter:AllureFormatter"
html = "behave_html_formatter:HTMLFormatter"
html-pretty = "behave_html_pretty_formatter:PrettyHTMLFormatter"
You can then use this formatter alias on the command-line (or in the config-file):
behave -f html --output=report.html ...
See Formatters and Reporters for more information.
Section: behave.runners¶
This configuration file section is used to:
Define aliases for own test runners
Override the mapping of builtin test runners
[behave.runners]
mine = behave4me.runner:SuperDuperRunner
[behave.runners]
mine = "behave4me.runner:SuperDuperRunner"
You can then use this runner alias on the command-line:
behave --runner=mine ...
See Runners for more information.