Releases: Telefonica/toolium
Releases · Telefonica/toolium
Release list
3.8.3
Release date: 2026-07-15
- Fix
openai_requestto renameazure_api_keyandopenai_api_keyparameters toapi_keyto avoid errors when Azure and OpenAI are created. - Add
openai_temperatureandazure_temperatureparameters to be configurable intoolium.cfgfile to set the temperature for OpenAI and Azure requests. - Generalize documentation for
openai_requestconfiguration.
3.8.2
Release date: 2026-07-13
- Update the
openai_requestmethod to centralize logic and allow loading the configuration fromtoolium.cfgfile.
3.8.1
- Add token usage tracking to OpenAI requests
- Add pytest and unittest runners documentation in
Docs <http://toolium.readthedocs.io/en/latest/tests_runners_integration.html>_ - Fix key error when a scenario with accuracy tag is skipped
3.8.0
- Add pyproject.toml file for packaging and publishing Toolium
- Configure ruff for linting and formatting files, replacing flake8 and black
- Add text analysis tool to get an overall match of a text against a list of expected characteristics using AI libraries that come with the ai extra dependency
- Add langgraph methods to create a ReAct AI agent to test the behavior of other AI agents or LLMs
- Add llm-as-a-judge methods to use an LLM to evaluate the answer of another LLM and give a similarity score based on the user's question and a reference answer
3.7.0
- Fix accuracy tag to exclude skipped executions from total executions count
- Add
after_accuracy_scenariohook to allow custom behavior after accuracy scenario execution - Add csv report for accuracy scenario results
- Add text readability assessment function based on the AI libraries that come with the
aiextra dependency
3.6.0
- Remove Python 3.9 support (Python 3.9 reached the end of its life on October 31st, 2025)
- Remove xcuitest deprecated get_window_size method and replaced it with get_window_rect in all mobile actions
- Add SHARP replacement, to convert [SHARP] to # character in behave steps parameters
- Add text comparison methods based on AI libraries. To use them, install the ai extra dependency:
$ pip install toolium[ai] - Add accuracy tags to behave scenarios using @accuracy__, e.g. with @accuracy_80_10 tag, the scenario is executed 10 times expecting 80% accuracy
- Add accuracy data tags to behave scenarios using @accuracy_data_, e.g. @accuracy_data_greetings for accuracy data with greetings suffix, that allows to execute accuracy scenarios with different data sets
3.5.0
-
Add support for Python 3.13
-
Remove Python 3.8 support (Python 3.8 reached the end of its life on October 14th, 2024)
-
Add
LANGreplacement, to use different language translations. Example: [LANG:some_text::new_language] -
Playwright installation is now optional, it can be installed with the
playwrightextra dependency. To install
Toolium with Playwright support, use:$ pip install toolium[playwright]
3.4.0
3.3.1
3.3.0
- Allow negative indexes for list elements in context searches. Example: [CONTEXT:element.-1]
- Add support for JSON strings to the DICT and LIST` replacement. Example: [DICT:{"key": true}], [LIST:[null]]
- Add REPLACE replacement, to replace a substring with another. Example: [REPLACE:[CONTEXT:some_url]::https::http]
- Add TITLE replacement, to apply Python's title() function. Example: [TITLE:the title]
- Add ROUND replacement, float number to a string with the indicated number of decimals. Example: [ROUND:3.3333::2]
- Remove accents from generated file names to avoid errors in some filesystems
- Update Appium-Python-Client requirement to enable 3 and 4 versions
- Deprecate set_text method in InputText class to make it compatible with Appium-Python-Client 3 and 4