A listener for RF >= 4.0 that prints a Stack Trace to console to faster find the code section where the failure appears.

Last update: Nov 24, 2022

Overview

robotframework-stacktrace

A listener for RF >= 4.0 that prints a Stack Trace to console to faster find the code section where the failure appears.

Installation

pip install robotframework-stacktrace

Usage

robot --listener RobotStackTracer <your file.robot>

Example

Old Console Output:

> ../.. >> select" selector resolved to visible

New Stack Trace Output

> ../.. >> select (str) | ${basemodel} = aMinigolf (str) ______________________________________________________________________________ Configure Car with Pass | FAIL | TimeoutError: page.selectOption: Timeout 3000ms exceeded. =========================== logs =========================== waiting for selector ""Basismodell" >> ../.. >> select" selector resolved to visible

Comments

Should not do mutating variable resolution

Using parameter --listener RobotStackTracer in regular robot run results in different test result (pass vs fail):

running robot Test.robot

running robot --listener RobotStackTracer Test.robot

This --listener RobotStackTracer is now used in latest pabot version and i wonder, why my tests fail with pabot but pass in robot.

Versions: Windows 10 python 3.9.6 robotframework-pabot 2.0.0 robotframework 4.0.3
bug

opened by DirkRichter 8
Topic side effecting

Resolve variable values only when failing. Specifically DO NOT resolve then during execution as this can cause failures if the variable value resolving has side-effects.

opened by mkorpela 0

The test suite is failing

Hi,

Perhaps I'm doing something wrong, but here's what I get when running python -m robot tests on the latest 0.4.1 release (archive from PyPI):

starting phase `check'
==============================================================================
Tests                                                                         
==============================================================================
Tests.A-Suite                                                                 
==============================================================================
Tests.A-Suite.B-Suite                                                         
==============================================================================
Tests.A-Suite.B-Suite.C-Suite                                                 
==============================================================================
Tests.A-Suite.B-Suite.C-Suite.D-Suite                                         
==============================================================================
first teardown fail                                                   | FAIL |
Teardown failed:
by purpose
------------------------------------------------------------------------------
Second setup fails                                                    | FAIL |
Setup failed:
'False' should be true.

Also teardown failed:
this fails as well
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C-Suite.D-Suite                                 | FAIL |
Suite teardown failed:
'False' should be true.

2 tests, 0 passed, 2 failed
==============================================================================
Tests.A-Suite.B-Suite.C-Suite                                         | FAIL |
2 tests, 0 passed, 2 failed
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite                                                
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite.Never Runs                                     
==============================================================================
Hi                                                                    | FAIL |
Parent suite setup failed:
This is a Suite Setup
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C2-Suite.Never Runs                             | FAIL |
Parent suite setup failed:
This is a Suite Setup

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite                                        | FAIL |
Suite setup failed:
This is a Suite Setup

Also suite teardown failed:
Here the teardow

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite                                                
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite.Fails Suite Teardown                           
==============================================================================
Test                                                                  | PASS |
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C3-Suite.Fails Suite Teardown                   | FAIL |
Suite teardown failed:
in Suite Teardown

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite                                        | FAIL |
1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite                                                 | FAIL |
Suite teardown failed:
This Fails as well....

4 tests, 0 passed, 4 failed
==============================================================================
Tests.A-Suite                                                         | FAIL |
4 tests, 0 passed, 4 failed
==============================================================================
[ ERROR ] Error in file '/tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/tests/basics.robot' on line 4: Resource file 'keywords.resource' does not exist.
Tests.Basics                                                                  
==============================================================================
PASS Testing 1                                                        | PASS |
------------------------------------------------------------------------------
Testing 1                                                             | FAIL |
1 != 2
------------------------------------------------------------------------------
Testing 2                                                             | FAIL |
No keyword with name 'Keyword2' found. Did you mean:
    Keyword
    BuiltIn.Run Keyword
------------------------------------------------------------------------------
Resolve Variable                                                      | FAIL |
scalar content
------------------------------------------------------------------------------
Fail with a List                                                      | FAIL |
Lists are different:
Index 2: three != 3
------------------------------------------------------------------------------
Fail with dict                                                        | FAIL |
Dictionary does not contain key 'key'.
------------------------------------------------------------------------------
Fail expanded keys                                                    | FAIL |
Keyword 'Fail Expanded' got unexpected named arguments 'key1' and 'key2'.
------------------------------------------------------------------------------
Fail expanded items                                                   | FAIL |
['key1', 'key2']
------------------------------------------------------------------------------
Fail expanded list                                                    | FAIL |
['one', 'two', 'three']
------------------------------------------------------------------------------
Fail with large file                                                  | FAIL |
This file is full of vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
 vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
  vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit v...
    [ Message content over the limit has been removed. ]
...mit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
                 vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit









 != puke
------------------------------------------------------------------------------
Fail with number                                                      | FAIL |
1775675 != 23
------------------------------------------------------------------------------
Fails with Unknown Variable                                           | FAIL |
Variable '${unknown_var}' not found.
------------------------------------------------------------------------------
Fail a compount                                                       | FAIL |
this is a scalar content text with a ['one', 'two', 'three']
------------------------------------------------------------------------------
Wrong If                                                              | FAIL |
Evaluating expression 'time.seven' failed: AttributeError: module 'time' has no attribute 'seven'
------------------------------------------------------------------------------
Tests.Basics                                                          | FAIL |
14 tests, 1 passed, 13 failed
==============================================================================
Tests.RunKeywords and WUKS                                                    
==============================================================================
Tests.RunKeywords and WUKS.Run Keywords WUKS                                  
==============================================================================
Run Keyword                                                           | FAIL |
This one fails
------------------------------------------------------------------------------
Run Keyword And Ignore Error                                          | PASS |
------------------------------------------------------------------------------
Run Keyword And Continue On Failure                                   | FAIL |
Several failures occurred:

1) 1st Error

2) 2nd Error

3) 3rd Error

4) 4th Error

5) 5th Error
------------------------------------------------------------------------------
Run Keyword And Expect Error                                          | PASS |
------------------------------------------------------------------------------
Run Keyword And Return                                                | FAIL |
Evaluating expression '" ".join(None)' failed: TypeError: can only join an iterable
------------------------------------------------------------------------------
Run Keyword And Return If                                             | FAIL |
Evaluating expression '" ".join(None)' failed: TypeError: can only join an iterable
------------------------------------------------------------------------------
Run Keyword And Return Status                                         | FAIL |
'False' should be true.
------------------------------------------------------------------------------
Run Keyword And Warn On Failure                                       [ WARN ] Executing keyword 'Top Level One' failed:
This should basically be a warning
| PASS |
------------------------------------------------------------------------------
Run Keywords                                                          | FAIL |
with a message
------------------------------------------------------------------------------
Pass WUKS                                                             | PASS |
------------------------------------------------------------------------------
Fail in WUKS                                                          | FAIL |
Keyword 'Fails some times' failed after retrying 9 times. The last error was: 10 != 9
------------------------------------------------------------------------------
Tests.RunKeywords and WUKS.Run Keywords WUKS                          | FAIL |
11 tests, 4 passed, 7 failed
==============================================================================
Tests.RunKeywords and WUKS                                            | FAIL |
11 tests, 4 passed, 7 failed
==============================================================================
Tests.Side-Effecting                                                          
==============================================================================
Side effect in variable resolving                                     | PASS |
------------------------------------------------------------------------------
Side effect in variable resolving FAILING                             | FAIL |
a
------------------------------------------------------------------------------
Tests.Side-Effecting                                                  | FAIL |
2 tests, 1 passed, 1 failed
==============================================================================
Tests                                                                 | FAIL |
31 tests, 6 passed, 25 failed
==============================================================================
Output:  /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/output.xml
Log:     /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/log.html
Report:  /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/report.html
error: in phase 'check': uncaught exception:
%exception #<&invoke-error program: "python" arguments: ("-m" "robot" "tests") exit-status: 25 term-signal: #f stop-signal: #f> 
phase `check' failed after 0.5 seconds
command "python" "-m" "robot" "tests" failed with status 25

Ideas?

The only direct dependencies are [email protected] and [email protected].

opened by Apteryks 0

Cloudshell-sandbox-reporter - Helper modules and classes for writing to Cloudshell sandbox console

Cloudshell Sandbox Reporter This project provides utility classes for formatting

2 Sep 7, 2022

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline!

LocalStack - A fully functional local AWS cloud stack LocalStack provides an easy-to-use test/mocking framework for developing Cloud applications. Cur

45.3k Jan 2, 2023

A Serverless Application Model stack that persists the $XRP price to the XRPL every minute as a TrustLine. There are no servers, it is effectively a "smart contract" in Python for the XRPL.

xrpl-price-persist-oracle-sam This is a XRPL Oracle that publishes external data into the XRPL. This Oracle was inspired by XRPL-Labs/XRPL-Persist-Pri

11 Dec 17, 2022

Simulation artifacts, core components and configuration files to integrate AWS DeepRacer device with ROS Navigation stack.

AWS DeepRacer Overview The AWS DeepRacer Evo vehicle is a 1/18th scale Wi-Fi enabled 4-wheel ackermann steering platform that features two RGB cameras

31 Nov 21, 2022

CloudFormation template and CDK stack that contains a CustomResource with Lambda function to allow the setting of the targetAccountIds attribute of the EC2 Image Builder AMI distribution settings which is not currently supported (as of October 2021) in CloudFormation or CDK.

ec2-imagebuilder-ami-share CloudFormation template and CDK stack that contains a CustomResource with Lambda function to allow the setting of the targe

2 Oct 22, 2022

0.4.1(Jun 7, 2021)

Fixes https://github.com/MarketSquare/robotframework-stacktrace/issues/2 "Should not do mutating variable resolution"
Source code(tar.gz)
Source code(zip)
robotframework-stacktrace-0.4.1.tar.gz(12.33 KB)
robotframework_stacktrace-0.4.1-py3-none-any.whl(8.34 KB)

A listener for RF >= 4.0 that prints a Stack Trace to console to faster find the code section where the failure appears.

Related tags

Overview

robotframework-stacktrace

Installation

Usage

Example

You might also like...

Cloudshell-sandbox-reporter - Helper modules and classes for writing to Cloudshell sandbox console

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline!

A Serverless Application Model stack that persists the $XRP price to the XRPL every minute as a TrustLine. There are no servers, it is effectively a "smart contract" in Python for the XRPL.

Simulation artifacts, core components and configuration files to integrate AWS DeepRacer device with ROS Navigation stack.

CloudFormation template and CDK stack that contains a CustomResource with Lambda function to allow the setting of the targetAccountIds attribute of the EC2 Image Builder AMI distribution settings which is not currently supported (as of October 2021) in CloudFormation or CDK.

Stack overflow search API

A multi-tenant multi-client scalable product categorising demo stack

A part of HyRiver software stack for accessing hydrology data through web services

Please Do Not Throw Sausage Pizza Away - Side Scrolling Up The OSI Stack

Comments

Should not do mutating variable resolution

Topic side effecting

The test suite is failing

Releases(0.4.1)

0.4.1(Jun 7, 2021)

Owner

marketsquare

Isobot is originally made by notsniped. This is a remix of iso.bot by archisha.

Amazon AWS Web Tool (view only)

📦 Opensource Python wrapper for Hiven's REST and WebSocket API

Play Video & Music on Telegram Group Video Chat

a simple python script that monitors the binance hotwallet and refunds the withdrawal fee to encourage people to withdraw their Nano and help decentralisation

Backend.AI Client Library for Python

Automatically commits and pushes changes from a specified directory to remote repository

A Pancakeswap v2 trading client (and bot) with limit orders, stop-loss, custom gas strategies, a GUI and much more.

Ethone-Selfbot - Open Source Discord Self-Bot, written in discord.py

Pure Python 3 MTProto API Telegram client library, for bots too!

VaccineAlarm is a simple python script that allows user to get notified when their desired vaccine doses are available at vaccine centers near them.

Programa capaz de gerar QR Code a partir do link inserido.

A stable and Fast telegram video convertor bot which can compress, convert(video into audio and other video formats), rename with permanent thumbnail and trim.

Use an air-gapped Raspberry Pi Zero to sign for Bitcoin transactions! (and do other cool stuff)

A script written in python3 for bruteforcing Gmail accounts.

This is a repository for the Duke University Cloud Computing course project on Serveless Data Engineering Pipeline. For this project, I recreated the below pipeline.

Announces when a web3 wallet receives a token

A supabase client for python

An Undertale RPG Discord bot to fight monsters, bosses, level up and duel with other players