matrix-org/trafficlight issues and pull requests

#87 - Temporarily move all tests/ into sample-tests/

Pull Request - State: open - Opened by michaelkaye over 1 year ago

#86 - Refactor style of running

Pull Request - State: closed - Opened by michaelkaye over 1 year ago - 1 comment

#85 - Ensure we have enough image space to handle images that compress weirdly.

Pull Request - State: closed - Opened by michaelkaye over 1 year ago

#84 - Build arm docker image

Pull Request - State: closed - Opened by dbkr over 1 year ago - 4 comments

#83 - Refactor method of video assertions

Pull Request - State: closed - Opened by michaelkaye over 1 year ago

#82 - Element Call load test

Pull Request - State: closed - Opened by michaelkaye over 1 year ago

#81 - Add element call

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#80 - Extend the response API to handle multipart/form-data as a way to return pictures of the screen to the trafficlight server

Issue - State: open - Opened by michaelkaye almost 2 years ago

#79 - If adapter times out, it doesn't mark the run as a failure

Issue - State: open - Opened by michaelkaye almost 2 years ago

#78 - Swap to standard format name

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#77 - Try to add test cases to the run as well as the plan.

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#76 - Kiwi TCMS integration

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#75 - Remove extra @ sign in test.

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#74 - Tests on element x (including self-signing)

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#73 - Permit static server config

Pull Request - State: closed - Opened by michaelkaye almost 2 years ago

#72 - Use JSON config instead of ENVVAR

Pull Request - State: closed - Opened by michaelkaye about 2 years ago

#71 - Some more improvements for trafficlight

Pull Request - State: open - Opened by MidhunSureshR about 2 years ago

#70 - Swap all uses of SynapseStable to SynapseDevelop

Pull Request - State: closed - Opened by michaelkaye about 2 years ago

#69 - Timeout for clients, v1

Pull Request - State: closed - Opened by michaelkaye about 2 years ago - 1 comment

#68 - Use newly created complement images

Pull Request - State: closed - Opened by michaelkaye about 2 years ago

#67 - Fallback key test

Pull Request - State: open - Opened by bwindels about 2 years ago - 1 comment

#66 - Permit network-proxy to act between a federation of servers

Issue - State: open - Opened by michaelkaye about 2 years ago

#65 - Refactor tests to use get_timeline instead of specific verification requests.

Pull Request - State: open - Opened by michaelkaye about 2 years ago

#64 - Add notes on client guidelines and link to docs.

Pull Request - State: closed - Opened by michaelkaye about 2 years ago - 2 comments

#63 - Handle exceptions from adapters and the test code better.

Pull Request - State: closed - Opened by michaelkaye about 2 years ago

#62 - Show status icon for tests rather than table with 1s and 0s

Issue - State: open - Opened by bwindels about 2 years ago - 1 comment

#61 - When running tests, provide more information on why no further tests are running

Issue - State: open - Opened by michaelkaye about 2 years ago

#60 - Demonstrate use of matrix-nio for actions outside of adapters.

Pull Request - State: closed - Opened by michaelkaye about 2 years ago - 1 comment

#59 - Add missing title on top of test cases

Pull Request - State: closed - Opened by michaelkaye about 2 years ago

#58 - Build a functioning federation test.

Pull Request - State: closed - Opened by michaelkaye about 2 years ago

#57 - Fix test failures after new syntax

Pull Request - State: closed - Opened by MidhunSureshR about 2 years ago

#56 - Refactor test definitions

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#55 - Test if device that restores from key backup is marked as verified

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago

#54 - Write test to verify that cross-signing between two devices work as expected

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago

#53 - Verification should not fail if ready request is received out of order

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago

#52 - Test if invited user can decrypt message when nine users are invited

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago - 2 comments

#51 - Support for hydrogen adapter

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago - 1 comment

#50 - Write test to confirm that keys are sent to all devices after you regain lost connection to your hs

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago - 2 comments

#49 - Write test to confirm that messages decrypted using key from key backup does not show warning

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago

#48 - Allow an identity server to be created in the same way as homeservers are.

Issue - State: open - Opened by michaelkaye over 2 years ago

#47 - Test for dehydrated device

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago - 1 comment

#46 - Support element-android as a traficlight adapter

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#45 - Support element-ios as a trafficlight adapter

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#44 - Write up best practices for contributing tests

Issue - State: open - Opened by michaelkaye over 2 years ago

#43 - Write test to see if messages can be decrypted after indexeddb is cleared

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago - 3 comments

#42 - Test element call

Issue - State: open - Opened by michaelkaye over 2 years ago

#41 - Improve the way we start tests by making it easier to be more specific about the slots for a test

Issue - State: closed - Opened by michaelkaye over 2 years ago

#40 - Improve the way we write tests by being more of a per-client flow + synchronization points, rather than massively explicit state machine.

Issue - State: closed - Opened by michaelkaye over 2 years ago

#39 - Test large number of clients

Pull Request - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#38 - Uploads should name by filename, not all as 'file'

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#37 - Test to ensure that clients retry sending toDevice messages

Pull Request - State: closed - Opened by MidhunSureshR over 2 years ago

#36 - Handle errors and uploads from clients better.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#35 - Reorder client registration

Issue - State: open - Opened by michaelkaye over 2 years ago

#34 - Add test to share keys with invited members

Pull Request - State: closed - Opened by bwindels over 2 years ago - 2 comments

#33 - Dockerfile for trafficlight.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#32 - scripts + instructions how to install and run everything locally

Pull Request - State: closed - Opened by bwindels over 2 years ago

#31 - Only allow one test setup to occur at once.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#30 - Test key sharing with invited members

Pull Request - State: closed - Opened by bwindels over 2 years ago - 1 comment

#29 - Implement a network proxy API in a sample test

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#28 - Network Proxy Support

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#27 - Proxy server to simulate network conditions

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#26 - Tidy up code a bit.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#25 - Test setup failures should be clear in the UI

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#24 - Trafficlight startup checks

Issue - State: open - Opened by michaelkaye over 2 years ago

#23 - Allow uploading of errors and files by client.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#22 - Clearer ui reporting

Issue - State: closed - Opened by michaelkaye over 2 years ago - 2 comments

#21 - Add some thoughts on client guidelines

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#20 - Make status page less ugly

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#19 - Specify servers and clients via env vars

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#18 - Allow test pattern to be specified via envvar

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#17 - Permit dynamic model stages

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#16 - Improve the Model writing flows

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#15 - Randomize (?) or otherwise improve the order of TestCases such that all cases are picked for action over time.

Issue - State: open - Opened by michaelkaye over 2 years ago

#14 - Update tests to pull from directory rather than explicit naming.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#13 - Initial cut of a post-test validation.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#12 - Timeout and fail tests with clients if they don't poll within X seconds.

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#11 - Migrate to Quart, make registration do an async search for a new test to start.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#10 - Refactor testsuite/cases, update status pages

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#9 - Better test generation / factoring out

Issue - State: closed - Opened by michaelkaye over 2 years ago

#8 - Make a junit-style output template

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#7 - Generate junit-style test report after tests complete

Issue - State: closed - Opened by michaelkaye over 2 years ago

#6 - Be clearer on status page where clients and tests are in their processes

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#5 - Create endpoint for uploading test media once complete (videos, client logs, server logs, snapshots)

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#4 - Factor out model creation (inc homerunner calls) to background thread/process/???

Issue - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#3 - Homerunner can be used to setup synapse instances

Pull Request - State: closed - Opened by michaelkaye over 2 years ago - 1 comment

#2 - See what it looks like to define actions / responses more.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

#1 - Add delay parameter to idle command.

Pull Request - State: closed - Opened by michaelkaye over 2 years ago

GitHub / matrix-org/trafficlight issues and pull requests