Comments (5)
I think the tests are running correctly again. I'm not sure precisely what was broken but documenting what I saw and the resolution steps for posterity:
- Running
d livetest-gecko
initially failed because the browser wasn't found. It was looking in.replay-playwright-browsers
instead of.replay
. It should have been using.replay
based on my reading of the playwright installer code and theRECORD_REPLAY_DIRECTORY
wasn't set to override it to something else. My next suspicion was that we had an out of date dependency. Runningnpm ls --depth=0
in thebackend
showed a lot of dependency errors so I rannpm ci
to wipe and reinstall the pinned versions. This resolved finding the browser directory. - Once running the tests were all failing with tab crashes. I used VNC to screenshare into the macstadium box and saw several instances of replay still running (including some seemingly old ones with our old logo). I killed all of those instances and started up the livetests again (while still in VNC) and most of them appear to be running successfully. I saw a couple tab crashes but they seem to be running better now.
Going to look into adding more telemetry next so we have better insight into these failures.
from playwright-tests.
The playwright browser was out of date (by a couple months) so it was unable to authenticate. Merged the latest webreplay-release
into replay-playwright
, ran d deploy-playwright
and d release-playwright
on macstadium, killed all runlive processes and open replay browsers, and started them again via d livetest-gecko
and we're getting sample recordings again!
https://ui.honeycomb.io/replay/datasets/backend/result/er82JjoAcGy
from playwright-tests.
Yeah a telemetry event {name: "live-test", success: true, testName: "airbnb" }
from playwright-tests.
Opened #89 to improve error handling. We already have telemetry for runlive tests but we lacked the test info so I've added that in https://github.com/RecordReplay/backend/pull/3198.
from playwright-tests.
I restarted runlive on mac and we're getting the example in honeycomb now but none of the tests are passing. Investigating ...
from playwright-tests.
Related Issues (20)
- add finviz HOT 1
- Record replit HOT 2
- Record ebay.com
- Record excalidraw
- Create a solidjs example
- Create a marko example
- Support chromium/headful in test runner
- Refactor existing tests HOT 2
- Add test manifest
- Support installing chromium browser
- Create a built with lit test
- Upload recording metadata
- Record Pixijs HOT 1
- Fix examples that require a login HOT 1
- Error "Execution context was destroyed, most likely because of a navigation"
- Test natto.dev HOT 1
- Fix replay.io test HOT 1
- Remove download/update logic
- Record qa wolf tests automtically
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from playwright-tests.