E2E testing: challenges & lessons learned

End-to-end testing. The holy grail of all testing types.

Here’s everything we learned regarding the ins and outs of end-to-end testing – lessons, takeaways, mistakes, you name it.

So, let’s start out with why

Swimm started growing, we …


This content originally appeared on DEV Community and was authored by Swimm 🤿

End-to-end testing. The holy grail of all testing types.

Holy Grail gif

Here's everything we learned regarding the ins and outs of end-to-end testing - lessons, takeaways, mistakes, you name it.

So, let's start out with why

Swimm started growing, we added new features, and we found that we simply couldn't keep up with changes.

We realized that our goal for a testing solution had two parts:

  1. Find a solution that allowed us to catch regressions bugs DURING development
  2. Save manual regression QA time

E2E testing seemed to be the right answer to our testing paradigm.

We ended up choosing Cypress

Pros

  • Awesome community

  • Great documentation

  • Great features: automatic waiting, automatic sreenshots & videos, time travel

  • Cypress is intuitive & easy to set up

  • Writing tests is fun

  • Using Cypress' API applies for user behavior

Cons

  • Lack of multi-tab support

  • Difficulty with iFrames

  • Limited browser support (just Chrome-based browsers & firefox)

Challenges of E2E testing

Wins:

  • Identified & fixed a lot of bugs

  • Saved so much time by not having to repeat manual flows weekly

  • Dramatically increased stability & coverage
    Challenges

  • Human vs machine testing

  • We had zero experience with e2e tests

  • Monitoring tests that are less reliable

  • It takes more time than you think

Key takeaways

  1. Appoint an owner for E2E testing
  2. Patience, patience, patience
  3. Write stable tests
  4. Trust. Your. Tests.
  5. Stable tests = stable product

Here's a detailed blog on how we implemented E2E testing.


This content originally appeared on DEV Community and was authored by Swimm 🤿


Print Share Comment Cite Upload Translate Updates
APA

Swimm 🤿 | Sciencx (2022-01-23T11:42:53+00:00) E2E testing: challenges & lessons learned. Retrieved from https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/

MLA
" » E2E testing: challenges & lessons learned." Swimm 🤿 | Sciencx - Sunday January 23, 2022, https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/
HARVARD
Swimm 🤿 | Sciencx Sunday January 23, 2022 » E2E testing: challenges & lessons learned., viewed ,<https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/>
VANCOUVER
Swimm 🤿 | Sciencx - » E2E testing: challenges & lessons learned. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/
CHICAGO
" » E2E testing: challenges & lessons learned." Swimm 🤿 | Sciencx - Accessed . https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/
IEEE
" » E2E testing: challenges & lessons learned." Swimm 🤿 | Sciencx [Online]. Available: https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/. [Accessed: ]
rf:citation
» E2E testing: challenges & lessons learned | Swimm 🤿 | Sciencx | https://www.scien.cx/2022/01/23/e2e-testing-challenges-lessons-learned/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.