Embed Size (px)
Citation preview
Тест-менеджер:
достоинства, недостатки и
советы по применению на
примере TestRail
Oksana Kharchuk
QA Engineer
Недостатки работы без test management tool
• Отсутствует связь с баг репортами
• Трата времени на поиски необходимых тест кейсов
• Неудобное прохождение тест кейсов
• Неудобство предоставления отчетной информации заказчику
• Документация не упорядочена
• Документация не up to date
• У каждого члена команды своя версия документа
• Нет взаимодействия с автотестами
• Один член команды не имеет представления что тестирует другой
Mobile application testingP ro j ec t Nam e: Mobile testing
Mo b ile D ev ise: Google Nexus 7.2
Test er (s): Oksana
Test En v iro n m en t : Android 4.3
high
Test Case No
Sc en ar io NoP r io r it ies Test Su m m ary P rec o n d it io n s St ep s Ex p ec t ed Resu lt
Functional ity
1 .1 high Verifying the possibility to open web site
1. The device is connected to the Internet.
2. The browser is opened. 1.Input link http://pencil.evolus.vn into browser's adress field.
2. Follow to link The Page http://pencil.evolus.vn is open
1.2 high Portrait/Landscape view the Home page of web site
1. The device is connected to the Internet.
2. The browser is opened.
3. The tab is oriented Landscape.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Rotate device to Portrait and check view
4. Rotate device toLandscape and check view
1. The Header and Footer are present
2. Image of Preview Pencil Tool is present.
3. The button "Download" is present.
4. Some informatioon about application is present.
1 .3 highVerifing the possibility to download application
"Pencil"
1. The device is connected to the Internet.
2. The browser is opened.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Click to the button "Download for Android"
1. The application is downloaded in mobile device.
2. User can install application.
1 .4 high Unsuccessful download when connection is lost
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – switch off the Internet (WiFi/Mobile data).
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Download is unsuccessful.
2. Unsuccessful notification is shown.
3. Downloaded file is not in ‘Download’ folder.
1.5 highVerifing the possibility to download the application
when screen is turn off
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – turn off screen, afrer 10 sec turn on it
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Browser is opened with appropriate site.
2. Download is successful.
3. Downloaded file is displayed at the Notifications.
4. Downloaded file is in ‘Download’ folder.
1.6 high Verifying the possibility to open web site
1. The device is connected to the Internet.
2. The browser is opened. 1.Input link http://pencil.evolus.vn into browser's adress field.
2. Follow to link The Page http://pencil.evolus.vn is open
1.7 high Portrait/Landscape view the Home page of web site
1. The device is connected to the Internet.
2. The browser is opened.
3. The tab is oriented Landscape.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Rotate device to Portrait and check view
4. Rotate device toLandscape and check view
1. The Header and Footer are present
2. Image of Preview Pencil Tool is present.
3. The button "Download" is present.
4. Some informatioon about application is present.
1 .8 highVerifing the possibility to download application
"Pencil"
1. The device is connected to the Internet.
2. The browser is opened.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Click to the button "Download for Android"
1. The application is downloaded in mobile device.
2. User can install application.
1 .9 high Unsuccessful download when connection is lost
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – switch off the Internet (WiFi/Mobile data).
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Download is unsuccessful.
2. Unsuccessful notification is shown.
3. Downloaded file is not in ‘Download’ folder.
1.10 highVerifing the possibility to download the application
when screen is turn off
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – turn off screen, afrer 10 sec turn on it
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Browser is opened with appropriate site.
2. Download is successful.
3. Downloaded file is displayed at the Notifications.
4. Downloaded file is in ‘Download’ folder.
1.11 high Verifying the possibility to open web site
1. The device is connected to the Internet.
2. The browser is opened. 1.Input link http://pencil.evolus.vn into browser's adress field.
2. Follow to link The Page http://pencil.evolus.vn is open
1.12 high Portrait/Landscape view the Home page of web site
1. The device is connected to the Internet.
2. The browser is opened.
3. The tab is oriented Landscape.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Rotate device to Portrait and check view
4. Rotate device toLandscape and check view
1. The Header and Footer are present
2. Image of Preview Pencil Tool is present.
3. The button "Download" is present.
4. Some informatioon about application is present.
1 .13 highVerifing the possibility to download application
"Pencil"
1. The device is connected to the Internet.
2. The browser is opened.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Click to the button "Download for Android"
1. The application is downloaded in mobile device.
2. User can install application.
1 .14 high Unsuccessful download when connection is lost
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – switch off the Internet (WiFi/Mobile data).
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Download is unsuccessful.
2. Unsuccessful notification is shown.
3. Downloaded file is not in ‘Download’ folder.
1.15 highVerifing the possibility to download the application
when screen is turn off
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – turn off screen, afrer 10 sec turn on it
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Browser is opened with appropriate site.
2. Download is successful.
3. Downloaded file is displayed at the Notifications.
4. Downloaded file is in ‘Download’ folder.
Жизнь тестировщика без
test management tool
Или так
Спасение есть!!!
Что такое Test Management Tool?
Согласно ISTQB:
Полезный инструмент, помогающий в управлении тестированием и
контроле процесса тестирования. Обычно включает в себя такие
функции как:
• управление тестовым обеспечением
• планирование графика тестов
• протоколирование результатов
• отслеживание прогресса
• управление инцидентами
• составление отчетов о тестировании.
Анализ ваших требований к
Test Management Tool
• Объем информации
• Удобная совместная работа
• Возможность разбиения информации по разным репозиториям
• Интеграция с баг трекинговыми системами
• Спец требования вашего проекта (сколько человек в команде,
автоматизация, размещение инструмента, политика проекта,
поддержка)
Как продать Test Rail?
• Описать все плюсы, которые влечет за собой приобретение данного
продукта
• Показать наглядный пример использования продукта с реальными
данными заказчика
• Исходить из потребностей проекта
• О цене говорить в последнюю очередь
• Дать заказчику возможность подумать
Как это делали мы: Benefits for customer
• Save time for supporting test cases up to date
• Save time for test cases execution
• Save time to perform functional and regression testing
• Save time for analyzing regression results
• Track test results and provide reports
• Organize test suites, sections and cases
• Project iterations: separate testing process for iterations
• Integration with TFS, Automation framework
• Usable UI
• Highly flexible and customizable for our needs
• Convenient in collaboration work
• Flexible permission configuration
Цена вопроса:
• Manage Test cases
• Monitor Defects
• Monitor Automated tests
• Reports about testing progress
• All information in one place
• Increase quality level
Что нам дал Test Rail
Достоинства Test Rail:
• Удобный в использовании
• Очень гибкий инструмент
• Легко создавать тест кейсы, тест раны
• Интеграция с баг трекинговой системой
• Генерация отчетов
• Экономия времени
• Хорошая поддержка
• Много обучающих видео по работе с Test Rail
Недостатки Test Rail
• Нет готового решения для автоматизации
• Цена
Questions?
