Upload
abhinav-das
View
153
Download
1
Embed Size (px)
Citation preview
TenXLabsDigital Enterprise: Testing As a Service -“TaaS”
www.tenxlabs.com 2
Requirements of Current Quality Organizations
• Ability to handle fractional QA needs.• Continuously upgrade testing skills to be in line with
new technology.• Reduce spend on owning and maintaining testing
infrastructure.• Drive reusability and reliability of solutions.
www.tenxlabs.com 3
Introducing TaaS
• Testing as a Service (TaaS) is an outsourcing model in which testing activities associated with some of an organization's business activities are performed by a service provider rather than employees.
www.tenxlabs.com 4
TaaS: Next Gen Delivery Platform
http://www.anztb.org/userfiles/files/Robert%20Abbey%20-%20Testing%20as%20a%20Service.pdf
5
TaaS Solutions
•Load and stress testing
•Performance profiling and monitoring
•Compliance to legal requirements like Section 508 and WCAG.
•Usability aspects
•Penetration Testing
•Network Security Testing
•Social Engineering
•Automation and execution•Crowd testing•Cloud setup•Cross platform
Functional Testing
Security Testing
Performance Testing
Usability& Accessibility
www.tenxlabs.com
Mobility Testing IoT Testing ETL
Open Source, Commercial , Hybrid platform solutions
6
Evaluate TaaS For:
www.tenxlabs.com
Testing demands that are morefractional in nature
Performance, Security and Usability Testing Browser Compatibility Testing
Testing needs that requires complexskills and infrastructure (Tools & Environment)
Mobile Applications Testing Security Testing
No dedicated testing groups or capacity is available
Tech upgrade Testing One time internal projects
Test Asset Management & IncreasedCapacity Utilization through SharedInfrastructure
Tools Provisioning Test Packs and Test Data Management
http://www.anztb.org/userfiles/files/Robert%20Abbey%20-%20Testing%20as%20a%20Service.pdf
www.tenxlabs.com 7
Characteristics of TaaS
TaaS
On Demand
Pay As You go
Specialized
Standardized
Service Focused
www.tenxlabs.com 8
Characteristics of TaaSTa
aSOn Demand
Pay As You goSpecialized
StandardizedService Focused
Traditional Model• Test Environment :Manually created and
maintained.• Resources : Ongoing expense, pipeline
maintained• Agility is low since people to validate and
execute new ideas are not readily available
TaaS• Test Environment :Created dynamically as
required.• Resources: Right resources on-boarded quickly• New ideas can be validated quickly since right
resources can selected quickly
9
Characteristics of TaaSTa
aSOn Demand
Pay As You goSpecialized
StandardizedService Focused
Traditional Model• Ongoing cost of maintaining people and
skills independent of utilization: Resource Costing
• Team size cannot easily be scaled up or down
• Test tools are purchased and owned
TaaS• Pay for only utilized people: Value costing.• Team size can be scaled up and down as
needed• Test tools are paid based on usage.
www.tenxlabs.com
10
Characteristics of TaaSTa
aSOn Demand
Pay As You goSpecialized
StandardizedService Focused
Traditional Model• Need to maintain a team with skills that
are both broad and deep• Ongoing hiring needed to seed the team
with technology thought leaders• Project based group
TaaS• TaaS service provider makes available test
architects and thought leaders as required• Deep expertise available across entire
technology spectrum• Skill based group.
www.tenxlabs.com
11
Characteristics of TaaSTa
aSOn Demand
Pay As You goSpecialized
StandardizedService Focused
Traditional Model• Ongoing costs of staying up to date with
changing standards and tools• Sub-optimal use / no use of new tools
because of near continuous learning curve.
TaaS• TaaS service provider brings up to date
best practices, standards and tools• Up to date knowledge and optimal use of
tools is guaranteed.
www.tenxlabs.com
12
Characteristics of TaaSTa
aSOn Demand
Pay As You goSpecialized
StandardizedService Focused
Traditional Model• People centric requirement selection is
driven by availability of resources• Organizational focus is diluted by the need
to focus to non-core functions• Complacency tends to set in.
TaaS• Result centric since resource are selected
based on desired business outcomes• Non-core functions outsourced to external
experts• No room for complacency.
www.tenxlabs.com
www.tenxlabs.com 13
Consideration when options for TaaS
• Provide testers enough domain and product knowledge required for efficient and effective testing
• Invest in tools for collaboration with developers.• Understand the vendor offerings and service levels.• Do a low stake pilot exercise if required.• Ensure reversibility and migration i.e. vendor lock-in
should not happen.
www.tenxlabs.com 14
TaaS Process
Strategize and Plan
Develop Governance
Execute, Monitor and Refine
Establish your business need as per security, privacy, availability of in-house skill set and onsite/offsite resource presence. Involve legal advisors and authorities as required.
Draft requirements for vendors. Identify and interview them.
Leverage social media to evaluate their competency.
Seek to run a pilot program
Establish clear policies on team management, data security, IP protection. Demand compliance.
Communicate clear outcome desired and metrics for measurement.
Establish communication and reporting channels and ways to monitor progress.
Understand and agree on any costs in addition to service.
Identify any breaches in goals and corrective action.
Track progress trajectory to ensure work is delivered in time bound manner with agreed upon quality.
Measure outcome and compare against set goals.
Ask for trainings as required.
Follow agreed upon payment model.
www.tenxlabs.com 15
Summary
• TaaS offerings provide substantial benefits but prudence lies in validating if it can be easily customized and adopted by the internal business organization.
• While potential of Cloud based TaaS is huge, its deployment may vary from one industry to another.
• The service works best where volumes are high and workload can be easily delinked from live operations. This makes outsourcing easier to manage.
• True benefit of TaaS lies in aligning the pricing to successful outcome based models.
Case Study 1: Low cost mobile automation & performance solution
• A private travel booking company in India looking for end to end testing solution for stabilizing its mobile travel booking app
About Client
• Provide a robust reusable cross platform automation solution.
• Performance profiling and monitoring setup to identify resource consumption and weak points.
• Community testing performed to provide holistic feedback.
• 50% decrease in customer complaints.• Consistent and reliable user experience.• Substantial cost saving by leveraging offshore
team, test automation and reuse of components.
• Comprehensive solution allowing faster roll out of updates.
• No streamlined quality assurance strategy on various mobile platforms.
• No insights into app performance on real devices.
• Poor end user experience frequent app outages.
TenXLabs Solution
Business Challenge
Business Benefits
Case Study 2: Cross Platform Automation Solution for Agile Testing
• A popular educational publisher which provides an integrated solution to cater to collaboration needs of teachers, students and admins.
About Client
• Provide automation solution with GitHub, Travis, Selenium and Sauce Labs using Robot Framework.
• Private crowd testing was introduced for each release to identify usability issues.
• Reusable assets were leveraged to reduce turnaround time.
• Left shift quality.• Time for testing enhancements was reduced
to one business day.• Automation solution was extended to spin off
demo environments on demand with SLA of 3 hours.
• Test strategy to provide ability to roll out updates quickly and cater to frequent build cycles.
• Application was to be tested on various devices with OS and browsers.
• Sales env spin off SLA was 5 days
TenXLabs Solution
Business Challenge
Business Benefits
TenXLabs TaaS Offerings
www.tenxlabs.com 18
1
5
4
6
3
2
Test ExecutionOvercome test schedule challenges
Test AutomationUse 10x proprietary framework to deliver reliable automation suite
Mobile App AutomationX platform mobile test automation
suite
Test Design and ExecutionRely on scientific techniques to get the optimal test case suiteReduce time to market
Performance TestingOn demand performance test services
Mobile App TestingMobile platform compatibility
Mobile AppTesting Types
www.tenxlabs.com 19
Q & A
TenXLabsBlock B6, Vindhya C6IIIT Campus, GachibowliHyderabad, 500032Indiawww.tenxlabs.com