April 13, 2018, Västerås, Sweden

InSTA 2018

5th International Workshop on Software Test Architecture

conjunction with ICST 2018

5th International Workshop on Software Test Architecture (InSTA) is the 5th series of international workshop on software test architecture. Software test architecture includes analyses of system under test, approaches to design test cases, and notation of software testing. Designing better software test architectures is important for software testing. The software test architecture is a key to the test strategy. In software testing, there are various keywords for test design concepts. However, there are no widely standardized diagrams or notations to communicate the test design concepts, to increase the productivity and reusability of tests by raising their levels of abstraction, to generally grasp the overall perspective of the software for testing it. By focusing on the higher concepts of test architectures, our discussions can raise the quality of the testing.

Test architectures must be approached indirectly as a part of the test strategies. Some organizations are working to establish new ways to design novel test architectures, but there is no unified understanding of the key concepts of test architectures. In InSTA workshop, researchers and practitioners will discuss the research works, industrial experiences and emerging ideas about software test architectures. The topics are concepts of test architectures like as abstraction of test cases, design of test architecture as application or enhancement of existing notation UML and UTP, test requirement analysis like as patterns for test requirement analysis, application of test architecture as quality evaluation of test architecture and other software testing related topics.

Past events

InSTA 2015
InSTA 2016
InSTA 2017

Program

Keynote

From hacking to product - Our journey from ad hoc tool development to an organised test system

Dr. Kristian Wiklund, Ericsson

Everyone knows that software architecture is “good”, but when it comes to test systems, it turns out that it can be a hard sell. Test systems are often informally developed and designed, but at the same time, they are absolutely mission critical. Recognizing this, we have transitioned over the last decade from ad hoc local implementation of “test scripts” to organized and structured development and maintenance of test systems that are products in their own right. This has been - and continue to be - an intense and eventful journey, where many of the insights and challenges we have encountered are related to architectural effects. I have been fortunate to participate in that journey, in many roles, as user, developer, project manager, researcher and product leader. In this presentation, I will share my views and experiences from this journey and connect it to what I perceive to be areas of future work.

Program

Time Session Title Authors
9:00 Opening
9:15 Keynote From hacking to product - Our journey from ad hoc tool development to an organised test system Kristian Wiklund
10:30 Break
11:00 Research paper Testing of big data analytics systems by benchmark Mingang Chen, et al.
11:30 Test case reduction based on the join condition in pairiwise coverage-based database testing Yuper Lay Myint, et al.
12:00 Model-based security testing - Deriving test models from artefacts of security engineering Armin Lunkeit, et al.
12:30 Lunch
14:00 Industry experience Software Test Architectures and Advanced Support Environments for IoT Jon Hagar
14:30 Extending the UML Testing Profile with a fine-grained test logging model Marc-Florian Wendland, et al.
15:00 Break
15:30 Emerging idea Proposal for Adding a “Test Concern” Concept to UTP2 Makoto Nakakuki, et al. (Presentation)
15:55 A Test Architecture for Machine Learning Product Yasuharu Nishi, et al.
16:20 A Survey of Software Quality for Machine Learning Applications Satoshi Masuda, et al.
16:45 Closing

Call for papers

Recommended Topics or Themes

Concepts of software test architecture

- Abstraction of test cases (e.g. test levels, test types, abstract equivalent classes, high-level test conditions and high-level test cases)
- Relationships of abstract test cases
- Separation of concerns for test
- Architecture of test suite based on abstract test cases (e.g. design of test levels and test types)
- Types of software test architecture (e.g. architecture of test suite and architecture of test system/environment)
- Similarities, differences and harmonization between test suite architecture and test system architecture
- Similarities and differences among software test architecture, test strategy, test plan and test sub-process in ISO/IEC/IEEE 29119

Design of software test architecture

- How to design several test levels
- How to design complicated test types and test cycles
- Design concepts for software test architecture design
- Modeling technique for software test architecture design
- Design patterns for software test architecture design
- Styles of software test architecture
- Quality characteristics of software test architecture (e.g. maintainability of test suite)
- Original diagrams and notation for software test architecture design
- Application or enhancement of existing notation (e.g. UML/UTP, SysML and future diagram for SPL)
- Connection of software test architecture design and test case design (e.g. structure of test case based on test architectural components)
- Meta-models or ontology for software test architectures

Test requirement analysis

- Whether software requirement specification is the goal of software test or not?
- How to model holistic test requirement
- How to model nonfunctional requirement for test
- How to organize test requirement for several source (e.g. from customer, from design and from environment)
- How to overview large-scale and complex requirements for test
- Analysis patterns for test requirement analysis
- Emerging techniques of test requirements analysis (e.g. using Natural Language Processing, Machine Learning, and etc.)

Application of software test architecture

- Quality evaluation of software test architecture
- Overall test engineering methodology based on software test architecture design
- Reuse of software test architecture design
- Product line engineering of test suite (e.g. how to design and manage variants of test suite)
- Design example of software test architecture for large-scale and complicated system
- Roles and responsibilities of test architect
- Automation based on software test architecture (e.g. separating automated test and manual test in keyword driven testing based on software test architecture)
- Test process improvement based on software test architecture
- Relationships between software architectures and software test architectures
- Typical software test architecture for a domain and/or comparison among domains (e.g. banking, logistics, cloud, automotive, medical, industrial automation and telecommunications)
- Industrial experiments and case studies of software test architectures

Paper Submission

• Research papers (up to 10 pages)
• Industrial experience reports (up to 6 pages)
• Emerging idea proposals (up to 6 pages)
Research papers require both original work and quantitative evaluation. Industrial experience reports require practical insight or actual improvement in industry as well as (quantitative if possible) evaluation. Emerging idea proposals require vision, perspective, concept, new idea, new research theme proposal and cross-technical discussion around test architecture design.

All papers must conform to IEEE's format: http://www.ieee.org/conferences_events/conferences/publishing/templates.html

Workshop papers will be published in the IEEE Digital Library in the form of a post-proceedings.

InSTA 2018 papers submissions site:
https://easychair.org/conferences/?conf=insta2018

Organization

General chairs

- General Co-Chair: Satoshi Masuda, IBM Research - Tokyo, Japan
- General Co-Chair: Yasuharu Nishi, The University of Electro-Communications, Tokyo, Japan

Program committee

- Jon Hagar, Grand Software Testing, USA
- Tetsuro Katayama, University of Miyazaki, Japan
- Zhenyu Liu, Shanghai Key Laboratory of Computer Software Testing and Evaluation, China
- Kazuhiko Tsuda, University of Tsukuba, Japan
- Hironori Washizaki, Waseda University, Japan
The program committee members are being invited.

Venue

InSTA 2018 will be held conjunction with ICST 2018, please see the details information about the venue.