HT02 - Test Methodology for NFV: Difference between revisions

From NFVwiki
 
(12 intermediate revisions by the same user not shown)
Line 2: Line 2:
This Hot Topic has the following goals:
This Hot Topic has the following goals:


* Validate and improve the Test Methodology guidelines and templates being described in TST001 and TST002.
* Validate and improve the Test Methodology guidelines and templates being described in TST002.
 
* Contribute Interoperability Test Descriptions & guidelines to TST007.  


* Compile a collection of examples of the application of such guidelines and templates in the context in NFV PoCs : Systems Under Test configurations, Test Descriptions, etc,
* Compile a collection of examples of the application of such guidelines and templates in the context in NFV PoCs : Systems Under Test configurations, Test Descriptions, etc,
Line 8: Line 10:
These goals may be met in a PoC whose focus is testing, or as additional goals for a PoC primarily addressing another topic.
These goals may be met in a PoC whose focus is testing, or as additional goals for a PoC primarily addressing another topic.


[https://docbox.etsi.org/ISG/NFV/TST/05-CONTRIBUTIONS/2015//NFVTST(15)000084r4_Hot_topic__Testing_in_NFV_POC.zip HT#2 (TST) Test Methodology for NFV]
[https://docbox.etsi.org/ISG/NFV/TST/05-CONTRIBUTIONS/2015//NFVTST(15)000084r5_Hot_topic__Test_Methodology_for_NFV.zip HT#2 (TST) Test Methodology for NFV]


= Status =
= Status =
Line 16: Line 18:


==Points to prove/refute==
==Points to prove/refute==
• For '''TST001- Pre deployment validation'''
# validate and suggest improvements to SUT configurations
# validate and suggest improvements for the Test Description template
# provide descriptions (following the Test Description template) of pre-deployment scenarios successfully tested by the PoC Team in a reproducible way
• For '''TST002 – Interoperability Test Methodology'''
• For '''TST002 – Interoperability Test Methodology'''
# validate and suggest improvements for the Test Description template (section 4)
# validate and suggest improvements for the Test Description template (section 4)
# identify the functions under test in the context of the PoC
# identify the functions under test in the context of the PoC
# provide the list of interoperability features tested by the PoC, and the impacted entities (see http://nfvprivatewiki.etsi.org/index.php?title=IOP_Methodology)
# provide the list of interoperability features tested by the PoC, and the impacted entities (see analysis in [http://nfvprivatewiki.etsi.org/index.php?title=IOP_Methodology the WIKI])
# Provide SUT configurations tested by the PoC Team following the guidelines in section 4. Identify the test interfaces (where actions are triggered and observed)
# Provide SUT configurations tested by the PoC Team following the guidelines in section 4. Identify the test interfaces (where actions are triggered and observed)
# provide descriptions (following the Test Description template) of interoperability features successfully tested by the PoC Team in a reproducible way
# provide descriptions (following the Test Description template) of interoperability features successfully tested by the PoC Team in a reproducible way
• For '''TST007 – VIM- VNFM Interoperability Testing Guidelines'''
# validate, suggest improvements and contribute additional Test Descriptions


==Criterion of success==
==Criterion of success==
• Provide input and concrete examples to at least one of the 2 WIs (TST001 or TST002)  
• Provide input and concrete examples to at least one of the 2 WIs (TST002 or TST007)  


== Other information ==
== Other information ==
Provide feedback to other NFV Working Groups on the items that have been validated by the testing and/or the gaps identified in the specifications.
Provide feedback to other NFV Working Groups on the items that have been validated by the testing and/or the gaps identified in the specifications.


= Technical information to be provided by the PoC Team=
* For '''TST002 - Interoperability Test methodology'''
* TST001 - Pre-deployment validation
# SUT configurations (as exercised by the POC)  
# SUT configurations (as exercised by the POC)  
# Pre-deployment validation Test Descriptions (run by the POC, following TD template)  
# List of NFV IOP Features tested by the POC project
PoC Teams shall follow the [[Media:HT_2_FB_Template_TST001.doc | HT#2 FB-TST001]]  on their contributions to Hot Topic#2 - TST001
# IOP Test Descriptions (run by the POC, following TD template)  
# Lessons learnt and suggestions for improvements in the methodologies
PoC Teams shall follow the [[Media:HT_2_FB_Template_TST002.doc | HT#2-TST002 Feedback Template]]  on their contributions to Hot Topic#2 - TST002


* TST002 - Interoperability Test methodology
* For '''TST007 - VIM-VNFM Interoperability Testing Guidelines'''
# SUT configurations (as exercised by the POC)  
# SUT configurations (as exercised by the POC)  
# List of NFV IOP Features tested by the POC project
# List of NFV IOP Features tested by the POC project
# IOP Test Descriptions (run by the POC, following TD template)  
# IOP Test Descriptions (run by the POC, following TD template)  
# Lessons learnt and suggestions for improvements in the methodologies
# Lessons learnt and suggestions for improvements in the methodologies
PoC Teams shall follow the [[Media:HT_2_FB_Template_TST007.doc | HT#2-TST007 Feedback Template]]  on their contributions to Hot Topic#2 - TST007


=Concerned WGs/WI=  
=Concerned WGs/WI=  
TST WG – [http://webapp.etsi.org/WorkProgram/Report_WorkItem.asp?WKI_ID=44516 EVE005: Report on SDN Usage in NFV Architectural Framework] - [http://docbox.etsi.org/ISG/NFV/Open/Drafts/EVE005_SDN_usage_in_NFV_Report/ Latest draft]
TST WG:
 
• TST WG – TST001
• TST WG – TST002


[http://webapp.etsi.org/WorkProgram/Report_WorkItem.asp?WKI_ID=46009 TST001] - [http://docbox.etsi.org/ISG/NFV/Open/Drafts/TST001_-_Pre-deployment_Validation/ Latest draft]
* [http://webapp.etsi.org/WorkProgram/Report_WorkItem.asp?WKI_ID=46043 TST002 - Interoperability Test Methodology] - [http://docbox.etsi.org/ISG/NFV/Open/Drafts/TST002_Interoperability_Testing_Methodology/ Latest draft]


[http://webapp.etsi.org/WorkProgram/Report_WorkItem.asp?WKI_ID=46043 TST002] - [http://docbox.etsi.org/ISG/NFV/Open/Drafts/TST002_Interoperability_Testing_Methodology/ Latest draft]
* [http://webapp.etsi.org/WorkProgram/Report_WorkItem.asp?WKI_ID=49500 TST007 - VIM-VNFM Interoperability Testing Guidelines] - [http://docbox.etsi.org/ISG/NFV/Open/Drafts/TST007_VIM_VNFM_Iop_Testing_Guidelines/ Latest draft]


=Coordinator=
=Coordinator=
Line 60: Line 59:


=Contributions (feedback) deadline=
=Contributions (feedback) deadline=
Q3 2015
Q4 2016

Latest revision as of 09:32, 14 April 2016

Description

This Hot Topic has the following goals:

  • Validate and improve the Test Methodology guidelines and templates being described in TST002.
  • Contribute Interoperability Test Descriptions & guidelines to TST007.
  • Compile a collection of examples of the application of such guidelines and templates in the context in NFV PoCs : Systems Under Test configurations, Test Descriptions, etc,

These goals may be met in a PoC whose focus is testing, or as additional goals for a PoC primarily addressing another topic.

HT#2 (TST) Test Methodology for NFV

Status

ACTIVE

What is expected to be learnt from the NFV PoCs

Points to prove/refute

• For TST002 – Interoperability Test Methodology

  1. validate and suggest improvements for the Test Description template (section 4)
  2. identify the functions under test in the context of the PoC
  3. provide the list of interoperability features tested by the PoC, and the impacted entities (see analysis in the WIKI)
  4. Provide SUT configurations tested by the PoC Team following the guidelines in section 4. Identify the test interfaces (where actions are triggered and observed)
  5. provide descriptions (following the Test Description template) of interoperability features successfully tested by the PoC Team in a reproducible way

• For TST007 – VIM- VNFM Interoperability Testing Guidelines

  1. validate, suggest improvements and contribute additional Test Descriptions

Criterion of success

• Provide input and concrete examples to at least one of the 2 WIs (TST002 or TST007)

Other information

Provide feedback to other NFV Working Groups on the items that have been validated by the testing and/or the gaps identified in the specifications.

  • For TST002 - Interoperability Test methodology
  1. SUT configurations (as exercised by the POC)
  2. List of NFV IOP Features tested by the POC project
  3. IOP Test Descriptions (run by the POC, following TD template)
  4. Lessons learnt and suggestions for improvements in the methodologies

PoC Teams shall follow the HT#2-TST002 Feedback Template on their contributions to Hot Topic#2 - TST002

  • For TST007 - VIM-VNFM Interoperability Testing Guidelines
  1. SUT configurations (as exercised by the POC)
  2. List of NFV IOP Features tested by the POC project
  3. IOP Test Descriptions (run by the POC, following TD template)
  4. Lessons learnt and suggestions for improvements in the methodologies

PoC Teams shall follow the HT#2-TST007 Feedback Template on their contributions to Hot Topic#2 - TST007

Concerned WGs/WI

TST WG:

Coordinator

NFV TST vice-chair: Marie-Paule Odini, HP Marie-paule.odini@hp.com

Contributions (feedback) deadline

Q4 2016