Test matrix

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
(→Category)
(Refactoring layout a bit)
Line 1: Line 1:
'''Version 1.12'''
'''Version 1.12'''
-
This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!
+
This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!
-
The matrix is divided into five categories, each on its own page in this page.
+
-
 
+
= Category =
= Category =
-
*'''[[Matrix_functional_section|Functional]]''' Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.
+
==[[Matrix_functional_section|Functional Testing]]==
-
*'''[[Matrix_interop_section|Interoperability]]''' Ability to work with other versions of nfs, other operating systems and other software/filesystems/etc. generally associated with NFS
+
Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.
-
*'''[[Matrix_robustness_section|Robustness]]''' : Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc
+
-
*'''[[Matrix_performance_section|Performance]]''' : Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc
+
-
*'''[[Matrix_secutity_section|Security]]''' : Resistant to being compromised and difficult to attack
+
-
 
+
-
= Status Summary =
+
-
==Definitions==
+
-
 
+
-
*'''New''' : An owner has not been identified for the item and work has not started on it
+
-
*'''Open''': The task has been adopted, but either has not been started, or progress is not yet known
+
-
*'''In Progress''' : Some work has been completed on the task
+
-
*'''Near Done''': The principle essense of the task has been finished, but there are some loose ends left
+
-
*'''Done''': The task has been fully completed
+
-
 
+
-
==Functional Testing==
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
!style="background: #ececec;"|
!style="background: #ececec;"|
Line 45: Line 29:
|}
|}
-
==Interoperability Testing==
+
==[[Matrix_interop_section|Interoperability Testing]]==
 +
 
 +
Ability to work with other versions of NFS, other operating systems and other software/filesystems/etc. generally associated with NFS
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
Line 69: Line 55:
|}
|}
-
==Robustness Testing==
+
==[[Matrix_robustness_section|Robustness Testing]]==
 +
 
 +
Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
Line 93: Line 81:
|}
|}
-
==Performance Testing==
+
==[[Matrix_performance_section|Performance Testing]]==
 +
 
 +
Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc
 +
 
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
!style="background: #ececec;"|
!style="background: #ececec;"|
Line 116: Line 107:
|}
|}
-
==Security Testing==
+
==[[Matrix_security_sectionSecurity Testing]]==
 +
 
 +
Resistant to being compromised and difficult to attack
 +
 
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
!style="background: #ececec;"|
!style="background: #ececec;"|
Line 138: Line 132:
|9
|9
|}
|}
 +
 +
==Definitions==
 +
 +
*'''New''' : An owner has not been identified for the item and work has not started on it
 +
*'''Open''': The task has been adopted, but either has not been started, or progress is not yet known
 +
*'''In Progress''' : Some work has been completed on the task
 +
*'''Near Done''': The principle essense of the task has been finished, but there are some loose ends left
 +
*'''Done''': The task has been fully completed

Revision as of 22:50, 19 May 2005

Version 1.12

This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!

Contents

Category

Functional Testing

Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.

New Open In progress Near Done Done High Medium Low
current status 104 26 1 1 4 43 72 22

Interoperability Testing

Ability to work with other versions of NFS, other operating systems and other software/filesystems/etc. generally associated with NFS

New Open In progress Near Done Done High Medium Low
current status 55 12 0 0 1 33 12 25

Robustness Testing

Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc

New Open In progress Near Done Done High Medium Low
current status 43 4 1 0 3 32 8 2

Performance Testing

Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc

New Open In progress Near Done Done High Medium Low
current status 33 10 3 0 1 19 26 4

Matrix_security_sectionSecurity Testing

Resistant to being compromised and difficult to attack

New Open In progress Near Done Done High Medium Low
current status 28 4 0 0 1 14 9 9

Definitions

  • New : An owner has not been identified for the item and work has not started on it
  • Open: The task has been adopted, but either has not been started, or progress is not yet known
  • In Progress : Some work has been completed on the task
  • Near Done: The principle essense of the task has been finished, but there are some loose ends left
  • Done: The task has been fully completed
Retrieved from "http://linux-nfs.org/wiki/index.php/Test_matrix"
Personal tools