Test matrix

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
(→Functional Testing)
 
(26 intermediate revisions not shown)
Line 1: Line 1:
-
'''Version 1.12'''
+
This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!
-
This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!
+
==[[Matrix_functional_section|Functional Testing]]==
-
The matrix is divided into five categories, each on its own page in this page.
+
Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.
 +
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
 +
!style="background: #ececec;"|
 +
!style="background: #ececec;"|'''New'''
 +
!style="background: #ececec;"|'''Open'''
 +
!style="background: #ececec;"|'''In progress'''
 +
!style="background: #ececec;"|'''Near Done'''
 +
!style="background: #ececec;"|'''Done'''
 +
!style="background: #ececec;"|'''High'''
 +
!style="background: #ececec;"|'''Medium'''
 +
!style="background: #ececec;"|'''Low'''
 +
|-
 +
|current status
 +
|102
 +
|30
 +
|1
 +
|0
 +
|5
 +
|43
 +
|72
 +
|22
 +
|}
 +
==[[Matrix_interop_section|Interoperability Testing]]==
-
= Category =
+
Ability to work with other versions of NFS, other operating systems and other software/filesystems/etc. generally associated with NFS
-
*'''[[Matrix_functional_section|Functional]]''' Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
*'''[[Matrix_interop_section|interop]]''' Ability to work with other versions of nfs, other operating systems and other software/filesystems/etc. generally associated with NFS
+
!style="background: #ececec;"|
-
*'''[[Matrix_robustness_section|Robustness]]''' : Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc
+
!style="background: #ececec;"|'''New'''
-
*'''[Matrix_performance_section|Performance]]''' : Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc
+
!style="background: #ececec;"|'''Open'''
-
*'''[[Matrix_secutity_section|security]]''' : Resistant to being compromised and difficult to attack
+
!style="background: #ececec;"|'''In progress'''
 +
!style="background: #ececec;"|'''Near Done'''
 +
!style="background: #ececec;"|'''Done'''
 +
!style="background: #ececec;"|'''High'''
 +
!style="background: #ececec;"|'''Medium'''
 +
!style="background: #ececec;"|'''Low'''
 +
|-
 +
|current status
 +
|57
 +
|12
 +
|0
 +
|0
 +
|1
 +
|33
 +
|12
 +
|25
 +
|}
-
= Status Summary =
+
==[[Matrix_robustness_section|Robustness Testing]]==
-
==Definitions==
+
-
*'''New''' : An owner has not been identified for the item and work has not started on it
+
Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc
-
*'''Open''': The task has been adopted, but either has not been started, or progress is not yet known
+
-
*'''In Progress''' : Some work has been completed on the task
+
-
*'''Near Done''': The principle essense of the task has been finished, but there are some loose ends left
+
-
*'''Done''': The task has been fully completed
+
-
==Functional Testing==
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<center>
+
!style="background: #ececec;"|
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|'''New'''
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''Open'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''In progress'''
-
<td>'''New'''</td>
+
!style="background: #ececec;"|'''Near Done'''
-
<td>'''Open'''</td>
+
!style="background: #ececec;"|'''Done'''
-
<td>'''In progress'''</td>
+
!style="background: #ececec;"|'''High'''
-
<td>'''Near Done'''</td>
+
!style="background: #ececec;"|'''Medium'''
-
<td>'''Done'''</td>
+
!style="background: #ececec;"|'''Low'''
-
<td>'''High'''</td>
+
|-
-
<td>'''Medium'''</td>
+
|current status
-
<td>'''Low'''</td>
+
|29 <!-- It was 37 -->
-
</tr>
+
|6
-
<tr>
+
|1  
-
<td>
+
|2 <!-- add maximum files exported / mounted  -->
-
Current status</td>
+
|6 <!-- tests ffsb/fsstress and IOZone running long periods (1 week) + disk limits on server/client  maximum file size (=local fs)-->
-
<td>104</td>
+
|32
-
<td>26</td>
+
|8
-
<td>1</td>
+
|2
-
<td>1</td>
+
|}
-
<td>4</td>
+
-
<td>43</td>
+
-
<td>72</td>
+
-
<td>22</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
-
==Interoperability Testing==
+
==[[Matrix_performance_section|Performance Testing]]==
-
<center>
+
Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc
-
<table nosave="" border="1" width="85%">
+
-
<tr nosave="" align="center" valign="CENTER">
+
-
<td nosave="" align="center" valign="CENTER"></td>
+
-
<td>'''New'''</td>
+
-
<td>'''Open'''</td>
+
-
<td>'''In progress'''</td>
+
-
<td>'''Near Done'''</td>
+
-
<td>'''Done'''</td>
+
-
<td>'''High'''</td>
+
-
<td>'''Medium'''</td>
+
-
<td>'''Low'''</td>
+
-
</tr>
+
-
<tr>
+
-
<td>
+
-
Current status</td>
+
-
<td>55</td>
+
-
<td>12</td>
+
-
<td>0</td>
+
-
<td>0</td>
+
-
<td>1</td>
+
-
<td>33</td>
+
-
<td>12</td>
+
-
<td>25</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
-
==Robustness Testing==
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
 +
!style="background: #ececec;"|
 +
!style="background: #ececec;"|'''New'''
 +
!style="background: #ececec;"|'''Open'''
 +
!style="background: #ececec;"|'''In progress'''
 +
!style="background: #ececec;"|'''Near Done'''
 +
!style="background: #ececec;"|'''Done'''
 +
!style="background: #ececec;"|'''High'''
 +
!style="background: #ececec;"|'''Medium'''
 +
!style="background: #ececec;"|'''Low'''
 +
|-
 +
|current status
 +
|35
 +
|10
 +
|6
 +
|1
 +
|3
 +
|19
 +
|26
 +
|4
 +
|}
-
<center>
+
==[[Matrix_security_section|Security Testing]]==
-
<table nosave="" border="1" width="85%">
+
-
<tr nosave="" align="center" valign="CENTER">
+
-
<td nosave="" align="center" valign="CENTER"></td>
+
-
<td>'''New'''</td>
+
-
<td>'''Open'''</td>
+
-
<td>'''In progress'''</td>
+
-
<td>'''Near Done'''</td>
+
-
<td>'''Done'''</td>
+
-
<td>'''High'''</td>
+
-
<td>'''Medium'''</td>
+
-
<td>'''Low'''</td>
+
-
</tr>
+
-
<tr>
+
-
<td>
+
-
Current status</td>
+
-
<td>37</td>
+
-
<td>4</td>
+
-
<td>1</td>
+
-
<td>0</td>
+
-
<td>0</td>
+
-
<td>32</td>
+
-
<td>8</td>
+
-
<td>2</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
-
==Performance Testing==
+
Resistant to being compromised and difficult to attack
-
<center>
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''New'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''Open'''
-
<td>'''New'''</td>
+
!style="background: #ececec;"|'''In progress'''
-
<td>'''Open'''</td>
+
!style="background: #ececec;"|'''Near Done'''
-
<td>'''In progress'''</td>
+
!style="background: #ececec;"|'''Done'''
-
<td>'''Near Done'''</td>
+
!style="background: #ececec;"|'''High'''
-
<td>'''Done'''</td>
+
!style="background: #ececec;"|'''Medium'''
-
<td>'''High'''</td>
+
!style="background: #ececec;"|'''Low'''
-
<td>'''Medium'''</td>
+
|-
-
<td>'''Low'''</td>
+
|current status
-
</tr>
+
|28
-
<tr>
+
|4
-
<td>
+
|0
-
Current status</td>
+
|0
-
<td>33</td>
+
|1
-
<td>10</td>
+
|14
-
<td>3</td>
+
|9
-
<td>0</td>
+
|9
-
<td>1</td>
+
|}
-
<td>19</td>
+
-
<td>26</td>
+
-
<td>4</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
-
==Security Testing==
+
==Definitions==
-
<center>
+
*'''New''' : An owner has not been identified for the item and work has not started on it
-
<table nosave="" border="1" width="85%">
+
*'''Open''': The task has been adopted, but either has not been started, or progress is not yet known
-
<tr nosave="" align="center" valign="CENTER">
+
*'''In Progress''' : Some work has been completed on the task
-
<td nosave="" align="center" valign="CENTER"></td>
+
*'''Near Done''': The principle essense of the task has been finished, but there are some loose ends left
-
<td>'''New'''</td>
+
*'''Done''': The task has been fully completed
-
<td>'''Open'''</td>
+
-
<td>'''In progress'''</td>
+
-
<td>'''Near Done'''</td>
+
-
<td>'''Done'''</td>
+
-
<td>'''High'''</td>
+
-
<td>'''Medium'''</td>
+
-
<td>'''Low'''</td>
+
-
</tr>
+
-
<tr>
+
-
<td>
+
-
Current status</td>
+
-
<td>28</td>
+
-
<td>4</td>
+
-
<td>0</td>
+
-
<td>0</td>
+
-
<td>1</td>
+
-
<td>14</td>
+
-
<td>9</td>
+
-
<td>9</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+

Latest revision as of 09:25, 14 November 2005

This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know!

Contents

Functional Testing

Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.

New Open In progress Near Done Done High Medium Low
current status 102 30 1 0 5 43 72 22

Interoperability Testing

Ability to work with other versions of NFS, other operating systems and other software/filesystems/etc. generally associated with NFS

New Open In progress Near Done Done High Medium Low
current status 57 12 0 0 1 33 12 25

Robustness Testing

Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc

New Open In progress Near Done Done High Medium Low
current status 29 6 1 2 6 32 8 2

Performance Testing

Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc

New Open In progress Near Done Done High Medium Low
current status 35 10 6 1 3 19 26 4

Security Testing

Resistant to being compromised and difficult to attack

New Open In progress Near Done Done High Medium Low
current status 28 4 0 0 1 14 9 9

Definitions

  • New : An owner has not been identified for the item and work has not started on it
  • Open: The task has been adopted, but either has not been started, or progress is not yet known
  • In Progress : Some work has been completed on the task
  • Near Done: The principle essense of the task has been finished, but there are some loose ends left
  • Done: The task has been fully completed
Retrieved from "http://linux-nfs.org/wiki/index.php/Test_matrix"
Personal tools