Test matrix

From Linux NFS

(Difference between revisions)
Jump to: navigation, search
(→Functional Testing)
Line 47: Line 47:
==Interoperability Testing==
==Interoperability Testing==
-
<center>
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''New'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''Open'''
-
<td>'''New'''</td>
+
!style="background: #ececec;"|'''In progress'''
-
<td>'''Open'''</td>
+
!style="background: #ececec;"|'''Near Done'''
-
<td>'''In progress'''</td>
+
!style="background: #ececec;"|'''Done'''
-
<td>'''Near Done'''</td>
+
!style="background: #ececec;"|'''High'''
-
<td>'''Done'''</td>
+
!style="background: #ececec;"|'''Medium'''
-
<td>'''High'''</td>
+
!style="background: #ececec;"|'''Low'''
-
<td>'''Medium'''</td>
+
|-
-
<td>'''Low'''</td>
+
|current status
-
</tr>
+
|55
-
<tr>
+
|12
-
<td>
+
|0
-
Current status</td>
+
|0
-
<td>55</td>
+
|1
-
<td>12</td>
+
|33
-
<td>0</td>
+
|12
-
<td>0</td>
+
|25
-
<td>1</td>
+
|}
-
<td>33</td>
+
-
<td>12</td>
+
-
<td>25</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
==Robustness Testing==
==Robustness Testing==
-
<center>
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''New'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''Open'''
-
<td>'''New'''</td>
+
!style="background: #ececec;"|'''In progress'''
-
<td>'''Open'''</td>
+
!style="background: #ececec;"|'''Near Done'''
-
<td>'''In progress'''</td>
+
!style="background: #ececec;"|'''Done'''
-
<td>'''Near Done'''</td>
+
!style="background: #ececec;"|'''High'''
-
<td>'''Done'''</td>
+
!style="background: #ececec;"|'''Medium'''
-
<td>'''High'''</td>
+
!style="background: #ececec;"|'''Low'''
-
<td>'''Medium'''</td>
+
|-
-
<td>'''Low'''</td>
+
|current status
-
</tr>
+
|37
-
<tr>
+
|4
-
<td>
+
|1
-
Current status</td>
+
|0
-
<td>37</td>
+
|0
-
<td>4</td>
+
|32
-
<td>1</td>
+
|8
-
<td>0</td>
+
|2
-
<td>0</td>
+
|}
-
<td>32</td>
+
-
<td>8</td>
+
-
<td>2</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
==Performance Testing==
==Performance Testing==
-
 
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<center>
+
!style="background: #ececec;"|
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|'''New'''
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''Open'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''In progress'''
-
<td>'''New'''</td>
+
!style="background: #ececec;"|'''Near Done'''
-
<td>'''Open'''</td>
+
!style="background: #ececec;"|'''Done'''
-
<td>'''In progress'''</td>
+
!style="background: #ececec;"|'''High'''
-
<td>'''Near Done'''</td>
+
!style="background: #ececec;"|'''Medium'''
-
<td>'''Done'''</td>
+
!style="background: #ececec;"|'''Low'''
-
<td>'''High'''</td>
+
|-
-
<td>'''Medium'''</td>
+
|current status
-
<td>'''Low'''</td>
+
|33
-
</tr>
+
|10
-
<tr>
+
|3
-
<td>
+
|0
-
Current status</td>
+
|1
-
<td>33</td>
+
|19
-
<td>10</td>
+
|26
-
<td>3</td>
+
|4
-
<td>0</td>
+
|}
-
<td>1</td>
+
-
<td>19</td>
+
-
<td>26</td>
+
-
<td>4</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+
==Security Testing==
==Security Testing==
-
 
+
{|border="1" cellpadding="1" cellspacing="0" style="font-size: 85%; border: gray solid 1px; border-collapse: collapse; text-align: center; width: 100%
-
<center>
+
!style="background: #ececec;"|
-
<table nosave="" border="1" width="85%">
+
!style="background: #ececec;"|'''New'''
-
<tr nosave="" align="center" valign="CENTER">
+
!style="background: #ececec;"|'''Open'''
-
<td nosave="" align="center" valign="CENTER"></td>
+
!style="background: #ececec;"|'''In progress'''
-
<td>'''New'''</td>
+
!style="background: #ececec;"|'''Near Done'''
-
<td>'''Open'''</td>
+
!style="background: #ececec;"|'''Done'''
-
<td>'''In progress'''</td>
+
!style="background: #ececec;"|'''High'''
-
<td>'''Near Done'''</td>
+
!style="background: #ececec;"|'''Medium'''
-
<td>'''Done'''</td>
+
!style="background: #ececec;"|'''Low'''
-
<td>'''High'''</td>
+
|-
-
<td>'''Medium'''</td>
+
|current status
-
<td>'''Low'''</td>
+
|28
-
</tr>
+
|4
-
<tr>
+
|0
-
<td>
+
|0
-
Current status</td>
+
|1
-
<td>28</td>
+
|14
-
<td>4</td>
+
|9
-
<td>0</td>
+
|9
-
<td>0</td>
+
|}
-
<td>1</td>
+
-
<td>14</td>
+
-
<td>9</td>
+
-
<td>9</td>
+
-
</tr>
+
-
</table>
+
-
</center>
+

Revision as of 12:35, 19 May 2005

Version 1.12

This pages summarizes testing efforts for NFSv4, and identify testing gaps. Email nfsv4@linux-nfs.org with feedback or to take ownership of a task. If you are doing NFSv4 testing, please let us know! The matrix is divided into five categories, each on its own page in this page.


Contents

Category

  • Functional Ability to do what it's supposed to do. Standards compliance, regression, compatibility, static code analysis, etc.
  • interop Ability to work with other versions of nfs, other operating systems and other software/filesystems/etc. generally associated with NFS
  • Robustness : Remains stable and recovers even in extreme situations, Stability, interoperability, error recovery, race conditions, etc
  • Performance : Able to perform well under real and theoretical workloads Load, stress, destruction, scalability, etc
  • security : Resistant to being compromised and difficult to attack

Status Summary

Definitions

  • New : An owner has not been identified for the item and work has not started on it
  • Open: The task has been adopted, but either has not been started, or progress is not yet known
  • In Progress : Some work has been completed on the task
  • Near Done: The principle essense of the task has been finished, but there are some loose ends left
  • Done: The task has been fully completed

Functional Testing

New Open In progress Near Done Done High Medium Low
current status 104 26 1 1 4 43 72 22

Interoperability Testing

New Open In progress Near Done Done High Medium Low
current status 55 12 0 0 1 33 12 25

Robustness Testing

New Open In progress Near Done Done High Medium Low
current status 37 4 1 0 0 32 8 2

Performance Testing

New Open In progress Near Done Done High Medium Low
current status 33 10 3 0 1 19 26 4

Security Testing

New Open In progress Near Done Done High Medium Low
current status 28 4 0 0 1 14 9 9
Retrieved from "http://linux-nfs.org/wiki/index.php/Test_matrix"
Personal tools