Results and Reporting
Tip
To view any result chart next to risk or ranging inputs, open the same file in another instance of NetRisk and snap them each side-by-side.
Chart Layouts
Layouts store the configuration preferences of the results charts to the computer for applying across multiple files. The following items comprise a layout and will be discussed in more detail in this chapter:
Characteristic | Definition | Scope |
---|---|---|
Markers | Markers are added or removed to the charts to call attention to specific values on the chart. | A change to a marker applies across all chart types within a file |
Labels | The text/names for the chart, x-axis, y-axis, and secondary y-axis | A change to the labels is unique to each chart type within a file |
Curves and bars | For example, visibility, color, points, point values, bar width, etc. | A change to the formatting of curves and bars applies across all chart types within a file |
Formatting | For example, font, size, bold, italics, underline, color, alignment, case | A change to the formatting is unique to each chart type within a file |
Filters | For example, statistical significance or hiding values on axes | A change to the filters applies across all chart types within a file |
To save the active configuration preferences for all charts:
- Click the Layouts icon in the Chart pane toolbar
- Choose New Layout
- Enter a name and click Save
- To rename or delete, repeat step 1 and choose accordingly.
- To apply a different layout to your file, click the dropdown next to Chart Layout and choose accordingly.
Key Milestones
key milestones allow you to filter the table to only the most important milestones (or activities) in the schedule quickly and easily. For example, major stage gates, completion of important phases, enclosure of a building, or substantial completion of the project. Key milestones are only available in the Results view.
- Click the Results icon.
- In the Key column of the Table pane, click once in the star icon until it turns yellow.
- Click the Filter icon above the table and select Key, or type "key" into the search box.
Distribution Charts
Distribution charts show bars representing the number of iterations a value was observed during simulation, as well the cumulative total via the cumulative curve. Distribution charts can be viewed for start date, finish date, duration, drift, float, total float, cost, probabilistic cash flow, and float risk envelope. As different activities or WBS nodes are selected in the Table pane, the chart will update accordingly.
- Click the Results icon.
- Click the Simulation dropdown in the Table pane and choose a desired simulation.
- Click the Chart Type dropdown in the Chart pane and choose the desired chart.
Tip
Hover over any bar or any data point to see the actual values.
In the Table pane, activities and their data correspond to the state when the simulation was ran, regardless of whether or not the model has since been updated.
Adding/Removing Markers
Markers perform the following functions:
Function | Chart(s) |
---|---|
Call attention to specific values on the chart | Completion Date, Start Date, Duration, Drift, Float, Total Float, Cost, Cash Flow, Float Risk Envelope |
Add or remove series of data for desired percentiles | Cash Flow |
Four types of markers exists, as follows:
Marker Type | Definition | Inputs |
---|---|---|
Delta Marker | Shows the variance between two values, for example, the deterministic duration and the P80 duration. Not available for Cash Flow. The horizontal portion of the delta marker will be drawn at whatever height is entered in the Percentile column. |
|
Deterministic Marker | Shows the planned (pre-simulation) value or data. For the Cost chart, if an activity was in-progress and had both a Planned Cost and Actual Cost entered on the Ranging tab, two deterministic markers will show up on the chart: one for "Planned Cost" and one for "Projected Cost". Projected cost is equal to the planned cost minus the actual cost for the remaining duration. |
|
P Value Marker | A P value is the value which was observed during at least X% of iterations. For example, the P80 Finish Date is the finish date observed during at least 80% of the iterations. To put it another way, 80% of the iterations completed on that date or earlier. The P80 cash flow is the cash flow observed during at least 80% of the iterations. |
|
Variance Marker | Shows the variance between two points at the selected percentile. Only available when comparing more than one series (e.g. simulation, activity, or cash flow percentile) |
|
- Click the Results icon.
- In the Chart Properties pane, click the Add button next to the Markers list.
- Click the dropdown in the Type column to change marker types.
- To remove, select the row in the list and click Remove.
Recalculating the X-Intervals for Cost Charts
The x-axis of the cost distribution chart can be grouped into smaller or larger buckets, e.g. $100, $1,000, $10,000 etc. Larger intervals will reduce the number of bars and smaller intervals will increase the number of bars. For example, with an interval of $1,000, an iteration with a total cost of $500 and an iteration with a total cost of $1,000 would be represented by a single bar with 2 hits rather than two separate bars each with one hit.
The cash flow chart can be recalculated based on days, weeks, months (default), quarters, or years. When choosing weeks, whichever day the project starts on will define the beginning of the week. To recalculate the x-axis interval:
- Click the Results icon.
- In the Chart pane, click the dropdown next to Chart Type and choose either Cost or Cash Flow.
- In the toolbar above the chart, click the dropdown next to X-Axis Interval and choose as desired.
Scatter Plots
Distribution charts show a single variable (completion, OR cost, OR duration). The problem is, if we target a date with an 80% probability of being met, there are many costs associated with that date, some of which are not 80% likely to occur. Similarly, if we target a cost with an 80% probability of being met, there are many dates associated with that cost, some of which are not 80% likely to occur. Targeting the P80 cost and P80 finish will not result in an overall P80. Scatter plots combine two variables and allow us to see the joint probabilities. Scatter plots are available for Completion & Cost or Duration & Cost.
Scatter plots are divided into four quadrants, which can be adjusted by moving the vertical and horizontal lines. Each quadrant shows the percentage of iterations that fall within the quadrant. To see, for example, the joint P80, move each line until the quadrant at the bottom left (Q3) shows 80%. You'll see there are many combinations of cost and date to achieve this. A curve can be drawn connecting all of the combinations called the joint confidence level curve by clicking the Joint Confidence Colors icon in the chart toolbar. The curves default, and are fixed, to 20%, 50%, and 80%.
- Click the Results icon.
- In the Chart pane, click the dropdown next to Chart Type and choose either Completion & Cost or Duration & Cost.
- Click on either line or at the center and adjust until you see the desired probability or value for each line.
- To change color scheme, click the Joint Confidence Colors icon in the chart toolbar.
Overlaying Scatter Plot and Cash Flow
While viewing the cash flow chart, the scatter plot can be overlayed on top of it. To do so:
- Click the Results icon.
- In the Chart pane, click the dropdown next to Chart Type and choose Cash Flow.
- In the toolbar above the chart, click the Scatter button.
Tornado Charts
Tornado charts show results organized from high to low for a variety of data sets.
Tip
When the number of results is larger than the amount of vertical space, bars will be merged to make them fit on a single screen. To view every bar individually, use the scroll wheel on your mouse to "zoom in". The chart can then be scrolled up and down.
Chart | Definition | ||||||||
---|---|---|---|---|---|---|---|---|---|
Activity Priority | The significance of an activity on the project's duration defined as criticality * (1+cruciality). Milestones, WBS summaries, hammocks, or LOE's will not show up. | ||||||||
Criticality | The proportion of iterations activities were observed on the path with 0 days of float (GPM) or total float (CPM). | ||||||||
Duration Cruciality | The correlation between activity durations and the duration of the project. Milestones, WBS summaries, hammocks, or LOE's will not show up. | ||||||||
Risk Priority | The potential gain in calendar days or dollars after removing each risk during simulation. Non-working calendars are NOT treated as risks/removed when calculating risk priority. | ||||||||
Risk Sensitivity | The correlation between existence of a risk and the duration or cost of the project. A positive result suggests that when the risk occurs, the project takes or cost more; a negative result suggests that when the risk occurs, the project takes or costs less:
| ||||||||
Safe Float | The number of days an activity can be delayed without delaying a desired probabilistic finish date (p value). |
As different activities or WBS nodes are selected in the Table pane, the chart will update accordingly, as well as be filtered or recalculated as indicated. To view tornado charts:
- Click the Results icon.
- Click the Simulation dropdown in the Table pane and choose a desired simulation.
- Click the Chart Type dropdown in the Chart pane and choose accordingly.
Tip
Hover over any bar or any data point to see the actual values.
Safe Float
Total float is a fundamental scheduling concept; however, it is measured to the deterministic project completion date. During risk analysis, the project completion depends on the p value, or likelihood, chosen by the team. Total float to the P80 project completion date is not the same as total float to the P70 completion date - in fact, it's greater, since, despite the fact that the confidence must be higher, the P80 project completion date is ultimately later. To solve this issue, NetRisk introduces Safe Float: the number of days an activity can be delayed without delaying a desired probabilistic finish date (p value). In addition, NetRisk provides the date by which the activity must start so as to not delay the designated probabilistic finish date, i.e. the Safe Float Start Date.
Safe float and the safe float start date can be viewed in the table for any p-value in increments of 5. For details on customizing columns, see Interface Tour.
Safe float can be viewed as a tornado chart for up to 2 p-values simultaneously. For instructions, see Tornado Charts above.
Chart Properties
The Chart Properties Pane will update depending on the selected chart type. Any modifications are stored with the file.
Labels
Property | Definition | Available for |
---|---|---|
Title | A label for describing the chart, which displays at the top in bold. |
|
X-Axis | A label for describing the x-axis. |
|
Y-Axis | A label for describing the y-axis on the left. |
|
Y2-Axis | A label for describing the y-axis on the right. |
|
X2-Axis | A label for describing the x-axis on the top. |
|
Legend
Property | Definition | Available for |
---|---|---|
Show Legend | A toggle for showing a color legend. |
|
Include ID's | A toggle for including activity/WBS ID's in the legend for each series |
|
Markers
A table for adding, modifying, and removing annotations to the chart. See Results and Reporting above.
Series
Property | Definition | Available for |
---|---|---|
Legend Description | A description of the series, which will be displayed in the legend. By default, truncates to 40 characters. |
|
Curve | A toggle for displaying the cumulative curve. |
|
Curve Color | The color of the curve. |
|
Curve Points | A toggle for showing points where the x and y-axes intersect. |
|
Curve Values | A toggle for showing the y-axis value for the intersections. |
|
Bars | A toggle for displaying the frequency bars. |
|
Bar Color | The color of the bars. |
|
Bar Width | The size of the bars, independent of time. |
|
Bar Values | A toggle for showing the values of the bars. |
|
Values Centered | A toggle for centering the values in the middle of the bars instead of at the end. |
|
Point Size | An option for adjusting the size of the dots. |
|
Q1 Color | The color of the dots in quadrant 1. |
|
Q2Color | The color of the dots in quadrant 2. |
|
Q3 Color | The color of the dots in quadrant 3. |
|
Q4 Color | The color of the dots in quadrant 4. |
|
Deterministic Shape | The shape for the deterministic point on the chart. |
|
Deterministic Size | The size of the shape for the deterministic point. Options include: Circle, Square, Diamond, Triangle, Pentagon, Hexagon, Star, |
|
Tornado Charts
Property | Definition | Available for |
---|---|---|
Significance Level | The significance value, for example 90%, tells us the likelihood that the result is truly correlated vs. the likelihood that the correlation is random (for example, 20%). From a statistical perspective, a significance of 90% or higher is ideal. Anything below 20% is basically random. Hover the mouse over any bar on the chart and look for the value in parenthesis at the end. |
|
Hide values between | A toggle for filtering out values from being displayed. For example, to hide negative values, enter -100 to 0. To hide positive values, enter 0 to 100. |
|
Correlation Method | The Pearson method uses original simulation values and is a measure of the linear relationship between the two variables. The Spearman method takes original simulation values, assigns each one a rank, and then applies the pearson method. Pearson is considered better if the values being compared are normally distributed while spearman may be better if the data is more scattered or outliers exist. |
|
Risk Priority Percentile | The percentile by which to measure the potential gains. For example, entering "80" would tell us the number of days or dollars potentially gained during at least 80% of the iterations. |
|
Risk Priority Sorting | An option for sorting the risk priority tornado chart. When sorting by Potential Gains or Potential Savings, the chart is arranged from the risk that contributed the highest gains at the top to the risk that contributed the lowest gains at the bottom. When sorting by Order Removed, the chart is arranged from the first risk removed during simulation to the last risk removed during simulation. |
|
Label Format | A toggle for choosing what combination of ID and description to show for each bar. |
|
Risk Sensitivity | A toggle for choosing what to display on the risk sensitivity tornado chart. Checking Risks will display a single bar for a risks/scenario's schedule sensitivity and a single bar for cost sensitivity. Checking Risk-Activity Assignments will display multiple bars, one for every activity to which a risk/scenario has been assigned. |
|
Risk Sensitivity Order | An option for sorting the risk sensitivity chart. Schedule, Cost will sort schedule from high to low with no sorting of cost. Cost, Schedule will sort cost from high to low with no sorting of schedule. |
|
Chart Formatting
The following chart elements can be formatted directly on the chart:
Element | Supported | Not Supported |
---|---|---|
Chart Title | Font style, font size, bold, italics, underline, color, case, alignment | |
X-Axis Line | Color | Font style, font size, bold, italics, underline, case, alignment |
X-Axis Values (as a group) | Font style, font size, bold, italics, underline, color | Case, alignment |
X-Axis Label | Font style, font size, bold, italics, underline, color, case | Alignment |
Y-Axis Line | Color | Font style, font size, bold, italics, underline, case, alignment |
Y-Axis Values (as a group) | Font style, font size, bold, italics, underline, color | Case, alignment |
Y-Axis Label | Font style, font size, bold, italics, underline, color, case | Alignment |
2nd Y-Axis Line | Color | Font style, font size, bold, italics, underline, case, alignment |
2nd Y-Axis Values (as a group) | Font style, font size, bold, italics, underline, color | Case, alignment |
2nd Y-Axis Label | Font style, font size, bold, italics, underline, color, case | Alignment |
Bars/Values | Font style, font size, bold, italics, underline, color | Case, alignment |
Curve/Values | Font style, font size, bold, italics, underline, color | Case, alignment |
Marker/Values | Font style, font size, bold, italics, underline, color, position To modify the position, click and drag with the mouse. | Case, alignment |
Legend | Font style, font size, bold, italics, underline, color | Case, alignment |
Quadrant Labels | Font style, font size, bold, italics, underline, color, position To modify the position, click and drag with the mouse. | Case, alignment |
Dots | Color | Font style, font size, bold, italics, underline, color, case, alignment |
To do so:
- Click the Results icon.
- Select the desired element directly on the chart with the mouse. The selected element will be confirmed in the toolbar above the chart, e.g. "Title Formatting".
- Click the desired icon or font picker immediately to the right.
Comparing Charts
The following comparisons can be made:
- Simulation to simulation, for example completion dates for the same activity in multiple simulations
- Activity to activity, for example completion dates for multiple activities within the same simulation
- Multiples, for example completion dates for multiple activities in multiple simulations
Charts of different types cannot be compared to one another. When comparing tornado charts for multiple simulations, the order of the simulation selected will determine the order for the tornado.
To compare Risk Priority for two simulations, select the first simulation group (to determine the tornado order) and then select each run individually beneath the second simulation group. If you select the second group parent, the first simulation group will be deselected.
Simulation to Simulation
- Click the Results icon.
- Click the Simulation dropdown above the Table pane
- Check the box next to each simulation desired.
- Click Close.
The table will only show activities and their data for the LAST simulation clicked, indicated above the list. If an activity existed in the last simulation clicked but did NOT exist in one of the other simulations, a series will NOT show up for it on the chart. If an activity didn't exist in the last simulation clicked, it will not show up in the table at all.
Activity to Activity
Click the Results
icon.In the Compare column, check the box next to each activity desired.
Printing or Exporting Charts
Charts can be printed to paper or to PDF or copied to the clipboard as an image for pasting into reports.
When printing to PDF, it is recommended to choose "Adobe PDF" rather than "Microsoft Print to PDF" for best results.
- Click the Results icon.
- In the toolbar above the Chart pane, click the dropdown next to Chart Type and choose the desired chart.
- To generate a screenshot, click the Copy to Clipboard icon in the toolbar above the chart.
- To print, click the Print icon .
- Customize using the operating system's print window and click OK.
Portions of a chart can be printed by hovering over the chart with the mouse and zooming in using the scroll wheel.
Exporting Percentile Results to P6
Percentile data, or p values, can be exported to XER user defined fields (UDFs) for importing into P6. In P6, this data can be used to illustrate, for example, the entire schedule on P80 dates, side-by-side with the deterministic schedule on the Gantt chart.
When exporting out of P6, UDFs must have data for at least one activity to be included the export.
- Click the Results icon.
- Click the Export icon above the table and choose Export Percentile Results to P6 XER.
- Click the Add button and customize as desired.
- When finished, click Export.
- Enter a filename and click Save.
P values can only be mapped to UDFs of the same type. For example, a start date CANNOT be mapped to a finish date UDF, or vice versa. Nor can it be mapped to cost, indicator, integer, number, or text.
P Value-to-UDF Columns
Column | Description |
---|---|
P Value (NetRisk) | The percentile from the simulation results, from 0-100. |
Date Type | A toggle for choosing between Start and Finish data. |
User Defined Field (P6) | A dropdown containing all user defined fields that were imported (if any) if the project began from an XER file. If no selection is made, a new UDF is created, named after the P value/Date Type. |
Available Table Columns
For details on customizing columns, filtering, sorting, and organizing by WBS, see Interface Tour.