Awesome
<a href="https://zetane.com"> <img src="screenshots/Zetane_logo_for_white_background.png" alt="logo" width="250"/> </a> <br/><br/>
The free Zetane Viewer is a tool to help understand and accelerate discovery in machine learning and artificial neural networks. It can be used to open the AI black box by visualizing and understanding the model's architecture and internal data (feature maps, weights, biases and layers output tensors). It can be thought of as a tool to do neuroimaging or brain imaging for artificial neural networks and machine learning algorithms.
You can also launch your own Zetane workspace directly from your existing scripts or notebooks via a few commands using the Zetane Python API.
<p align="center"> <img src="screenshots/model_node.gif" alt="nodes" width="400" height="600"/> <img src="screenshots/tensor_panel.gif" alt="tensors" width="400" height="600"/> </p>Zetane Viewer
Installation
You can install the free Zetane viewer for Windows, Linux and Mac, and explore ZTN and ONNX files.
Tutorial
In this video, we will show you how to load a Zetane or ONNX model, navigate the model and view different tensors:
<img src="screenshots/zetane_viewer_tutorial.gif" width=400\>
Below is the step-by-step instruction of how to load and inspect a model in the Zetane viewer:
-
How to load a model
The viewer supports both .ONNX and .ZTN files. The ZTN files were generated from the Keras and Pytorch scripts shared in this Git repository. After launching the viewer, to load a Zetane model, simply click “Load Zetane Model” in the DATA I/O menu. To load an Onnx model, click on “Import ONNX Model” in the same menu. Below you can access the ZTN files for a few models to load. You can also access ONNX files from the ONNX Model Zoo. <br/><br/> <img src="screenshots/load.png" alt="loading">
When a model is displayed in the Zetane engine, any components of the model can be accessed in a few clicks.
At the highest level, we have the model architecture which is composed of interconnected nodes and tensors. Each node represents an operator of the computational graph. Usually, an input tensor is passed to the model and as it goes through the nodes it will be transformed into intermediate tensors until we reach the output tensor of the model. In the Zetane engine, the data flows from left to right. <br/><br/>
<img src="screenshots/model_architecture.png" alt="architecture">-
How to navigate
You may navigate the model viewer window by right clicking and dragging to explore the space and using the scroll wheel to zoom in and out. Here is the complete list of navigation instructions. You can change the behavior of the mouse wheel (either to zoom or to navigate) via the Mouse Zoom toggle in the top menu. <br><br/>
<p align="center"> <img src="screenshots/zoom.png" alt="zoom" /> </p>-
Loading custom model inputs
After loading a model you may want to send your own inputs to the model to inference. Zetane supports loading .npy, .npz, .png, .jpg, .pb (protobuf), .tiff, and .hdr files that match the input dimensions of the model. The Zetane engine will attempt to intelligently resize the file loaded (if possible) in order to send the data to the model. After loading and running the input, you will be able to explore in detail how your model interpreted the input data.
<p align="center"> <img src="screenshots/pro_load_inputs.png" alt="nodes" height="600"/> <img src="screenshots/pro_load_inputs_run.png" alt="tensors" height="600"/> <img src="screenshots/pro_load_inputs_tensor.png" alt="tensors" height="600"/> </p>-
How to inspect different layers and feature maps
For each layer, you have the option to view all the feature maps and filters by clicking on the “Show Feature Maps” on each node. You may inspect the inputs and outputs and weights and biases using the tensor view bar. <br/><br/>
<p align="center"> <img src="screenshots/featuremap.png" alt="featuremap" width="700"/> </p>-
Tensor view bar
By clicking on the associated button, you can visualize inputs, outputs, weights and biases (if applicable) for each individual layer. You can also investigate the shape, type, mean and standard deviation of each tensor. <br/><br/>
<p align="center"> <img src="screenshots/tensorview.png" alt="tensorview" width="700"/> </p>Statistics about the tensor value and its distribution is given in the histogram in the top panel. You can also see the tensor name and shape. The tensor and its values is represented in the middle panel and the bottom section contains tensor visualization parameters and a refresh button which allow the user to refresh the tensor. This is useful when the input or the weights are changing in real-time. <br/><br/>
<p align="center"> <img src="screenshots/tensor_panel.png" alt="tensorpanel" width="500"/> </p>-
Styles of tensor visualization
Tensors can be inspected in different ways, including 3D view and 2D view with and without actual values. <br/><br/>
<p align="center"> <img src="screenshots/tensorview2.png" alt="tensorview2" width="700"/> </p><br/><br/>
| Tensor View | Screenshot |
|---|---|
| N-dimensional tensor projected in the 3D space | <img src="screenshots/tensor_viz_3d.png" alt="tensor_viz_3d" width="400"/> |
| N-dimensional tensor projected in the 2D space | <img src="screenshots/tensor_viz_2d.png" alt="tensor_viz_2d" width="400"/> |
| Tensor values and color representations of each value based on the gradient shown on the x-axis of the distribution histogram | <img src="screenshots/tensor_viz_color-values.png" alt="tensor_viz_color-values" width="400"/> |
| Tensor values__ | <img src="screenshots/tensor_viz_values.png" alt="tensor_viz_values" width="400"/> |
| Feature maps view when the tensor has shape of dimension 3 | <img src="screenshots/tensor_viz_feature_maps.png" alt="tensor_viz_values" width="400"/> |
Models
We have generated a few ZTN models for inspecting their architecture and internal tensors in the viewer. We have also provided the code used to generate these models.
Image Classification
Object Detection
Image Segmentation
Body, Face and Gesture Analysis
Image Manipulation
XAI
Classic Machine Learning
Installation
Install the Zetane Viewer here.