From 427c224394d57fbb14bf77ded2c07fe16ebb7c70 Mon Sep 17 00:00:00 2001
From: auphelia <jakobapk@web.de>
Date: Tue, 7 Feb 2023 19:36:39 +0000
Subject: [PATCH] [Notebooks] Change board execution section in cnv notebook
---
.../bnn-pynq/cnv_end2end_example.ipynb | 131 +++++++-----------
1 file changed, 51 insertions(+), 80 deletions(-)
diff --git a/notebooks/end2end_example/bnn-pynq/cnv_end2end_example.ipynb b/notebooks/end2end_example/bnn-pynq/cnv_end2end_example.ipynb
index c46ae2532..32f1c1303 100644
--- a/notebooks/end2end_example/bnn-pynq/cnv_end2end_example.ipynb
+++ b/notebooks/end2end_example/bnn-pynq/cnv_end2end_example.ipynb
@@ -462,11 +462,9 @@
"cell_type": "markdown",
"metadata": {},
"source": [
- "## 5. Deployment and Remote Execution\n",
+ "## 5. Deployment and Execution\n",
"\n",
- "Now that we're done with the hardware generation, we can copy the necessary files onto our PYNQ board.\n",
- "\n",
- "**Make sure you've [set up the SSH keys for your PYNQ board](https://finn-dev.readthedocs.io/en/latest/getting_started.html#pynq-board-first-time-setup) before executing this step.**"
+ "The bitfile and generated driver files(s) will be copied into a deployment folder which then can be used to run the network on the PYNQ board."
]
},
{
@@ -475,33 +473,33 @@
"metadata": {},
"outputs": [],
"source": [
- "import os\n",
+ "from shutil import copy\n",
+ "from distutils.dir_util import copy_tree\n",
+ "\n",
+ "# create directory for deployment files\n",
+ "deployment_dir = make_build_dir(prefix=\"pynq_deployment_\")\n",
+ "model.set_metadata_prop(\"pynq_deployment_dir\", deployment_dir)\n",
"\n",
- "# set up the following values according to your own environment\n",
- "# FINN will use ssh to deploy and run the generated accelerator\n",
- "ip = \"192.168.2.99\"\n",
- "username = os.getenv(\"PYNQ_USERNAME\", \"xilinx\")\n",
- "password = os.getenv(\"PYNQ_PASSWORD\", \"xilinx\")\n",
- "port = os.getenv(\"PYNQ_PORT\", 22)\n",
- "target_dir = os.getenv(\"PYNQ_TARGET_DIR\", \"/home/xilinx/finn_cnv_end2end_example\")\n",
- "# set up ssh options to only allow publickey authentication\n",
- "options = \"-o PreferredAuthentications=publickey -o PasswordAuthentication=no\"\n",
+ "# get and copy necessary files\n",
+ "# .bit and .hwh file\n",
+ "bitfile = model.get_metadata_prop(\"bitfile\")\n",
+ "hwh_file = model.get_metadata_prop(\"hw_handoff\")\n",
+ "deploy_files = [bitfile, hwh_file]\n",
"\n",
- "# test access to PYNQ board\n",
- "! ssh {options} {username}@{ip} -p {port} cat /var/run/motd.dynamic"
+ "for dfile in deploy_files:\n",
+ " if dfile is not None:\n",
+ " copy(dfile, deployment_dir)\n",
+ "\n",
+ "# driver.py and python libraries\n",
+ "pynq_driver_dir = model.get_metadata_prop(\"pynq_driver_dir\")\n",
+ "copy_tree(pynq_driver_dir, deployment_dir)"
]
},
{
- "cell_type": "code",
- "execution_count": null,
+ "cell_type": "markdown",
"metadata": {},
- "outputs": [],
"source": [
- "from finn.transformation.fpgadataflow.make_deployment import DeployToPYNQ\n",
- "\n",
- "model = ModelWrapper(build_dir + \"/end2end_cnv_w1a1_synth.onnx\")\n",
- "model = model.transform(DeployToPYNQ(ip, port, username, password, target_dir))\n",
- "model.save(build_dir + \"/end2end_cnv_w1a1_pynq_deploy.onnx\")"
+ "Next to these files, we will also need an example numpy array to test the network on the PYNQ board. (*and before you ask, that's supposed to be a cat (CIFAR-10 class number 3)*) Recall that we partitioned our original network into a parent graph that contained the non-synthesizable nodes and a child graph that contained the bulk of the network, which we turned into a bitfile. The only operator left outside the FPGA partition was a `Transpose` to convert NCHW images into NHWC ones. Thus, we can skip the execution in the parent as long as we ensure our image has the expected data layout. The example numpy array can then be saved as .npy file."
]
},
{
@@ -510,8 +508,14 @@
"metadata": {},
"outputs": [],
"source": [
- "target_dir_pynq = target_dir + \"/\" + model.get_metadata_prop(\"pynq_deployment_dir\").split(\"/\")[-1]\n",
- "target_dir_pynq"
+ "import pkg_resources as pk\n",
+ "import matplotlib.pyplot as plt\n",
+ "import numpy as np\n",
+ "\n",
+ "fn = pk.resource_filename(\"finn.qnn-data\", \"cifar10/cifar10-test-data-class3.npz\")\n",
+ "x = np.load(fn)[\"arr_0\"]\n",
+ "x = x.reshape(3, 32,32).transpose(1, 2, 0)\n",
+ "plt.imshow(x)"
]
},
{
@@ -520,14 +524,19 @@
"metadata": {},
"outputs": [],
"source": [
- "! ssh {options} {username}@{ip} -p {port} 'ls -l {target_dir_pynq}'"
+ "model = ModelWrapper(build_dir + \"/end2end_cnv_w1a1_pynq_deploy.onnx\")\n",
+ "iname = model.graph.input[0].name\n",
+ "ishape = model.get_tensor_shape(iname)\n",
+ "np.save(deployment_dir + \"/input.npy\", x.reshape(ishape))"
]
},
{
- "cell_type": "markdown",
+ "cell_type": "code",
+ "execution_count": null,
"metadata": {},
+ "outputs": [],
"source": [
- "We only have two more steps to be able to remotely execute the deployed bitfile with some test data from the CIFAR-10 dataset. Let's load up some test data that comes bundled with FINN -- *and before you ask, that's supposed to be a cat (CIFAR-10 class number 3)*."
+ "! ls {deployment_dir}"
]
},
{
@@ -536,54 +545,34 @@
"metadata": {},
"outputs": [],
"source": [
- "import pkg_resources as pk\n",
- "import matplotlib.pyplot as plt\n",
- "import numpy as np\n",
- "\n",
- "fn = pk.resource_filename(\"finn.qnn-data\", \"cifar10/cifar10-test-data-class3.npz\")\n",
- "x = np.load(fn)[\"arr_0\"]\n",
- "x = x.reshape(3, 32,32).transpose(1, 2, 0)\n",
- "plt.imshow(x)"
+ "from shutil import make_archive\n",
+ "make_archive('deploy-on-pynq-cnv', 'zip', deployment_dir)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
- "Recall that we partitioned our original network into a parent graph that contained the non-synthesizable nodes and a child graph that contained the bulk of the network, which we turned into a bitfile. The only operator left outside the FPGA partition was a `Transpose` to convert NCHW images into NHWC ones. Thus, we can skip the execution in the parent as long as we ensure our image has the expected data layout, which we have done above."
+ "You can now download the created zipfile (File -> Open, mark the checkbox next to the deploy-on-pynq-tfc.zip and select Download from the toolbar), then copy it to your PYNQ board (for instance via scp or rsync). Then, run the following commands on the PYNQ board to extract the archive and run the execution:"
]
},
{
- "cell_type": "code",
- "execution_count": null,
- "metadata": {},
- "outputs": [],
- "source": [
- "import numpy as np\n",
- "from finn.core.onnx_exec import execute_onnx\n",
- "\n",
- "model = ModelWrapper(build_dir + \"/end2end_cnv_w1a1_pynq_deploy.onnx\")\n",
- "iname = model.graph.input[0].name\n",
- "oname = model.graph.output[0].name\n",
- "ishape = model.get_tensor_shape(iname)\n",
- "input_dict = {iname: x.astype(np.float32).reshape(ishape)}\n",
- "ret = execute_onnx(model, input_dict, True)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": null,
+ "cell_type": "markdown",
"metadata": {},
- "outputs": [],
"source": [
- "ret[oname]"
+ "```shell\n",
+ "unzip deploy-on-pynq-cnv.zip -d finn-cnv-demo\n",
+ "cd finn-cnv-demo\n",
+ "sudo python3.6 -m pip install bitstring\n",
+ "sudo python3.6 driver.py --exec_mode=execute --batchsize=1 --bitfile=resizer.bit --inputfile=input.npy\n",
+ "```"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
- "We see that the network correctly predicts this as a class 3 (\"cat\"). "
+ "The output will be saved on the PYNQ board as `output.npy` and can be copied to the host and opened with `np.load()`."
]
},
{
@@ -592,7 +581,7 @@
"source": [
"### Validating the Accuracy on a PYNQ Board <a id='validation'></a>\n",
"\n",
- "All the command line prompts here are meant to be executed with `sudo` on the PYNQ board, so we'll use a workaround (`echo password | sudo -S command`) to get that working from this notebook running on the host computer.\n",
+ "All the command line prompts here are meant to be executed with `sudo` on the PYNQ board.\n",
"\n",
"**Ensure that your PYNQ board has a working internet connecting for the next steps, since some there is some downloading involved.**\n",
"\n",
@@ -601,16 +590,7 @@
"\n",
"Command to execute on PYNQ:\n",
"\n",
- "```pip3 install git+https://github.com/fbcotter/dataset_loading.git@0.0.4#egg=dataset_loading```"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": null,
- "metadata": {},
- "outputs": [],
- "source": [
- "! ssh {options} -t {username}@{ip} -p {port} 'echo {password} | sudo -S pip3 install git+https://github.com/fbcotter/dataset_loading.git@0.0.4#egg=dataset_loading'"
+ "```sudo pip3 install git+https://github.com/fbcotter/dataset_loading.git@0.0.4#egg=dataset_loading```"
]
},
{
@@ -624,15 +604,6 @@
"`python3.6 validate.py --dataset cifar10 --batchsize 1000`"
]
},
- {
- "cell_type": "code",
- "execution_count": null,
- "metadata": {},
- "outputs": [],
- "source": [
- "! ssh {options} -t {username}@{ip} -p {port} 'cd {target_dir_pynq}; echo {password} | sudo -S python3.6 validate.py --dataset cifar10 --batchsize 1000'"
- ]
- },
{
"cell_type": "markdown",
"metadata": {},
--
GitLab