The wind tunnel is all ready to go we are waiting on caps for the propellers tho. Today we are going to try and get a virtual wind tunnel.
It has been a while since the last journal and we have made a lot of progress. The image attached below is the new schematic of all four motors working. During the poster session of the fan blades snapping of cutting a motor, we bought a new motor and hope to rebuilt it this week.
I have continued to work on the wind tunnel and tested out all the speed controllers, and motors. I have built a schematic, and am trying to link all the motors.
Its been a very long time since I last journaled and a lot has happened. The AR/VR computer is fully built, we have bought a new zed camera (Zed 2i) and are still attempting to fully scan the Theatre. A picture is below. I have picked up helping someone build plant boxes for their project, currently, I’ve made 8 and need to make one more, these will be hung up outside due to limited garden space. Finally today I have chosen to start working on the wind tunnel and hope to get it up and running.
The parts haven’t come today which is unfortunate so today ill be prettying up the AR/VR page, my own journal, and looking over past AR/VR projects.
This is one of the first classes back from summer, and weve gotten new parts for our computers and are currently in the process of building them. We’ve had a little hiccup with our CPU cooler not being compattible with our motherboard, but we’ve ordered a new one and should be pretty much done with the computer by the end of the week if the parts come fast. The other members of the group have not returned this year to WISRD, so I also need to decide if I would like to recruit people.
The camera has continued to not work, however on HD720 on the Jetson we can run at 15fps. If we attempt to run higher the camera disconnects and says no usb 3.0 showing.
The camera has started to work, however the diagnostic to see whats wrong either crashes or still shows errors so we are still looking for fixes.
The Camera has continued to not work, we have continued contacting Stereo Labs on the situation and have seemed to not get anywhere. We think it might be the cameras usb cord, but are still looking.
Over the past week, I have continued to hard to get the Zed SDK back up and running, unfortunately, I still have not. I reached out the Stereo labs the company that creates it, and they released a new patch just today, I have struggled to Install the new patch, however, we seem to be getting closer.
Today I am continuing to work on getting the Zed SDK back up, we also have successfully gotten engage working with two VR headsets.
Over the time I haven’t been journaling a lot has happened. The Jetson Nano scans have stopped working, when we attempt to open the program we use called ZedFu it crashes almost immediately and ive been looking for a fix for it for a while. Some things it might be is that the firmware for the camera corrupted so ive bene trying to update it. We have also had a poster session and completed another poster (see picture below). I have tried pugging the Jetson into other devices with the same issues, and haven’t found a fix but am actively looking for one.
We have scanned the gallery and successfully gotten textures into Blender. We plan on making four scans of the theatre as its much easier, and easier to work with. Like we do in the picture below, we are going to scan all the walls individually, and combine them in blender. One thing we learnt from this is that the camera is very sensitive to light, as you can see on the right side when we attempted to scan a window.
Today, we scanned the Gallery to find the strengths, we found that It is very light sensitive, and really needs to go slowly to be accurate. We have also gotten them off of the Jetson Into Blender with textures.
Today in WISRD I have successfully set up ftp on the Jetson Nano so we are now able to take files directly from it. The login and pass will be found at \\192.168.168.40\assets\IT\passwords\Jetson Nano
I have attempted to scan the gallery, to explore the strengths of the Jetson, I have found that you have to move the camera extremely slowly if you want a detailed scan. While I was saving this it accidently unplugged, and only the mesh saved. We have found out how to import textures into Blender using .obj files, and that’s what in going to work towards getting the scan with textures into Blender.
A couple of days ago we ordered a new power supply for the Jetson Nano, and today it arrived. The camera finally worked when plugged in and this is really good news.
How to use Jetson Nano: Boot up
How to use Jetson Nano: Starting up ZED programs:
Once you are on the desktop of the Jetson Nano, which will look like (See Picture Above) move to the left side of the screen and click on “files” which is circled on the photo. Once its open, near the bottom of the list on the left click on + Other Locations, After that click on “Computer” with a logo of a hard drive. From there navigate to usr/local/zed/tools. Once you are here there should be 8 different files you are able to open. The most important of the 8 are “ZEDfu” Which is the app used to scan the rooms, and “ZED_Explorer” Which I use to make sure the zed is working, and all the functions on it.
Over the past days, I’ve been struggling to get the zed camera to work, I’ve found a lot of issues, some being low bandwidth, or just shutting off completely so I’m still working on getting it to launch. I also joined a zoom meeting about robots, and how they are companions. This meeting mainly consisted of robots helping people with rehabilitation, and teaching. This is a companionship robot, meaning that it stays with the owner, and reminds them to do things such as eat, or take medicine.
Over the past couple of days, I have trouble shoot on why the password stopped working. I found a couple of threads on a forum online of people with similar problems. The fix that I used was the re flash the Jetson Nano again. When I launched it with the newly flashed Micro Sd card it worked. I then started trying to set up VNC. I had alot of trouble with this as the tutorial posted from Nvidia doesn’t work, I looked for blogs, or threads from other people and found a couple. Most of them didn’t work so I had to change the code that they had, and made it work. So VNC is now set up. Right now when we plug in the camera to the Jetson Board, the whole thing turns off, I have found that this is because we are drawing to much power from our current Micro USB power supply. Some fixes of this is using a different type of power supply.
Today, when logging in to the Jetson Nano, the password stopped working. I attempted to log in via the terminal but had no luck. I am attempting to re flash the Jetson and it will act as a hard reset to the device. I have done some research on others with the issue, I have found a couple of threads with people with the same problem as me.
I have been working on getting the ZED SDK on the Jerson Nano, I have a couple issues, one being that when the camera is plugged in it is drawing to much power and shuts off the system. There are a couple of fixes for this, one is buying a different type of power cable which supplies more power. The Login to the Jetson Nano can be found at \\192.168.168.40\assets\IT\passwords\Jetson Nano. I have had some trouble with downloading the SDK, mainly there is an area which requires a password typed in but does not give enough time to type it.
Today I have gotten the Jetson Nano board to boot, we have gotten on to the desktop of it, and next class I plan on installing the Zed Sdk for Nano, which allows the zed sdk to be used.
The Jetson Board came today, I have been setting up the board, and downloading files to a sd card that we need to use.
Today we had a meeting with a former member of WISRD, named Will. We asked him a couple of questions about our project, and some new software’s we should use. Will recommended that for the scans, you should Import them into Blender, and finish it up, this can be re texturizing, or finishing a broken wall. Using this completed scan Will then said you can import it into Unreal Engine instead of Unity, Unreal Engine is a game engine similar to Unity, but is more advanced, and has better graphics. Then once the scan is in unreal engine you can then import to VR, and other places.
I have continued to work on scanning environments, and have found the strengths and weaknesses of the Zed Camera, it seems to be very strong in open spaces, with very few objects. Today, I have found a new program called ZedFu to 3d scan environments and am looking to see if ZedFu is better then Unity.
I have continued to work on getting the other computer to work with unity and the 3d scans. I have finally got it to work, and am going to try scanning a whole environment, and look for strengths, and areas to try and make better with the scans. In the time between updates, I have written my Vitae, and preparing for my interview here in WISRD. Later this week we plan on coming in early to attempt to scan the Theatre room.
We have been invited to have a brainstorming discussion with some members from the Bill and Melinda foundation to see how VR can be used in third world countries, to help teach, and also to help train people. This discussion is this afternoon. Also a 3d stand that we have been working on to hold up our sensors have finished, but it cant connect to a wall so we are going to move the support beams back, and make a modification so it fits both sensors in the next design.
I have uninstalled Unity and am reinstalling hopefully for a fix.
I had major issues with Unity today. My progress from last time has seem to be gone, and I haven’t been able to open Unity all class since its been crashing. I am looking for a fix.
I am continuing to look at a way to scan rooms from the zed camera into unity. I have found major trouble trying to room map with the zed camera. I have come across numerous errors that I will continue to work out. I have figuired out how to make a mesh, and am currently struggling with adding textures.
Joe has given us a Microsoft HoloLens which we will research and see how it can be used. We have also received a zed camera which can be used to scan rooms, however we are missing a very important part called the Jetson Nano board. So we are looking into getting another. The zed camera can scan rooms, so I am looking at a way to use this in help with the theatre project. I am looking at a way to scan directly into unity.
For AR/VR today, I spent a lot of my time researching past members of the AR/Vr group. I have found out that past groups have made a virtual gallery space which is very similar to the theatre we are making. I have also looked at the past people, and the equipment they have used, and I hope to replicate them with my theatre.
Today the ARVR group setup the Vive, with this we are now able to have multiple people in the VR environment. We also have found trouble with making the sensors have a more permanent setup. We would like the sensors to be wall mounted but one wall doesn’t have any outlets, so we may have to use a way that is not recommended or find another way. We also have found trouble with the “PolyCam” app. Its scans seem to be inconsistent and missing parts of the object every time.
Everyone in the ARVR group downloaded a mobile app called “PolyCam”. We used this app to all scan objects to attempt to get them into the Virtual space. I have scanned an object using the app and it is processing right now. I also am emailing somebody at FrameVR about sparkles in the Vr environment. In the future we plan to use the “PolyCam” to help achieve our goals of creating a virtual theatre. This would be very helpful to the theatre group because they struggle with space, so if are able to successfully improit objects from real life into VR, they could build full sets without the issue of being interrupted or even being in the space at all.
Today in WISRD I finished up the WISRD virtual gallery https://framevr.io/wisrd2. I plan on working more with this adding more posters, and some pictures of the groups.
Today in WISRD I continued to work on setting up a VR WISRD space, this space will have the posters that each project made, and some items from the respective projects.
Today in WISRD we made the discovery on how to get .stl files, and photos into the VR environment. We will continue to look for ways to import real life objects into the VR space. We also made a tweet on the WISRD twitter account.