Project 1 - Eat It

This project was built with an idea to explore Augmented Reality at an intermediate level. The project will have several real world targets that will be captured with an camera and different Augmented objects would be placed. Different themes are used for different kind of targets. The aumgented images and objects placed for each of the targets are based on themes. We have tried different scenarios and tried to create a 3d scene around the targets with appropriate sounds, animation, music and models that would provide the user with a very pleasant experience of using it. We tested out the project with different targets like image, cuboid and cylinders.

Few of the targets are created on our own while some were taken from the internet. Same goes for the materials, models and texture that are used in the project. Materials and textures were developed using different softwares like Paint , Paint-3D and GIMP ( GNU Image Manipulation software), an open source equivalent of the Adobe Photoshop. Models were created using sketchUp software. Some animations were done within the Unity-3D software while some where taken from different internet sources mentioned at the end. Scripts are totally created by us following multiple examples taken from internet and vuforia documentation videos.

Images of the targets are in the folder "/Project1/images".
Image targets takes width as 24 units.
Cylinder targets take radius of 6 units and height of 13 units.
Cuboid targets has Width, height and length of 20, 10 and 20 units respectively.
For creating the real world objects of these targets, we have provided with separate files that needs to be printed and moulded into targets.

The source code of the project can be downloaded from here
Also please find the video of the project here.


Futuristic thoughts on Augmeted Reality

There are a lot of ideas, thoughts that can be done or implemented to use this kind of technology for this situation like breakfast. Apart from displaying nutritional information or providing more content in the reality, it has a lot more scope. They can be integrated with Google Home, Alexa or any personal assistants like Siri and Google Now and provide contents based on their data. Every day, as we wake up from the bed these AR glasses can become an integral part of our daily life routine. It is possible to suggest us the breakfast menu based on our calendar schedule. It will help us decide what kind of food do we need to have to feel energized all throughout the day. If there is an early meeting that needs to be attended it can suggest the menu that can be cooked fast. Or on a leisure day, it can suggest our favorite items along with their recipes. By bringing in Machine Learning and Artificial Intelligence technologies into the AR, we will be able to achieve a lot more than we can imagine.

It would then be possible for the AR technology to understand the environment of the user and provide content based on that. For example, if the user opens up the fridge, the AR glasses should be able to identify the food items stored in them along with their nutritional content. They can then suggest recipes based on what food is available. It can also start suggesting food that needs to be bought from the supermarket. This will even reduce our search efforts looking for food. We will be able to talk to the AR glasses asking it to look for the food and it will point us where to look for. If there exist multiple items of the same food, then it can suggest which particular item to pick and prepare the menu out of it. It may be based on the expiry date or nearest item or anything. Even during preparing food, the AR glasses can keep a close observation of what we are preparing and suggest us if our preparation went wrong somewhere. We will be able to compare the recipe videos with what we are preparing and check on our own too.

Another idea would be to include our medical history with the AR glasses and its AI technology then they would be empowered to suggest us a diet that will keep our health better. Even our daily workout/fitness session can be included so that it gives them more context about what kind of breakfast would be needed. These are a few examples of how an AR will be useful in our daily life around breakfast time.


Models, sounds, animations sources

Placemat - 1

Robot - https://assetstore.unity.com/packages/3d/characters/robots/space-robot-kyle-4696
Fruits - https://assetstore.unity.com/packages/3d/props/food/free-food-pack-85884
Food - https://assetstore.unity.com/packages/3d/props/food/rpg-food-drinks-pack-121067
Created Model - https://3dwarehouse.sketchup.com/model/2e528ceb-7341-480d-8d1f-c705bc3fdab9/Flower-Basket
Sound - http://soundbible.com/1902-Fire-Burning.html
Animation - https://assetstore.unity.com/packages/vfx/particles/fire-explosions/particle-dissolve-shader-package-33631
Static images - Google Images

Placemat - 2

Big fat guy with animation (Big Vegas) - https://www.mixamo.com/#/?page=2&type=Character
Fruits - https://assetstore.unity.com/packages/3d/props/food/free-food-pack-85884
Food - https://assetstore.unity.com/packages/3d/props/food/rpg-food-drinks-pack-121067
Created Model - https://3dwarehouse.sketchup.com/model/fd904b43-0cc0-4b81-b04a-664bba5d83de/Metallic-Fork
Sound - http://soundbible.com/1571-Fishtank-Bubbles-2.html
Static images - Google Images

Cereal box - 1

Chuck Norris with animation - https://www.himix.lt/augmented-reality/augmented-reality-animated-character-model/
Cans - https://assetstore.unity.com/packages/3d/props/free-cans-pack-122374
Vending machine - https://assetstore.unity.com/packages/3d/props/interior/snack-machines-3517
Created Model - https://3dwarehouse.sketchup.com/model/0d413533-69c8-4633-81d3-9cd5a463e462/ATM
Sound - http://soundbible.com/2165-Creepy-Background.html
Box images - Google Images

Cereal box - 2

Cars - https://assetstore.unity.com/packages/3d/vehicles/land/4x-low-poly-cars-105478
Buildings - https://assetstore.unity.com/packages/3d/environments/urban/simple-urban-buildings-pack-1-33563
Cop - https://assetstore.unity.com/packages/3d/characters/police-officer-smashy-craft-series-107256
Railing, Stop signage - https://assetstore.unity.com/packages/3d/props/traffic-cone-roadblock-3dscan-109209
Created Model - https://3dwarehouse.sketchup.com/model/81e5ce3c-8592-47a4-9320-c783452f7a4b/Fountain
Water Splash, Smoke - https://assetstore.unity.com/packages/vfx/particles/fire-explosions/
particle-dissolve-shader-package-33631
Sound - http://soundbible.com/2175-Street.html

Milk can - 1

Can images - Google Images Dinner set Model - https://assetstore.unity.com/packages/3d/environments/fantasy/dinner-table-55180
Cloud, Moon - https://assetstore.unity.com/packages/3d/3le-low-poly-cloud-pack-65911
Created Model - https://3dwarehouse.sketchup.com/model/7e67fc7d-abd8-49fe-85cb-bb4ea6831a15/Balloons
Sound - https://www.youtube.com/watch?v=LTgRm6Qgscc
Dancing Lady - https://www.mixamo.com/#/?page=2&type=Character

Milk can - 2

Animals - https://assetstore.unity.com/packages/3d/characters/animals/animals-pack-lowpoly-67734
Fountain - https://assetstore.unity.com/packages/3d/environments/fantasy/hand-painted-fountain-41694
Trees - https://assetstore.unity.com/packages/3d/environments/nature-starter-kit-2-52977
Created Model - https://3dwarehouse.sketchup.com/model/3561ca38-0368-4c7f-b104-8c00009f41b5/Campfire
Fire - https://assetstore.unity.com/packages/tools/utilities/particle-system-preview-73346
Creature 1 - https://assetstore.unity.com/packages/3d/characters/creatures/rock-warrior-123300
Creature 2 - https://assetstore.unity.com/packages/3d/characters/humanoids/naga-guard-123303
Sound - http://soundbible.com/1818-Rainforest-Ambience.html

Can - 3

Classroom - https://assetstore.unity.com/packages/3d/props/interior/props-for-the-classroom-5977
Professor with Animation - https://www.mixamo.com/#/?page=2&type=Character
Created Model - https://3dwarehouse.sketchup.com/model/e9f2d3ed-a79f-423d-a3fc-85cdff366deb/Cupboard
Sound - http://soundbible.com/1561-Classroom-Ambiance.html

Can - 4

Beach Model - https://assetstore.unity.com/packages/3d/environments/island-assets-56989
Man exercising - https://www.mixamo.com/#/?page=2&type=Character
Woman Warmup - https://www.mixamo.com/#/?page=2&type=Character
Created Model - https://3dwarehouse.sketchup.com/model/417d1566-0c58-4ce4-bec3-d16032b40eb9/Beach-house
Sound - http://soundbible.com/885-Sea-Waves.html

Magazines

Images from 9gag and google


Screenshots