Augmented Reality SDK: Insight into Wikitude

Imagine simply directing your smartphone at a historical building and finding out everything there is to know about it. Wikitude’s software development kit (SDK) makes that possible.

Wikitude are one of the companies developing leading tools for creating genuine augmented reality (AR) experiences for iOS and Android users. The firm’s SDK has been trialled by 20 of the “World’s Top 100 Companies”,[1] putting it at the forefront of AR development. The SDK contains tools such as 3D rendering, which allows an app user to discover their surroundings through immersion, thereby enhancing their experience. It is a must-have for developers interested in adding any AR to their applications. You may have come across apps that use this technology by, for example, requiring you to point your iPad towards the sky for it to tell you the names of the stars you can see.

The company was founded in 2008 in Salzburg, Austria. Initially, the company focused on bringing AR experiences through its own app, the Wikitude World Browser App.[2] The first version of the current SDK was launched in 2012. There are now about 10,000 applications that use it in some way, such as the Golfscape GPS Rangefinder.[3] This iOS app enhances the golf course experience, giving real-time distances to the front, middle and back of the green, all superimposed from the user’s current view of the golf course. Beyond this, there are over 100,000 registered developer accounts with Wikitude, creating a large community that support each other through a dedicated forum. This is helpful for anyone implementing AR for the first time, but also for developers looking for help on niche situations.

Wikitude achieves its interactivity through location-based AR. By pointing your phone in a certain direction, the position of the objects that can be observed on the screen is determined using the user’s location, the direction the user is facing using the built-in compass, and the accelerometer (to align the objects in portrait or landscape view on the mobile device).[4] The SDK is designed for iOS, Android, and wearable devices including eyewear products such as Google Glass, Vuzix M100, and Epson BT-200. It allows developers to superimpose videos, images, 3D models and entire HTML code to create a more interactive app for users. One particularly useful feature of Wikitude is that it takes out the complexity of coding the AR, and lets developers focus on the content, making it a friendly tool. However, more advanced uses of AR development might benefit from the D’Fusion SDK, which offers a more secure, custom solution.[5]

 

dev2dev
Figure 1: Illustraion showing some example code, courtesy of Wikitude.[10]

Another possible application for Wikitude’s features includes improving the user experience of sports fixtures. For example, by pointing your phone towards a tennis court at Wimbledon, the app would give the user a full description of who is playing, along with live scores and instant replays of noteworthy points. This would combine the experience of a live match with content available only when watching a broadcast on TV.

The SDK also features 2D image recognition, which could enable more information about a product to be given on a mobile device. For example, in a catalog containing pictures of products, this SDK would recognise the product image and render a virtual 3D version, making it easier for the app user to see what the product looks like in reality. It can also provide options such as instant online buying, saving the user time. This interactivity could have provide further functionality; for example, in primary education, it could be used to transpose a 2D paper representation of a cube into an easier-to-understand 3D object.

The SDK can also be used to recognise articles in magazines that are written in a foreign language, and give the user the option to read the article in their own language on their mobile device. It can even be used to convert handwritten text on a piece of paper to computer text. Google offers a similar conversion service, but it has been argued that it may not work as reliably when converting handwritten work.[6]

 

Screen Shot 2016-04-22 at 15.19.16
Figure 2: Picture showing 2D image recognition in action. A virtual 3D version of the product is rendered, along with a phone number through which the user can buy the product. Photo courtesy of Wikitude.[11]

Wikitude also offer the ability to manage content using a cloud-based system. This is useful if the app being developed will need to recognise more than 1,000 images. However, an Internet connection will be required for this to work. The cloud recognition software is based on Restful APIs that manage the content. This means that the app sends and receives data from the cloud server using an HTTP request.[7]

The Wikitude SDK offers some distinct advantages over its competitors: it is a well-respected, widely used development platform, and has been in use for several years now —and incorporated in many apps⁠—suggesting that the software works in the way it’s supposed to. Nevertheless, the steep pricing⁠—particularly with the Pro versions⁠—may put off amateur developers.[8] There is a free trial version without a time limit, offering all the features available on the pro products. However, this version does contain a watermark, which may be off-putting for anyone hoping to develop a product.

In future releases, the company hopes to expand on its object-tracking capabilities. This new feature will enable apps to recognise and track 3D objects and augment them.[9] It builds upon the idea of recognising images on a 2D layer, and expands these capabilities to any 3D objects through the addition of a third plane (the z-plane). This will improve the accuracy and precision of object recognition.

The improvement of AR techniques will increase in importance as the technology becomes more widespread. Its main growth area will most likely be in eyewear, which⁠—due to the small screen size (the lens size)⁠—relies heavily on AR to create an immersive user experience.

 

References

  1. Philipp Nagele, The 2016 Wearable Technology Show, 2016.
  2. Wikitude, Publish your AR project to the world with the Wikitude app!.
  3. Iphoneness, 40 Best Augmented Reality iPhone Apps, 2015.
  4. Gerhard Reitmayr & Dieter Schmalstieg, Location Based Applications for Mobile Augmented Reality, 2003.
  5. Mark Baldwin, The Top 5 Augmented Reality SDK's, 2013.
  6. Google, Translate Images, 2016.
  7. Stack Overflow, What exactly is RESTful programming?, 2009.
  8. Wikitude, Wikitude Store, 2016.
  9. Wikitude, Unity Plugin Update – 3D tracking, new sample app and more!, 2016.
  10. Wikitude, Dev to Dev, 2015.
  11. Wikitude, SDK Overview, 2016.

Books

Jobs

Entry-Level Engineer at NC Department of Transportation
Expires: 02/03/2021 Employer: NC Department of Transportation
Registered Nurse ($3,200 Hiring Incentive)(Job Id 15544) at South Dakota State Government
Expires: 02/17/2021 Employer: South Dakota State Government - Department of Health
Registered Nurse ($3,200 Hiring Incentive)(Job Id 15541) at South Dakota State Government
Expires: 02/17/2021 Employer: South Dakota State Government - Department of Health
Engineering Technician III at Washington County, Oregon
Expires: 02/07/2021 Employer: Washington County, Oregon
Customer Accounts Specialist I at City of Portland Bureau of Human Resources
Expires: 01/30/2021 Employer: City of Portland Bureau of Human Resources
Social Worker IA&T - 2nd shift at Carteret County Government
Expires: 02/01/2021 Employer: Carteret County Government
Supervisory Interdisciplinary Scientist at US Food and Drug Administration (FDA)
Expires: 02/02/2021 Employer: US Food and Drug Administration (FDA)
Mental Health Professional at El Paso County
Expires: 02/01/2021 Employer: El Paso County
Maintenance Supervisor at CSL
Expires: 02/15/2021 Employer: CSL
Clean Utilities Engineer at CSL
Expires: 02/15/2021 Employer: CSL
BAS Engineer at CSL
Expires: 02/15/2021 Employer: CSL
Program Manager - Family Planning at El Paso County
Expires: 02/01/2021 Employer: El Paso County
Deputy Human Services Director - Health at Carteret County Government
Expires: 02/08/2021 Employer: Carteret County Government
Student Trainee for Engineers and Architects at U.S. Army Corps of Engineers, Baltimore District
Expires: 01/30/2021 Employer: U.S. Army Corps of Engineers, Baltimore District
Business Systems Analyst (Operations and Policy Analyst 2) at Oregon Department of Environmental Quality
Expires: 02/01/2021 Employer: Oregon Department of Environmental Quality
Management and Program Analyst Summer Student Trainee (GS-7/GS-9) at U.S. Government Accountability Office
Expires: 02/08/2021 Employer: U.S. Government Accountability Office
Management and Program Analyst Summer Student Trainee (GS-04) at U.S. Government Accountability Office
Expires: 02/08/2021 Employer: U.S. Government Accountability Office
Associate General Counsel at Office of the Massachusetts State Treasurer and Receiver General
Expires: 02/04/2021 Employer: Office of the Massachusetts State Treasurer and Receiver General
Fiscal Policy Analyst at Office of the City Auditor, City of Sacramento
Expires: 02/03/2021 Employer: Office of the City Auditor, City of Sacramento
Director Human Resources at Hillsborough County Government
Expires: 02/27/2021 Employer: Hillsborough County Government
Planning Director at County of Frederick, VA Local Government
Expires: 02/08/2021 Employer: County of Frederick, VA Local Government
Planner Coordinator at Maryland-National Capital Park and Planning Commission (Prince George's County, MD)
Expires: 02/16/2021 Employer: Maryland-National Capital Park and Planning Commission (Prince George's County, MD)
Consumer Safety Officer (Emergency Response Coordinator) at US Food and Drug Administration (FDA)
Expires: 01/25/2021 Employer: US Food and Drug Administration (FDA)
Public Affairs Specialist at Federal Emergency Management Agency (FEMA) Pathways Students and Recent Graduates
Expires: 01/29/2021 Employer: Federal Emergency Management Agency (FEMA) Pathways Students and Recent Graduates
Code Comp Investigator II at Fairfax County Government
Expires: 01/30/2021 Employer: Fairfax County Government - Fairfax County Human Resources
Behavioral Health Senior Clinician - Youth & Family at Fairfax County Government
Expires: 02/06/2021 Employer: Fairfax County Government - Fairfax County Human Resources
Social Services Specialist III at Fairfax County Government
Expires: 01/30/2021 Employer: Fairfax County Government - Fairfax County Human Resources
Public Health Nurse IV at Fairfax County Government
Expires: 01/30/2021 Employer: Fairfax County Government - Fairfax County Human Resources
Kinship Care Specialist (Social Services Specialist III) at Fairfax County Government
Expires: 01/30/2021 Employer: Fairfax County Government - Fairfax County Human Resources
Water Resources/Dam Safety Engineer (Senior Engineer III) at Fairfax County Government
Expires: 02/06/2021 Employer: Fairfax County Government - Fairfax County Human Resources
FOIA Analyst (Management Analyst II) at Fairfax County Government
Expires: 01/23/2021 Employer: Fairfax County Government - Fairfax County Human Resources
Administrative Assistant & Scheduler (Administrative Aide) at Fairfax County Government
Expires: 01/30/2021 Employer: Fairfax County Government - Fairfax County Human Resources