OVERVIEW

On September 8th, 2016, Apple Inc. has released its newest batch of products, including iPhone 7, Apple Watch series 2, and AirPods. iOS 10 was also shipped with these products and it is said to be the most advanced mobile smart operating system. With its new features, the structures and forms of new software applications on iOS 10 will be significantly changed. To be able to stay in business, it is necessary to research the new iOS documentation and have developers acquiring the skills for the future iOS developments.

GOALS

  • Find out what’s different in the new iOS 10
  • Comprehensively research and acquire the ability to implement the new features
  • Implement a demo app containing the new features

PARTICIPANTS

  • Ye, Xianyong
  • Zhu, Zhihai
  • Zhang, Xiaobo

RESULTS

SiriKit

SiriKit enables your iOS 10 apps to work with Siri, so users can get things done with your content and services using just their voice. In addition to extending Siri’s support for messaging, photo search and phone calls to more apps, SiriKit also adds support for new services, including ride booking and personal payments.

Apps adopt SiriKit by building an extension that communicates with Siri, even when your app isn’t running. The extension registers with specific domains and intents that it can handle. For example, a messaging app would likely register to support the Messages domain, and the intent to send a message. Siri handles all of the user interaction, including the voice and natural language recognition, and works with your extension to get information and handle user requests.

HomeKit

HomeKit is a framework for communicating with and controlling connected accessories in a user’s home. You can enable users to discover HomeKit accessories in their home and configure them, or you can create actions to control those devices. Users can group actions together and trigger them using Siri.

OVERVIEW

On November 3rd, Tencent has announced the beta test version of its new platform - the Weapp platform. The Weapp platform provides a place inside of Wechat that allows developers to create and deploy apps that can easily be used and shared by Wechat users. With the Weapp platform, users are no longer required to download separate apps to use many of the functionalities of the service providers, the only thing they need is the Wechat app, and we believe that in China, the Weapp platform will be the third mobile app distribution platform, aside from iOS and Android. The objective of this project is to familiarize the platform and its development documentation, and get hands-on experience of what’s crucial to developing a weapp.

GOALS

  • Research the Weapp platform to gain ability to develop weapps
  • Develop a demo weapp that has the most basic functionalities of an e-commerce application

PARTICIPANTS

  • Hiratsuka, Shinu
  • Chen, Ethan

OVERVIEW

Today’s technology has grown into a place where electronic devices such as our phones, watches are becoming more intelligent, users are trained to be using various apps across those devices, and expecting to interact with them by talking to them. Therefore, apps that support the voice control features would stand a better chance against similar opponents. In order to achieve that, the very first step is to have the technology to transform voice speech into text, called speech to text technology, or STT.

GOALS

  • Research existing speech recognition toolkits
  • Continuous development of the existing technologies and modularize them for easier plug in
  • Develop own STT technology and modularize it

PARTICIPANTS

  • Chen, Ethan

SPECIFICATIONS

For the first and second goals of this project, it is expected that we have a complete list of what is out there and what are the pricing policies. And with the modularization, we can easily provide our clients with various solution options that fit their budgets. The module is expected to be in the following 2 forms:

  1. Offline API library that has corresponding functions/methods of each of the web APIs, when called, the module will send web requests to vendors’ servers and return the results in the form of our module definition
  2. Online web service that serves RESTful interfaces, which link to vendors’ web APIs. When called, our server will reform the original requests to match the criteria of the vendors’ APIs and return the results in the form of our module definition
For the third goal, there is expected to be a RESTful web API that takes audio files as input, along with an indicator of the language the audio uses, and the API returns the translated text. It can also be a module (Python/Django app, jar, etc) that can be installed into project codes. One of the promising core technologies is called CMU Sphinx, it is an open source project created by Carnegie Mellon University and can be used and developed based on that project.