How to use mobile device's camera and microphone in business applications

Current mobile devices feature such tech specs, one could only dream about a few years ago. They provide great work optimization opportunities. Despite that, many of them are used in business scenarios only occasionally.

This article uncovers the utilization of mobile device's built-in camera and microphone in a photo documentation application that enables creating a voice tag.

Such application has numerous ways of usage. Practically, it is suitable for any kind of work force collecting data in the field. A good example is a Field Service solution, where a service technician fills out a report when being in the field. In such situation, the photo documentation describing a technical defect is an essential part of the report.

Another example can be a policeman or an insurance agent that uses mobile application for documentation of a car accident or an insurance claim.

Last but not least, the solution can be hosted, for instance, by a mobile operator that can include it in their portfolio of services adding interesting value for their customers.

Let's develop the application in Microsoft Visual Studio and .NET Compact Framework. In order to avoid complicated technology of picture and sound processing, we will use components from the Resco MobileForms Toolkit. These components dramatically simplify the overall development and save lots of time.

After running a quick brainstorming, this is the expected functionality our application shall possess:

• Creating a new photo documentation project;
• Adding a new photo image to an existing project;
  • Launching a built-in camera and picture capturing;
  • Picture editing;
  • Adding a voice tag.

Data scheme

Creating a New Photo Documentation Project

The user has following options when creating a new project: a new project name, setting date, time and location, and adding a note. In order to save the project to the database click the 'Save' button in the lower part of the screen.

Adding a New Picture to the Existing Project

A click to 'Capture' button in the lower left corner launches the application that manages the built-in camera. Furthermore, it allows the photo capturing itself.

Afterwards, the photo image is transferred to the application, where it can be edited by the user.

To display a photo image, we will use a component Resco ImageBox. It allows photo editing and transformations. In order to offer these editing options to the user, we need a control element, such as Toolbar. A reasonable choice is a Resco component - CustomKeyboard.

As you can see in the picture above, the user can use a stylish and easily operable keyboard with rich scale of editing options: gamma correction, brightness, contrast, resize, crop, rotate counterclockwise, zoom out, fit to screen, zoom in, rotate clockwise. After the user clicks one of the editing options, the keyboard is transformed to a new layout. The new layout enables performing the preferred changes. For instance, after I click a brightness button, following layout is displayed:

In order to perform sufficient photo quality, I can repeat the editing of other features. Once I am satisfied with the overall photo quality, I click 'Apply' button in the lower right corner, and the photo transformation is saved.

Adding a voice tag to the photo image is simple - a single click to 'Click to Record' launches sound recorder.

For this purpose was used a Resco component - Resco Audio. It allows sound recording and play back in multiple audio formats. The voice tag needs to be saved to be assigned to the photo image.

In order to complete the Project, the user can add more photo images and voice tags in the same way as described above.
The final step is the project synchronization with server. This can be done by a single click to 'Sync' button in the starting form of the application.

Putting It All Together

About Resco MobileForms Toolkit

About PhotoAssistant ESP