Building Qt Virtual Keyboard
Overview
This document describes how to build the Qt Virtual Keyboard plugin.
The project is split into the following subprojects:
examples/virtualkeyboard/basic/basic.pro | Qt Virtual Keyboard Demo application |
src/virtualkeyboard/import/ | Qt Virtual Keyboard QML plugin (QtQuick.VirtualKeyboard) |
src/virtualkeyboard/plugin/ | Qt Virtual Keyboard platform input context plugin. This plugin provides the QPlatformInputContext interface for the Qt and is also responsible for loading the Virtual Keyboard Plugins (QtQuick.VirtualKeyboard.Plugins). |
src/virtualkeyboard/plugins/ | A directory containing Qt Virtual Keyboard plugins, such as the Hunspell plugin |
src/virtualkeyboard/settings/ | Qt Virtual Keyboard Settings QML plugin (QtQuick.VirtualKeyboard.Settings) |
src/virtualkeyboard/styles/styles.pro | Qt Virtual Keyboard Styles QML plugin (QtQuick.VirtualKeyboard.Styles) |
src/virtualkeyboard/virtualkeyboard.pro | Qt Virtual Keyboard module, QML components and layouts |
The input methods are implemented either in C++ or QML. Qt Virtual Keyboard provides implementations of PlainInputMethod, MultitapInputMethod and HunspellInputMethod. The MultitapInputMethod is implemented in QML while the others are implemented in C++.
Build Instructions
The Qt Virtual Keyboard can be built for Linux Desktop/X11, Windows Desktop or Boot2Qt targets. The target is automatically detected by QMAKE and requires no special configuration parameters.
Qt Creator is the preferred build environment for Qt Virtual Keyboard as you can then leverage the shadow build functionality and rapidly switch between build targets.
Configuration Options
The table below contains the top-level options for configuring the virtual keyboard features.
Option | Arguments | Description | Remarks |
---|---|---|---|
-vkb-enable <code>[,<code>]*" | Supported language codes or 'all' | Enables the specified language | The specified languages can be explicitly enabled using this option. Each language code has the format language[_country], where:
This option can be used to define the language support as required. The virtual keyboard can support one or more languages at a time. For example, The virtual keyboard automatically includes all supported languages if no other languages are specified. |
-vkb-handwriting | [no|myscript-hwr|cerence-hwr] | Enables or disabled handwriting input | This flag enables handwriting input. By default, the engine is automatically activated if it is located in the proper plugins folder even without using of this option. But, in case MyScript and Cerence SDK co-exist, one of [no|myscript-hwr|cerence-hwr] must be configured. |
[-no]-vkb-arrow-keynavigation | Enables or disables arrow key navigation for the keyboard | Allows controlling the keyboard using the arrow and return keys. This feature is off by default. | |
-vkb-style | [standard|retro] | Choose the style of the virtual keyboard | The Qt Virtual Keyboard supports two styles, standard and retro. Both styles will be included in the package, but this option allows you to change the built-in default style. |
[-no]-vkb-cangjie | Enables or disables the Cangjie input method for Traditional Chinese. | This option enables or disables the Cangjie input method for the Traditional Chinese language. The input method is enabled by default if support for Traditional Chinese is enabled. | |
[-no]-vkb-zhuyin | Enables or disables the Zhuyin input method for Traditional Chinese. | This option enables or disables the Zhuyin input method for the Traditional Chinese language. The input method is enabled by default if support for Traditional Chinese is enabled. | |
[-no]-vkb-desktop | Enables or disables Desktop integration | By default, the desktop integration is enabled when the target environment is X11 or Windows desktop. With this option, the desktop integration can be disabled. Note: For embedded integration, where the InputPanel is instantitated by the application, there is no need to use this option explicitly. The virtual keyboard will not create the desktop input panel if the application creates InputPanel before the focus is set to an input field. | |
[-no]-vkb-layouts | Enables or disables built-in layouts | By default, the virtual keyboard plugin contains the English keyboard layout. By specifiying -no-vkb-layouts, the built-in layout(s) are excluded from the virtual keyboard plugin. Note: In this scenario, the |
These options can be passed to configure when doing a full build of Qt. Alternatively, when building only the Qt Virtual Keyboard, you can configure the keyboard using the following command (where SRCDIR points to the source directory of QtVirtualKeyboard):
qmake $SRCDIR -- [options]
disable-hunspell | n/a | Disables Hunspell integration | Hunspell integration is enabled if the Hunspell library is available on the system, or if it is built using the local project file. Integration can be disabled using this option. |
-vkb-no-bundle-pinyin | n/a | Disables bundling of pinyin resources | This option excludes pinyin resources from the plugin binary. This option may be used to reduce the plugin binary size. |
-vkb-no-bundle-tcime | n/a | Disables bundling of tcime resources | This option excludes tcime resources from the plugin binary. This option may be used to reduce the plugin binary size. |
pinyin | lang-zh_CN | Enables the Pinyin input method for Simplified Chinese. | This option activates the Pinyin input method for the Simplified Chinese language. As this option activates a particular language, the |
tcime | lang-zh_TW | Enables the both Cangjie and Zhuyin input methods for Traditional Chinese. | This option activates the both Cangjie and Zhuyin input methods for the Traditional Chinese language. As this option activates a particular language, the |
openwnn | lang-ja_JP | Enables the OpenWnn input method for Japanese. | This option activates the OpenWnn input method for the Japanese language. As this option activates a particular language, the |
-vkb-cerence-sdk | path/to/cerence/sdk | Configures the Cerence SDK location and enables the Cerence Handwriting and XT9 integrations. | The Cerence SDK (zip) must be unpacked using the src/virtualkeyboard/plugins/cerence/unpack.py script. By default, the SDK is unpacked to src/virtualkeyboard/plugins/cerence/sdk, where the build scripts can pick it up automatically. However, by using the second parameter to the unpack.py script, it is possible to use different location for the SDK. In that case, the location must be passed to the build script using the -vkb-cerence-sdk command line parameter. |
-vkb-cerence-static | handwriting | Enables static linking of the Cerence Handwriting engine. | The Cerence Handwriting engine is linked dynamically by default. Use -vkb-cerence-static to force static linking. |
-vkb-bundle-cerence-hwr or -vkb-bundle-cerence | n/a | Enables bundling of Cerence Handwriting resources | This option bundles the Cerence Handwriting resources in the plugin binary. |
-vkb-bundle-xt9 or -vkb-bundle-cerence | n/a | Enables bundling of XT9 resources | This option bundles the XT9 resources in the plugin binary. |
-vkb-myscript-sdk | path/to/myscript/sdk | Configures the MyScript Text SDK location and enables the MyScript Handwriting integration. | The MyScript Text SDK (zip) which is unpacked to src/plugins/myscript/sdk, can be picked up automatically by the build scripts. However, the SDK can be placed in different location. In that case, the location must be passed to the build script using the -vkb-myscript-sdk command line parameter. |
-vkb-myscript-arch | [x86|x64|armv7hf|armv7|arm64] | Configures the target CPU architecture | The MyScript Text SDK offers shared (dynamic) libraries for different CPU architectures - [x86|x64|armv7hf|armv7|arm64] for Linux and [x86|x64] for Windows. It can automatically configured. However, a user also can specify the target CPU architecture using the -vkb-myscript-arch command line parameter. |
Building Documentation
make docs | Generates documentation |
Hunspell Integration
By default, HunspellInputMethod will not be available unless the Hunspell library and development headers are found. For Linux/X11 targets, the Hunspell library can be provided by installing the libhunspell-dev package. Alternatively, the Hunspell sources can be extracted into the src/plugins/hunspell/3rdparty/hunspell directory. The sources are automatically detected by the qmake and the project will be configured to use the local Hunspell. If Hunspell sources are used, then the dictionary files must also be copied into the src/plugins/hunspell/3rdparty/hunspell/data directory.
An example of how the directory structure should look after copying in the Hunspell sources and dictionary files is listed below:
3rdparty └── hunspell ├── data │ ├── en_GB.aff │ └── en_GB.dic ├── hunspell.pro └── src └── hunspell ├── affentry.cxx ├── affentry.hxx (etc.)
Cerence Handwriting Integration
Cerence Handwriting integration supports the Alphabetic and CJK (Chinese Japanese Korean) engines. Both engines are integrated via T9WriteInputMethod. The input method is initialized with one engine at the time. The engine selection happens automatically based on the current input locale.
Cerence Handwriting Compatibility
Qt Virtual Keyboard is compatible with Cerence Handwriting v8.7 or later.
Cerence Handwriting Build Preparations
The contents of the SDK must unpacked using the unpack.py script located in the cerence directory. This ensures the correct directory structure for CMake to find the content.
$ cd src/plugins/cerence/ $ python unpack.py filename.zip
This will unpack the contents to the src/plugins/cerence/sdk directory, where the CMake can pick it up automatically.
Alternatively, you can unpack to any other directory by adding extra parameter to the command line. In this case, the location of the SDK must be passed to the configure script.
configure ... -vkb-cerence-sdk /path/to/cerence/sdk
Layout of the Cerence SDK
The extracted content of the SDK looks like this:
sdk ├───t9write │ ├───api │ ├───data │ │ ├───arabic │ │ ├───hebrew │ │ └───thai │ └───lib │ ├───linux │ │ ├───arm64 │ │ │ ├───shared │ │ │ │ ├───alphabetic │ │ │ │ └───cjk │ │ │ └───static │ │ │ ├───alphabetic │ │ │ └───cjk │ │ └───x86_64 │ │ ├───shared │ │ │ ├───alphabetic │ │ │ └───cjk │ │ └───static │ │ ├───alphabetic │ │ └───cjk │ └───win32 │ ├───x86 │ │ ├───shared │ │ │ ├───alphabetic │ │ │ └───cjk │ │ └───static │ │ ├───alphabetic │ │ └───cjk │ └───x86_64 │ ├───shared │ │ ├───alphabetic │ │ └───cjk │ └───static │ ├───alphabetic │ └───cjk └───xt9 ├───api ├───data └───lib ├───linux │ ├───arm64 │ │ ├───shared │ │ └───static │ └───x86_64 │ ├───shared │ └───static └───win32 ├───x86 │ ├───shared │ └───static └───x86_64 ├───shared └───static
Where the contents of each directory are:
Directory | Description | Remarks |
---|---|---|
api | This directory should contain all of the API files | The API files usually located in the "api" and "public" directories of the SDK, but sometimes in the "demo" directory. When using both Alphabetic and CJK engines at the same time, any overlapping files can be copied from either SDK. |
data | This directory should contain all HWR databases and optionally XT9 databases. | HWR database for the Cerence Handwriting Alphabetic:
HWR database for the Cerence Handwriting CJK:
Language database:
|
lib/<target>/<linkage>/<engine-variant> | Directory structure holding supported target builds. | These directories should hold the desired target libraries. If both shared and static libraries are found, shared libraries are preferred. |
The Cerence Handwriting and XT9 integration code is automatically activated when the Cerence SDK is detected.
All other extensions should be cleaned from the [qtbase]/plugins/virtualkeyboard directory before building the Cerence extensions to avoid conflicting behavior at runtime. The Cerence extensions do not require any other virtual keyboard plugin to function.
Handwriting databases and language databases for XT9 are installed in the [qtbase]/qtvirtualkeyboard/cerence directory. In addition, there are two other alternatives for locating these files:
- A custom runtime location defined by Environment Variables
- The -vkb-bundle-cerence command line option to embed resources in the plugin binaries
MyScript Text SDK Integration
MyScript Text is designed for building applications that enable the recognition of handwritten text. MyScript Text supports the recognition of isolated characters, cursive, print and superimposed writing. MyScript superimposed writing is integrated into Qt Virtual Keyboard. It enables the recognition of letters, words or parts of words written one over the other, without any explicit separation between consecutive fragments. It is capable of running on memory and CPU constrained devices.
Input handwriting styles of MyScript Text SDK
The end-user can write one word fragment over the other, or one character over the other, as depicted below. Space between two written words are automatically added, so that there is no need for an explicit gesture.
Language coverage of MyScript Text SDK
MyScript Superimposed supports 72 languages.
MyScript Text SDK Packages Installation
The MyScript delivery team can provide you the packages with various .zip
archives. To access all the code, tools, and resources needed for building your own handwriting application, extract all the packages in the same destination folder as src/plugins/myscript/sdk
, where the CMake can pick it up automatically.
Alternatively, you can extract the packages to any other directory. In this case, the location of the SDK must be passed to the configure script.
configure ... -vkb-myscript-sdk /path/to/myscript/sdk
The file hierarchy should look like below:
myscript └── sdk ├─── conf ├─── doc ├─── edk ├─── engine │ └─── bin │ ├─── lin-arm64 │ │ └─── *.so │ ├─── lin-armv7 │ │ └─── *.so │ ├─── lin-armv7hf │ │ └─── *.so │ ├─── lin-x64 │ │ └─── *.so │ ├─── lin-x86 │ │ └─── *.so │ ├─── win-x64 │ │ └─── *.dll │ ├─── win-x86 │ │ └─── *.dll │ (etc.) ├─── rdk ├─── resources │ ├─── ar │ │ └─── *.res │ ├─── en_GB │ │ └─── *.res │ ├─── ja_JP │ │ └─── *.res │ ├─── ko_KR │ │ └─── *.res │ ├─── zh_CN │ │ └─── *.res │ (etc.) ├─── tools └─── voim ├─── api ├─── bin │ ├─── lin-arm64 │ │ └─── *.so │ ├─── lin-armv7 │ │ └─── *.so │ ├─── lin-armv7hf │ │ └─── *.so │ ├─── lin-x64 │ │ └─── *.so │ ├─── lin-x86 │ │ └─── *.so │ ├─── win-x64 │ │ └─── *.dll │ ├─── win-x86 │ │ └─── *.dll │ (etc.) └─── conf
The description for the contents of each directory are:
Directory | Description |
---|---|
conf | Contains the language configuration files that the Engine uses to configure language resources. |
doc | Contains the HTML documentation files. The file index.html displays the main page. |
edk | Contains the Engine Development Kit and handwriting programming elements for each supported programming language API, including code samples. |
engine | Contains libraries of each engine object, depending on the target platforms it could be SO, A, or DLL. |
rdk | Contains the Resource Development Kit, i.e. tools and examples for creating custom resources. |
resources | Contains resource files with the /c .res extension. They are binary assets used at run time by the different MyScript technologies to achieve the various recognition tasks. |
tools | Contains useful programmer tools including InkTool for ink testing. |
voim | Contains libraries of MyScript Text Input Method. It is an extension SDK to the MyScript Text recognition system and designed for building input methods using handwriting recognition easily and quickly. |
Setting the Certificate of MyScript Text SDK
A valid certificate is mandatory to use the MyScript Text SDK. This is a security measure that uniquely identifies you as a legitimate customer of MyScript technologies. The certificate helps MyScript trace customers' identify and the products that have been purchased.
The certificate is delivered in the [your_login].vo.zip package
. When you unzip this package, the certificate is automatically put in the appropriate location. This ensure that the certificate is instantly working within the services and code samples that you have been provided with.
How to build Qt Virtual Keyboard with MyScript Text SDK
The MyScript integration code is automatically activated when the MyScript Text SDK is detected.
Language resources for MyScript Text SDK are installed in the [qtbase]/qtvirtualkeyboard/myscript directory.
Static builds
The virtual keyboard can be built and linked statically against the application. This implies that Qt is also built statically (using the -static option in the configure command line).
Static builds of the virtual keyboard are enabled by adding CONFIG+=static
to the qmake command line and then rebuilding.
Some third party modules used by the virtual keyboard are always built as shared libraries (e.g. Hunspell).
Using the static plugin
The following section should be added to the application project file that uses the statically built virtual keyboard.
static { QTPLUGIN += qtvirtualkeyboardplugin QT += svg }
QTPLUGIN
causes qmake to pull linker dependencies for the virtual keyboard plugin. The SVG module is required as an extra dependency for Qt, since the SVG format is required by the default styles.
From here on, using a statically built virtual keyboard is no different from the normal case.
Deployment
Desktop Targets
Add a Deploy Step that executes the make install command, then deploy using the Deploy All command.
Boot2Qt Targets
The installation is done by copying the necessary files to the memory card, or by using the adb push command.
© 2024 The Qt Company Ltd. Documentation contributions included herein are the copyrights of their respective owners. The documentation provided herein is licensed under the terms of the GNU Free Documentation License version 1.3 as published by the Free Software Foundation. Qt and respective logos are trademarks of The Qt Company Ltd. in Finland and/or other countries worldwide. All other trademarks are property of their respective owners.