QML is a user interface markup language that is used in the Qt Framework. Squish Coco has an add-on that supports code coverage for QML. The add-on is delivered separately and requires an additional license.
It consists of two parts, a program to instrument the QML code and a QML plugin that is needed at runtime.
The instrumentation program is called
cocoqmlscanner and it inserts code into the QML sources of a program. The plugin implements a QML object that at runtime collects the coverage data and writes them to a file. The plugin is delivered in source form and must be compiled by the customer.
The CocoQML package is a ZIP archive. When unpacked, it generates a directory with two subdirectories:
bin: The directory with the
cocoqmlscannerexecutable and some libraries that are needed by it.
trackerplugin: The source code of the tracker plugin.
Both directories are independent of each other and it is possible to copy them to different places of a test installation.
The plugin is a
qmake project. It must be compiled for the same Qt version as the application for which the coverage should be measured. We recommend that you make it part of your project and include it in the repository, so that it is automatically compiled correctly.
Under UNIX®, the compilation looks like this:
$ /Qt/5.11.3/gcc_64/bin/qmake ../trackerplugin Info: creating stash file /home/user/trackerplugin-build/.qmake.stash $ make g++ -c -pipe -O2 -std=gnu++11 -D_REENTRANT -Wall -W -fPIC -DQT_NO_DEBUG -DQT_PLUGIN -DQT_GUI_LIB -DQT_QML_LIB -DQT_NETWORK_LIB -DQT_CORE_LIB -I../trackerplugin -I. -I/Qt/5.11.3/gcc_64/include -I/Qt/5.11.3/gcc_64/include/QtGui -I/Qt/5.11.3/gcc_64/include/QtQml -I/Qt/5.11.3/gcc_64/include/QtNetwork -I/Qt/5.11.3/gcc_64/include/QtCore -I. -isystem /usr/include/libdrm -I/Qt/5.11.3/gcc_64/mkspecs/linux-g++ -o csexeapi.o ../trackerplugin/csexeapi.cpp [...] mv -f libcocoqmltracker.so QmlJsCoverage/libcocoqmltracker.so cp -f /home/user/trackerplugin/qmldir QmlJsCoverage $
When compiled this way, the build directory contains a subdirectory
QmlJsCoverage which contains the plugin:
$ ls QmlJsCoverage/ libcocoqmltracker.so qmldir $
The Microsoft® Windows build is similar; the plugin directory then contains a DLL instead of a .so file.
To measure QML coverage in a software project, its QML files must be be instrumented. This is done by the
cocoqmlscanner command, in the form
$ cocoqmlscanner project directory
All QML files in subdirectories of <project directory> are then (reversibly) instrumented and a program database (or
.csmes file) is written. By default, the program database file is .
After the QML files are instrumented, it is recommended to recompile the project. This is especially important in two cases:
- The QML files are resources of the program (i.e. specified in a
- The QML compiler is used. (This is the default for release builds that are compiled with Qt Creator).
In both cases, the compilation makes the instrumented files part of the executable.
After instrumentation, an application needs the tracker plugin to run. To find the plugin, it uses the environment variable
QML2_IMPORT_PATH. This variable must be set and its value must be the parent directory of .
If this variable is set correctly, the instrumented AUT can run.
If something goes wrong, it is useful to set the variables
COCOQML_VERBOSE to 1. With the first one set, Qt shows where it searches for modules. With the second one, the plugin logs its activity.
cocoqmlscanner [options] directory...
where the options stand for:
- <directory>: is the path to a directory that contains files that will be instrumented or restored.
The action depends on whether the option
-r(see below) is set.
-ris not set, the <directory> is scanned recursively and each file that ends with "
.qml" or "
.js" is read and instrumented. A backup copy of each file is kept; it has the suffix "
.qmlbak" or "
.jsbak", respectively. If there are already backup copies, nothing is done and the program returns with an error.
-ris set, all the backup files are renamed back to their old names, replacing the instrumented files. If there are no backup copies, the program does nothing and returns with an error.
--restore: Enable the restore mode.
--csmes-name=<filename>: If this option is used, the resulting
.csmesfile is saved as <filename>. A suffix "
.csmes" is appended if it does not exist already.
Without this option, the resulting data is saved as
--blacklist=<filename>: Exclude certain paths from instrumentation. The <filename> is the path to a text file which contains in each line a regular expression. If one of the regular expressions matches a file name, the file is excluded from the instrumentation.
Lines beginning with a "
#" are ignored.
--no-tracker: Do not insert an import statement for the tracker plugin into the instrumented code.
With this option,
cocoqmlscannerbehaves the same way as it did before the tracker plugin was introduced. The option was introduced only for compatibility with the previous version of
cocoqmlscannerand is rarely, if ever needed. In particular, it will break the tracker plugin functionality.
--version: Print the version number of the program and finish.
--help: Print a help message and finish.
The tracker plugin is provided in source form because the Qt version with which it is compiled must be the same as the Qt version of the QML application.
The following variables control various debug output generated by the tracker. All log messages are prefixed with "
CocoQML:" (without the quotes).
COCOQML_QUIET: Set this variable to 1 if you want to disable all messages generated by the add-on. Usually all messages will be printed to standard error, but if you rely on parsing standard error in your application you can use this to avoid interference.
This setting overrides the verbose mode, see below.
COCOQML_VERBOSE: Set this variable to 1 if you want to enable verbose mode. If the verbose mode is active, the CocoQML extension will print additional messages that might be helpful for debugging purposes. Usually you will not need to enable verbose mode.
This setting can be overridden by quiet mode, see above.
COCOQML_LOGFILE: If this variable is set, the CocoQML add-on writes its log messages to a file. The value of
COCOQML_LOGFILEmust be an absolute or relative file path. A relative file path is interpreted relative to the working directory of the application when it starts. If the log file already exists, the new data is appended to it. If the path contains directories, they must already exist, otherwise no log file will be created.
Example: Under Unix, one could set
COCOQML_LOGFILE=/tmp/cocoqml.log. Since the directory
/tmp/exists in any normal Unix installation and is writable, all log messages are then written to the file
© 2022 The Qt Company Ltd. Documentation contributions included herein are the copyrights of their respective owners. The documentation provided herein is licensed under the terms of the GNU Free Documentation License version 1.3 as published by the Free Software Foundation. Qt and respective logos are trademarks of The Qt Company Ltd. in Finland and/or other countries worldwide. All other trademarks are property of their respective owners.