Home

Awesome

xcparse

A command line tool to extract code coverage & screenshots from Xcode 11 XCResult files.

To learn more about Xcode 11's xcresult format, read Rishab Sukumar's post on the ChargePoint Engineering blog

Installation

Homebrew

Enter the following command into your terminal:

brew install chargepoint/xcparse/xcparse

This will tap into our xcparse Homebrew tap and install the tool on your local machine.

Mint

To use xcparse via Mint, prefix the normal usage with mint run ChargePoint/xcparse like so:

mint run ChargePoint/xcparse xcparse <command> <options>

To use a specific version of xcparse, add the release tag like so:

mint run ChargePoint/xcparse@2.1.0 xcparse --help

Bitrise

Want to use this in Bitrise? We have an xcparse Bitrise step available in the Bitrise StepLib so you can add xcparse directly from the Bitrise Workflow UI!

See our Bitrise step's README for more information.

Usage

xcparse <command> <options>

Below are a few examples of common commands. For further assistance, use the --help option on any command

Screenshots

xcparse screenshots --os --model --test-plan-config /path/to/Test.xcresult /path/to/outputDirectory

This will cause screenshots to be exported like so:

Screenshots exported into folders

Options can be added & remove to change the folder structure used for export. Using no options will lead to all attachments being exported into the output directory.

Options available include:

OptionDescription
--modelDivide by test target model
--osDivide by test target operating system
--test-plan-configDivide by test run configuration
--languageDivide by test language
--regionDivide by test region
--testDivide by test

See xcparse screenshots --help for a full-listing

Test Status

The --test-status option can allow for whitelisting only screenshots from tests that have a status that matches at least one of the provided status strings

ExamplesDescription
--test-status SuccessPassing tests only
--test-status FailureFailing tests only
--test-status Success FailurePassing or failing tests only
--test-status 'Expected Failure' FailureExpected failure or failing tests only
--test-status 'Expected Failure'Expected failure tests only

Test status strings can be found by using verbose mode with the screenshots sub-command.

Activity Type

The --activity-type option allows for whitelisting screenshots whose activity type matches at least one of the provided activity type strings.

ExamplesDescription
--activity-type com.apple.dt.xctest.activity-type.testAssertionFailureTest failure screenshots only
--activity-type attachmentContainer userCreatedUser created screenshots only

Note that when an activity type string is provided which doesn't have a reverse-DNS style domain, it is assumed to be of com.apple.dt.xctest.activity-type.<activityTypeString> and the domain is automatically added.

Therefore, these two are option calls are equivalent:

--activity-type userCreated attachmentContainer

--activity-type com.apple.dt.xctest.activity-type.userCreated com.apple.dt.xctest.activity-type.attachmentContainer

Activity types can be found in verbose mode. Below are a listing of common ones:

Activity TypeDescription
com.apple.dt.xctest.activity-type.attachmentContainerPlaceholder activity that contains an attachment, may contain user created screenshot
com.apple.dt.xctest.activity-type.deletedAttachmentDeleted attachment placeholder activity
com.apple.dt.xctest.activity-type.internalInternal test step, may have automatic screenshot to show test progression
com.apple.dt.xctest.activity-type.testAssertionFailureStep where the test failed in an assertion, may have failure screenshot
com.apple.dt.xctest.activity-type.userCreatedUser created screenshot/attachment

Attachments

xcparse attachments /path/to/Test.xcresult /path/to/outputDirectory --uti public.plain-text public.image

Export all attachments in the xcresult that conform to either the public.plan-text or the public.image uniform type identifiers (UTI). The screenshots command, for example, is actually just the attachments command operating a whitelist for public.image UTI attachments. Other common types in xcresults are public.plain-text for debug descriptions of test failures.

Read this Apple documentation for a list of publicly documented UTIs.

Code Coverage

xcparse codecov /path/to/Test.xcresult /path/to/exportCodeCoverageFiles

This will export the action.xccovreport & action.xccovarchive into your output directory.

Logs

xcparse logs /path/to/Test.xcresult /path/to/exportLogFiles

This will export logs & diagnostic files into a per-action folder structure similar to Xcode 10's xcresult format.

Logs exported into folders

Convert

xcparse convert /path/to/AppThinningSizeReport.txt /path/to/outputDirectory --flagVariants sizeLimit

This will export a JSON representation of the given App Thinning Size Report to the output directory.

Flag Variants

The --flag-variants option can allow for the generation of an app size violations report with all the app variants that exceed the specified size limit.

ExamplesDescription
--flag-variants 10MBFlags variants that exceed 10MB
--flag-variants 13Flags variants that exceed 13MB
--flag-variants invalidFlags variants that exceed 10MB

If a size unit is not specified, the default unit is considered to be megabytes. Similarly, invalid arguments cause a default size limit of 10MB to be used for flagging app size violations.

Help

xcparse --help

xcparse screenshots --help

Learn about all the options we didn't mention with --help!