Home

Awesome

Materials about RealityKit in iOS/iPadOS/visionOS

Here are several materials about Metal, ARKit, and RealityKit in iOS/iPadOS/visionOS.

Progress of Metal, ARKit, and RealityKit frameworks

These diagrams show the progress of Apple Metal, ARKit, and RealityKit frameworks in iOS/iPadOS and visionOS.

Please modify and use them as you like. CC0

Progress in visionOS, 2024

<!-- <details> <summary> Progress of Metal, ARKit, and RealityKit (Click to expand) </summary> -->

Image

<!-- </details> -->

Progress in iOS / iPadOS, 2024

<!-- <details> <summary> Progress of Metal, ARKit, and RealityKit (Click to expand) </summary> -->

Image

<!-- </details> -->

Asset creation workflow for AR apps

This diagram shows the asset creation workflow for AR apps in iOS / iPadOS / visionOS.

It illustrates very basic tools. You can use other tools such as InstaMAT for material creation, Spline for 3d scene creation, and EmberGen / After Effects for texture creation. You can also use Game Engine's built-in tools. They are not included in this diagram.

<details> <summary> Asset creation workflow (Click to expand) </summary>

Image

</details>

When exporting USDZ from Blender to Reality Composer Pro (RCP), you need to convert the orientation from Z-up in Blender to Y-up in RCP. You have two options to do the conversion. See the pros and cons of them.

<details> <summary> 3D Model Orientation Conversion From Blender (Z-up) to RCP (Y-up) (Click to expand) </summary>

Image

</details>

ShaderGraph Nodes in RealityKit

This documentation shows a list of ShaderGraph nodes. ShaderGraph nodes are components for creating shaders provided by RealityKit, one of Apple's frameworks. Developers can create complex materials and visual effects using Reality Composer Pro's node-based material editor, or manipulate them programmatically through the API.

<!-- ![Image](files/List_of_ShaderGraph_Nodes_in_visionOS2_Nov2024.png | width=300) --> <img alt="shadergraphnodes" src="files/List_of_ShaderGraph_Nodes_in_visionOS2_Nov2024.png" width=600>

MaterialX Nodes in RealityKit

This document summarizes MaterialX Specification v1.38 and MaterialX Supplemental Notes v1.38, and describes the Standard MaterialX Nodes and RealityKit Custom Nodes. It also shows correspondence between MaterialX Standard Nodes and RealityKit implementation.<br><br> Information about RealityKit is based on the visionOS beta. It may change with the release.

<details> <summary> MaterialX Nodes in RealityKit (Click to expand) </summary>

Image

</details>

Particle System in the Reality Composer Pro

This document shows the overview of the RealityKit Particle System and the preset particles' parameters. The explanation of each parameter is from Apple API documentation.

<details> <summary> Asset creation workflow (Click to expand) </summary>

Image

</details>

Presentation Materials

visionOS Meetup: ShaderGraph in RealityKit

This is a presentation slide about ShaderGraph materials in visionOS.

<details> <summary> Asset creation workflow (Click to expand) </summary>

Image

</details>

Related documents

License

License: CC0