Awesome

Codama

[!NOTE]
Wait, wasn't this called Kinobi before? It was! We've renamed this project Codama. Check out this PR for more details.

Codama is a tool that describes any Solana program in a powerful standardised format known as the Codama IDL. This IDL can then be used to create a variety of utility such as rendering client code for your programs in various languages/frameworks, generating CLIs and providing more information to explorers.

Codama header: A small double-sided mind-map with the Codama logo in the middle. On the left, we see the various ways to get a Codama IDL from your Solana programs such as "Anchor Program" and "Shank macros". On the right, we see the various utility tools that are offered for the IDL such as "Rendering client code" or "Rendering documentation".

Nodes and visitors

The Codama IDL is designed as a tree of nodes starting with the RootNode which contains a ProgramNode and additional data such as the Codama version used when the IDL was created. Codama provides over 60 different types of nodes that help describe just about any aspect of your Solana programs. You can read more about the Codama nodes here.

A small example of a Codama IDL as a tree of nodes. It starts with a RootNode and goes down to ProgramNode, AccountNode, InstructionNode, etc.

Because everything is designed as a Node, we can transform the IDL, aggregate information and output various utility tools using special objects that can traverse node trees known as visitors. See this documentation to learn more about Codama visitors.

A small example of how a visitor can transform a Codama IDL into another Codama IDL. This example illustrates the "deleteNodesVisitor" which recursively removes NumberTypeNodes from a tree of nested TypleTypeNodes.

From program to Codama

There are various ways to extract information from your Solana programs in order to obtain a Codama IDL.

Using Codama macros. This is not yet available but you will soon have access to a set of Rust macros that help attach IDL information directly within your Rust code. These macros enable Codama IDLs to be generated whenever you build your programs.
From Anchor IDLs. If you are using Anchor programs or Shank macros, then you can get an Anchor IDL from them. You can then use the @codama/nodes-from-anchor package to convert that IDL into a Codama IDL as shown in the code snippet below. Note that the Anchor IDL might not offer all the information that Codama can hold and therefore, you may want to transform your Codama IDL to provide additional information. You can learn more about this in the next section.
```
import { createFromRoot } from 'codama';
import { rootNodeFromAnchor } from '@codama/nodes-from-anchor';
import anchorIdl from 'anchor-idl.json';

const codama = createFromRoot(rootNodeFromAnchor(anchorIdl));
```
By hand. If your Solana program cannot be updated to use Codama macros and you don’t have an Anchor IDL, you may design your Codama IDL by hand. We may provide tools such as a Codama Playground to help with that in the future.

Transforming Codama

Once you have your Codama IDL, you may use visitors to transform it. This can be useful when the Codama IDL was obtained from another source that may not contain some necessary information. Here is an example using two provided visitors that adjusts the accounts and instructions on the program.

import { updateAccountsVisitor, updateInstructionsVisitor } from 'codama';

codama.update(updateAccountsVisitor({ ... }));
codama.update(updateInstructionsVisitor({ ... }));

From Codama to utility

Now that you have the perfect Codama IDL for your Solana program, you can benefit from all the visitors and tools that provide utility such as rendering client code or registering your IDL on-chain so explorers can dynamically display relevant information for your program.

Note that some features such as rendering CLIs are not yet available. However, because the Codama IDL is designed as a tree of nodes, these features are only a visitor away from being ready. Feel free to reach out if you’d like to contribute to this Codama ecosystem.

Rendering client code. Want people to start interacting with your Solana program? You can use special visitors that go through your Codama IDL and generate client code that you can then publish for your end-users. Currently, we have the following renderers available:
- @codama/renderers-js: Renders a JavaScript client compatible with the soon-to-be-released 2.0 line of @solana/web3.js.
- @codama/renderers-js-umi: Renders a JavaScript client compatible with Metaplex’s Umi framework.
- @codama/renderers-rust: Renders a Rust client that removes the need for publishing the program crate and offers a better developer experience.
- And more to come.
Here’s an example of how to generate JavaScript and Rust client code for your program.
```
import { renderJavaScriptVisitor, renderRustVisitor } from '@codama/renderers';

codama.accept(renderJavaScriptVisitor('clients/js/src/generated', { ... }));
codama.accept(renderRustVisitor('clients/rust/src/generated', { ... }));
```
Registering your Codama IDL on-chain (Coming soon). Perhaps the biggest benefit of having a Codama IDL from your program is that you can share it on-chain with the rest of the ecosystem. This means explorers may now use this information to provide a better experience for users of your programs. Additionally, anyone can now grab your Codama IDL, select the portion they are interested in and benefit from the same ecosystem of Codama visitors to iterate over it. For instance, an app could decide to grab the IDLs of all programs they depend on, filter out the accounts and instructions they don’t need and generate a bespoke client for their app that only contains the functions the app needs.
Rendering CLIs (Not yet available). Whilst not available yet, we can imagine a set of CLI commands that can be generated from our Codama IDL (much like our clients) so that end-users can fetch decoded accounts and send instructions directly from their terminal.
Rendering documentation (Not yet available). Similarly to CLIs, we may easily generate documentation in various formats from the information held by our Codama IDL.