Awesome
CEPL (Code Evaluate Play Loop) - [Beta]
CEPL is a lispy and REPL-friendly Common Lisp library for working with OpenGL.
Its definition of success is making the user feel that GPU programming has always been part of the languages standard.
The usual approach to using CEPL is to start it at the beginning of your Lisp session and leave it open for the duration of your work. You can then treat the window it creates as just another output for your graphics, analogous to how *standard-output*
is treated for text.
CEPL is in beta. The API is close to what it needs to be but there are still many bugs to fix, features to add, and experiences to smooth out.
See the cepl.examples repository for some examples of how CEPL can be used
Videos: http://www.youtube.com/playlist?list=PL2VAYZE_4wRKKr5pJzfYD1w4tKCXARs5y
Installing
Run (ql:quickload :cepl)
at your REPL.
Cloning
Whilst it is recommended to get CEPL from quicklisp, if you clone please note that master
is not the stable branch. Please use release-quicklisp
for the stable code that will be in the next CEPL release.
Documentation
Currently we have full documentation of every exported symbol in the CEPL package. You can find this here: CEPL API Docs
Guides will be provided in future, however these take much longer to write.
I can also be reached by my email (techsnuffle [at] gmail · com) and sometimes on #lispgames IRC. Come to #lispgames anyway though, there are some lovely folks, all lispy dialects welcome!
Requirements
All of the following will be downloaded automatically by quicklisp
- cffi
- cl-opengl
- cl-plus-c
- cl-ppcre
- documentation-utils
- ieee-floats
- float-features
- named-readtables
- varjo
- bordeaux-threads
C Library dependency
CEPL uses OpenGL ( version >= 3.1 ) so you need to make sure it is available on your machine. Installing your GPU drivers will usually handle this.
CEPL's Host
CEPL abstracts working with OpenGL but is not responsible for creating a window or GL context; this is handled by a Host
. Right now the only supported host is SDL2
; the system to load is called cepl.sdl2
, you can find it here: cepl.sdl2
Getting Started
Note: On macOS
, slime
users will need to read docs/single-thread-swank.md
to deal with a complication specific to projects interacting with the window manager. You can then follow the rest of this guide as usual.
To load CEPL and the default host (sdl2
) do the following:
(ql:quickload :cepl.sdl2)
(cepl:repl)
You should see an empty window appear, OpenGL is now initialized, and you can use CEPL as you like.
Making a CEPL Project
The best way to get started is to make a new project that uses CEPL. Do the following in your REPL to get set up:
- First, run
(ql:quickload :cepl)
- Then run
(ql:quickload :quickproject)
. CEPL uses this to create a lisp project using its own templates - Then run
(cepl:make-project "my-proj")
. This will use quickproject to make a new project with all the correct dependencies. Remember that cepl does not handle window managers or input so by default your new project will use the following - cepl for the graphics
- cepl.sdl2 for the host
- skitter for handling input and events
- dirt for loading images There are many good event systems & image loaders out there so browse around. But here are two :)
You are now ready to get started. Simply run:
(ql:quickload "my-proj")
(in-package :my-proj)
- and finally (if you havent already)
(cepl:repl)
Windows C Library Hack
If you are having issues getting the C libraries to load and just need to rule out whether Lisp can find them, try putting them in the same folder as the lisp exe. For example C:\Program Files\sbcl\
.
CHANGELOG
This mainly covers features & news rather than individual bugfixes. When we are out of beta these will be covered more often
2019-05-05
- Added
#'clear-attachments
clear-fbo
now let's you specify attachments to clear- Added
with-outputs-to-attachments
which lets you rebind which outputs from your pipelines map to which of the currently bound fbo attachments - Deprecated
attachment-pattern
in favor ofcolor-attachments
- Can now specify a discarded attachment in
color-attachments
with+discard-attachment+
2019-04-XX
- stability work on
with-context-state-restored
. More coming to this soon.
2019-02-XX
- Add #'default-fbo accessor
2019-01-20
- Return from work crunch to add anisotropy support to samplers :)
2018-09-29
- Added support for MultiDrawIndirect using
multi-draw-g
- Added support for base-vertex in buffer-streams
2018-08-10
wait-on-gpu-fence
now expects an(unsigned-byte 64)
ornil
.nil
is used to indicate no timeout and anything else is the timeout in nanoseconds- added
copy-g
as an more general alternative topush-g
&pull-g
for moving data. - exported the many typed functions
copy-g
,push-g
&pull-g
use behind the scenes for transfers - fixed serious bug in clear which, when passed no fbo, would try to clear both the read & draw fbo attachments. Now only clears draw as per the gl spec.
make-texture
can now takegpu-array
s as the 'initial-contents' argument.- transfers between buffer & texture backed gpu arrays now work
- c-arrays & gpu-arrays now accept a row-alignment value on creation. This defaults to 1 but can be 1, 2, 4 or 8
- texture uploads/downloads now correctly take row alignment into account.
- Fixes to ensure mutable textures are 'complete' on creation
- fix issues when creating c-arrays from lisp arrays that stemed from specification of dimensions being (x-size y-size) in CEPL/GL and (column-size row-size) in lisp.
2018-07-15
- added
make-gpu-arrays-from-buffer-id
which lets you speicify a gl buffer-id and layouts of the data and get a CEPL gpu-buffer in return - added
make-gpu-array-from-buffer-id
which in shorthand for the above when you only need one gpu-array. - added option to
make-gpu-buffer-from-id
so you can pass layouts instead of initial-contents. This is handy when you allocate and layout out the buffer storage without providing new data. - add a
keep-data
argument, to a bunch of buffer related functions which take layouts. This lets you create the buffer object, specifying the content layout without replacing the data. - added
make-buffer-stream-from-id-and-layouts
. Makes it possible to make streams out of vaos without having gpu-arrays. - print-object for
gpu-buffers
- misc bug fixes
2018-04-02
Headlines:
The most important change this release is that lambda pipelines now recompile when the functions they use as stages are recompiled. This change comes with a performance cost of course so if you wish to opt out of this (recommended for when you ship your project) then pass :static
in the context argument to pipeline-g
Also if you are using GL>=4.3 you can now create empty fbos, which are handy if you want to use the fragment stage without writing data to bound textures (compute-type fun to be had here)
Other important changes:
viewport-resolution-x
&viewport-resolution-y
had been documented as returningsingle-float
s but were returning unsigned ints, this now fixed.- I'm an idiot that didn't know about
~/.swank.lisp
, please see the new 'single-thread-swank' advice above if running on macOS.
2018-02-17
BREAKING CHANGES
Due to the changes listed below you will now want to change your current asd's to require :rtg-math.vari and to change your packages to :use :rtg-math.
Some folks were asking for the ability to use their own math libraries rather than rtg-math which CEPL has depended on up until now. I have made this change but this means that this is something users will have to add themselves from now on.
For those picking a library cepl expects vectors & matrices to be sized simple-arrays of single-floats e.g. (make-array 3 :element-type 'single-float)
for 3 component vectors.
We have also removed the dependency on fn & cl-fad.
Other Changes:
- added the remove-surface function
- closing primary window no longer quits cepl
- removed interactive from lifecycle events (will add surface lifecycle events in future release)
2018-01-11
*I am terrible at changelogs. I am retroactively making the updates for everything between june 2017 and jan 2018
- Added support for using gpu-lambdas inline in
defpipeline-g
forms - Lots of work on the
cepl.tests
project resulting in fixes for: - gpu-lambdas
- lambda-pipelines
- struct uniforms
- uniform baking
2017-12-??
- Add render-buffer support
- Fix struct layout bugs. SSBOS work correctly now
- Add funcall-g (limited support for calling gpu-functions from cpu directly)
- Remove the deprecated
g->
,def-g->
&glambda
macros
2017-11-??
- Add compute support
- Add SSBO support (though currently hobbled by struct layout bug)
- Add single stage pipeline support
- Add transform feedback support
- Add shared context support
- Add gpu-fence support
- Add gl query support
- Complete rewrite of pipeline state cache (now faster and safer)
- Avoid recompilation of pipelines where dependencies have not changed
- Rewrite struct code to get away from some dependencies
2017-10-??
- Multiple (non-shared) context support
2017-09-??
- Add border-color support
2017-08-??
- Mostly bugfixes
2017-07-??
- Add instance array support (per instance data in pipelines)
- Add stencil support
- Add scissor support
- Add color-mask support
- Add multisample support
- renaming macros with confusing/inconsistent naming
- blending param caching on context (not optimized yet)
- Make #'free work with pipelines
2017-06-??
-
You can now modify a buffer-stream's primitive type after creation
-
experimental profiler
-
Huge improvements to per-frame performance through:
-
typing of functions & inlining where it made sense
-
fixing bug where uniforms ids queried too often
-
macros to reduce frequency of fetching the context object
-
much better state caching in context object
-
avoiding cffi enum conversion when lookup functions are faster
-
precompute & cache more size info in wrapper types
-
attachments have their own viewports, no more computing of viewport during draw
-
dont set viewport on every map-g (this was unnecessary)
-
remove some of the 'with-*' macros whos contract forced us to do more state changes/caching that we would otherwise like.
-
pipelines can be declared static. This tells cepl to type the generated functions.
-
a huge pile of other small changes
2017-06-04
-
pipelines can take
:dynamic
as their draw mode. This means they will take the draw-mode from thebuffer-stream
they are mapped over. This only works for pipelines withvertex
&fragment
stages. -
buffer-stream
s now hold the primitive type of their data. Defaults to:triangles
-
Fix bug that was stopping g-structs contain matrices
-
Cache more values in
buffer-stream
to save time during rendering -
Add
surface-dimensions
,surface-resolution
,surface-title
&surface-fullscreen-p
-
add
adjust-gpu-array
(pretty basic right now) -
Remove
cepl.spaces
, It is now a seperate project (and will be in quicklisp in the next cycle) -
Remove
cepl.misc
. If you were using thedraw-texture
function then please considerNineveh
(which will be in quicklisp in the next cycle) -
make-project
now usesdirt
instead ofdevil
.dirt
usescl-soil
which ships with binaries for multiple paltforms so has a better 'out of the box' experience (plus also supports more formats)
2017-05-16
I missed some logs here so this is a recap of everything since 2017-02-19
-
Geometry & Tessellation fully supported (including for inline glsl stages)
-
Draw mode can now be specified for pipelines
-
fixes for pull-g with gpu-functions & pipelines
-
add
with-gpu-array-range-as-pointer
&with-gpu-array-range-as-c-array
. These still feel experimental to me. -
add
reallocate-gpu-array
&reallocate-buffer
-
buffer-streams always hold on to their gpu-arrays by default
-
Refactoring based on changes in Varjo
-
Added bordeux-threads as a dependency. Will be needed for some context related things
-
Very basic support for multiple surfaces (windows)
-
New 'host' api. Is versioned so old hosts are still supported
-
remove
run-session
. All of these attempts at thread hackery felt bad. I'm sticking withslime-style
until we have a better fix
2017-02-19
- Removed the
continuable
macro. The macro can be found in thelivesupport
project. Simply(ql:quickload :livesupport)