Math Models for Creative Coders
Using matters of Life and Death Math and Code to Create Novel Experiences

Introduction
We will study several Mathematical Models and apply them to Art and Design. The algorithms will be examined and then coded in p5.js
/ q5.js
/ p5play.js
; however other open source tools (FOSS) and Javascript libraries may also be introduced as and when needed and as and when I learn and get excited about them.
This course stands on “three legs”: Maths, Code + Tech, and Artifacts, as shown below. As this course grows and hopefully becomes more un-popular ;-D, more and more of these modules below will become reality!
Maths | Code + Tech | Artifacts |
---|---|---|
Iterated Functions Complex Numbers Random Numbers Vector Algebra Perlin Noise |
p5.js / q5.js / p5play.js Shapes Stack, Push and Pull, Translate Vectors Recursion Constructors and OOP |
Fractals Kolams Angolan Sona Patterns L-Systems Symmetries Textures |
Linear Systems Impulse Responses Convolution Electrical System Theory (poles; zeroes; resonance…)? DSP basics? AM/FM/PM Modulation? Fourier Series Bessel Functions? Waves; Echoes ? Non-linearities; Saturation; Hysteresis ? |
Adding External Physics and Sound Librariesp5.sound Camera, Sound and Mic Handphone based Interactions OSP Protocol based interactions with external hardware over WiFi / BT |
Sound Video Text Crowd-Sourced acts (jam session; flash-techno mob…)? Mouse - Touchpad Orchestra? |
Neural Net Basics Matrix Algebra Training Backpropagation Gradient Descent Classification, Regression, Clustering |
ml5.js libraries |
Multi-Layer Perceptrons Convolutional Neural Networks Pose, Gesture, and Face Detection |
Complexity and Emergent Phenomena? | Interfacing p5.js with Makey-Makey / Arduino / Raspberry Pi?Sensors? Working with other materials like sand, water, paper, wood, cloth, balloons ? “Action at a Distance” using say |
Friendship Networks? Games? Public Space Installations Simulations Remote Education with Gesture tracking and live Coding? “Literary” Events with Tech? |
I’ll | Be | Back |
References
General
- Bret Victor. Learnable Programming. https://worrydream.com/LearnableProgramming/
- Michael Nielsen.(February 2016). Toward an exploratory medium for mathematics. https://cognitivemedium.com/emm/emm.html
- Rune Madsen. Programming Design Systems. https://programmingdesignsystems.com. A free digital book that teaches a practical introduction to the new foundations of graphic design.
- Colah’s ( not
Kolha’s🦊 ) Blog. https://colah.github.io/https://colah.github.io/
p5.js, p5play.js, q5.js, and Processing
- Getting Started with p5.js https://p5js.org/tutorials/setting-up-your-environment/
- Coding Rainbow: Basic-est set of videos on p5.js <https://youtube.com/playlist?list=PLglp04UYZK_PrN6xWo_nJ-8kzyXDyFUwi&si=BWSDVX9-Bt85KXdO>
- Coding Train with Dan Shiffman:
- p5.js Wiki. https://github.com/processing/p5.js/wiki
- p5.js at CodeAcademy https://www.codecademy.com/learn/learn-p5js
- p5.js at HappyCoding https://happycoding.io/tutorials/p5js/
- OpenProcessing https://openprocessing.org
- https://www.codecademy.com/content-items/5e5c0d2a7b20535fbe8aed05e739e027
- p5play Game Engine https://p5play.org/ p5play is for creating interactive art and games with the Box2D physics engine.
- q5.js Home https://q5js.org/home/
Deep Learning and AI
- Practical Deep Learning for Coders. https://course.fast.ai/
- Michael Nielsen. http://neuralnetworksanddeeplearning.com/index.html
- Ian Goodfellow and Yoshua Bengio and Aaron Courville. Deep Learning Book. https://www.deeplearningbook.org/
- Dive into Deep Learning. Interactive deep learning book with code, math, and discussions. Implemented with PyTorch, NumPy/MXNet, JAX, and TensorFlowUsing Other Tools. https://www.d2l.ai/index.html
- Simon Scardapane. Alice’s Adventures in Differentiable Wonderland. https://www.sscardapane.it/assets/alice/Alice_book_volume_1.pdf
- François Fleuret. The Little Book of Deep Learning. https://fleuret.org/public/lbdl.pdf
- Frank Rosenblatt. Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms. https://gwern.net/doc/ai/nn/1962-rosenblatt-principlesofneurodynamics.pdf
- Warren S. McCulloch, Walter Pitts (1943). A Logical Calculus of the Ideas of Immanent in Nervous Activity. BULLETIN OF MATHEMATICAL BIOPHYSICS VOLUME 5, 1943. <https://www.aemea.org/math/McCulloch_Pitts_1943.pdfhttps://www.aemea.org/math/McCulloch_Pitts_1943.pdf
Other Tools
- https://generatecoll.medium.com/how-i-used-excel-to-create-abstract-album-artwork-fee740d4414f
- Random Digital Beauty. https://anaselk.com/p/generative-r/
- Making Explanations (tools): https://explorabl.es/tools/
- Using p5 in R. Yeah. https://alistaire.rbind.io/blog/p5-in-r/
- createCanvas Podcast. https://soundcloud.com/processingfoundation
- https://processingfoundation.org/education
- https://nannou.cc
- https://openframeworks.cc/
- https://libcinder.org
- Sophia Crespo: (makes speculative biological creatures using neural networks)
- Website: https://sofiacrespo.com/
- Website: https://entangledothers.studio/
- Github:
- R for Scientific Visualization. https://www.rforscience.com/visualisation.html
- R for Scientific Computing. https://www.rforscience.com/scientific-computing.html
Other Interesting Websites and Works
- The Book of Shaders by Patricio Gonzalez Vivo and Jen Lowehttps://thebookofshaders.com/
- Scott Murray’s D3 Art page: https://scottmurray.org/
- Inigo Quilez, Digital Artist: https://iquilezles.org/ (ShaderToy, GraphToy, and MadeThisThing)
- Reddit Generative Art Forum. https://www.reddit.com/r/generative/
- AI tools for Journalists. https://journaliststoolbox.ai/ A vast list of tools for every purpose you can think of.
Creative Coding Courses Elsewhere
- Allison Parrish. https://creative-coding.decontextualize.com
- Matthew Bardin. https://pdm.lsupathways.org
- Tim Cortina at Carnegie Mellon Univ2. https://www.cs.cmu.edu/~tcortina/15104-f20/lectures/