Creativity and problem solving in SuperMemo
Incremental learning promotes creativity by association of remote ideas coming in proximate sequences during the learning process. This characteristic of incremental learning can be used for all sorts of creative processes that need a boost from extra knowledge or better recall. The most useful cases of creativity enhanced with incremental learning are:
Incremental problem solving
Incremental learning can assist you in problem solving. It will be particularly useful for the classes of problems with the following properties:
- problems that require processing large amounts of information
- problems that are complex and involve rich branching of the thought process
- problems where working memory becomes a bottleneck
Exemplary problems to solve
- How to fix a pesky problem with a computer?
- How to get rid of a health problem?
- How to move to another country?
- How to get a PhD?
- How to find a culprit in a crime?
- How to answer a difficult question in science?
Many technical issues and bugs in SuperMemo have been solved with incremental problem solving methods. Incremental approach is most suited for complex problems with multiple reasoning paths or requiring rich input of new information. Some bugs in SuperMemo would be particularly intractable due to their complex technical background or difficulty in reproducing the problem. In most severe cases, it makes sense to set up a separate collection for working on a single issue. That collection can later be integrated with larger bodies of knowledge (incl. problem solving knowledge).
How does incremental problem solving work?
Incremental problem solving works as follows:
- collect all information about the problem from all sources available
- write down your own ideas and comments as separate topics
- process all that information with incremental learning techniques
- document all new ideas and new sub-problems that need to be tackled
- import all relevant supplementary material that expands on core ideas
Advantages of incremental problem solving
- always focusing on a small sub-problem that requires further testing or gathering further information
- never missing a single idea in a jungle of criss-crossing inspiration
- never drowning in excess information
- using random association of ideas that boosts creativity
- never getting frustrated by lack of progress in solving the problem. There is always progress in incremental learning, which is reassuring
- never being limited by time constraints. Breaks taken from the work over the problem are not a problem and may actually improve one's chances of coming up with an original idea or the solution. This is due to:
- the spacing effect,
- the novelty effect produced by forgetting, and
- the creative power of memory optimization in sleep
Incremental writing
Incremental writing: Introduction
SuperMemo can be used in the process of creative writing, which combines two processes:
- writing texts and
- creative review and elaboration.
Both processes are based on incremental reading. By analogy to incremental reading, this process is called incremental writing.
The technique of incremental writing was used to compile some of the materials at super-memory.com. Most notably, Good sleep, good learning, good life (2012), and the present Incremental learning (2013) article.
The main difference between traditional writing and incremental writing is that the writer is free to re-organize the material and review it with incremental reading tools.
The main difference between incremental reading and incremental writing is that the "big picture" of the article is built primarily within the collection, and to a lesser extent in the writer's mind. This is suitable for large fact-packed material that is difficult to organize sequentially. In addition, one's own writing may be the source of most input, as opposed to external electronic sources. Incremental writing is also suitable in a compilation of a large body of prior writing, esp. of materials that are repetitive, fact-rich, and often loosely connected. Incremental writing is less useful for texts with a linear line of thought.
Incremental article writing is an open-ended process that can be interrupted at any stage for the article to be exported to as a single document for text-flow rewrites.
Articles written using incremental writing may be particularly suitable for incremental reading. They can be compared to Wikipedia. Crowdsourced Wikipedia is an excellent source for incremental reading due to its incremental growth and solid local context. For the exactly same reasons, materials compiled with incremental writing are highly suitable for incremental reading. They may be bloated and repetitive, however, with incremental reading, they can be prioritized in a rational way. Incremental writing leaves the texts highly granular and the flow of thought is jagged, however, in incremental reading, this is an advantage as all individual articles and subarticles carry sufficient local context to be read independently.
Incremental writing algorithm
The incremental writing algorithm involves the steps presented below. Note, however, that these steps are not executed one after another. All steps are executed incrementally and interleaved in unpredictable sequences that assist the creative process. Unpredictable association of text component is also useful in:
- the development of the logical structure of the text,
- the elimination of contradictions, and
- deleting/reconciling the repetitive material.
The steps involved in incremental writing:
- import all the relevant sources, supplementary material, and supporting knowledge to a single SuperMemo collection
- build a knowledge tree branch at the root of the collection with the desired structure of the article (e.g. name this branch ARTICLE)
- keep all the supplementary material in a separate branch (e.g. TO DO)
- review the ARTICLE branch incrementally, rewrite, improve, and rebuild the tree structure to organize a logical entirety
- add figures, citations, links, etc.
- review the TO DO branch incrementally, copy and paste, or move incrementally processed texts from the TO DO branch to the ARTICLE branch in the tree. Attach snippets to the right branches in the tree. Reschedule and re-prioritize less relevant texts. Delete texts that will be of no use in the final article
- use incremental learning. This implies that you will see articles from ARTICLE and TO DO branches interleaved in unpredictable sequences moderated only by material priority. Always work on the topic that comes next. Do as little as necessary or as much as you like it. You can finish the processed topic in one go, or you can just pass a single sentence and reschedule
- use Mercy to re-distribute the excess of the material in manageable portions
- use templates to visually indicate the status of individual portions of the article (e.g. "to write", "to expand", "to rewrite", "to review", "finished", etc.)
- branches that bloat beyond manageability can be treated in the same way as the entire article with subset review, tree reorganization, topic extraction and merging, etc.
- once the job is largely completed, or a deadline looms, export the article branch with Export : Document (on the contents menu), which also automatically adds a table of contents
Incremental writing example #1
Let us consider Good sleep, good learning, good life (2012) as an example. The source material for the article included its decade-old original version, several articles related to sleep and published at super-memory.com, as well as a great deal of basic knowledge taken from various scholarly sources involved in sleep research. Those materials were supplemented with the review of knowledge of sleep from a general knowledge collection compiled by the author. The whole process started from a massive review of the entire material with incremental learning. The construction of a rough outline of the structure of the article proceeded in parallel (in the Contents window). Supplementary materials were imported to fill in or complement individual pieces of knowledge. Figures, annotations, links, and literature citations were also processed incrementally in order of priority. This process quickly resulted in an article bloat, however, this was a bloat of valuable information rather than a bloat of excess writing. Towards the end of the process, individual topics from SuperMemo were imported to a single-page wiki. Some manual wikification was necessary at that step. Alternatively, multi-page wikis, blogs, or plain-HTML sites could have been used as the target of exports from SuperMemo.
Incremental writing example #2
Incremental learning (2013) has been compiled from a number of older articles on incremental reading, priority queue, incremental video, visual learning, as well as older articles such as Devouring knowledge, Flow of knowledge in SuperMemo, FAQ pages, SuperMemopedia, etc.
Advantages of incremental writing
The most tangible advantages of incremental writing in SuperMemo are:
- Incremental approach provides for a better focus on a task at hand
- Incremental approach is great for resolving writer's block
- Incremental approach makes it possible to compile new texts from old texts that need resolution of duplicates (e.g. converting two or more versions of older texts into a newer reconciled text)
- Priorities can be used to start from the most important portions of the text. In the end, lowest priority material may never be processed and left neglected or relegated to future versions of the text
- Working with the knowledge tree as opposed to a linear text helps to see the big picture of the entire article, and organize its logic
- Search returns chapters instead of portions of the text. This helps you locate portions of the text that include a keyword that is too frequent to make it useful in ordinary searches (e.g. as in MS Word)
- Search&review is great for minor edits, comparisons, reprioritization, safe search&replace, and more
- Toolkit : Statistics : Analysis : Use graphs and Toolkit : Calendar can be used to chart the progress through the writing material
- Outstanding topics can be sorted by priority to match the circadian cycle (high priorities for high alertness times, low priorities for less productive hours of the day)
- Add to outstanding (or other tools) can be used if a subset of texts needs to be processed more than once in a single day
- Open-ended writing and a "never-ending writing" are easy and natural
- Writing in SuperMemo is fun. It is not just more fun than writing. It is an order of magnitude more fun than traditional writing! Naturally, a high degree of fluency in using SuperMemo toolkit is necessary to experience the fun factor
Fun of writing boosts efficiency
When the fun of writing is gone, the writer's block can ensue. SuperMemo makes writing fun as compared to traditional methods (e.g. writing in a word processor). If you are in no mood to write about one topic today, you might be more inclined to try something else. If you are in no mood for writing anything, tackle some minor clean up jobs. Very often, once you start writing, you get sucked into the effort and the mood returns. A piece of information can trigger new ideas. If it happens in your writing slot, you can instantly write down new ideas. You can write them rough and short. But you need to write them instantly. If you keep waiting, the memory of the inspiration whittles down to just the need to write about a subject! This is how forgetting affects your own ideas! Strike the iron while it's hot. Process inspiration incrementally, and pick the pieces that raise most enthusiasm at any given moment. Those pieces will generate most new creative value.
Creative explosion vs. deadlines
Excess creativity and wish to include valuable information or ideas may cause an unstoppable bloat of writing materials and a never-ending writing loop. It is vital to keep all ideas well prioritized in a TO-DO branch, while the article grows independently in the ARTICLE branch.
Separating TO-DO from ARTICLE is the best solution that makes it easy to cut off the writing process at any stage depending on the writing goals, opportunity costs, and/or deadlines. Whatever is left in the TO-DO branch can be processed later or not at all. As long as strict priorities are applied, loss of value to the main article should be minimized.
Disadvantages of incremental writing
Incremental writing will always be superior over linear writing for a class of non-fiction texts, however, the toolkit is difficult to master, and the strategies are not obvious. This is a new set of techniques that requires a high degree of innovative thinking on the part of the author. This is why we do not expect any significant degree of adoption at the moment. Incremental writing should primarily be considered by authors who are already masters of incremental reading.
Incremental brainstorming
If you combine incremental learning with incremental problem solving and plain old brainstorming, you will arrive at incremental brainstorming. The brainstorming part may be executed face-to-face or over e-mail.
Incremental brainstorming sounds like an oxymoron. Incremental brainstorming has very little to do with "storming", but it makes a very good use of the brain's capacity to build creative associations in fertile knowledge-rich conditions. Incremental brainstorming might be slow, but it can deliver more than plain face-to-face brainstorming. At worst, the outcome will be different, and in creative work, this is always a desirable complementary effect.
In face-to-face brainstorming, two or more brains, preferably with different strengths, specializations, and biases, engage into a fast exchange of ideas, where Idea X from Brain A might generate ideas Y and Z from Brain B, which in turn may cause a chain reaction of creative inspiration in other participating brains. Moreover, brainstorming requires a degree of mental discipline that may be missing in brainstorming with oneself (in one's mind, i.e. without incremental learning). Converting thoughts to speech slows down the thinking, but increases the discipline and may dramatically enhance creative outcomes.
In incremental brainstorming, this process is taken a few steps further. Incremental learning is a form of brainstorming with oneself, as mentioned in the Creativity section, however, it can also be used in remote brainstorming via e-mail. The main tools of remote incremental brainstorming are:
- incremental learning (for processing knowledge),
- incremental mail processing (for processing exchanged ideas), and
- e-mail communication (which may be supplemented by live video).
Incremental brainstorming may be slow, and yet it adds an additional degree of discipline with an archive of written communications. Most of all, it adds more sources of inspiration to the mix. In addition to the participating brains, incremental brainstorming adds inspiration from external sources of knowledge (with non-participating authors providing further inspiration). It also adds from the history of the communication. Due to forgetting, incremental brainstorming makes it possible to brainstorm with one's past self. In other words, the participants of incremental brainstorming include:
- participating brains,
- past versions of participating brains, and
- non-participating authors from the past and the present.
Advantages of incremental brainstorming
The main advantages of incremental brainstorming are:
- wider knowledge: involvement of incremental learning in expanding upon the discussed ideas substantially extends the knowledge used in the creative process. This is a way of adding non-participating brains to the mix
- spacing effect: when brainstorming is slowed down, fading memory traces evoke the spacing effect that may:
- provide for better long-term consolidation of ideas, and
- evoke new creative reasoning pathways in cases where the fading signal needs to be rebuilt via new pathway searches.
- circadian synchronization: participating brains do not need to synchronize their peek performance hours (e.g. when working over different times zones)
- sleep: few people realize the monumental role of sleep in creativity. Neural optimization of memories in sleep works like an automatic creative thinker that is autonomous from the conscious brain even though it feeds on creative processes that occur in waking. Sleep is an organizer of memories and can convert results of brainstorming into new quality. Incremental brainstorming is slower, it may span weeks or months. As such, it employs sleep mechanisms as new autonomous brains in the creative process. Sleep converts the chaos of data into abstract models that yield higher quality reasoning
- balancing attention and creativity: in all creative pursuits, striking the ideal balance between creativity and attention is vital for the ultimate success. Our multitasking society is pretty good at stimulating creativity, however, the same factors that boost creativity have a destructive impact on attention. Incremental brainstorming helps you strike a balance between focused individual work and pulling the team brains together. You can brainstorm without ever interrupting each other
- free from reliance on the coincidence of interests: face-to-face brainstorming often fails due to differing levels of interests or motivations in the participating parties. Moderating face-to-face and adding a bigger dose of incremental brainstorming may be an easy solution. In those cases, most of the workload may shift to a single brain, while still capitalizing on the contribution of the less involved brains
Disadvantages of incremental brainstorming
The main disadvantage of incremental brainstorming is its snail's speed. Naturally, it won't be of much value right before a project's deadline. However, despite the hype speed receives in the media in reference to technological progress, the hardest problems are always solved by collective efforts of multiple brains working over generations. Incremental brainstorming might be less useful in hurrying a new iPad model, but it would be handy in slowly developing or slowly adopting theories like those of Darwin, Mendel, Wegener, and the like.
Future of brainstorming
Incremental brainstorming is not intended to replace face-to-face interactive collaboration. However, it should serve as its rich supplement. It carries all the advantages of incremental learning: creativity, attention, prioritization, meticulousness, consolidation, long-term sustainability based on long-term memories, and more. It requires a lot of training before it brings fruits. Therefore, if problem solving or creative work are vital for your progress, you might consider mastering the following progression of skills: classical SuperMemo (for better memory), incremental reading (for processing text), incremental learning (for overall learning), incremental problem solving (for employing knowledge in solving problems), to finally arrive at incremental brainstorming, i.e. combining incremental learning with classical brainstorming.
Elaborative IR
The advantages of a slow and incremental approach to writing articles (and possibly in any other type of creative endevour) are similar to regular SMIR. But because the creation process is in most ways the opposite of the learning process i think that this opposite process may need its own features although i'm not sure what, exactly :)
Anyway, it's just something for you to experiment on if you'd like, if you haven't already.
-- Georgios Zonnios