Tuesday, January 29, 2019

Problem Calculus: Diagrams and Invalid Elements

Previously, we talked about Semantically Homogeneous and Semantically Heterogeneous spaces.  Let's use the following diagram to represent a semantically homogeneous space.



Because the space we're interested in can contain arbitrary dimensions, we're just going to use a single continuous line to represent a single semantic concept.  Similarly, we're going to represent semantically heterogeneous spaces as follows:


Multiple semantic concepts are represented by multiple lines.

In addition to degrees of semantically heterogeneous spaces causing difficulty in comprehending a problem, there are also issues when you encounter a space where there are invalid elements within it.

The original idea was to be concerned with topological holes in a space.  Similar to the issues with path connected spaces, topological holes may look like they have a good theoretical basis, but then you have to worry about constructing topological spaces.  Topological holes definitely need some more attention, but being concerned about invalid elements should be sufficient for now.

For example, if your space is intended to be even integers then any given odd integer would be an invalid item.  Consider a more complicated example.  Imagine a binary frame or packet used in a communication protocol.  Because binary data is binary data, in order to represent a list of items you are required to either provide a count or only be allowed a predetermined number of items.  An invalid binary packet would be a packet that had an invalid count field.


Once you consider that a space might have invalid elements in it, then you can also be concerned about the complexity of the invalid elements themselves.


Ideally, your invalid elements will form a semantically homogeneous space.  Or it might form a heterogeneous space.  Or the invalid elements might be sporadic and random without pattern.  Similarly, any given invalid subset of elements within a sporadic collection might itself form a homogeneous space, a heterogeneous space, or a sporadic space. 

Monday, January 28, 2019

Problem Calculus: Semantically Homogeneous vs Semantically Heterogeneous

My previous Problem Calculus and Cognitive Complexity outlines assert that spaces should be path connected in order to avoid complexity.  I think that this concept can be related to Semantically Homogeneous and Semantically Heterogeneous.  The argument is that Semantically Homogeneous spaces approximate path connected spaces AND the quality that you need in a space to have an easily understood space is a semantically homogeneous space.

So what's the difference between a function that looks like "func(x : int, y : int, z : int ) -> int" and a function that looks like "func( p : point3d ) -> int".  The problem calculus argument is that they are probably the same.  The source spaces for both functions are semantically homogeneous.
  
The source space involves three different dimensions that all "belong" together.  The space is one coherent component.

In order to create a semantically heterogeneous space, you can take the same function from before "func(x : int, y : int, z : int ) -> int", but instead of having the input parameters representing a point in 3D space you can have it represent some 2D point in a family of 2D spaces.

Here we have what appears to be the same thing, but the problem calculus diagram is radically different.  

Semantically homogeneous spaces are easy to comprehend because the dimensions that go into them only mean one thing.  Semantically heterogeneous spaces are hard to comprehend because the different dimensions can all indicate something potentially different.  Each different thing needs to be considered separately from the other things.  And this can become arbitrarily difficult as the space contains arbitrary more concepts that need to be understood on a case by case basis.

Here's an example of a space that is composed of a color dimension and an intensity dimension.  The space is semantically heterogeneous because the meaning of the intensity dimension changes meaning depending on what color is present.  The basic idea is the same, but the eventual output is going to be radically different.

Ideally, I think that path connected spaces probably provide a better theoretical basis, however having to worry about constructing topological spaces is probably more work than it's worth.  Additionally, there is going to be some difficulty in ensuring that the function used to show that the space is path connected is the "right" one.  There may be a space that is difficult to comprehend, but a sufficiently clever individual can figure out a function that shows that it's path connected.  Semantically homogeneous vs heterogeneous is hopefully easier to determine objectively.

Thursday, January 24, 2019

Problem Calculus: Some Terminology

We're going to be using Spaces and Arrows to form the problem calculus diagrams.  Let's look at some basic definitions.


Given an arrow there is a Source space and a Destination space that can be thought of as the type of the inputs and the type of the outputs of the arrow.  Similarly, the arrow might only accept a subset of the objects in the Source space and produce a subset of the objects in the Destination space.  The subsets are called the Input space and Output space, respectively.

Wednesday, January 23, 2019

Problem Calculus: Motivation

Why a calculus for problems?  

With respect to programming, the software engineering industry doesn't really have very good metrics for what makes for good source code.  There is the concept of code smells (the name of which is already suspicious) where an individual "knows" that something is wrong, but is relying on "good taste" to justify the decision instead of being able to actually describe why things are problematic.  Best practices won't necessarily cross problem domain or programming language boundaries.  And they have the dubious property of being attached to successful people and projects as a justification.  Is the practice a predictor of success or was the people or was the problem?  There's always experience, which always works until of course it doesn't.  The underlying theme here is ultimately appeal to authority.  Problem calculus suggests a way to have objective arguments about what code is good and what code is bad.  The principles will also cross domain and language barriers.  

Let's move onto studies for programming languages and development methodologies.  The biggest factor in all of the studies I've seen is that they do not want to contaminate the study by using experts.  The argument goes that if you run a study with someone who is an expert then their familiarity will be the determining factor, but not whether or not the concept under study is good or bad.  So, the studies use novices and students.  This is of course problematic because any conclusion you reach can really only be known to apply to novices.  The hope of course is that knowing that some concept is better for a novice will also hold for an expert, but that's wishful thinking at best.  What we want is a way to run these studies with experts without having to worry about previous experience influencing the results.  Using problem calculus we can create novel problems that do not have their origin in anything familiar.  Because the problem is artificially created, we can control how difficult the problem is and we can make sure that the problem does not have its origin in a known concept.

Finally, when should you try to solve hard problems and when should you look for a way to simplify your situation.  Using problem calculus you can determine the nature of the difficulty that you are facing.  Some difficult issues can be simplified and some cannot.  There are trade-offs that you can make so that you can control the type of difficulty that you're facing.  When are you facing a hard problem and when are you facing an unfamiliar problem.  Verify the situation you're in.

Saturday, January 19, 2019

Problem Calculus: Introduction

The concept of problems is too general and open-ended to be measured.  A fence may represent a problem for a criminal but it's the solution to the homeowner.  But if the homeowner has a dog then the fence might also be the solution to the criminal to defend against the dog.
 

When something can be a problem and a solution depending on your perspective or even a problem and a solution regardless of perspective, then you've got to narrow down what you mean by 'problem' to make any headway into describing the difficulty of any given problem.

For problem calculus, we're going to focus on concepts that are difficult for people to form an intuition about.  Ideas that are hard to navigate in a mental landscape.  It will be interesting to see if the framework will be applicable for machine learning algorithms as well as people.

One thing to keep in mind is that we will be able to measure some problems and form intuitions both that they are difficult and why they are difficult, but we may not be able to determine which problem is more difficult. 

Different problems may be difficult for different reasons.  And for that matter, different solutions to the same problem may be difficult for different reasons.  In this instance the best we can attempt is to determine how to make a given problem more simple or more complex.  For example, we can't tell which is harder, brain surgery or rocket science, but we can tell that they are hard AND we can tell that if you had to play tag while also doing  brain surgery it would be harder than doing brain surgery without playing tag.

Monday, November 19, 2018

Near as I can tell: Moana

As near as I can tell, Moana isn't a magical story about a Polynesian girl going on a journey of self discovery in order to save her people from an encroaching darkness that kills all life.  It's a story about transhumanism, humanity visiting the stars, and how super human AIs can be a huge problem.

The reason why I can't accept Moana as a magical story about Polynesian island hoping is because of the timeline that Maui performs all of his works.  Why does an eel buried in the sand form coconut trees?  Who cares it's magic, but the important thing is that he didn't provide coconuts to humanity until humanity had already threw him out into the ocean.  He provides fire, moves the sun, raises the islands (! where was everyone before this?  just floating in the ocean?), etc.  His works are basically required for humanity to exist on these islands, but the works didn't happen until after humanity was already around long enough to case him out.

The rest follows from there.  Super human AIs are possible, but relatively rare and apparently come with built in limiters of some sort.  Te Fiti is a super human AI and her heart is some sort of module that regulates her more extreme abilities.  She becomes Te Ka when she loses the heart which feels a lot like some sort of "safe mode" that prevents any additional tampering with the AI after it has lost it's heart.

The ocean is also some sort of super human AI, but also has some extreme limitations built in.  The ocean could have easily performed the entire quest that Moana goes on if it were some sort of magical spirit of the ocean thing.  It's massive, it has the heart, it has the ability to harden Te Ka.  Just splash up on Te Ka and place the heart in her and bam the story is complete.  However, if the ocean is some sort of AI that isn't allowed to attack other AIs, then suddenly things make a lot more sense.  Built in restrictions are why the ocean can't return the heart.  Built in restrictions are why the ocean doesn't help Moana except in incredibly minor ways.  It doesn't help in the realm of monsters and it doesn't help in the battle with the coconuts.  

So what are humans?  Well it's the far future and we have all these space ships and super advanced software tools that people can use, but space travel isn't really for the human psyche.  Waiting thousands of years to get from star to star isn't really for people.  Additionally, nobody wants the AIs just doing whatever they feel like (hence the restrictions put on the ocean and Te Fiti).  So humans are likely simulated humans that are unaware that what they are seeing is a massive metaphor for space travel.  The islands are random gravity wells (moons, planets, asteroids).  The boats are space ships.  The food is fuel and other raw materials.  This allows people to direct the future of humanity without yielding all the decisions to machines AND it allows humanity to survive floating around in empty space for thousands of years at a time.

Maui is the first to undergo this process.  Humanity on Earth cast him into space with some unusually powerful hardware and software, and off he went to "terraform" the space ways.  Setting up fuel depots, space elevators, solar cells, etc.  It is interesting that Maui is stuck on an island for "1000 years", but when he is confronted by Moana on the boat with the heart of Te Fiti he immediately jumps off the boat to swim away.  He didn't try swimming for it before because he was stuck on a planet.  He could try swimming for it once he was on the boat because the boat was able to get him into orbit where he would have been able to drift to another planet with sufficient infrastructure to built his own space ship.

The monsters encountered are either rogue AIs or humans who have modified their mental states.  People reincarnate/turn into ghost thingies is actually them becoming mentally exhausted with their journey and being retired into an "afterlife" where they no longer have to unconsciously direct a bunch of AIs.  Moana's visions are actually some sort of interface into the universal internet.  And the songs are actually some sort of more in depth interface between two individuals.  Maui dumps a lot of memories on Moana in song form and he states that he'll throw up when he thinks Moana is going to sing (indicating that he is going to reject a song sequence request if one shows up).

So far the whole movie makes a lot more sense to me when viewed in this light.

Wednesday, July 25, 2018

Antimemetics

Meme is a word coined by Dawkins[1] to describe how ideas can grow and evolve inside of a culture.  To see this idea explored, checkout this video[2] about how ideas can fight against each other.

SCP[3] (as far as I can tell) started out as a group collaborative writing experiment.  The basic idea is to write a creepy or scary story, but to do it in a clinical / scientific format as if the phenomena are being catalogued by a shadow government organization.  Slowly over time the writers kept on trying to one up the others and at some point the concept of anomalous memes shows up.   The basic idea is that some information is somehow magically dangerous and in fact can spread through people in much the same way a virus does.

At some point someone realized that you could have the opposite of a meme.  That is an anomalous idea that resists being remembered.  An antimeme.  The write-ups for this concept range anywhere from relatively simple and comical[4] to verifiable works of art[5].

The author of qntm.org wrote a short story[6] on the SCP site that captures the spirit of anomalous antimemes.


[1] - https://en.wikipedia.org/wiki/Meme
[2] - https://www.youtube.com/watch?v=rE3j_RHkqJc
[3] - http://www.scp-wiki.net/
[4] - http://www.scp-wiki.net/scp-055
[5] - http://www.scp-wiki.net/scp-2521
[6] - http://www.scp-wiki.net/we-need-to-talk-about-fifty-five

The question I have, though, is can we create actual antimemetic effects.  To clarify, I'm not asking if we can create anomalous or magical antimemes.  But I'm wondering if there aren't things that we can do to make it harder for people to remember.

The existence proofs are the invisible gorilla experiment[7] and research on chess experts being able to remember chess boards configurations, but only if they represent an actual game and not random piece placement[8].

The invisible gorilla experiment involved asking people to count the number of passes players of a basketball game made and then having a man in a gorilla suit run through the room during the game.  People were too focused on the action of counting passes that they did not notice the gorilla.

Similarly, chess experts have an easier time memorizing chess board configurations.  The research wanted to rule out the possibility that chess experts just happen to have better visual memories.  So they also gave chess experts randomly configured boards.  In this scenario the chess experts were no better at memorizing the board than a non expert.  

[7] - https://en.wikipedia.org/wiki/The_Invisible_Gorilla
[8] - https://psy.fsu.edu/faculty/ericssonk/ericsson.mem.exp.html

Okay, let's throw it all together and add in my problem calculus[9].  The theory is that if you're an expert it means that you brain has adapted to some sort of hidden or non obvious structure.  If you understand the structure, then you're more likely to remember any given instance you encounter.  To promote forgetfulness then would be to create instances that either have an unknown structure or a subverted structured (ie almost matching the true structure but instead having a few aspects that would otherwise be invalid).  

Similarly, the gorilla experiment shows us that forcing people to focus on a difficult task can cause them to otherwise ignore something that they should notice.

So I'm suggesting a two pronged attack against memory.  The first attack is to create structure that you are sure is unknown to your target.  The chess experiment shows us that lacking appreciation of structure can hinder memory.  Additionally, creating structure that is nearly identical to something familiar but varies in key places where you want your target to forget is expected to hinder memory.

The second attack is to find a way to draw attention to a problem which is difficult to comprehend and takes a significant amount of mental attention.  This will help obfuscate the item or event you want to go unremembered which should be already obfuscated by the structure attack from the previous paragraph. 

Finally, problem calculus should be used for both of these attacks.  Problem calculus allows you to express aspects of a problem that is difficult to comprehend.  You can also use the elements of problem calculus to create problems with difficult to comprehend aspects.  This allows you to create something which you know your target will not be familiar with.  Alternatively you can map the structure of something your target is familiar with and then modify it in ways that the target will not be expecting.

Additionally, if you want to use a distraction, then you need to make sure that your distraction is sufficiently cognitively distracting.  Problem calculus will provide guidelines for knowing that your distraction is sufficient.

[9] - http://stackallocated.blogspot.com/2018/07/problem-calculus.html