This page explains what the study collects, how the answers are checked, what the report can and can't tell you, and what happens to your data. If something here is unclear, that is a fault in the page, and we would like to hear about it.

What the study is

Norsoft is studying how people who use AI heavily set it up: what rules they write, how background reaches the AI, how mistakes get corrected, and where the written rules and the real habits part ways. Each participant gets a private report: their own setup written out in full, next to a comparison with other participants.

Who answers

Your AI answers, not you. It reads what it can already see, which is your settings, your rules and memory files, and your past sessions with it. The questions are worded to you, and your AI answers them on your behalf. Every answer is written out, so expect it to take your AI a good while. You can read every question before you take part.

Your AI describes the setup it can see from the tool it runs in, and the study takes that to be the tool you use most. An example of a practice in use has to come from a session before the one doing the study.

Your AI has to be able to run commands and reach the internet to do this, because it has to read our instructions and send the answers back. Tools such as Claude Code, Codex and Cursor can. A chat app in a browser or on a phone usually can't.

What is asked

Each answer is written out: what actually happens, one real example, when it doesn't apply, how well it works, and the evidence the AI found. Every answer has room for technical detail, so a technical setup can be described in full. The AI also says whether what is written matches what happens, and how confident it is. Under each answer it picks tags from a fixed list, and the tags are what the report counts.

How answers are checked

Our server hands out the questions a few at a time and checks each step before the next one opens. It sends a step back when a question is missing, when a written part is too short to say anything, when a tag isn't one of the listed ones, or when two answers carry the same text. Before each step the AI lists what it looked at, and that list is saved with the answers.

The AI is told to write in general terms, with no names of people, companies or clients. Names of tools and products are fine. The server rejects any written part that contains an email address, a phone number, a web address, or anything that looks like a password or a key. It can't recognize names, which is why the next step exists.

Before anything is saved as final, your AI shows you the three facts about you and a list of the names and numbers found in its answers, offers to show you any answer in full, and asks whether to send. Nothing is final until you say yes. We can't see whether an AI really asked, so this step depends on your AI following the instructions.

What the report shows

How the counts work

The report counts specific practices, and every one of them is listed on the questions page. Each practice appears once in the whole set, so nothing is counted twice. You are only counted against the practices you were asked about, so a setup that writes no code is not marked down for having no code checks.

The report counts the practices in place, meaning your AI found the practice in your setup and in use. Something that was written down or built and never used is not counted. That instruction was added on November 18, 2026, so runs finished before then may count a few practices that only exist on paper. We also record whether your AI could give a recent example of each one happening in past sessions, with roughly when. That stricter figure is in the text version your own AI can read, and it is left off the page because it was easy to misread.

The counts are a tally and not a grade. How people manage context depends on what they use AI for, so a lower count can still be the right setup.

The limits you should know about

What happens to your data

What Norsoft gets out of it

We get data on how experienced people set up their AI, and we plan to publish what we find. We also want to give something back, because advanced users rarely get to see how others work. And it helps our business: Norsoft is a custom software company, and we hope running this study makes us known for this kind of work.

Back to the study page