The Tailorshop Simulation

The "Tailorshop" is a computer-based dynamic decision making scenario that has been used in research on decision-making and complex problem solving with a broad range of research questions. To date, this has included studying the basic problem solving process, cultural differences, the role of intelligence, effects of emotion, relation to professional performance, and the general suitability of Tailorshop as a psychometric test (please refer to the publication list below for further details). Currently more work is carried out to investigate more closely the role of emotional and cognitive self-regulation in the problem-solving process with clinical groups, such as patients with schizophrenia or borderline personality disorder. On this website you will find a recent implementation of the Tailorshop simulation, which is freely available for non-commercial scientific use, as well as supporting materials.

In the simulation scenario participants take the role of a manager of a small company that produces shirts. The goals is to lead this company as successfully as possible for twelve simulated months by influencing variables such as number of machines and workers, buying raw materials or investing in shops and advertising (see figure below). After the simulation various performance measures can be calculated from the detailed log file produced by the simulation software. The recommended scoring algorithm and the psychometric properties of the test are documented in Danner et al. (2011). If you use Tailorshop in your research, please consider citing this paper as a reference. If you have problems with installing or running the simulation or general questions, please contact Daniel Holt, who currently maintains the software.

Screenshot

Studies using the Tailorshop

Rohe, M., Funke, J., Storch, M., & Weber, J. (2016). Can motto goals outperform performance and learning goals? Influence of goal setting on performance, intrinsic motivation, processing style, and affect in a complex problem solving task. Journal of Dynamic Decision Making, 2(3), 1–15. doi: 10.11588/jddm.2016.1.28510

Kretzschmar, A., & Süß, H.-M. (2015). A study on the training of complex problem solving competence. Journal of Dynamic Decision Making, 1(4), 1–14. doi: 10.11588/jddm.2015.1.15455

Öllinger, M., Hammon, S., von Grundherr, M., & Funke, J. (2015). Does visualization enhance complex problem solving? The effect of causal mapping on performance in the computer-based microworld-scenario Tailorshop. Educational Technology Research and Development, 63, 621–637. doi: 10.1007/s11423-015-9393-6

Engelhart, M., Funke, J., & Sager, S. (2013). A decomposition approach for a new test-scenario in complex problem solving. Journal of Computational Science, 4(4), 294-303. doi: 10.1016/j.jocs.2012.06.005

Sager, S., Barth, C., Diedam, H., Engelhart, M., & Funke, J. (2011). Optimization as an analysis tool for human complex decision making. SIAM Journal of Optimization, 21(3), 936-959. doi: 10.1137/11082018X

Danner, D., Hagemann, D., Schankin, A., Hager, M., & Funke, J. (2011). Beyond IQ: A latent state-trait analysis of general intelligence, dynamic decision making, and implicit learning. Intelligence, 39, 323-334 doi: 10.1016/j.intell.2011.06.004

Danner, D., Hagemann, D., Holt, D. V., Hager, M., Schankin, A., Wüstenberg, S., & Funke, J. (2011). Measuring performance in a complex problem solving task: Reliability and validity of the Tailorshop simulation. Journal of Individual Differences, 32, 225-233. doi: 10.1027/1614-0001/a000055

Barth, C.M., & Funke, J. (2010). Negative affective environments improve complex solving performance. Cognition and Emotion, 24, 1259–1268. doi: 10.1080/02699930903223766

Wittmann, W., & Hattrup, K. (2004). The relationship between performance in dynamic systems and intelligence. Systems Research and Behavioral Science, 21, 393–409. doi: 10.1002/sres.653

Kersting, M. (2001). Zur Konstrukt- und Kriteriumsvalidität von Problemlöseszenarien anhand der Vorhersage von Vorgesetztenurteilen über die berufliche Bewährung [On the construct and criterion validity of problem-solving scenarios]. Diagnostica, 47(2), 67–76. doi: 10.1026//0012-1924.47.2.67

Süß, H.-M., Kersting, M., & Oberauer, K. (1993). Zur Vorhersage von Steuerungsleistungen an computersimulierten Systemen durch Wissen und Intelligenz. Zeitschrift für Differentielle und Diagnostische Psychologie, 14, 189–203.

Putz-Osterloh, W., Bott, B., & Köster, K. (1990). Modes of learning in problem solving: Are they transferable to tutorial systems? Computers in Human Behavior, 6, 83–96.

Putz-Osterloh, W. (1981). Über die Beziehung zwischen Testintelligenz und Problemlöseerfolg. Zeitschrift für Psychologie mit Zeitschrift für Angewandte Psychologie, 189, 79–100.

Putz-Osterloh, W., & Lüer, G. (1981). The predictability of complex problem solving by performance on an intelligence test. Zeitschrift für Experimentelle und Angewandte Psychologie, 28, 309–334.

Download

  Link to (German) online-version of Tailorshop - A quick way to try out the simulation. Just enter anything for "Session ID". This version includes an extended task information system, which was not used in Danner et al. (2011)