Text update for Mechanical Turk
diff --git a/exp_portal/users.py b/exp_portal/users.py
index fc471a5..7659cdd 100644
--- a/exp_portal/users.py
+++ b/exp_portal/users.py
@@ -190,15 +190,16 @@
print "Warning, more than 1 timestamp from Elastic"
if len(timestamps) < 1:
print "Warning, no timestamp from Elastic"
- timestamps = ["missing"]
+ timestamps = [["NA"]]
print "Elastic result: ", timestamps
+ #print "Timestamp: ", timestamps[0][0], "; Type: ", type(timestamps[0][0])
- stoutVars = {'SYS.FIL.DAT':task.op_task.dataset.name,
- 'SYS.FIL.EXP':SM_EXPERIMENT_NAME,
- 'SYS.FIL.APP':task.product.name,
- 'SYS.FIL.TSK':task.op_task.name,
- 'SYS.FIL.ORD':str(task.index),
- 'SYS.FIL.STD':timestamps[0]}
+ stoutVars = {'SYS.FIL.DAT.':task.op_task.dataset.name,
+ 'SYS.FIL.EXP.':SM_EXPERIMENT_NAME,
+ 'SYS.FIL.APP.':task.product.name,
+ 'SYS.FIL.TSK.':task.op_task.name,
+ 'SYS.FIL.ORD.':str(task.index),
+ 'SYS.FIL.STD.':timestamps[0][0]}
user_hashes[session_id]={'mtcode':mtcode,'vars':stoutVars}
response = JsonResponse(user_hashes, safe=False)
diff --git a/op_tasks/templates/instructions/exp_instructions.html b/op_tasks/templates/instructions/exp_instructions.html
index 3d8f585..51f41ec 100644
--- a/op_tasks/templates/instructions/exp_instructions.html
+++ b/op_tasks/templates/instructions/exp_instructions.html
@@ -3,21 +3,29 @@
{% block content %}
<h1>Hello and Thank You for Participating!</h1>
+
<p>Before you arrive at the XDATA Experiment Dashboard you should know more about what you’ll be asked to do, and how to do it. We will walk you through some of the things you’ll need to know.</p>
-<p>The purpose of this experiment is to determine how certain kinds of software user interfaces (analytic tools) affect analytic reasoning in the context of very large data sets—BIG data sets like social media, transportation data, and financial data, and others. </p>
+<p>The purpose of this experiment is to determine how certain kinds of software user interfaces (analytic tools) affect analytic reasoning in the context of very large data sets—BIG data sets like social media, transportation data, and financial data, and others.</p>
<p>You’ll be asked to complete a number of tasks, in a specific sequence, using one of the analytic tools we’re testing. After reviewing these instructions, you’ll have access to the XDATA Experiment Dashboard. This dashboard will give you access to all tasks, in the correct order—you won’t be able to complete tasks out of order. These tasks include:</p>
-<h4>Intake Questionnaire</h4><p>The first of your research tasks is a comprehensive intake questionnaire—this will ask you many questions regarding you expertise, education, background, as well as questions about how you approach complex analytic questions—we will even ask you to complete a few analytic problem solving questions as part of the intake. You can return to the intake at any time if you can’t complete it in one sitting, but please try to complete it.</p>
+<h4>Intake Questionnaire</h4>
+<p>The first of your research tasks is a comprehensive intake questionnaire—this will ask you many questions regarding you expertise, education, background, as well as questions about how you approach complex analytic questions—we will even ask you to complete a few analytic problem solving questions as part of the intake. You can return to the intake at any time if you can’t complete it in one sitting, but please try to complete it.</p>
<p>Once you’ve completed the Intake questionnaire, you’ll have access to the XDATA Experiment Dashboard, which has a number of features: </p>
-<h4>Analytic Tasks</h4><p>Analytic, or “operational tasks”, will require you to make sense of the data you’re given, with the analytic tool you’re provided. Note that these tools perform best in the Google Chrome browser. You’ll be asked select questions about various entities (persons, places, things, and patterns!) within the data. Your job is to do your best to answer these questions correctly in the time allotted. You’ll start with two analytic tasks (more tasks may be available at a later date). We will give you special instructions for how to interface with these tasks and the software you will use to complete them.</p>
+<h4>Analytic Tasks</h4>
+<p>Analytic, or “operational tasks”, will require you to make sense of the data you’re given, with the analytic tool you’re provided. Note that these tools perform best in the Google Chrome browser. You’ll be asked select questions about various entities (persons, places, things, and patterns!) within the data. Your job is to do your best to answer these questions correctly in the time allotted. You’ll start with two analytic tasks (more tasks may be available at a later date). We will give you special instructions for how to interface with these tasks and the software you will use to complete them.</p>
-<h4>Post-Task Surveys</h4><p>Following each of the two analytic tasks, you’ll be diverted to a short post-task survey that will ask about you about your experiences in the previous task. </p>
+<h4>Post-Task Surveys</h4>
+<p>Following each of the two analytic tasks, you’ll be diverted to a short post-task survey that will ask about you about your experiences in the previous task. </p>
-<h4>Comments</h4><p>Following your second analytic task and post-task, you’ll tracked in to a comments form that will allow you to tell us about your experience in your own words. Once submitted these comments will be immediately visible to the developers that built the application you used—help us make these applications better by providing constructive comments about your experience!</p>
+<h4>Comments</h4>
+<p>Following your second analytic task and post-task, you’ll tracked in to a comments form that will allow you to tell us about your experience in your own words. Once submitted these comments will be immediately visible to the developers that built the application you used—help us make these applications better by providing constructive comments about your experience!</p>
+
+<h4>Completing Your Tasks</h4>
+<p>Once you have completed your tasks, you will have the option to keep participating. If you are completing this study as a Mechanical Turk Worker, you will be provided a survey completion code at this time.</p>
<!-- <h4>Achievements</h4><p>As you complete tasks, and complete them correctly, you will unlock achievements. Additionally, if you complete all tasks, you will be allowed to come back for Free Play: you can choose different combinations of tasks and software and explore them at your leisure. Your performance on additional tasks associated with these other tools and datasets will count toward achievements, too!</p> -->
diff --git a/op_tasks/templates/intro.html b/op_tasks/templates/intro.html
index 7c41cdf..b09073b 100644
--- a/op_tasks/templates/intro.html
+++ b/op_tasks/templates/intro.html
@@ -6,81 +6,53 @@
<div id="recruitment-text">
<div id="consent-title">INFORMED CONSENT FOR PARTICIPATION IN A RESEARCH PROJECT</div>
- <div class="consent-details"><h4 style="display:inline-block;">TITLE:</h4> Examining User Experience in Data Analytic Operations</div>
+ <div class="consent-details"><h4 style="display:inline-block;">TITLE:</h4> Examining User Experience in Data Analytic Operations</div>
<div class="consent-details"><h4 style="display:inline-block;">PRINCIPAL INVESTIGATOR:</h4> Joshua C. Poore, Ph.D.; Draper Laboratory, Cambridge, MA.</div>
<div class="consent-details"><h4 style="display:inline-block;">AFFILIATED SITE LEAD RESEARCHER:</h4></div>
<p>In accordance with 45 C.F.R., Section 46.116, relating to the Protection of Human Subjects in
- Research, you must provide your informed consent prior to taking part in any of the procedures described below. We ask that you carefully consider the information about this research provided below before giving your informed consent for participation. This consent form contains technical terms. Please ask the research staff to explain any words or information that you do not clearly understand.</p>
+Research, you must provide your informed consent prior to taking part in any of the procedures described below. We ask that you carefully consider the information about this research provided below before giving your informed consent for participation. This consent form contains technical terms. Please ask the research staff to explain any words or information that you do not clearly understand.</p>
<h4>INVITATION TO PARTICIPATE</h4>
- <p>You are being asked to participate in a laboratory study investigating how you make sense of data and utilize user-interfaces, analytic tools, and visualizations as part of your analytic workflow. As part of this study you may be asked to engage with a variety of tasks, such as playing “table-top” games, pencil-and-paper tests, questionnaires and cognitive tests, as well as interactive tasks on a computer. You may be asked to engage in these experiences while you are monitored with physiological measurement equipment. The research team is conducting this study to determine whether certain types of analytic tools might change how people solve analytic problems and perform cognitive activities. This study is funded by the Defense Advanced Research Projects Agency.</p>
+ <p>You are invited to to participate in a laboratory study investigating how you make sense of data and utilize user-interfaces, analytic tools, and visualizations as part of your analytic workflow. As part of this study you may be asked to engage with a variety of tasks, such as questionnaires and cognitive tests, as well as interactive tasks on a computer. The research team is conducting this study to determine whether certain types of analytic tools might change how people solve analytic problems and perform cognitive activities. This study is funded by the Defense Advanced Research Projects Agency.</p>
<h4>DESCRIPTION OF PROJECT</h4>
- <p>You have been asked to take part in this study because: 1) you have indicated that you have some formal training or experience in interpretation of data, hypothesis testing, or construction of reasoned argument such that you can complete of laboratory task and/or provide thoughtful considertation of questions regarding data analysis; 2) you have indicated that you are not currently taking any medication or substance that would interfere with physiological monitoring (only required for laboratory experiments, not online experiments). Individuals younger than 18 years of age, non-US citizens, incarcerated (i.e., prisoners) individuals, or members of another legally protected population (i.e., intellectually handicapped, children, etc.) are not eligible for participation. Pregnant women are eligible for participation and are therefore not counted in our definition of “protected populations”—pregnancy does not impair a woman's ability to provide legally effective informed consent and we do not anticipate that protocol tasks introduce disproportional risks for pregnant women beyond those posed to other eligible participant populations.</p>
-
- <p>In order to decide whether you wish to be a part of this research study you should know enough about its risks and benefits to make an informed judgment. This consent form gives you detailed information about the research study, which a member of the research team will discuss with you. This discussion should go over all aspects of this research: its purpose, the procedures that will be performed, and any risks of the procedures, possible benefits, and possible alternatives. Once you have reviewed the terms outlined in this form, and had all of your questions answered to your satisfaction, you will be asked to provide your consent to participate in this research. Your consent indicates that you understand the procedures, risks, benefits, and compensation associated with participation in this study, as well as your rights as a research participant.</p>
-
- <p>This form will first be presented to you in electronic form, preceding your Online Intake Questionnaire. After reading this version, and having all your questions answered to your satisfaction, you will be asked to indicate your assent to and comprehension of the procedures, risks, benefits, and compensation outlined in this form. This assent does not obligate you to participate in any other future component of this study. If you are solicited to participate in a (subsequent) laboratory session, you will be asked to review this document again and provide your signature on a “hard-copy” of this form as proof of your consent. At this time you are free to decline further participation or ask any additional questions you might have before providing your consent and signature. In either case, you are entitled to a copy of this form that is both signed and dated by research staff for your records.</p>
+ <p>You have been invited to participate based on your interest or training in interpretation of data, hypothesis testing, or construction of reasoned argument such that you can complete of laboratory task and/or provide thoughtful consideration of questions regarding data analysis; Individuals younger than 18 years of age, non-US citizens, incarcerated (i.e., prisoners) individuals, or members of another legally protected population (i.e., intellectually handicapped, children, etc.) are not eligible for participation. </p>
+ <p>In order to decide whether you wish to be a part of this research study you should know enough about its risks and benefits to make an informed judgment. This consent form gives you detailed information about the research study, which a member of the research team will discuss with you. This discussion should go over all aspects of this research: its purpose, the procedures that will be performed, and any risks of the procedures, possible benefits, and possible alternatives. Once you have reviewed the terms outlined in this form, and had all of your questions answered to your satisfaction, you will be asked to provide your consent to participate in this research. Your consent indicates that you understand the procedures, risks, benefits, and compensation associated with participation in this study, as well as your rights as a research participant. </p>
+ <p>This form will first be presented to you in electronic form. After reading this version, and having all your questions answered to your satisfaction, you will be asked to indicate your assent to and comprehension of the procedures, risks, benefits, and compensation outlined in this form. This assent does not obligate you to participate in any other future component of this study. If you are solicited to participate in a subsequent sessions, you will be asked to review this document again and provide your assent. You are free to decline further participation and may ask any additional questions you might have before providing your assent (see contact information at the bottom of this form). In either case, you may print this form for your records.</p>
<h4>DESCRIPTION OF PROCEDURES</h4>
- <p>Your participation in this study may involve up to 9 hours of your time. However, no single component of this study will require more than 2 consecutive hours. All study components will occur on separate days and times to be negotiated between you and study personnel. If you have been recruited for an online experiment, these components will be distributed to you through an online portal that will direct you to the appropriate procedures. These components and the approximate time to complete each are listed below:</p>
+ <p>Your participation in this study may involve up to 9 hours of your time. However, no single component of this study will require more than 2 consecutive hours. All study components can be completed online, at a time and place of your own designation All components will be distributed to you through an online portal that will direct you to the appropriate procedures. These components and the maximum time to complete each are listed below:</p>
- <p>Online Intake Survey: 30-60 minutes
- <br>Online or Laboratory Task(s): 90-120 minutes
- <br>Follow-Up Tasks I (Online or Laboratory): 90-120 minutes
- <br>Follow-Up Tasks II (Online or Laboratory): 90-120 minutes
- <br>Follow-Up Tasks III (Online or Laboratory): 90-120 minutes</p>
+ <p>Online Intake Survey: 30-60 minutes<br />
+ Online Task(s): 90-120 minutes<br />
+ Follow-Up Tasks I: 90-120 minutes<br />
+ Follow-Up Tasks II: 90-120 minutes<br />
+ Follow-Up Tasks III: 90-120 minutes</p>
- <p>You will be (have been) notified at the time of your recruitment which procedures we are anticipating you to participate in, and whether your procedures are expected to take place exclusively online or in a laboratory, or some combination thereof. You will have the option to indicate you interest for being solicited for additional study components following your first at the bottom of this form. You may, at any time, indicate that you are NOT interested in further solicitation by submitting a request to study personnel via email or phone.</p>
+ <p>You will be directed automatically to the procedures we wish you to participate in You will have the option to indicate you interest for being solicited for additional study components following your first component. You may, at any time, indicate that you are NOT interested in further solicitation by submitting a request to study personnel via email or phone (see contact information at the bottom of this form). </p>
- <p>If you are recruited for a laboratory session (or follow-up laboratory session(s)), it will take place at either be at the Charles Stark Draper Laboratory (Cambridge, MA), or an affiliated research site. You will be notified of your research site at the time of your recruitment. Your research site is also identified on the signature page of this document.</p>
-
- <h4>Online Intake Survey</h4>
-
- <p>You will first be asked to complete questionnaires which gather information about your demographic information, education, personality, and analytic experience. This is estimated to take approximately 30-60 minutes of your time. Prior to completing these measures, you will be asked whether or not you agree and assent to the terms mentioned in this consent form. If you agree with and assent to these terms, you will proceed to the questionnaires, all of which can be answered online via a secure web-survey that is hosted through SurveyMonkey.com, a reputable company that hosts web-based surveys and allows for complete confidentiality through the use of sophisticated data-encryption techniques (all data submitted through SurveyMonkey.com is encrypted through secure socket encryption (SSL)). SurveyMonkey.com's data security and privacy statement will be made available to you upon request.</p>
-
- <p>If you are recruited for an online experiment, the online consent form and online intake survey will be made available to you via a web-based portal that will give you directions as to which tasks (see below) we are asking you to complete and the sequence with which we wish you to complete them. A link to this portal will accompany recruitment materials and will guide you through a brief registration that will provide you with a username (a valid email address) and password for repeated access to the portal.
-
- <p>If you are recruited for a laboratory experiment, the online consent form and online intake survey will be distributed to you as a link embedded in an email sent to you via study personnel.</p>
-
- <p>Following the completion of your online survey, you will be given instructions regarding a laboratory session, which constitutes part two of this study.</p>
+ <h4>Online Intake Questionnaire</h4>
+ <p>Following study registration and consenting procedures, you will first be asked to complete questionnaires which gather information about your demographic information, education, personality, and analytic experience. This is estimated to take approximately 15-30 minutes of your time. Questionnaires will be distributed online via a secure web-survey that is hosted through SurveyMonkey.com, a reputable company that hosts web-based surveys (or similar service) and allows for complete confidentiality through the use of sophisticated data-encryption techniques (all data submitted through services will be encrypted through secure socket encryption (SSL)). Data security and privacy statements from web-survey services will be made available to you upon request.</p>
+ <p>You may access instructions regarding procedures at any point during your study component.</p>
<h4>Online Tasks</h4>
-
- <p>If you have been recruited for an online experiment, a web-based portal will direct you through a number of tasks that you may complete at your convenience on a computer that meets the minimum operating requirements described on the web-based portal. The tasks that you will be asked to complete may consists of up to 3 kinds tasks. No single session of tasks is expected to last more than 2 hours. First, you will be asked to complete cognitive assessments for pattern recognition, learning acumen, attention and fatigue. Second, you will be asked to engage in an analytic task, in which you will be asked to make sense of complex data/information. This task may be timed. Finally, you will be asked follow-up questionnaires pertaining to your analytic task, including your assessments of the difficulty of the task, how useful the tools you were provided to complete your task, how you arrived at your answers and how you felt while you were completing the task.</p>
-
-
- <h4>Laboratory Tasks</h4>
-
- <p>If you have been recruited for a laboratory experiment, when you arrive at the laboratory, you will be given another opportunity to review a “hard-copy” of this form, which you will be asked to physically sign for our records and yours. At this time the procedures of this session will be explained to you verbally and you will have the opportunity to have any and all of your questions about your participation answered by research staff. At this time you will also be briefed about emergency exit procedures for the laboratory should there be an unexpected emergency.</p>
-
- <p>The Laboratory Session will take place at the Draper Laboratory or a satellite research laboratory and may consists of up to 3 kinds of tasks. No single session of tasks is expected to last more than 2 hours. First, you will be asked to complete cognitive assessments for pattern recognition, learning acumen, attention and fatigue. Second, you will be asked to engage in an analytic task, in which you will be asked to make sense of complex data/information. This task may be timed and may be presented to you in either paper-and-pencil or computerized format. Finally, you will be asked follow-up questionnaires pertaining to your analytic task, including your assessments of the difficulty of the task, how useful the tools you were provided to complete your task, how you arrived at your answers and how you felt while you were completing the task.</p>
-
- <h4>Physiological Monitoring — For Laboratory Experiments Only</h4>
-
- <p>While you are completing cognitive batteries (Task 1) and analytic tasks (Task 2) we may wish to collect physiological data from you. To do so we may collect a number of physiological features from a suite of physiological sensors. These include: heart rate, your pulse amplitude, skin conductance, brain activity, as well as eye-movements and pupil dilation. We have selected this suite of physiological sensors because they are minimally invasive and will not interfere with your completion of laboratory tasks. Before measurements can be taken using these techniques, some preparation of the skin is necessary. In some cases, this may include cleaning the skin with alcohol pads and application of water-based gels that will improve the quality of signals detected by the electrodes. A member of the research team will help secure the electrodes in place, and both male and female research staff will be available to assist this preparation for male and female research participants, respectively.</p>
-
- <p>All of these physiological monitoring techniques are deemed safe for all participants by the American Psychological Association, American Medical Association and/or have been approved for use with human research volunteers by the US Department of Health and Human Services. Safety documentation for the sensors will be made available upon request. Furthermore, we have selected specific sensor kinds to reduce the likelihood of your discomfort. Please do not hesitate to ask the researcher describing these procedures to show you the physiological sensors if you have any concerns; they will answer any questions you might have about the kind of data they collect, how they collect data, and how they are applied.</p>
-
- <p>You will be told at the start of your laboratory session whether or not we wish to monitor your physiology, and if so, which of the physiological features described above we wish to measure.</p>
+ <p>A web-based portal will direct you through a number of tasks with interactive software that you may complete at your convenience on a computer that meets the minimum operating requirements described on the web-based portal. No single session of tasks is expected to last more than 2 hours. You may be asked to complete cognitive assessments for pattern recognition, learning acumen, attention and fatigue prior to your online tasks with interactive software. Online tasks will ask you to engage in an analytic task, in which you will be asked to make sense of complex data/information. This task may be timed. After each task, you may be asked follow-up questionnaires pertaining to your analytic task, including your assessments of the difficulty of the task, how useful the tools you were provided to complete your task, how you arrived at your answers and how you felt while you were completing the task. </p>
<h4>Debriefing</h4>
- <p>Following your tasks, we will tell you more about the specific aims of the research study as well as answer any and all questions you may have. If you are a laboratory experiment participant, you will receive monetary compensation for your participation.</p>
+ <p>Following your tasks, we will tell you more about the specific aims of the research study. You may also contact study personnel with additional questions.</p>
<h4>Follow-Up Session(s)</h4>
-
- <p>You may be asked if you are interested in participating in a follow-up session at a date after your laboratory session (laboratory experiments only), or given additional task-sets to complete via the web-based portal (online experiments only). These tasks will be identical to those you complete in your first session, with respect to procedures and time necessary to complete them (up to 2 hours). However, these sessions or task-sets may involve different analytic tasks and/or analytic tools that were not previously available for testing or were not permitted by time in your original laboratory session. You will NOT be solicited for follow-up sessions without you express permission to do so (see end of Informed Consent Form).</p>
+ <p>You may be asked if you are interested in participating in additional task-sets to complete via the web-based portal . These tasks will be identical to those you complete in your first session, with respect to procedures and time necessary to complete them (up to 2 hours). However, these sessions or task-sets may involve different analytic tasks and/or analytic tools that were not previously available for testing or were not permitted by time in your original laboratory session. You will NOT be solicited for follow-up sessions without you express permission to do so.</p>
<h4>CONFIDENTIALITY</h4>
- <p>Your privacy and the confidentiality of your data will be protected. Your research records and recordings will be kept as confidential as possible. At no time, will you be photographed, nor will your identity be shared as part of the study. However, if you are a laboratory experiment participant, your likeness may be incidentally captured by research facility security cameras. No study personnel will have access to security footage and in no way will that footage be tied to the information you provide through participation in this study. Only a code number will identify your research records. The code number will not be based on any information that could be used to identify you (for example, social security number, initials, birth date, etc.). The master list linking names to code numbers will be kept separately from the research data in a locked file at the site at which participated. This list will only be accessible the Principal Investigator (Draper), engaged investigators responsible for data collection at an affiliated research site, and regulatory bodies that oversee the compliance of this study with human-subjects research procedures for the sole purpose of protecting human-subjects (i.e., New England Institutional Review Board; Department of Defense (study sponsor)). All data on computers are password protected and limited to authorized research personnel, and contain no identifiers. Only your code number will accompany your data for analytic purposes, whether at the primary research site (Draper Laboratory), or at any other approved research sites—your name and/or other identifying information will not be included when data are securely sent to other sites for analysis. Only authorized research staff will have access to the information gathered in this study. All laboratory sites conducting analyses are required to follow the same privacy/confidentiality regulations we described above. Your identity will not be revealed in any reports or publications resulting from this study for any reason without your express, written consent for your identity to be released. We will retain your contact information should we wish to contact you for your written consent in the future, or should you wish to participate in additional study procedures (i.e., Part 2).Please note that by law we are required to disclose certain information about you without your consent that would identify you as a participant in the research project. Specifically, we are mandated to report information about child abuse, elderly abuse, intent to hurt yourself, or intent to hurt others.</p>
-
+ <p>Your privacy and the confidentiality of your data will be protected. Your research records and recordings will be kept as confidential as possible. At no time, will you be photographed, nor will your identity be shared as part of the study. Only a code number will identify your research records. The code number will not be based on any information that could be used to identify you (for example, social security number, initials, birth date, etc.). The master list linking names to code numbers will be kept separately from the research data on a secure server that will only be accessible the Principal Investigator (Draper), engaged investigators responsible for data collection at an affiliated research site, and regulatory bodies that oversee the compliance of this study with human-subjects research procedures for the sole purpose of protecting human-subjects (i.e., New England Institutional Review Board; Department of Defense (study sponsor)). All data on computers are password protected and limited to authorized research personnel, and contain no identifiers. Only your code number will accompany your data for analytic purposes, and your name and/or other identifying information will not be included when data are securely sent to other approved sites for analysis. Only authorized research staff will have access to the information gathered in this study. All sites conducting analyses are required to follow the same privacy/confidentiality regulations we described above. Your identity will not be revealed in any reports or publications resulting from this study for any reason without your express, written consent for your identity to be released. We will retain your contact information should we wish to contact you for your written consent in the future, or should you wish to participate in additional study procedures .Please note that by law we are required to disclose certain information about you without your consent that would identify you as a participant in the research project. Specifically, we are mandated to report information about child abuse, elderly abuse, intent to hurt yourself, or intent to hurt others.</p>
<p>After the study is completed, the study data may be placed in a secure central storage location. The data will not include your name or other information that could identify you. The purpose is to make study data available to other researchers who must request permission to use it. Although the results of your research information will not be sold, the information obtained from the research may lead to the development of commercial products in the future. You will not receive any money from the use of your research information.</p>
<h4>RISKS AND INCONVENIENCES</h4>
- <p><b style="display:inline-block; font-family:'montserrat-bold';">Risks:</b> This study is associated with minimal risks. However, if the consent form is not read carefully, there could be a risk of not understanding fully the nature of the research being conducted, your responsibilities, and the safeguards to protect your confidentiality. Additionally, while most individuals tolerate all of the planned tasks, some may find them tedious and some individuals find it distressing or inconvenient to be monitored with physiological sensors. No procedures or materials (i.e., sensors/conductive gels/pastes) used in this study are deemed dangerous to any population (incl. pregnant women and fetuses). All gels/pastes used in this study are water-based and hypoallergenic. In very rare cases, participants with sensitive skin may feel some minor discomfort related to skin-preparation protocols, which include preparation with medical alcohol pads.</p>
+ <p><b style="display:inline-block; font-family:'montserrat-bold';">Risks:</b> This study is associated with minimal risks. However, if the consent form is not read carefully, there could be a risk of not understanding fully the nature of the research being conducted, your responsibilities, and the safeguards to protect your confidentiality. Additionally, while most individuals tolerate all of the planned tasks, some may find them tedious. No procedures or materials (i.e., sensors/conductive gels/pastes) used in this study are deemed dangerous to any population.</p>
<p><b style="display:inline-block; font-family:'montserrat-bold';">Risk reduction:</b> To minimize any risk of not truly understanding the elements of this study, you will be provided several opportunities in which the purpose and procedures of the study will be presented, and you will be able to ask any questions and have those questions answered. Additionally, if at any time you feel uncomfortable with any study procedures you may discontinue your participation without penalty (you may be eligible to receive prorated payment or course credit). In addition, you can request to meet with our clinical psychologist on staff to discuss any stress or emotional distress you may experience related to your participation today.</p>
@@ -90,9 +62,9 @@
<p>There is no direct benefit to you for participation in the study.</p>
<h4>ECONOMIC CONSIDERATIONS</h4>
- <p>Participants recruited for laboratory experiments are eligible to receive monetary compensation. Participants recruited for online only experiments are not eligible to receive monetary compensation. Student populations that are recruited for laboratory experiments at university/college sites may be eligible to receive either monetary compensation or course credit as per their institutions' guidelines. US government personnel that volunteer to participate as government employees (not private citizens) may not be eligible to receive compensation for their participation.</p>
-
- <p>The total compensation possible for laboratory experiments is $135, which accounts for full participation in the online intake questionnaire, the laboratory session and all possible follow-up sessions. Completion of a given study component will result in maximum compensation possible for that component at the rate of $15/hour; this will be based on the maximum time estimate for that component (see above). Partial completion of a given study component will result in pro-rated payment for time spent in participation at the same rate of $15/hour. For example, completion of the Online Intake Questionnaire and the first Laboratory Session results in the payment of $45, full completion of the Online Intake Questionnaire and partial completion of Laboratory Tasks may result in a payment of $30. Payment for partial completion of the Online Intake Questionnaire participation will be mailed directly to participants in the form of checks with a cash value of $15. Payment for laboratory session (or follow-up session) participation will be given to participants, in person, directly following their session.</p>
+ <p>Online study participants are eligible to receive monetary compensation. Compensation depends on how participants choose to participate, however, US government personnel (acting as government employees) may not be eligible to receive compensation for their participation.</p>
+ <p>Members of the general public are eligible for performance-based prizes. The “general public” refers to participants that are NOT students, members of the US Government (acting as government employees), or enrolled as members of a “panel service” (such as Mechanical Turk, etc.). One (1) $250.00 prize will be issued for the best overall performance on tasks with each unique software tool. Participants will be eligible for up to 4 awards. After your initial session comprised of two tasks with one software tool, you will be able to continue your participation with additional software tools. Two performance-based prizes will be awarded yearly for each unique software tool. To be eligible, you must complete two tasks with a given software tool. Performance will be measured by a combined score incorporating: 1) the number of analysis tasks completed correctly, 2) the amount of total time taken to complete tasks. If you complete tasks will all possible software tools, your best scores on tasks for each tool will be counted, however, you will only be eligble for up to 4 awards. Safeguards are in place for ensuring that participants cannot defraud the system.</p>
+ <p><b style="display:inline-block; font-family:'montserrat-bold';">Panel Service participants</b> recruited through services like Mechanical Turk, Crowdflower, etc. will be compensated $15 for their participation. Again, we anticipate that participants will spend no more than 2 hours for completing all tasks.</p>
<h4>ALTERNATIVES</h4>
<p>Participation in the study is VOLUNTARY. The alternative to participating in this study is NOT participating in this study. If you decide to participate in this study, you may withdraw from the study at ANY time. You may choose not to participate at ANY time.</p>
@@ -101,7 +73,7 @@
<p>Compensation may or may not be payable in the event of physical injury arising from this study under applicable federal law. If you have any questions about your rights as a participant, you may contact the Principal Investigator, Dr. Joshua C. Poore, at 617-258-4023, software-evaluation@draper.com.</p>
<h4>VOLUNTARY PARTICIPATION AND WITHDRAWAL</h4>
- <p>Your participation in this study is voluntary. You can refuse to participate in, or withdraw from this study at any time without penalty or loss of benefits to which you are otherwise entitled. If you decide to withdraw from the study, you can also request that all electronic data (including audio and video recordings) collected to that point be destroyed.</p>
+ <p>Your participation in this study is voluntary. You can refuse to participate in, or withdraw from this study at any time without penalty or loss of benefits to which you are otherwise entitled. If you decide to withdraw from the study, you can also request that all electronic data (including audio and video recordings) collected to that point be destroyed (see contact information at the bottom of this form).</p>
<p><b style="font-family:'montserrat-bold'">Study Withdrawal</b>
<br>The principal investigator may end your participation in this study for any of the following reasons:
@@ -110,7 +82,7 @@
<br>3. For administrative reasons.</p>
<h4>QUESTIONS</h4>
- <p>We have used some technical terms in this form. Please feel free to ask about anything you don't understand and to consider this research and the consent form carefully - as long as you feel is necessary - before you make a decision. If you have any questions about your rights as a participant, or the study itself, you may contact the Principal Investigator, Dr. Joshua C. Poore, at 617-258-4023, software-evaluation@draper.com (email preferred).</p>
+ <p>We have used some technical terms in this form. Please feel free to ask about anything you don't understand and to consider this research and the consent form carefully – as long as you feel is necessary – before you make a decision. If you have any questions about your rights as a participant, or the study itself, you may contact the Principal Investigator, Dr. Joshua C. Poore, at 617-258-4023, software-evaluation@draper.com (email preferred).</p>
<h4>VOLUNTEER'S STATEMENT</h4>
diff --git a/op_tasks/templates/task_list.html b/op_tasks/templates/task_list.html
index d73cc21..21427e5 100755
--- a/op_tasks/templates/task_list.html
+++ b/op_tasks/templates/task_list.html
@@ -193,13 +193,12 @@
<hr>
<div class="task-list-text">Thank you for participating, you have completed all analytic tasks!</div>
- <p>If you are interested in future study components or engagement with analytic tools, we will contact you if you indicated such interest in the intake questionnaire.</p>
- <p>The purpose of this research is not only to improve open-source big data analytic applications, but also to understand how future applications should be developed. For example, we are interested in whether specific configurations of analytic tools—user interfaces, analytics, etc.—are better for reducing user workload and increasing task performance during analytic tasks. In addition to the questionnaires you answer, we also collect real-time data about how you are using the tools and analyze that data. From that data we can develop mathematical models for how well you have learned to use the analytic tools’ functionality. From these models we can better understand how software design and user interface configuration contributes to user workload and performance.</p>
- <p>If you are interested in working on developing these analytic tools, which are free and open source, please return to <a href="http://www.xdataonline.com/">XDATA Online</a> to explore DARPA’s <a href="http://www.darpa.mil/opencatalog/XDATA.html">Open Catalog</a>, the applications you used, and datasets!</p>
- <br/>
- <p>You may activate FREE PLAY now! Click <a href="{% url 'op_tasks:activate_free_play' %}">here</a>.</p>
-
+ <p>If you are interested in future study components or engagement with analytic tools, we will contact you if you indicated such interest in the intake questionnaire.</p>
+ <p>The purpose of this research is not only to improve open-source big data analytic applications, but also to understand how future applications should be developed. For example, we are interested in whether specific configurations of analytic tools—user interfaces, analytics, etc.—are better for reducing user workload and increasing task performance during analytic tasks. In addition to the questionnaires you answer, we also collect real-time data about how you are using the tools and analyze that data. From that data we can develop mathematical models for how well you have learned to use the analytic tools’ functionality. From these models we can better understand how software design and user interface configuration contributes to user workload and performance.</p>
+ <p>If you are completing this study as a Mechanical Turk Worker, please enter the following survey completion code to register your task as complete: </p>
<p>Your Mechanical Turk Code is <strong>{{mtcode}}</strong></p>
+ <p>If you are interested in working on developing these analytic tools, which are free and open source, please return to <a href="http://www.xdataonline.com/">XDATA Online</a> to explore DARPA’s <a href="http://www.darpa.mil/opencatalog/XDATA.html">Open Catalog</a>, the applications you used, and datasets!</p>
+ <p>You may activate FREE PLAY now! Click <a href="{% url 'op_tasks:activate_free_play' %}">here</a>.</p>
{% endif %}
diff --git a/xdata/templates/index.html b/xdata/templates/index.html
index ad1b69e..c0ca9d4 100755
--- a/xdata/templates/index.html
+++ b/xdata/templates/index.html
@@ -47,18 +47,34 @@
</div>
<div id="recruitment-info-container">
<div id="recruitment-text">
- <h4>Call for Research Participants</h4>
+ <h4>Call for Research Participants</h4>
<p>The purpose of this study is to determine whether certain kinds of interfaces and analytic tools affect your analytic workflow. This study is funded by the Defense Advanced Research Projects Agency. Your participation will include providing information about your basic demographics, personality, analytic abilities via online questionnaire. This will be followed by a testing session to be completed at your convenience through our online testing portal. During the testing session, you will be asked to participate in a variety of tasks, questionnaires and cognitive tests, as well as interactive tasks on a computer.</p>
<h4>Eligibility Information</h4>
- <p>Participation in this research is open to any persons between the ages of 18 and 60 years, that are not incarcerated (i.e., prisoners) or a member of another legally protected population (i.e., intellectually handicapped, children, etc.), with the exception of pregnant women (the procedures and materials used in this study do not limit the participation of pregnant women). You may be excluded from participation if you do not have sufficient formal training or experience in interpretation of data, hypothesis testing, or construction of reasoned argument to effectively answer questions about analytic process or participate in laboratory tasks. Ideally, potential participants have at least 3 years applied or working experience within an analytic vocation (e.g., intelligence, military, legal, business, marketing, credit, banking, finance, and capital markets, etc.), OR post-graduate training within a relevant area of study and associated analytic skills (e.g., economics, behavioral sciences, statistics, political science, etc.), OR have had relevant internships, post-doctoral, or research experience. However, should you feel that you meet the requirements given your applied experience, we will consider eligibility on a case-by-case basis.</p>
+ <p>Participation in this research is open to any persons older than 18 years of age, that are not incarcerated (i.e., prisoners) or a member of another legally protected population (i.e., intellectually handicapped, children, etc.), with the exception of pregnant women (the procedures and materials used in this study do not limit the participation of pregnant women). </p>
<h4>Additional Study Details</h4>
- <p><i>Study Duration:</i> Your participation in this study can involve up to 3 hours of your time: approximately 30-60 minutes to fill out online questionnaires, and 90-120 minutes as you engage in online analytic tasks. Additional follow-up tasks with similar content may be solicited, with your permission. Each of these are estimated to take between 90-120 minutes.</p>
- <p><i>Participant Involvement:</i> Participation involves both completion of the online questionnaires and online tasks, which involve using next generation analytic tools to solve difficult analytic problems using complex data sources. However, participation in the online questionnaires neither obligates you to participate in online analytic tasks nor guarantees that you will be invited for follow up tasks.</p>
- <p><i>Compensation:</i> Participation is strictly voluntary—there is no monetary compensation for participation in this study. However, participants being recruited from university research sites may be eligible for course/research credit commensurate with their participation as per their institution’s guidelines.</p>
+ <p><em>Study Duration:</em> Your participation in this study can involve up to 2 hours of your time: approximately 30-60 minutes to fill out online questionnaires, and between 60-90 minutes as you engage in online analytic tasks. Additional follow-up tasks with similar content may be solicited, with your permission. Each of these are estimated to take between 60-90 minutes.</p>
- <p><b>To register as a participant or just to learn more about this unique research opportunity, please click on the green Register link above.</b> This will forward you to our Online Consent Form. If you acknowledge the terms in the consent form, you can register a unique, but anonymous username that will be used to keep track of your data. If, after visiting our website, you have additional questions and concerns, please contact us at <a href='mailto:software-evaluation@draper.com'>software-evaluation@draper.com</a>.</p>
+ <p><em>Participant Involvement:</em> Participation involves both completion of the online questionnaires and online tasks, which involve using next generation analytic tools to solve difficult analytic problems using complex data sources. However, participation in the online questionnaires neither obligates you to participate in online analytic tasks nor guarantees that you will be invited for follow up tasks. You are free to participate through a variety of methods:</p>
+
+ <ul>
+ <li><p>• As a university student: a member of a course or department that allows you participate in this research (specifically) for course credit. (Find the study at <a href="http://xdataonline.com">http://xdataonline.com</a>)</p></li>
+ <li><p>• A member of the general public (Find the study at <a href="http://xdataonline.com">http://xdataonline.com</a>)</p></li>
+ <li><p>• A member of a Panel Service (such as Mechanical Turk “workers”, or similar) may participate through their respective services. (Find “XDATA Online Testing” on Mechanical Turk!)</p></li>
+ </ul>
+
+ <p>You may participate through any 1 of the aforementioned methods.</p>
+
+ <p><em>Compensation:</em> Participation is strictly voluntary. Compensation varies based on the circumstances of participants.</p>
+ <ul>
+ <li><p>• Student participants being recruited from universities with appropriate protocols in place may be eligible for course/research credit commensurate with their participation as per their institution’s guidelines.</p></li>
+ <li><p>• The General Public will be eligible for monetary prizes based on their performance on tasks with software tools. Once every six months, task performance will be tabulated and the participants with the best performance on tasks for each software tool will be awarded a $250 prize. Participant may enroll to perform tasks in multiple software tools and will be eligible for up to 4 awards of $250 in a calendar year.</p></li>
+ <li><p>• Panel Service participants recruited through Mechanical Turk (and/or similar services) will be compensated $15 for their participation.</p></li>
+ </ul>
+
+ <p><b>To register as a participant or just to learn more about this unique research opportunity, please click on the “Register” link below.</b> This will forward you to our Online Consent Form. If you acknowledge the terms in the consent form, you can register a unique, but anonymous username that will be used to keep track of your data. If, after visiting our website, you have additional questions and concerns, please contact us at <a href="mailto:software-evaluation@draper.com">software-evaluation@draper.com</a>.</p>
+
<p>Thank you in advance for your interest and consideration!</p>
<p>Dr. Joshua C. Poore (Principal Investigator)
@@ -66,8 +82,7 @@
<br>The Charles Stark Draper Laboratory
<br>555 Technology Square, Rm. 2242
<br>Cambridge, MA 02139-3563
- <br>Phone: (617) 258-4023
- <br>Email: <a href='software-evaluation@draper.com'>software-evaluation@draper.com</a></p>
+ <br>Email: <a href="mailto:software-evaluation@draper.com">software-evaluation@draper.com</a></p>
<a class="btn-bordered" id="landing-button" href="{% url 'op_tasks:intro' process='register' %}" role="button">REGISTER</a>
</div>
