Online Technology for Research & Insight

FAQs: Analysis of Responses and Filters

Frequently asked questions. Click on any question to see the answer.

Analysis of Responses toolset


AOR01 What is included in the Analysis of Responses toolset?

This is your main data analysis toolset in Demographix. It has an easy-to-use interface with five different tabs across the top as follows:
Analysis: this allows you to see all your data in a single view with dynamic percentages and numbers for each answer option
For more on ANALYSIS go to: Analysis of Responses and Filters.
Filters: this allows you to filter the data by specific variables from the survey (e.g. all males)
For more on FILTERS go to: Analysis of Responses and Filters.
Crosstabs: this allows you to run crosstab reports with data options from a question or several questions across the top and answers from either all or a selected number of questions down the side
For more on CROSSTABS go to: Crosstabs and Derived Variables.
Derived Variables: this tab allows to create answers based on a combination of questions in the survey (e.g. males who are 25-44 and do not live in London)
For more on DERIVED VARIABLES go to: Crosstabs and Derived Variables.
Weighting: allowing to weight your data based on the population you are interested in
For more on WEIGHTING go to: Sampling, quotas and weighting.
Excel and PDF reports of this analysis can be generated within the toolset, but users may also easily cut and paste data from the Excel reports into other office programs, such as Powerpoint or Word.

The ANALYSIS tab


ATB01 What viewing tools are available in the main Analysis tab?

You can customise your overall VIEW of the data from your survey in the following ways:
1. By pages: SHOW ALL PAGES allows you to view the names and contents of all pages in your survey; HIDE ALL PAGES will hide all contents and show just the page titles. You can then open up the pages whose contents you want to focus on, or include in a report - particularly useful in a very long survey.
2. By Sample Sizes: A drop-down tool at right allows you to SHOW/HIDE SAMPLE SIZES. Hiding sample sizes will take the actual number counts out of the report and leave only percentages.
3. By Nett/Gross figures: A drop-down menu at top right allows you to choose nett percentages (based on respondents per individual question) or gross percentages (based on total respondents for the whole survey). See separate FAQ below for further explanations of nett/gross figures.

ATB02 What is the basic difference between GROSS and NETT figures?

Consider a survey with 100 respondents in total. However, Question 10 ("Do you prefer red or yellow cars?") is answered by only 88 people (12 respondents either didn't qualify because it was conditional or just didn't answer). The responses to the question were: Red=68 and Yellow=20. Therefore:
GROSS response rates are: Red 68% (68/100) and Yellow 22% (22/100). These add up to 88%. You would report that "68% of all people sampled chose Red".
NETT response rates are: Red 77% (68/88) and Yellow 23% (20/88). These add up to 100%. You would report that "77% of people who expressed an opinion chose Red".
In an analysis report the nett percentages always add up to 100%, gross ones don't.

ATB03 Can I change the way the data is displayed in an individual question?

Depending on what type of question it is, you can change the way data is displayed in the Analysis view. Any single choice, multiple choice, matrix, slider or ranking question that has a list of possible answers will be displayed, by default, in the order in which these are listed in the survey building process. There will be a drop-down labelled SURVEY ORDER showing the default order. But you can choose HIGHEST FIRST or LOWEST FIRST from this dropdown menu to reorder the data. A similar dropdown menu tool lets you choose whether the data for each question is shown as NETT or GROSS. These local changes will override whatever the global setting for the data is. NOTE: Whatever is shown in the analysis view is how the data will be displayed in any report.

ATB04 Can I change the way data is displayed the Card Sort - Ranking questions?

Card Sort ranking questions allow respondents to move and rank text and image items. The Analysis of Responses shows how the text / image names have been ranked – both the actual numbers for each ranking position, as well as a weighted value that takes into account the number of times a choice is actively selected. The default view is to see them in the order they are listed in the survey, but a drop-down menu allows you to change this to highest first or lowest first. Highest first shows the list arranged by how they have scored overall: top points are awarded to the actively chosen items, and a weight tally is created to give an overall ranking (e.g. 10 points for 1st ranked item, 9 points for a second rank, 8 points for 3rd, etc). The weighting algorithm takes into account that Choice A chosen 40 times in positions 2 and 3, is being more actively chosen than Choice B which is ranked 10 times in top position only.

ATB05 Where is the data from write-in questions kept?

The data from a write-in question could be considerable, so we do not show it in the Analysis tab view. There is a VIEW option at right of the text of the write-in question. Click on this, and all responses to the question are shown listed (in submission order) in a tabbed pop-up interface. The default view in this pop-up is the WRITE-IN TEXT tab. But another tab, labelled KEYWORD ANALYSIS, allows you to specify repetitive words or phrases (see separate FAQ for more tips on using keyword analysis). When you click "Apply", the system will tally up the number of responses and display them in the main Analysis interface when you next click on the tool.

ATB06 Can you give me some tips on using Keyword Analysis for write-ins?

Our keyword analysis tool looks for repeated strings of characters in the write-ins and tallies them up. It doesn't double-count (i.e. if the same string of characters is used twice in a single response to a question, it counts it only once). For multiple words, the space is included, so they need to be exact matches.
Example 1: you have the following three responses...
1. I really like keyword analysis
2. I kind of like to analyse key words
3. I like to use analysis of a keyword
...you could use the word "like" to get a tally of all 3, or use "keyword, key words" which takes into account the alternative usages, and also gets a count of 3.
Example 2: a write-in question asking people to nominate their favourite ice cream flavour. In the keyword analysis, you could add the following sets of keywords (using a separate line for each category, and with a comma or comma/space between each string):
vanilla, plain
chocolate,cocoa
berry, strawberry, raspberry
mango,guava,tropical
mint
hokey pokey,tutti frutti
Note that the analysis tool can be used to look for parts of words so the mint category would also include spearmint or peppermint or any word with the letters "mint" in it. Words between commas are treated as an exact phrase so the above would find "hokey pokey" but not hokey on its own. By viewing the write-ins in the raw form you can spot popular flavours and then add them to the keyword list at any time. The incidence of keywords is shown in the analysis and cross-tab reports as standard bar graphs.

ATB07 Can I apply numeric values to answer lists to calculate average values?

Yes, there is a tool attached to every question where this can be applied, signified by a brown square icon with an equals sign in it. Click this, and a pop-up will appear with every answer list item shown, and each having a write-in box in which values can be entered. You can assign a numeric value for each option (positive values do not need the + symbol, but negative values such as -5 can be used). No other punctuation, spaces or currency symbols can be used. Use # to ignore an option that you don't want included in the average calculation (such as the "Not applicable", or "Don't want to say"). Click the Apply button when you've added ALL the values (the system will alert you to any that you've missed) and the calculation will be applied instantly. These values are saved automatically so that the next time you come to analyse the data, the values are there.

ATB08 How can I download an Excel or PDF report of the data shown in the ANALYSIS tab?

At the top of the ANALYSIS tab interface are two reporting options: DOWNLOAD AS EXCEL and CREATE PDF. Choosing the former, DOWNLOAD AS EXCEL, brings up a configuration tool: you are asked to choose what pages to include, how nett/gross figures are to be shown, and whether to include sample sizes. The default selects all pages, and the data is shown as in the interface. Click "Continue" and the Excel file will be generated. The latter tool, CREATE PDF, will generate another button (OPEN PDF VERSION) once the download version has been built. Click on the new button and the PDF can be downloaded and viewed. NOTE: The write-in question data is available in separate tabs in the Excel report (one tab for each question). Because of potential size issues, write-in data is not included in a PDF report. But this data can be downloaded in PDF format for each write-in question through the View data tool in the main Analysis interface.

ATB09 Is there a way to calculate the average value for responses to a question?

Yes, you can apply average values to any question for which it makes sense. These may be numerically-based questions (for example, age, income, expenditure) or non-numerical (such as "Very satisfied to Very dissatisfied" ratings). See FAQ ATB07 above for more information on non-numerical averages. You can either apply the averages when building your survey or at the analysis stage.
To apply averages while working on the survey, tick the "Calculate average results in analysis report" within the Question/Item editor. Then place an equals sign after each answer option and put in a value or mid-point for that option. For example, if you have an age break of 25-34 the midpoint would be 29.5. (An easy way to work out midpoints is to add up the two numbers and divide by 2. You may need to make a judgement call for certain options e.g. Age 65+). To ignore an option in the average calculation, put in a # after the equals sign.
To calculate averages in the analysis report, click on the brown equals sign shown next to each question and add in your values here. Whichever way you choose, the averages will be shown underneath the question when you next run the analysis report.

The FILTERS tab


FTB01 I want to analyse just a subset of my responses. How can I do this?

Demographix enables you to filter your surveys on the answers to a question or questions, when viewing the analysis of responses. To access this tool, click on the FILTERS tab. Under "Configure filters" there is a list of every question in the survey that can be used for filtering. Select the question you want to filter on, and all its answer options will display beneath. Choose the options you want (note the handy SELECT ALL button if you want to choose most of them and unselect a few options). Note that question types that allow multiple responses will display an "ANY OF" and "ALL OF" option above them that must be set. ANY OF selects respondents who have answered EITHER or ANY of the options, ALL OF selects only those who have answered BOTH or ALL of the options. Then click the "Apply filter" button, and the tool will work through the data and filter out only respondents who meet your criteria.

FTB02 Is it possible to filter the analysis on more than one question?

Yes, multiple filters are easily created. After you've specified your first filter question (see above) you'll notice an "ADD ANOTHER FILTER QUESTION" option beneath. You can then choose your second filter question and the answers you want to specify as needing to be fulfilled. But before you can apply the filter, you must fill in the section labelled "RESPONDENT MUST HAVE SATISFIED". This is the necessary logical operator. "ANY of the control questions" will select respondents who have satisfied criteria in Q1 OR Q2, while "ALL of the control questions" will select those who satisfy Q1 AND Q2. Click "Apply filter" and the data set will be dynamically filtered.

FTB03 Is there an easy way to filter responses from a dual-option (e.g. yes/no or male/female) question?

For a simple filter on one option in one question, just click on the red bar in the analysis report. The system will filter out all the responses that included that particular answer and display a new filtered analysis. This will be clearly labelled with an ACTIVE FILTER statement in brown at the top of the new analysis. There is a CLEAR FILTER option at right, if you want to undo this filter and return to a full analysis data set.

FTB04 My keyword analysis is showing as a bar graph in the main Analysis tab. Can I use this to filter?

Yes, it is possible to filter the entire data set from a single line of a keyword analysis bar chart, by simply clicking on it. The filter will then be applied. However, you cannot filter out multiple lines of a keyword analysis.

FTB05 Once I have filtered my data, can I then use this data set in a crosstab?

Yes, a filtered data set can be used as the basis for a crosstab. Simply click on the Crosstab tab and select the crosstab question and questions to be crosstabbed (see section below). The crosstab will be applied only to the filtered data set.

FTB06 Can I generate a report (Excel or PDF) of my filtered data?

At the top of the ANALYSIS tab interface with an active filter applied are two reporting options: DOWNLOAD AS EXCEL and CREATE PDF. DOWNLOAD AS EXCEL brings up a configuration tool: you are asked to choose what pages to include, how nett/gross figures are to be shown, and whether to include sample sizes. The default selects all pages, and the data is shown as in the interface. Click "Continue" and the Excel file will be generated. CREATE PDF will generate another button (OPEN PDF VERSION) once the download version has been built. Click on the button and the PDF can be downloaded and viewed.

FTB07 How do I undo a filter, to get back to the full data set?

A filtered analysis report is clearly labelled with an ACTIVE FILTER statement in brown at the top of the new analysis. There is a CLEAR FILTER option at right, if you want to undo this filter and return to a full analysis data set.

FTB08 Can I filter on a Date Picker question?

Yes, you are able to use a Date Picker (DP) question to filter the answers based on date ranges. To do this, click the Filter tab in the Analysis of Responses interface, then select the filter question from the scrollable list of questions in your survey. Then you can choose the date range by selecting start and end dates from the two calendar pop-ups. Please note that the calendars initially default to the date you are using the analysis tool. So be aware that if you are using the "Date within a range" type of DP question, the tool will not pre-select the dates defining that range. Once done, click the "Apply filter" button.

Back to FAQs list