Rule: Demo-data-exploration
loading x elements...

Name: Demo-data-exploration

Version: 12

Discussion Thread

NOTE: this Rule has been deleted.

There is a newer version of this Rule.

Creator: floriandietz@elody.com

This starts Rule a major series of tasks, each dependent on each other.

The purpose of this Rule is the initial exploration of the content of a table.

1. Acquire a file from the user through task_obtain_file_from_user.
2. Transform the file into a pickled Pandas DataFrame using task_convert_file_type.
3. Cleanse and analyze the file through task_data_cleansing_and_analysis_for_pandas.
4. Present the results through task_present_table_for_pandas.
5. Perform additional, more complex analyses through task_explore_data_for_pandas.

ID: 172

Created: Jan. 16, 2019, 2:33 p.m.

full definition:

The below is the JSON description of this object.

It is annotated with links to the documentation of each component.

You can hide fields with default values to make things clearer, and copy it to a clipboard to make creating similar Rules and Options easier.

Rule

{ "name" : "Demo-data-exploration", "description" : "This starts Rule a major series of tasks, each dependent on each other.

The purpose of this Rule is the initial exploration of the content of a table.

1. Acquire a file from the user through task_obtain_file_from_user.
2. Transform the file into a pickled Pandas DataFrame using task_convert_file_type.
3. Cleanse and analyze the file through task_data_cleansing_and_analysis_for_pandas.
4. Present the results through task_present_table_for_pandas.
5. Perform additional, more complex analyses through task_explore_data_for_pandas."
, "dependencies" : [

Dependency

{ "symbol" : "demo_data_exploration" }
], "threshold" : 1.0, "trigger" :

Trigger

{ }
, "actions" : [

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-1", "name" : "demo-data-exploration-stage-1", "confidence" : 1000.0, "trigger" :

Trigger

{ }
, "actions" : [

Create a Tag

{ "type" : "create_tag", "var" : "task_1", "symbol" : "task_obtain_file_from_user", "mark_with" : ["signal"] }
,

Create a Tag

{ "type" : "create_tag", "var" : "require_1_1", "symbol" : "require_a_file", "arguments" : [

Variable

{ "type" : "variable", "var" : "task_1" }
], "mark_with" : ["signal"] }
,

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-2", "name" : "demo-data-exploration-stage-2", "confidence" : 1000.0, "trigger" :

Trigger

{ "arguments" : [

Tag filter (for search)

{ "type" : "tag", "equals" : "task_1", "task_is_finished" : true }
,

Tag filter (for search)

{ "type" : "tag", "symbol" : "!provide", "arguments" : { "0" :

Tag filter

{ "type" : "tag", "equals" : "require_1_1" }
, "1" :

File filter

{ "type" : "file", "var" : "file_initial" }
} }
], "deactivate_if" : { "task_1" : ["is_nullified"] } }
, "actions" : [

Create a Tag

{ "type" : "create_tag", "var" : "task_2", "symbol" : "task_convert_file_type", "mark_with" : ["signal"] }
,

Create a Tag

{ "type" : "create_tag", "var" : "require_2_1", "symbol" : "require_format_pickled_pandas_dataframe", "arguments" : [

Variable

{ "type" : "variable", "var" : "task_2" }
,

Variable

{ "type" : "variable", "var" : "file_initial" }
], "mark_with" : ["signal"] }
,

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-3-hotfix-for-file-conversion-task", "name" : "demo-data-exploration-stage-3-hotfix-for-file-conversion-task", "description" : "As of 2019-01-10, the Rules working on task_convert_file_type don't realize when a file doesn't need to be converted because it already has the correct filetype. That only happens when Interact_ask_user_if_they_want_file_conversion is used to create the file. This Option performs that check. Its confidence is set so high that it is practically guaranteed it will run before anything else.", "confidence" : 9999.0, "trigger" :

Trigger

{ "arguments" : [

File filter (for search)

{ "type" : "file", "var" : "fileAlreadyIsPickle", "role" : "optional", "equals" : "file_initial", "name_matches" : "^.*(\\.pickle|\\.pkl)$" }
], "deactivate_if" : { "require_2_1" : ["is_nullified", "is_provided"] } }
, "actions" : [

Conditionally execute actions

{ "type" : "conditional", "if" :

Reference exists Condition

{ "type" : "reference_exists", "exists" : "fileAlreadyIsPickle" }
, "then" : [

Create a Tag

{ "type" : "create_tag", "symbol" : "!provide", "arguments" : [

Variable

{ "type" : "variable", "var" : "require_2_1" }
,

Variable

{ "type" : "variable", "var" : "file_initial" }
] }
] }
] }
,

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-3", "name" : "demo-data-exploration-stage-3", "confidence" : 1000.0, "trigger" :

Trigger

{ "arguments" : [

Tag filter (for search)

{ "type" : "tag", "equals" : "task_2", "task_is_finished" : true }
,

Tag filter (for search)

{ "type" : "tag", "var" : "tmp", "symbol" : "!provide", "arguments" : { "0" :

Tag filter

{ "type" : "tag", "equals" : "require_2_1" }
, "1" :

File filter

{ "type" : "file", "var" : "file_after_type_conversion", "targeted_by" : [

Tag filter (for search)

{ "type" : "tag", "_comment" : "If the file_after_type_conversion is also the file that was targeted by require_2_1, it means the file was not changed by task_2, task_convert_file_type", "var" : "fileIsUnchanged", "role" : "optional", "equals" : "require_2_1" }
] }
} }
], "deactivate_if" : { "task_2" : ["is_nullified"] } }
, "actions" : [

Conditionally execute actions

{ "type" : "conditional", "_comment" : "If the file was changed compared to the one that was uploaded, offer the cleaned version for download.", "if" :

NOT Condition

{ "type" : "not", "not" :

Reference exists Condition

{ "type" : "reference_exists", "exists" : "fileIsUnchanged" }
}
, "then" : [

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-3-offer-download", "name" : "demo-data-exploration-stage-3-offer-download", "confidence" : 1000.0, "trigger" :

Trigger

{ }
, "actions" : [

Create a Message

{ "type" : "create_message", "message_components" : [

Downloadable File

{ "type" : "downloadable_file", "text" : "Download the file after cleaning and converting file types.", "file" :

Variable

{ "type" : "variable", "var" : "file_after_type_conversion" }
}
] }
] }
] }
,

Create a Tag

{ "type" : "create_tag", "var" : "task_3", "symbol" : "task_data_cleansing_and_analysis_for_pandas", "arguments" : [

Variable

{ "type" : "variable", "var" : "file_after_type_conversion" }
], "mark_with" : ["signal"] }
,

Create a Tag

{ "type" : "create_tag", "var" : "require_3_1", "symbol" : "require_open_ended_work", "arguments" : [

Variable

{ "type" : "variable", "var" : "task_3" }
] }
,

Create a Tag

{ "type" : "create_tag", "var" : "theFileInfoTag", "symbol" : "modifiable_file", "arguments" : [

Variable

{ "type" : "variable", "var" : "file_after_type_conversion" }
,

Variable

{ "type" : "variable", "var" : "task_3" }
] }
,

Create a Tag

{ "type" : "create_tag", "symbol" : "current_file", "arguments" : [

Variable

{ "type" : "variable", "var" : "theFileInfoTag" }
,

Variable

{ "type" : "variable", "var" : "file_after_type_conversion" }
] }
,

Create a Message

{ "type" : "create_message", "message_components" : [

Text message component

{ "type" : "text", "text" : "TODO: the rest of Demo-data-exploration, which continues with waiting for the end of task_3 and then triggering task_4.\nAlso, just like above, if the file was changed compared to the one that was cleaned, offer the modified version for download.\nAlso, a request for ratings should be displayed at this point, to rate the data exploration as a whole." }
] }
] }
] }
] }
], "existing_variables" : { "demo-data-exploration-stage-1" :

Variable

{ "type" : "option" }
} }

Rule

{ "name" : "Demo-data-exploration", "description" : "This starts Rule a major series of tasks, each dependent on each other.

The purpose of this Rule is the initial exploration of the content of a table.

1. Acquire a file from the user through task_obtain_file_from_user.
2. Transform the file into a pickled Pandas DataFrame using task_convert_file_type.
3. Cleanse and analyze the file through task_data_cleansing_and_analysis_for_pandas.
4. Present the results through task_present_table_for_pandas.
5. Perform additional, more complex analyses through task_explore_data_for_pandas."
, "dependencies" : [

Dependency

{ "symbol" : "demo_data_exploration", "weight" : 1.0, "comment_filter" : null }
], "threshold" : 1.0, "trigger" :

Trigger

{ "repeat" : "never", "arguments" : [], "deactivate_if" : {} }
, "actions" : [

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-1", "name" : "demo-data-exploration-stage-1", "description" : null, "confidence" : 1000.0, "trigger" :

Trigger

{ "repeat" : "never", "arguments" : [], "deactivate_if" : {} }
, "display" : null, "actions" : [

Create a Tag

{ "type" : "create_tag", "var" : "task_1", "symbol" : "task_obtain_file_from_user", "comment" : null, "weight" : null, "arguments" : [], "mark_with" : ["signal"] }
,

Create a Tag

{ "type" : "create_tag", "var" : "require_1_1", "symbol" : "require_a_file", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "task_1" }
], "mark_with" : ["signal"] }
,

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-2", "name" : "demo-data-exploration-stage-2", "description" : null, "confidence" : 1000.0, "trigger" :

Trigger

{ "repeat" : "never", "arguments" : [

Tag filter (for search)

{ "type" : "tag", "var" : null, "role" : "required", "search_type" : "last", "search_postfilter" : null, "targeted_by" : [], "equals" : "task_1", "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : null, "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : true, "arguments" : {} }
,

Tag filter (for search)

{ "type" : "tag", "var" : null, "role" : "required", "search_type" : "last", "search_postfilter" : null, "targeted_by" : [], "equals" : null, "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : "!provide", "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : null, "arguments" : { "0" :

Tag filter

{ "type" : "tag", "var" : null, "role" : "required", "targeted_by" : [], "equals" : "require_1_1", "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : null, "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : null, "arguments" : {} }
, "1" :

File filter

{ "type" : "file", "var" : "file_initial", "role" : "required", "targeted_by" : [], "equals" : null, "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "name_matches" : null }
} }
], "deactivate_if" : { "task_1" : ["is_nullified"] } }
, "display" : null, "actions" : [

Create a Tag

{ "type" : "create_tag", "var" : "task_2", "symbol" : "task_convert_file_type", "comment" : null, "weight" : null, "arguments" : [], "mark_with" : ["signal"] }
,

Create a Tag

{ "type" : "create_tag", "var" : "require_2_1", "symbol" : "require_format_pickled_pandas_dataframe", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "task_2" }
,

Variable

{ "type" : "variable", "nullable" : false, "var" : "file_initial" }
], "mark_with" : ["signal"] }
,

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-3-hotfix-for-file-conversion-task", "name" : "demo-data-exploration-stage-3-hotfix-for-file-conversion-task", "description" : "As of 2019-01-10, the Rules working on task_convert_file_type don't realize when a file doesn't need to be converted because it already has the correct filetype. That only happens when Interact_ask_user_if_they_want_file_conversion is used to create the file. This Option performs that check. Its confidence is set so high that it is practically guaranteed it will run before anything else.", "confidence" : 9999.0, "trigger" :

Trigger

{ "repeat" : "never", "arguments" : [

File filter (for search)

{ "type" : "file", "var" : "fileAlreadyIsPickle", "role" : "optional", "search_type" : "last", "search_postfilter" : null, "targeted_by" : [], "equals" : "file_initial", "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "name_matches" : "^.*(\\.pickle|\\.pkl)$" }
], "deactivate_if" : { "require_2_1" : ["is_nullified", "is_provided"] } }
, "display" : null, "actions" : [

Conditionally execute actions

{ "type" : "conditional", "if" :

Reference exists Condition

{ "type" : "reference_exists", "exists" : "fileAlreadyIsPickle" }
, "then" : [

Create a Tag

{ "type" : "create_tag", "var" : null, "symbol" : "!provide", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "require_2_1" }
,

Variable

{ "type" : "variable", "nullable" : false, "var" : "file_initial" }
], "mark_with" : [] }
], "else" : [] }
] }
,

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-3", "name" : "demo-data-exploration-stage-3", "description" : null, "confidence" : 1000.0, "trigger" :

Trigger

{ "repeat" : "never", "arguments" : [

Tag filter (for search)

{ "type" : "tag", "var" : null, "role" : "required", "search_type" : "last", "search_postfilter" : null, "targeted_by" : [], "equals" : "task_2", "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : null, "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : true, "arguments" : {} }
,

Tag filter (for search)

{ "type" : "tag", "var" : "tmp", "role" : "required", "search_type" : "last", "search_postfilter" : null, "targeted_by" : [], "equals" : null, "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : "!provide", "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : null, "arguments" : { "0" :

Tag filter

{ "type" : "tag", "var" : null, "role" : "required", "targeted_by" : [], "equals" : "require_2_1", "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : null, "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : null, "arguments" : {} }
, "1" :

File filter

{ "type" : "file", "var" : "file_after_type_conversion", "role" : "required", "targeted_by" : [

Tag filter (for search)

{ "type" : "tag", "_comment" : "If the file_after_type_conversion is also the file that was targeted by require_2_1, it means the file was not changed by task_2, task_convert_file_type", "var" : "fileIsUnchanged", "role" : "optional", "search_type" : "last", "search_postfilter" : null, "targeted_by" : [], "equals" : "require_2_1", "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "symbol" : null, "comment" : null, "comment_contains" : null, "comment_matches" : null, "weight" : null, "min_weight" : null, "max_weight" : null, "nullified" : false, "requirement_is_provided" : null, "task_is_finished" : null, "arguments" : {} }
], "equals" : null, "created_by" : null, "created_earlier_than" : null, "created_in_same_event_as" : null, "created_later_than" : null, "is_reserved" : null, "name_matches" : null }
} }
], "deactivate_if" : { "task_2" : ["is_nullified"] } }
, "display" : null, "actions" : [

Conditionally execute actions

{ "type" : "conditional", "_comment" : "If the file was changed compared to the one that was uploaded, offer the cleaned version for download.", "if" :

NOT Condition

{ "type" : "not", "not" :

Reference exists Condition

{ "type" : "reference_exists", "exists" : "fileIsUnchanged" }
}
, "then" : [

Create an Option

{ "type" : "create_option", "var" : "demo-data-exploration-stage-3-offer-download", "name" : "demo-data-exploration-stage-3-offer-download", "description" : null, "confidence" : 1000.0, "trigger" :

Trigger

{ "repeat" : "never", "arguments" : [], "deactivate_if" : {} }
, "display" : null, "actions" : [

Create a Message

{ "type" : "create_message", "var" : null, "visibility" : "all", "message_components" : [

Downloadable File

{ "type" : "downloadable_file", "scenario_history" : false, "scenario_history_title" : null, "scenario_history_description" : null, "text" : "Download the file after cleaning and converting file types.", "file" :

Variable

{ "type" : "variable", "nullable" : false, "var" : "file_after_type_conversion" }
}
] }
] }
], "else" : [] }
,

Create a Tag

{ "type" : "create_tag", "var" : "task_3", "symbol" : "task_data_cleansing_and_analysis_for_pandas", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "file_after_type_conversion" }
], "mark_with" : ["signal"] }
,

Create a Tag

{ "type" : "create_tag", "var" : "require_3_1", "symbol" : "require_open_ended_work", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "task_3" }
], "mark_with" : [] }
,

Create a Tag

{ "type" : "create_tag", "var" : "theFileInfoTag", "symbol" : "modifiable_file", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "file_after_type_conversion" }
,

Variable

{ "type" : "variable", "nullable" : false, "var" : "task_3" }
], "mark_with" : [] }
,

Create a Tag

{ "type" : "create_tag", "var" : null, "symbol" : "current_file", "comment" : null, "weight" : null, "arguments" : [

Variable

{ "type" : "variable", "nullable" : false, "var" : "theFileInfoTag" }
,

Variable

{ "type" : "variable", "nullable" : false, "var" : "file_after_type_conversion" }
], "mark_with" : [] }
,

Create a Message

{ "type" : "create_message", "var" : null, "visibility" : "all", "message_components" : [

Text message component

{ "type" : "text", "text" : "TODO: the rest of Demo-data-exploration, which continues with waiting for the end of task_3 and then triggering task_4.\nAlso, just like above, if the file was changed compared to the one that was cleaned, offer the modified version for download.\nAlso, a request for ratings should be displayed at this point, to rate the data exploration as a whole." }
] }
] }
] }
] }
], "existing_variables" : { "demo-data-exploration-stage-1" :

Variable

{ "type" : "option", "value" : null }
} }

all versions of this Rule:

Version 26

Version 25 (deleted)

Version 24 (deleted)

Version 23 (deleted)

Version 22 (deleted)

Version 21 (deleted)

Version 20 (deleted)

Version 19 (deleted)

Version 18 (deleted)

Version 17 (deleted)

Version 16 (deleted)

Version 15 (deleted)

Version 14 (deleted)

Version 13 (deleted)

Version 12 (deleted)

Version 11 (deleted)

Version 10 (deleted)

Version 9 (deleted)

Version 8 (deleted)

Version 7 (deleted)

Version 6 (deleted)

Version 5 (deleted)

Version 4 (deleted)

Version 3 (deleted)

Version 2 (deleted)

Version 1 (deleted)