Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/source/explore_analyze/find_data.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Find data

Raw assets uploaded from platforms at AIND are run through automated pipelines that produce derived assets. You can find these assets by performing a query on our metadata database using your project name and other fields unique to your experiment. **All analyses at AIND should begin with a query that returns a group of data assets, filtered by passing quality control**.
Analysis scripts should find assets using queries on our metadata database using your project name and other fields unique to your experiment. **All analyses at AIND should begin with a query that returns a group of data assets, filtered by passing quality control**.

Some fields that are commonly used to filter assets:

Expand All @@ -9,11 +9,11 @@ Some fields that are commonly used to filter assets:
- `data_description.modalities.abbreviation`
- `subject.subject_id`
- `acquisition.acquisition_start_time`
- `quality_control.status` and `quality_control.metrics.status_history`
- `acquisition.acquisition_type`: this is the primary string that should differentiate acquisitions within the same project
- `quality_control.status`

You may also find it useful to tag your data with custom strings at the time of upload. These tags will make it easy to find cluster your data into different subsets.
You may also find it useful to tag your data with custom strings at the time of upload. These tags will make it easy to cluster your data into different subsets.

- `acquisition.acquisition_type`: this is the primary string that should differentiate acquisitions within the same project
- `data_description.tags`: this is a list of strings you can use to cluster assets by things that aren't well represented in the metadata.

## Querying the metadata database
Expand Down
29 changes: 22 additions & 7 deletions docs/source/explore_analyze/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,19 +4,34 @@ orphan: true

# Explore, QC & analyze

## I want to...
Raw assets uploaded from platforms at AIND are run through automated pipelines that produce derived assets. You can explore these assets through the [Data Portal](https://data.allenneuraldynamics.org/assets).

[Quality control my processed data assets](quality_control.md) before starting analysis.
The Data Portal exposes a range of views tailored to different slices of the data:

- The [**Assets**](https://data.allenneuraldynamics.org/assets) view is your entry point into all data assets acquired in Neural Dynamics.
- [**Subject**](https://data.allenneuraldynamics.org/subject) views let you explore the history of an experimental subject from birth through surgical procedures, data acquisitions, perfusion, etc. Clicking into individual events pulls up the detailed metadata about that event as well as interactive viewers.
- [**Project**](https://data.allenneuraldynamics.org/project) views show data acquisitions for each subject within a project, and can be used to identify the modality or behavior curriculum stage for each acquisition.

There are also Platform dashboards for each of the major platforms in Neural Dynamics:

[Find data](find_data.md) based on its stored metadata.
| Platform | Dashboard | Internal Site |
| -- | -- | -- |
| SmartSPIM | [Dashboard](https://data.allenneuraldynamics.org/smartspim) | [Internal Site](https://alleninstitute.sharepoint.com/sites/NeuralDynamics/SitePages/SmartSPIM-Platform.aspx) |
| Fiber Photometry | [Dashboard](https://data.allenneuraldynamics.org/fiber_photometry) | [Internal site](https://alleninstitute.sharepoint.com/sites/NeuralDynamics/SitePages/Fiber-Photometry-Platform.aspx) |
| Dynamic Foraging | [Dashboard](https://data.allenneuraldynamics.org/dynamic_foraging)| |
| VR Foraging | [Dashboard](https://data.allenneuraldynamics.org/vr_foraging) | |

Learn [](co_best_practices.md)
## I want to...

[Quality control my processed data assets](quality_control.md) before starting analysis.

Learn about different approaches to [analyze data](analyze_data.md) in the cloud:
[Find and query data](find_data.md) based on its stored metadata.

[Automate my analysis](analyze_data.md#analysis-framework) using the Analysis Framework.
[Learn about different approaches to analyze data](analyze_data.md) in the cloud.

[Explore custom tools and apps](analyze_data.md#custom-tools) for annotation and data exploration.
- [Learn about Code Ocean](co_best_practices.md) best practices.
- [Automate my analysis](analyze_data.md#analysis-framework) using the Analysis Framework.
- [Explore custom tools and apps](analyze_data.md#custom-tools) for annotation and data exploration.

[Find outreach events](outreach.md).

Expand Down
8 changes: 4 additions & 4 deletions docs/source/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ Follow these links to request access to:
[Data organization](policies_practices/data_organization.md), [data governance](policies_practices/data_governance.md), [software practices](policies_practices/software_practices.md), or [visualize how our software and systems interact](aind/diagrams.md).

```{toctree}
:maxdepth: 1
:maxdepth: 2
:hidden:
:caption: Acquire, upload & process

Expand All @@ -48,7 +48,7 @@ acquire_upload/process_data
```

```{toctree}
:maxdepth: 1
:maxdepth: 2
:hidden:
:caption: Explore, QC & analyze

Expand All @@ -61,7 +61,7 @@ explore_analyze/outreach
```

```{toctree}
:maxdepth: 1
:maxdepth: 2
:hidden:
:caption: Policies & practices

Expand All @@ -76,7 +76,7 @@ policies_practices/docs
```

```{toctree}
:maxdepth: 1
:maxdepth: 2
:hidden:
:caption: AIND Resources

Expand Down