Data Access: Difference between revisions

From CNI Wiki
Jump to navigation Jump to search
imported>Rfbowen
Created page with "For the time being, dirmonitor and pfilemonitor are the two ever-running processes that manage moving data from cnimr to cnirt in an organized format. Should data stop showing u..."
 
imported>Lmperry
No edit summary
 
(52 intermediate revisions by 4 users not shown)
Line 1: Line 1:
For the time being, dirmonitor and pfilemonitor are the two ever-running processes that manage moving data from cnimr to cnirt in an organized format.
The CNI uses [https://flywheel.io Flywheel] for data management and access. Please see the [[ Flywheel | Flywheel ]] page for more information regarding data access via Flywheel.


Should data stop showing up at any time, a variety of things could have been to blame.  Perhaps the mount of the pfile or dicom directories reset or is absent, or someone may have reset the scanner (or maybe even cnirt).
= Data Sharing =
This section describes the way in which data can be shared among researchers.


To check if dirmon is running, try:
== IRB Considerations ==
ps aux | grep dirmon


You should see something like:
Before data can be shared across researchers the principal investigator responsible for the original data should make sure that provisions are in place within the approved IRB protocol that allow data sharing and assure that all requirements set forth in the protocol regarding data sharing are met.
cni      31446  6.8 29.3 3769888 3616544 ?    Sl  May09 200:00 /usr/bin/python ./dirmonitor.py


To check if pfilemon is running, try:
== Sharing data within the Stanford community ==
ps aux | grep pfilemon
Those seeking to gain access to data should FIRST contact the Stanford PI who is responsible for the data to request access. ''Requests should be made between PIs.''<br>
'''Persons seeking the data (PI or Lab Manager):'''
<ol>
# Find the data to be shared and note the experiment name, subject code, and session numbers.
# Contact the principal investigator and officially ask for the data to be shared. ''Contact should be between PIs.''
# Once permission is granted you can log into [https://cni.flywheel.io Flywheel] and download the data.
</ol>
'''The persons responsible for the data (PI or Lab Manager):'''
<ol>
# Assure that the IRB protocol under which the data were collected allows for data sharing.
# Log into [https://cni.flywheel.io Flywheel]
</ol>


You should see something like:
== Sharing data with collaborators outside of Stanford ==
cni      15878 97.2  0.0  41548  8648 ?        Rl  12:45 350:59 /usr/bin/python ./pfilemonitor.py
Collaborators seeking to gain access to data should FIRST contact the Stanford PI who is responsible for the data to request access. If the PI agrees to share their data, then the collaborator and PI should do the following steps.


Pfiles are located on the mount:
'''Outside collaborators'''
/net/cnimr/export/home/signa/research/mrraw/
<ol>
<li>Set up a SUNetID by visiting [http://accounts.stanford.edu Stanford Accounts] and choosing 'Create' -> 'I do not have a university ID' -> 'Continue without University ID'</li>
<li>Follow the steps to create a SUNET ID and pick a password, etc. </li>
:Your SUNETID must:
:*Be 3-8 characters long (lower-case letters and numbers only)
:*Start with a letter
:*We recommend: ''FirstinitialLastInstitution'' (e.g.: For Michael Perry @ Stanford sunetid = '''mperrysu''').
:*For more info regarding SUNET IDs: http://itservices.stanford.edu/service/accounts/sunetids


Dicoms are located on the mount:
<li> Once the SUNET ID is created, email your SUNET ID the collaborating Stanford PI; he/she must give you permission to access the data.</li>
/net/cnimr/export/home1/sdc_image_pool/images
<li> After they have confirmed that they have granted you permission navigate to the Flywheel interface, find the experiment with the data and 'Download' those data </li>
</ol>


If you can ls both of those, you're in good shape.


Assuming you want to reset whatever happens to be not working (be it dirmon or pfilemon), use a killall and re-initialize it.
'''Stanford PI'''
 
<ol>
If you aren't getting dicoms/niftis try:
# After your collaborator has requested a SUNET ID, sponsor his/her account by visiting [http://sponsorship.stanford.edu the sponsorship page], entering the SUNET ID and following the prompts to sponsor a free account.  
killall -9 dirmonitor.py
# Go to the NIMS database interface and choose -> 'Manage Experiments'
/home/cni/dirmonitor/dirmonitor.py &
# Find the SUNET ID of your collaborator and drag it to the experiment containing the data you wish to share.
 
# A popup will appear allowing you to choose the access level you wish to grant your collaborator.  We suggest you choose read-only or anon-read.
If you aren't getting pfiles try:
</ol>
killall -9 pfilemonitor.py
/home/cni/dirmonitor/pfilemonitor.py

Latest revision as of 23:16, 4 December 2019

The CNI uses Flywheel for data management and access. Please see the Flywheel page for more information regarding data access via Flywheel.

Data Sharing

This section describes the way in which data can be shared among researchers.

IRB Considerations

Before data can be shared across researchers the principal investigator responsible for the original data should make sure that provisions are in place within the approved IRB protocol that allow data sharing and assure that all requirements set forth in the protocol regarding data sharing are met.

Sharing data within the Stanford community

Those seeking to gain access to data should FIRST contact the Stanford PI who is responsible for the data to request access. Requests should be made between PIs.
Persons seeking the data (PI or Lab Manager):

    1. Find the data to be shared and note the experiment name, subject code, and session numbers.
    2. Contact the principal investigator and officially ask for the data to be shared. Contact should be between PIs.
    3. Once permission is granted you can log into Flywheel and download the data.

The persons responsible for the data (PI or Lab Manager):

    1. Assure that the IRB protocol under which the data were collected allows for data sharing.
    2. Log into Flywheel

Sharing data with collaborators outside of Stanford

Collaborators seeking to gain access to data should FIRST contact the Stanford PI who is responsible for the data to request access. If the PI agrees to share their data, then the collaborator and PI should do the following steps.

Outside collaborators

  1. Set up a SUNetID by visiting Stanford Accounts and choosing 'Create' -> 'I do not have a university ID' -> 'Continue without University ID'
  2. Follow the steps to create a SUNET ID and pick a password, etc.
    3. Your SUNETID must:
  3. Once the SUNET ID is created, email your SUNET ID the collaborating Stanford PI; he/she must give you permission to access the data.
  4. After they have confirmed that they have granted you permission navigate to the Flywheel interface, find the experiment with the data and 'Download' those data


Stanford PI

    1. After your collaborator has requested a SUNET ID, sponsor his/her account by visiting the sponsorship page, entering the SUNET ID and following the prompts to sponsor a free account.
    2. Go to the NIMS database interface and choose -> 'Manage Experiments'
    3. Find the SUNET ID of your collaborator and drag it to the experiment containing the data you wish to share.
    4. A popup will appear allowing you to choose the access level you wish to grant your collaborator. We suggest you choose read-only or anon-read.
Retrieved from "http://cni.su.domains/wiki/index.php?title=Data_Access&oldid=1609"