Difference between revisions of "Reference Data"

From UFRC
Jump to navigation Jump to search
(Created page with "UFRC maintains a repository of reference data that can be accessed by all HiPerGator users. The primary purposes of this repository are convenience and efficient use of filesy...")
 
(19 intermediate revisions by 5 users not shown)
Line 1: Line 1:
UFRC maintains a repository of reference data that can be accessed by all HiPerGator users. The primary purposes of this repository are convenience and efficient use of filesystem space. We download and or build reference datasets and configure applications we make available through the [[Environment Modules System]] to automatically make use of the available reference data. We also would like to avoid seeing multiple users download many copies of the same large reference datasets that are of general interest to our clients. Having UFRC host common reference data also means that a research group does not have to use their Blue or Orange quota to host a redundant copy of common reference data.
+
[[Category:Reference Data]]__NOTOC__
 +
UFRC maintains a repository of reference data that can be accessed by all HiPerGator users. The primary purposes of this repository are researcher convenience, efficient use of filesystem space, and cost savings. We are happy to download and build reference datasets and configure applications installed on HiPerGator to automatically make use of the available reference data. Having UFRC host common reference data means that a research group does not have to use their Blue or Orange quota to host redundant copies of common reference data.
  
 
Use [https://support.rc.ufl.edu https://support.rc.ufl.edu] to request either addition of reference data or to ask for an addition of a directory that you can put reference data into for shared use.
 
Use [https://support.rc.ufl.edu https://support.rc.ufl.edu] to request either addition of reference data or to ask for an addition of a directory that you can put reference data into for shared use.
Line 9: Line 10:
 
* [[SnpEff Databases]]
 
* [[SnpEff Databases]]
  
==Genome Data==
+
Many other application specific references are located in <code>/data/reference</code>.
* 3k Rice genomes - reference/genomes/rice3k - from [http://gigadb.org/dataset/200001 http://gigadb.org/dataset/200001], downloaded from SRA.
+
 
 +
==Raw Genomic Data==
 +
* [http://gigadb.org/dataset/200001 3k Rice genomes] - /data/reference/genomes/rice3k, fastq format
 +
* [https://www.internationalgenome.org/data/ 1000 Genomes Data Releases] - /data/reference/1000genomes
 +
* [https://www.girinst.org/repbase/ RepBase] - /data/reference/repbase
 +
* [https://bfd.mmseqs.com/ BFD] - /data/reference/bfd
 +
* [https://www.uniprot.org/help/uniref Uniref30] - /data/reference/uniref30
 +
* [https://www.uniprot.org/help/uniref Uniref90] - /data/reference/uniref90
 +
* [https://www.ebi.ac.uk/metagenomics/ MGnify] - /data/reference/mgnify
 +
* [http://wwwuser.gwdg.de/~compbiol/data/hhsuite/databases/hhsuite_dbs/ pdb70] - /data/reference/pdb70
 +
* Various other references - /data/reference/fasta
 +
 
 +
==AI Reference Datasets and Models==
 +
A variety of reference machine learning and AI datasets are located in <code>/data/ai</code>. You may need to use the full path /blue/data/ai for applications to find the files. Browse the [[AI Reference Datasets|catalog of all available AI reference datasets]] to learn more.
 +
 
 +
==Repbase Sequencing Data==
 +
[https://www.girinst.org/about/repbase.html Repbase] is 'a database of representative repetitive sequences from eukaryotic species. Repbase is being used worldwide as the reference standard for annotating the presence of repetitive DNA in genomic data.'
 +
 
 +
A university-wide license for Repbase data is currently in effect for the University of Florida. It will expire on March 22nd, 2022.
 +
 
 +
Repbase data can be [https://www.girinst.org/server/RepBase/index.php downloaded] from UF IP Addresses for use on local computers.
 +
 
 +
We maintain copies of Repbase releases in sub-directories under /data/reference/repbase on HiPerGator and also configure RepeatMasker and Maker applications to use Repbase data automatically.

Revision as of 22:34, 24 October 2022

UFRC maintains a repository of reference data that can be accessed by all HiPerGator users. The primary purposes of this repository are researcher convenience, efficient use of filesystem space, and cost savings. We are happy to download and build reference datasets and configure applications installed on HiPerGator to automatically make use of the available reference data. Having UFRC host common reference data means that a research group does not have to use their Blue or Orange quota to host redundant copies of common reference data.

Use https://support.rc.ufl.edu to request either addition of reference data or to ask for an addition of a directory that you can put reference data into for shared use.

The following is not an exhaustive list of the hosted reference data. If an existing reference is missing from the list below please let us know and we will update the list.

Application-Specific Data

Many other application specific references are located in /data/reference.

Raw Genomic Data

AI Reference Datasets and Models

A variety of reference machine learning and AI datasets are located in /data/ai. You may need to use the full path /blue/data/ai for applications to find the files. Browse the catalog of all available AI reference datasets to learn more.

Repbase Sequencing Data

Repbase is 'a database of representative repetitive sequences from eukaryotic species. Repbase is being used worldwide as the reference standard for annotating the presence of repetitive DNA in genomic data.'

A university-wide license for Repbase data is currently in effect for the University of Florida. It will expire on March 22nd, 2022.

Repbase data can be downloaded from UF IP Addresses for use on local computers.

We maintain copies of Repbase releases in sub-directories under /data/reference/repbase on HiPerGator and also configure RepeatMasker and Maker applications to use Repbase data automatically.