Difference between revisions of "AI Help"

From UFRC
Jump to navigation Jump to search
 
(33 intermediate revisions by 5 users not shown)
Line 4: Line 4:
 
   |}
 
   |}
 
== New User's Guide ==
 
== New User's Guide ==
For new users on HiPerGator, please read '''[[Getting Started]]''' to become familiar with the HiPerGator system and take '''[[New user training]]''' with step-by-step instructions on how to use HiPerGator.  
+
For new users on HiPerGator, please read [[Getting Started]] to become familiar with the HiPerGator system and take [[New user training]] with step-by-step instructions on how to use HiPerGator.  
  
'''[[AI Education and Training]]''' provides learning materials and training videos on various AI topics. '''[[Jupyter_Notebooks#JupyterHub | JupyterHub]]''' and '''[[Jupyter Notebooks]]''' on HiPerGator are popular platforms for developing and running AI programs.
+
[[AI Education and Training]] provides learning materials and training videos on various AI topics. [[Jupyter_Notebooks#JupyterHub | JupyterHub]] and [[Jupyter Notebooks]] on HiPerGator are popular platforms for developing and running AI programs.
  
'''AI Computing Resources''': [https://www.rc.ufl.edu/get-started/hipergator/ '''HiPerGator''' and '''HiPerGator AI'''] provide world class computing infrastructure for conducting AI research and building AI applications. To purchase resource allocations, please refer to [https://www.rc.ufl.edu/get-started/purchase-request/ Purchase Request]. For computing server features and GPU access, please visit '''[[Available Node Features]]''' adn '''[[GPU Access]]'''.
+
AI Computing Resources: [https://www.rc.ufl.edu/get-started/hipergator/ HiPerGator and HiPerGator AI] provide world class computing infrastructure for conducting AI research and building AI applications. To purchase resource allocations, please refer to [https://www.rc.ufl.edu/get-started/purchase-request/ Purchase Request]. For computing server features and GPU access, please visit [[Available Node Features]] and [[GPU Access]].
  
== AI Frameworks ==
+
== AI Frameworks and Tools ==
AI frameworks provide building blocks for designing and training machine learning and deep learning models. The following AI frameworks are available on HiPerGator.
 
  
==== PyTorch====
+
=== General AI Frameworks===
'''[[PyTorch]]''' is a deep learning framework developed by Facebook AI Research Lab and has interfaces for Python, Java, and C++, is most commonly used with Python. It supports training on both GPU and CPUs, as well as distributed training and multi-GPU models.
 
  
==== Tensorflow/Keras ====
+
AI frameworks provide building blocks for designing and training machine learning and deep learning models. The following AI frameworks are available on HiPerGator.  
*'''[[TensorFlow]]''' is an open-source AI framework/platform developed by the Google Brain team. [https://keras.io/ Keras] is an open-source neural network library that runs on top of TensorFlow. With TensorFlow 2.0, the Keras API has been integrated in TensorFlow's core library and serves as a high-level Python interface for TensorFlow. TensorFlow supports both GPU and CPUs, as well as multi-GPU and distributed training. APIs are available for Python, Java, Go and C++. See our [[TensorFlow|TensorFlow quickstart page]] for help getting started using TensorFlow on HiPerGator.
 
  
*'''[[Tensorboard]]''' is a visualization tool for monitoring neural network training.
+
*'''[[PyTorch]]''' is a deep learning framework developed by Facebook AI Research Lab and has interfaces for Python, Java, and C++, which is most commonly used with Python. It supports training on both GPU and CPUs, as well as distributed training and multi-GPU models.
  
==== Sci-kit Learn ====
+
*'''[[TensorFlow]]''' is an open-source AI framework/platform developed by the Google Brain team. [https://keras.io/ Keras] is an open-source neural network library that runs on top of TensorFlow. With TensorFlow 2.0, the Keras API has been integrated into TensorFlow's core library and serves as a high-level Python interface for TensorFlow. TensorFlow supports both GPU and CPUs, as well as multi-GPU and distributed training.  
[https://scikit-learn.org/stable/ Sci-kit learn] is a Python library for machine learning and statistical modeling. It is available in many of the [[Python]] modules on HiPerGator.
 
  
==== MATLAB ====
+
*''' [[Tensorboard]]''' is a visualization tool for monitoring neural network training.
'''[[Matlab]]''' provides convenient toolboxes for machine learning, deep learning, computer vision, and automatic driving, which are supported on both CPUs and GPUs.
 
  
==== Fastai ====
+
*[https://scikit-learn.org/stable/ '''Sci-kit learn'''] is a Python library for machine learning and statistical modeling. It is available in many of the [[Python]] modules on HiPerGator.
'''[[Fastai]]''' simplifies training fast and accurate neural nets using modern best practices. It can be used without any installation by using [https://colab.research.google.com Google Colab].
 
  
==== Triton ====
+
*'''[[Matlab]]''' provides convenient toolboxes for machine learning, deep learning, computer vision, and automatic driving, which are supported on both CPUs and GPUs.
'''[[TRITONSERVER|Triton]]''' Nvidia Triton Inference Server provides a cloud and edge inferencing solution optimized for both CPUs and GPUs. Triton supports an HTTP/REST and GRPC protocol that allows remote clients to request inferencing for any model being managed by the server.
 
  
== AI Software for Specific Domains ==
+
*'''[[Rapidsai|RAPIDS AI]]''' is a suite of CUDA-enabled open-source software libraries and APIs by NVIDIA. It accelerates end-to-end data science pipelines by providing a familiar dataframe API. It supports machine learning integration without the typical serialization costs and enables multi-node, multi-GPU deployments for faster processing of large datasets.
A comprehensive software library, toolkits, frameworks, and packages for big data and AI research. The following domain-specific AI software spacks are available on HiPerGator:
 
  
=== Data Science Platform ===
+
*'''[[Fastai]]''' simplifies training fast and accurate neural nets using modern best practices. It can be used without any installation by using [https://colab.research.google.com Google Colab].
  
'''[[Data Science Platform]]''' is the practice of using mathematics, programming, analytics, AI, and machine learning to discover valuable insights within large data sets.  
+
*'''[[TRITONSERVER|Triton]]''' is a Nvidia Inference Server that provides a cloud and edge inferencing solution optimized for both CPUs and GPUs. Triton supports an HTTP/REST and GRPC protocol that allows remote clients to request inferencing for any model being managed by the server.
  
=== NLP ===
+
=== AI Software for Specific Domains ===  
  
Natural Language Processing '''[[Nlp|NLP]]''' page describes the collection of Natural language processing software on HiperGator, such as Nemo, Bionemo, Llama, Mistral AI, and Gemma LLMs. NLP is a part of AI that helps computers understand and respond to human language. It's used in things like voice assistants, chatbots, and translation apps.
+
Comprehensive software libraries, toolkits, and frameworks for big data and AI research are available on HiPerGator:
  
=== Computer Vision ===
+
'''[[Data Science Platform]]''' is the practice of using mathematics, programming, analytics, AI, and machine learning to discover valuable insights within large data sets.  
 
 
The '''[[Computer Vision]]''' page describes the software environment on HiPerGator for image and video processing.
 
  
=== Health Care and Life Science ===
+
'''[[Nlp|Natural Language Processing]]''' page describes a collection of Natural Language Processing software on HiperGator, such as Nemo, BioNemo, Llama2, Llama3, Mistral AI, and Gemma LLMs. NLP is a part of AI that helps computers understand and respond to human language. It's used in things like voice assistants, chatbots, and translation apps.
  
The '''[[Healthcare and Life Sciences]]''' page describes the collection of Healthcare and Life Sciences software for medical image analysis, disease detection, and genomic data interpretation on HiperGator, such as AlphaFold, Bionemo, Clara Parabricks, and MONAI.
+
'''[[Computer Vision]]''' page describes the software, tools, and environments on HiPerGator for image and video processing.
  
=== Simulation and Modeling ===
+
'''[[Healthcare and Life Sciences]]''' page describes the collection of Healthcare and Life Sciences software for medical image analysis, disease detection, and genomic data interpretation on HiperGator AI, such as AlphaFold, BioNemo, Clara Parabricks, and MONAI.
  
HiperGator supports some advanced simulation tools, including NVIDIA Modulus and Omniverse, to predict the behavior of systems within a real-world scenario.
+
'''Simulation and Modeling''' HiPerGator supports advanced simulation tools, including NVIDIA Modulus and Omniverse, to predict the behavior of systems within a real-world scenario.
  
*Nvidia '''[[Modulus]]''' is a neural network framework that blends the power of physics in the form of governing partial differential equations (PDEs) with data to build high-fidelity, parameterized surrogate models with near-real-time latency. Examples of running modulus on HiperGator are available on /data/ai/examples/pinn/modulus or [[AI_Examples]].
+
*Nvidia '''[[Modulus]]''' is a neural network framework that blends the power of physics in the form of governing partial differential equations (PDEs) with data to build high-fidelity, parameterized surrogate models with near-real-time latency. Examples of running modulus on HiperGator are available on /data/ai/examples/pinn/modulus or [[AI_Examples]].
  
 
*Nvidia '''[[Omniverse]]''' provides a platform for virtual collaboration and real-time photorealistic simulation. It allows developers, designers, and engineers to collaborate in simulated environments, facilitating the creation of complex simulations that integrate physical accuracy and visual fidelity.
 
*Nvidia '''[[Omniverse]]''' provides a platform for virtual collaboration and real-time photorealistic simulation. It allows developers, designers, and engineers to collaborate in simulated environments, facilitating the creation of complex simulations that integrate physical accuracy and visual fidelity.
  
 
==AI Reference Datasets==
 
==AI Reference Datasets==
A variety of reference machine learning and AI datasets are located in <code>/data/ai/ref-data</code>. Browse the '''[[AI Reference Datasets|catalog of all available AI reference datasets]]''' to learn more.
+
A variety of AI reference datasets are located in <code>/data/ai/ref-data</code>. Browse the '''[[AI Reference Datasets|catalog of all available AI reference datasets]]''' to learn more.
  
 
==AI Examples ==
 
==AI Examples ==
A suite of short examples is provided on using the software stack on HiPerGator to do different tasks in imaging and NLP, located in <code>/data/ai/examples</code>. Browse the '''[[AI Examples|catalog of all available AI examples]]''' to learn more.
+
A suite of short examples is provided using the software stack on HiPerGator to do different tasks in various AI domains, located in <code>/data/ai/examples</code>. Browse the '''[[AI Examples|catalog of all available AI examples]]''' to learn more.
  
 
== AI Benchmarks and Models ==
 
== AI Benchmarks and Models ==
Line 70: Line 60:
  
 
== AI Zoom Support ==
 
== AI Zoom Support ==
You can schedule a Zoom call with an AI support member. For details see [https://help.rc.ufl.edu/doc/Remote_Support Remote Support]
+
You can schedule a Zoom call with an AI support staff member. For details see [https://help.rc.ufl.edu/doc/Remote_Support Remote Support]

Latest revision as of 19:48, 15 July 2024

New User's Guide

For new users on HiPerGator, please read Getting Started to become familiar with the HiPerGator system and take New user training with step-by-step instructions on how to use HiPerGator.

AI Education and Training provides learning materials and training videos on various AI topics. JupyterHub and Jupyter Notebooks on HiPerGator are popular platforms for developing and running AI programs.

AI Computing Resources: HiPerGator and HiPerGator AI provide world class computing infrastructure for conducting AI research and building AI applications. To purchase resource allocations, please refer to Purchase Request. For computing server features and GPU access, please visit Available Node Features and GPU Access.

AI Frameworks and Tools

General AI Frameworks

AI frameworks provide building blocks for designing and training machine learning and deep learning models. The following AI frameworks are available on HiPerGator.

  • PyTorch is a deep learning framework developed by Facebook AI Research Lab and has interfaces for Python, Java, and C++, which is most commonly used with Python. It supports training on both GPU and CPUs, as well as distributed training and multi-GPU models.
  • TensorFlow is an open-source AI framework/platform developed by the Google Brain team. Keras is an open-source neural network library that runs on top of TensorFlow. With TensorFlow 2.0, the Keras API has been integrated into TensorFlow's core library and serves as a high-level Python interface for TensorFlow. TensorFlow supports both GPU and CPUs, as well as multi-GPU and distributed training.
  • Tensorboard is a visualization tool for monitoring neural network training.
  • Sci-kit learn is a Python library for machine learning and statistical modeling. It is available in many of the Python modules on HiPerGator.
  • Matlab provides convenient toolboxes for machine learning, deep learning, computer vision, and automatic driving, which are supported on both CPUs and GPUs.
  • RAPIDS AI is a suite of CUDA-enabled open-source software libraries and APIs by NVIDIA. It accelerates end-to-end data science pipelines by providing a familiar dataframe API. It supports machine learning integration without the typical serialization costs and enables multi-node, multi-GPU deployments for faster processing of large datasets.
  • Fastai simplifies training fast and accurate neural nets using modern best practices. It can be used without any installation by using Google Colab.
  • Triton is a Nvidia Inference Server that provides a cloud and edge inferencing solution optimized for both CPUs and GPUs. Triton supports an HTTP/REST and GRPC protocol that allows remote clients to request inferencing for any model being managed by the server.

AI Software for Specific Domains

Comprehensive software libraries, toolkits, and frameworks for big data and AI research are available on HiPerGator:

Data Science Platform is the practice of using mathematics, programming, analytics, AI, and machine learning to discover valuable insights within large data sets.

Natural Language Processing page describes a collection of Natural Language Processing software on HiperGator, such as Nemo, BioNemo, Llama2, Llama3, Mistral AI, and Gemma LLMs. NLP is a part of AI that helps computers understand and respond to human language. It's used in things like voice assistants, chatbots, and translation apps.

Computer Vision page describes the software, tools, and environments on HiPerGator for image and video processing.

Healthcare and Life Sciences page describes the collection of Healthcare and Life Sciences software for medical image analysis, disease detection, and genomic data interpretation on HiperGator AI, such as AlphaFold, BioNemo, Clara Parabricks, and MONAI.

Simulation and Modeling HiPerGator supports advanced simulation tools, including NVIDIA Modulus and Omniverse, to predict the behavior of systems within a real-world scenario.

  • Nvidia Modulus is a neural network framework that blends the power of physics in the form of governing partial differential equations (PDEs) with data to build high-fidelity, parameterized surrogate models with near-real-time latency. Examples of running modulus on HiperGator are available on /data/ai/examples/pinn/modulus or AI_Examples.
  • Nvidia Omniverse provides a platform for virtual collaboration and real-time photorealistic simulation. It allows developers, designers, and engineers to collaborate in simulated environments, facilitating the creation of complex simulations that integrate physical accuracy and visual fidelity.

AI Reference Datasets

A variety of AI reference datasets are located in /data/ai/ref-data. Browse the catalog of all available AI reference datasets to learn more.

AI Examples

A suite of short examples is provided using the software stack on HiPerGator to do different tasks in various AI domains, located in /data/ai/examples. Browse the catalog of all available AI examples to learn more.

AI Benchmarks and Models

Commonly used benchmarks and models are provided on HiPerGator at /data/ai/benchmarks and /data/ai/models. Browse the catalog of all available AI models to learn more.

AI Zoom Support

You can schedule a Zoom call with an AI support staff member. For details see Remote Support