Data Parallelism & Model Parallelism
Kurious Fox Let’s break down the two concept and how to implement it. The Difference: Data Parallelism vs. Model Parallelism…
Programming
How to change working directory in Colab
In Google Colab, cd changes the directory only within the current cell. However, Colab resets the working directory…
Pip package installation specifications and Error fixed: pip install -U ‘accelerate>=0.26.0’ ERROR: Invalid requirement: “‘accelerate”: Expected package name at the start of dependency specifier ‘accelerate
Error detected: The error suggests that the package name isn’t correctly formatted. Try using double quotes or removing…
Google Vertex AI for Streamlining AI Development and model fine – tuning
Google Vertex AI is a comprehensive AI platform by Google Cloud aimed at streamlining the development of AI…
Effective GPU Monitoring in Slurm Environments
Monitoring GPU usage within an SSH-accessed Slurm environment requires a combination of Slurm commands and GPU monitoring utilities,…
How to use AWS CLI to generate SESSION_TOKEN
Setting things up for the first time may not be an easy task. If you are unlucky, you…
Step-by-Step Guide to Clone and Write repos with GitHub Personal Access Tokens
GitHub’s fine-grained personal access tokens allow precise control over repository access. Here’s a step-by-step guide to generate and…
How to Check GPU Access in SLURM Clusters
To determine the number of GPUs your account can access in a SLURM-managed cluster, follow these steps: Check…
Fixed: OSError: You are trying to access a gated repo. Make sure to have access to it at https://huggingface.co….
OSError: You are trying to access a gated repo. Make sure to have access to it at https://huggingface.co/google/gemma-3-27b-it.…
SSH and SLURM basic and how to send a notification email upon job completion
How to run – basic To run a .sh file with a specific environment using SLURM, you can…