Articles

Creating your custom Ghibli Text-to-Image model
Anas Amchaar, Abdellah Oumida, Mohammed Sbaihi, Abdeljalil Elmajjodi

AtlasIA

While Ghibli-style AI-generated images have become a global trend, we're taking a unique approach by creating something more culturally meaningful. We've developed a specialized Text-to-Image model fine-tuned from the Flux.1-dev diffusion model using LoRA, trained on a carefully curated dataset that celebrates Moroccan heritage.

Read on AtlasIA or on HF Blogs
1st May 2025
Fine-Tuning ModernBERT for Classification — Single or Multi-GPU with PyTorch & Accelerate
Mohammed Sbaihi, Abdellah Oumida

lemon42-ai

A practical guide to fine-tuning ModernBERT on any text classification task using PyTorch and Hugging Face Accelerate. Whether you're training on a single GPU or scaling up to multiple GPUs, this tutorial walks you through the full process—with clean, well-explained code and tips for efficient multi-GPU training. Read More
February 2025
Code-Aware Tokenization: ModernBERT
Mohammed Sbaihi
In code related tasks (e.g, Code Search), it is important to choose a model that has "code-aware" tokenization (i.e. common code keywords/operators etc are kept as a single token). This article presents a way to evaluate this tokenization feature. It also shows the results of three encoder-only models: BERT, CodeBERT & ModernBERT. Read Blog
January 2025