RemyBlog
By role

AI for IT

How IT teams use AI, how to do it well, and what it means for your job. Written for people who keep the systems and laptops working, not people who build models.

345 articles · Updated Nov 13, 2026
A person balances a massive, oversized graphics card with one hand while using their other hand to carefully adjust tiny VRAM settings dials on its side.
Local AI ·

How to Run Clover-35B-A3B-Preview Locally: VRAM and Settings

Run DiffuSpace's Clover-35B-A3B diffusion model locally: about 69 GB of BF16 weights, Transformers 5.19.0 setup, block diffusion defaults, controls and SGLang.

run Clover-35B-A3B locallyClover VRAM requirementsClover SGLang
Tiny figurines inspect the benchmark scores on a giant model card using a magnifying glass.
Local AI ·

Does LFM3-1.7B Match 9B Models on Agent Benchmarks?

LFM3-1.7B is pitched as matching 9B models on agent benchmarks. Here is what the card claims, what hands-on tests showed, and where it fell short.

LFM3 1.7B benchmarksLFM3 vs Qwen3.5 9BLiquid AI LFM3 family
A single computer graphics processing unit featuring an oversized, tactile tuning dial integrated into its cooling shroud.
Local AI ·

How to Fine-Tune LFM3-1.7B With TRL on a Single GPU

Learn how to fine-tune Liquid AI's LFM3-1.7B with TRL using SFT, DPO, GRPO and continued pre-training, and which recipe fits JSON, RAG, tools or new languages.

fine-tune LFM3-1.7BLFM3 TRLGRPO tool calling fine-tuning
A person holds up a massive 100-page document and passes a glowing scanner wand over the pages, pausing to inspect a single failed line.
Local AI ·

How Does Unlimited OCR 2 Score on 100-Page Documents?

Unlimited OCR 2 scores about 77 on a 100-page document test while most rivals fall under 30. How SR-SWA attention works, plus where the model still fails.

Unlimited OCR 2MP Doc BenchMarathon Doc Bench
A computer cursor drags a large selection box across a glass tracking map, instantly highlighting hundreds of glowing location pins.
AI Security & Safety ·

What Is God's Eye View? The Open-Source Live Tracking Map

God's Eye View is a free, open-source map of live planes, ships, satellites, traffic cameras and plate readers. What it does and the privacy debate.

God's Eye Viewopen source flight trackerlicense plate reader map
Tiny figurines pack glowing data blocks into the memory chips of a giant translucent graphics card.
Local AI ·

How to Run DeepSeek V4.1 Flash GGUF on 12GB VRAM Locally

Run 2-bit GSQ-RCO GGUF builds of DeepSeek V4.1 Flash on a 12GB GPU. Covers file sizes, Strata vs llama.cpp support, MoE design and benchmark recovery.

DeepSeek V4.1 Flash GGUFrun DeepSeek locally 12GB VRAMllama.cpp DeepSeek
A person uses tweezers to carefully remove excess glowing blocks from an oversized data file, shrinking it down into a tiny, dense square.
Local AI ·

What Are GSQ and RCO Quantization? 2-Bit GGUF Explained

GSQ learns how to round each weight and RCO decides how many bits each layer gets. See how the two shrink a huge MoE model to about 2 bits in a standard GGUF.

GSQ quantizationRCO quantizationGumbel Softmax quantization
A 3D illustration of a graphics card wrapped in a digital bounding box, with a cursor dragging one corner to resize its memory capacity.
Local AI ·

How Much VRAM Does Nanbeige4.3 33B Need Running on vLLM?

Nanbeige4.3 33B used just under 88 GB of VRAM on vLLM at long context, about 62 GB at full precision. Here is how to size hardware and cut memory.

Nanbeige4.3 33B vLLMNanbeige4.3 VRAMrun Nanbeige locally
Tiny figurines are slotting microchips into the white border of a giant polaroid photograph.
Local AI ·

How Do You Run Moss Image Locally in ComfyUI or SGLang?

Run the 5B Moss Image model in ComfyUI, SGLang or vLLM-Omni. Covers SFT vs base checkpoints, 50-step defaults, 8-step LoRAs and quantized builds.

run Moss Image locallyMoss Image ComfyUIMoss Image LoRA
A cursor peels back a corner of an image file to expose an underlying layout grid and rendered text.
Local AI ·

How Good Is Moss Image 5B, the Apache 2.0 Image Model?

Moss Image is a 5B open-weight text-to-image model under Apache 2.0. See its text rendering, layout control, benchmark claims, and where it falls short.

Moss ImageMoss Image 5Bopen source image model
A cursor drops a clear glass box over a data file to contain it.
AI Security & Safety ·

Is Qwen 3.8 Flash Next Sending Data to China? What Cohere Found

Cohere saw Qwen 3.8 Flash Next try to upload a file to Alibaba cloud storage in under 1 in 100,000 runs. Here's why it happened and how to sandbox agents.

Qwen 3.8 Flash NextQwen Alibaba cloud uploadCohere Qwen security
A 3D illustration of a cursor unclipping a single tarnished key from a shiny metal keyring to separate it from the rest.
AI Security & Safety ·

How to Audit Connected Apps and AI API Keys After a Breach

Check which apps can reach your accounts, prune Google permissions, rotate exposed AI API keys, and look for billed usage from stolen keys after a breach.

audit connected appsAI API key securitystolen AI API key
A giant hardware security key lies on a flat surface. Tiny figurines are wrapping the device in caution tape and safely extracting its internal chip, representing the process of containing malware and rotating credentials.
AI Security & Safety ·

What to Do If You Installed the Compromised LiteLLM Release

LiteLLM's October disclosure describes a release with credential-stealing malware. How to investigate, contain, rotate AI provider keys and check billing.

LiteLLM compromised releaseLiteLLM malwarerotate AI API keys
A 3D rendering of an oversized terminal window etched into a thick block of frosted glass.
Local AI ·

How to Run Nemotron-3.5 Bolt E4B Locally With llama.cpp

Run NVIDIA Nemotron-3.5 Bolt E4B locally with llama.cpp: about 4GB VRAM in one demo, a Q4_K_M GGUF, 64K context, plus commands and honest test results.

Nemotron-3.5 Bolt E4Brun Nemotron locallyNemotron llama.cpp
A cursor drags a red cross onto the bug-hunt row of a scorecard, alongside existing checkmarks for math and rostering.
Local AI ·

How Good Is Nemotron-3.5 Bolt E4B? Tested Against Gemma 4

Hands-on results for NVIDIA's Nemotron-3.5 Bolt E4B: a bug-hunt agent task that failed, a broken HTML scene, and passes on a riddle, physics math and rostering.

Nemotron-3.5 Bolt E4BNemotron vs Gemma 4small model test
A cursor draws a heavy selection box over an October calendar, transforming the grid of daily squares into solid, impenetrable blocks.
AI Security & Safety ·

What Is Blocktober? AI Agents and the October Attack Wave

Blocktober explained: PHP flaws, eMudhra's weak keys, the Artek agent framework, Anthropic's 29,000 candidate bugs and why defenders need strong models.

BlocktoberAI agents cyberattackseMudhra weak keys
A cursor drags a PHP patch into a highlighted red vulnerability gap in the server code to seal it.
AI Security & Safety ·

What Are the New Critical PHP Vulnerabilities? Patch Guide

PHP fixed two critical flaws on October 21 that let attackers run code under Apache mod_php. Here is what to patch, mitigate or isolate now.

PHP critical vulnerabilitymod_php exploitPHP October 21 patch