Skip to content
@bluorion-com

bluorion.com

Pinned Loading

  1. ZClip ZClip Public

    Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".

    Python 141 10

  2. weight_rescaling weight_rescaling Public

    Official implementation of the "Variance control via weight rescaling in LLM pretraining" paper.

    Python 5

  3. refine_massive_activations refine_massive_activations Public

    Official implementation of the paper: "A Refined Analysis of Massive Activations in LLMs".

    Python 10 3

Repositories

Showing 10 of 19 repositories
  • ZClip Public

    Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".

    bluorion-com/ZClip’s past year of commit activity
    Python 141 Apache-2.0 10 3 3 Updated Nov 20, 2025
  • perftest Public
    bluorion-com/perftest’s past year of commit activity
    Shell 0 0 0 0 Updated Nov 3, 2025
  • weight_rescaling Public

    Official implementation of the "Variance control via weight rescaling in LLM pretraining" paper.

    bluorion-com/weight_rescaling’s past year of commit activity
    Python 5 Apache-2.0 0 0 0 Updated Jun 29, 2025
  • refine_massive_activations Public

    Official implementation of the paper: "A Refined Analysis of Massive Activations in LLMs".

    bluorion-com/refine_massive_activations’s past year of commit activity
    Python 10 MIT 3 0 0 Updated May 21, 2025
  • raydp Public Forked from ray-project/raydp

    RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.

    bluorion-com/raydp’s past year of commit activity
    Scala 0 Apache-2.0 80 0 0 Updated Apr 22, 2025
  • Megatron-LM Public Forked from NVIDIA/Megatron-LM

    Ongoing research training transformer models at scale

    bluorion-com/Megatron-LM’s past year of commit activity
    Python 1 3,549 0 0 Updated Mar 21, 2025
  • vllm-production-stack Public Forked from vllm-project/production-stack

    vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

    bluorion-com/vllm-production-stack’s past year of commit activity
    Python 0 Apache-2.0 351 0 0 Updated Mar 14, 2025
  • lingua Public Forked from facebookresearch/lingua

    Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

    bluorion-com/lingua’s past year of commit activity
    Python 0 BSD-3-Clause 280 0 0 Updated Feb 6, 2025
  • flash-attention Public Forked from Dao-AILab/flash-attention

    Fast and memory-efficient exact attention

    bluorion-com/flash-attention’s past year of commit activity
    Python 0 BSD-3-Clause 2,283 0 0 Updated Jan 16, 2025
  • bluorion-com/torchx_nccl_test’s past year of commit activity
    Python 0 0 0 0 Updated Jan 15, 2025

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…