Algorithm Watch

xai-org/x-algorithm

Back to list
902a06fd616e
High Impact5 min readSeptember 7, 2026

Inside X's Open-Source Algorithm: Phoenix RecSys, Author Cold Start, and Mutual Follow Mechanics

A major open-source update to the X algorithm repository reveals the inner workings of the next-generation 'Phoenix (xrex)' neural recommendation framework, Rust-based Home Mixer enhancements for author cold-start scoring and mutual-follow metrics, and low-latency visibility filtering subsystems.

Impact Score
9/10

Simple Explanation

This update exposes the core architecture of how X populates your For You feed. It reveals how new creators receive algorithmic distribution through author cold-start scoring, how mutual-follow relationship graphs boost content discovery, and how deep-learning models (Phoenix) work alongside strict safety filters to determine post visibility.

Key Points

  • 1Phoenix RecSys: Modern neural candidate retrieval and ranking pipeline powered by JAX and encrypted checkpointing.
  • 2Author Cold Start: Dedicated ranking logic to surface quality content from low-history or emerging creators.
  • 3Mutual-Follow Signals: Dedicated side-effects tracking reciprocal relationships and bidirectional engagement metrics.
  • 4Visibility Filtering: Sub-millisecond safety label verification and candidate suppression utilizing Twemcache hydration.

Technical Details

The commit details tight integration between the Rust-based 'home-mixer' and 'visibility-filtering' services, and the Python/JAX 'phoenix/xrex' recsys stack. The pipeline leverages 'author_cold_start.rs' for author-level ranking exploration, 'mutual_follow_stats_side_effect.rs' to track reciprocal graph interactions, and Phoenix retrieval training via Orbax-encrypted checkpoints. In parallel, visibility-filtering handles sub-millisecond safety label evaluations and dark traffic simulation backed by Twemcache.

Affected Users

New and mid-tier content creators, community accounts with high mutual-follow ratios, and creators publishing sensitive or borderline content.

Before & After

Previously opaque interactions between neural recommendation pipelines and the Home Mixer are now openly defined, detailing exact cold-start scoring algorithms, mutual-follow tracking, and safety filtering pipelines.

Action Items

  • Prioritize building meaningful reciprocal (mutual-follow) relationships with bidirectional engagement to boost graph affinity.
  • Ensure post content cleanly clears visibility safety filtering criteria to avoid candidate suppression before ranking.
  • Maximize first-impression quality on new accounts to take full advantage of author cold-start exploration windows.

Monetization Tips

  • Foster active bidirectional discussions with mutuals to maximize algorithmic distribution for promotional posts.
  • Keep monetized or external-link posts well within safety guidelines to prevent visibility filters from dropping the candidate.

FAQ

Q. What does the author cold-start scorer do?

It provides algorithmic exploration opportunities for new or low-history authors, ensuring their posts can reach the For You feed despite having limited historical engagement.

Q. How significant are mutual-follow signals?

The presence of a dedicated mutual-follow stats component confirms that reciprocal connections and their bidirectional interactions serve as high-priority features in candidate hydration and ranking.

Changed Files

  • + home-mixer/candidate_hydrators/engagement_counts_hydrator.rs
  • + home-mixer/models/candidate.rs
  • + home-mixer/params/param.rs
  • + home-mixer/scorers/author_cold_start.rs
  • + home-mixer/side_effects/mutual_follow_stats_side_effect.rs
  • + phoenix/crates/serving/xai-recsys-proto/proto/recsys.proto
  • + phoenix/python/common/xai-proto/proto/recsys.proto
  • + phoenix/python/training/xai-checkpointing/xai_checkpointing/dek.py
  • + phoenix/python/training/xai-checkpointing/xai_checkpointing/orbax_encrypted.py
  • + phoenix/xrex/data/retrieval_dataset.py
  • + phoenix/xrex/train/recsys_bundle_export.py
  • + phoenix/xrex/train/trainer_recsys.py
  • + phoenix/xrex/utils/log_util.py
  • + visibility-filtering/config.rs
  • + visibility-filtering/dark_traffic_setup.rs
  • + visibility-filtering/hydration/mod.rs
  • + visibility-filtering/hydration/tes_hydrator.rs
  • + visibility-filtering/lib.rs
  • + visibility-filtering/models/mod.rs
  • + visibility-filtering/models/safety_labels.rs
  • + visibility-filtering/models/tweet.rs
  • + visibility-filtering/params.rs
  • + visibility-filtering/server.rs
  • + visibility-filtering/twemcache/client.rs
  • + visibility-filtering/twemcache/mod.rs
View Commit on GitHub