Meta

Tin tức, mô hình và bản phát hành AI mới nhất từ Meta. ['Astryx', 'Business Agent', 'BYT5', 'CodeLlama', 'expressive voice AI', 'FAIRChem v2 UMA', 'Gemma 4', 'Gemma4:e2b', 'HuBERT', 'llama', 'Llama', 'LLaMA', 'LLaMA2-chat-70B', 'Llama 3', 'Llama 3.1', 'Llama 3.1-405B', 'Llama-3.1-405B', 'LLaMA-3.1 405B', 'Llama 3.1-70B', 'Llama 3.1 8B', 'Llama 3.1-8B', 'Llama-3.1-8B', 'Llama 3.2', 'Llama-3.2-1B-Instruct', 'Llama 3.3', 'llama-3.3-70b', 'Llama 3 8B', 'Llama3-8B-Instruct', 'Llama 4', 'Llama 4 Maverick', 'LLaMA 65B', 'Llama 70B', 'M2M100', 'M**a AI', 'mBART', 'Meta AI', 'Meta AI model (model name not specified)', 'Meta Muse Spark', 'Muse Spark', 'Muse Spark 1.1']

Trang chính thức ↗

Kinh doanh & Thị trường 🇺🇸

Monday.com Joins List of Tech Firms Blaming AI for Layoffs — 20 More Examples

Monday.com will lay off 20% of its workforce (over 600 people) as part of a restructuring, citing a transformation toward an AI-driven growth strategy. According to the Financial Times, U.S. IT companies have cut nearly 140,000 jobs since the start of the year, with Amazon, Oracle, Meta, and Microsoft alone accounting for almost 50,000. However, the market is skeptical of such explanations: shares of companies citing AI have underperformed the Nasdaq by 10%.

monday.com

Microsoft

Oracle

GitLab

Google/DeepMind

Intuit

Writing a Decoder-Only Transformer for LLM from Scratch in Python

The author of a series of articles describes in detail the implementation of a transformer block for a small decoder-only LLM using the PyTorch framework. Components covered include: Multi-Head Attention with masking, Feed Forward Network with GELU, normalization layer, and residual connections. The article explains the difference from the original architecture: pre-normalization (Pre-LN) is used instead of post-normalization for training stability.

Google/DeepMind

OpenAI