{"id":444,"date":"2026-11-11T15:00:00","date_gmt":"2026-11-11T09:30:00","guid":{"rendered":"https:\/\/akshaymaurya.in\/blog\/?p=444"},"modified":"2026-11-11T08:19:03","modified_gmt":"2026-11-11T02:49:03","slug":"ai-training-opt-out-signal-robots-txt-hindi","status":"publish","type":"post","link":"https:\/\/akshaymaurya.in\/blog\/ai-training-opt-out-signal-robots-txt-hindi\/","title":{"rendered":"AI Training \u0915\u0947 \u0932\u093f\u090f \u0905\u092c \u090f\u0915 \u0939\u0940 Opt-Out Signal: Google, Microsoft, OpenAI \u0914\u0930 Anthropic \u0928\u0947 robots.txt \u0915\u0947 \u0928\u090f \u0928\u093f\u092f\u092e \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0915\u093f\u092f\u093e"},"content":{"rendered":"\n

30 \u0905\u0915\u094d\u091f\u0942\u092c\u0930 2026 \u0915\u094b Google, Microsoft, OpenAI \u0914\u0930 Anthropic \u0928\u0947 \u090f\u0915 \u0938\u093e\u0925 \u090f\u0915 \u092c\u0921\u093c\u0940 \u0918\u094b\u0937\u0923\u093e \u0915\u0940 \u0939\u0948\u0964 \u091a\u093e\u0930\u094b\u0902 \u0915\u0902\u092a\u0928\u093f\u092f\u094b\u0902 \u0928\u0947 \u0915\u0939\u093e \u0939\u0948 \u0915\u093f \u0935\u0947 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u092e\u093e\u0932\u093f\u0915\u094b\u0902 \u0915\u0940 AI training \u092a\u0938\u0902\u0926 \u092c\u0924\u093e\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f robots.txt \u092e\u0947\u0902 \u090f\u0915 \u0938\u093e\u091d\u093e \u0938\u0902\u0915\u0947\u0924 \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0915\u0930\u0947\u0902\u0917\u0940\u0964 \u0907\u0938\u0938\u0947 \u0939\u0930 \u0915\u0902\u092a\u0928\u0940 \u0915\u0947 \u0932\u093f\u090f \u0905\u0932\u0917 \u0928\u093f\u092f\u092e \u0928\u0939\u0940\u0902 \u0932\u093f\u0916\u0928\u0947 \u092a\u0921\u093c\u0947\u0902\u0917\u0947, \u090f\u0915 \u0939\u0940 \u0938\u0902\u0915\u0947\u0924 \u0915\u093e\u092b\u0940 \u0939\u094b\u0917\u093e\u0964 \u092f\u0939 \u0938\u0902\u0915\u0947\u0924 Internet Engineering Task Force \u0915\u0947 AI Preferences \u0938\u092e\u0942\u0939 (AIPREF) \u0915\u0947 \u0915\u093e\u092e \u092a\u0930 \u0906\u0927\u093e\u0930\u093f\u0924 \u0939\u0948\u0964<\/p>\n

\u0915\u094d\u092f\u093e \u0939\u0941\u0906: \u091a\u093e\u0930 \u092c\u0921\u093c\u0940 \u0915\u0902\u092a\u0928\u093f\u092f\u094b\u0902 \u0928\u0947 \u090f\u0915 \u0938\u093e\u091d\u093e \u0938\u0902\u0915\u0947\u0924 \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0915\u093f\u092f\u093e<\/h2>\n

\u091a\u093e\u0930\u094b\u0902 \u0915\u0902\u092a\u0928\u093f\u092f\u094b\u0902 \u0928\u0947 30 \u0905\u0915\u094d\u091f\u0942\u092c\u0930 2026 \u0915\u094b \u0915\u0939\u093e \u0915\u093f \u0935\u0947 robots.txt \u092e\u0947\u0902 AI training \u0915\u0940 \u092a\u0938\u0902\u0926 \u092c\u0924\u093e\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u090f\u0915 \u0938\u093e\u091d\u093e \u0924\u0930\u0940\u0915\u0947 \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0915\u0930\u0947\u0902\u0917\u0947\u0964 \u092f\u0939 \u0924\u0930\u0940\u0915\u093e IETF \u0915\u0947 \u0926\u0938\u094d\u0924\u093e\u0935\u0947\u091c Machine-Readable Training Preference Signal \u092e\u0947\u0902 \u0932\u093f\u0916\u093e \u0939\u0948, \u091c\u093f\u0938\u0947 Anthropic \u0915\u0947 Kevin Kelley \u0928\u0947 \u0924\u0948\u092f\u093e\u0930 \u0915\u093f\u092f\u093e \u0939\u0948\u0964 \u0907\u0938\u092e\u0947\u0902 __usage_ai-training \u0928\u093e\u092e \u0915\u093e \u090f\u0915 policy token \u092a\u0947\u0936 \u0915\u093f\u092f\u093e \u0917\u092f\u093e \u0939\u0948, \u091c\u093f\u0938\u0938\u0947 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u092e\u093e\u0932\u093f\u0915 \u092c\u0924\u093e \u0938\u0915\u0924\u093e \u0939\u0948 \u0915\u093f \u0909\u0938\u0915\u0940 \u0938\u093e\u092e\u0917\u094d\u0930\u0940 AI model \u0915\u094b train \u0915\u0930\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0939\u094b \u0938\u0915\u0924\u0940 \u0939\u0948 \u092f\u093e \u0928\u0939\u0940\u0902\u0964 OpenAI \u0928\u0947 \u0907\u0938\u0947 \u0938\u094d\u0935\u0948\u091a\u094d\u091b\u093f\u0915 \u0915\u094b\u0936\u093f\u0936 \u092c\u0924\u093e\u092f\u093e \u0939\u0948, \u0914\u0930 Google \u0915\u0947 \u0905\u0928\u0941\u0938\u093e\u0930 \u0907\u0938\u0938\u0947 \u0935\u0947\u092c\u0938\u093e\u0907\u091f\u0947\u0902 \u0905\u092a\u0928\u0940 \u092a\u0938\u0902\u0926 \u0915\u0908 \u0915\u0902\u092a\u0928\u093f\u092f\u094b\u0902 \u0924\u0915 \u090f\u0915 \u0939\u0940 \u0915\u0926\u092e \u092e\u0947\u0902 \u092a\u0939\u0941\u0902\u091a\u093e \u0938\u0915\u0947\u0902\u0917\u0940\u0964<\/p>\n

\u0928\u092f\u093e \u0938\u0902\u0915\u0947\u0924 \u0915\u094d\u092f\u093e \u0939\u0948: __usage_ai-training \u0915\u094b \u0906\u0938\u093e\u0928 \u092d\u093e\u0937\u093e \u092e\u0947\u0902 \u0938\u092e\u091d\u0947\u0902<\/h2>\n

robots.txt \u0939\u0930 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u0915\u0947 \u092e\u0942\u0932 \u092e\u0947\u0902 \u0930\u0939\u0928\u0947 \u0935\u093e\u0932\u0940 \u090f\u0915 \u091b\u094b\u091f\u0940 \u0938\u0940 \u092b\u093e\u0907\u0932 \u0939\u0948, \u091c\u094b crawler \u0915\u094b \u092c\u0924\u093e\u0924\u0940 \u0939\u0948 \u0915\u093f \u0935\u0947 \u0938\u093e\u0907\u091f \u0915\u0947 \u0915\u093f\u0928 \u0939\u093f\u0938\u094d\u0938\u094b\u0902 \u0915\u094b \u0926\u0947\u0916 \u0938\u0915\u0924\u0947 \u0939\u0948\u0902\u0964 \u0928\u092f\u093e \u0938\u0902\u0915\u0947\u0924 \u0907\u0938\u0940 \u092b\u093e\u0907\u0932 \u092e\u0947\u0902 \u090f\u0915 \u0928\u092f\u093e \u0938\u092e\u0942\u0939 \u091c\u094b\u0921\u093c\u0924\u093e \u0939\u0948, \u0915\u094b\u0908 \u0928\u092f\u093e \u0928\u093f\u092f\u092e \u0914\u0930 \u0915\u094b\u0908 \u0928\u092f\u093e \u0935\u094d\u092f\u093e\u0915\u0930\u0923 \u0928\u0939\u0940\u0902 \u092c\u0928\u093e \u0939\u0948\u0964 User-Agent \u0935\u093e\u0932\u0940 \u092a\u0902\u0915\u094d\u0924\u093f \u092e\u0947\u0902 __usage_ai-training \u0932\u093f\u0916\u093e \u091c\u093e\u0924\u093e \u0939\u0948, \u0914\u0930 \u0909\u0938\u0915\u0947 \u0928\u0940\u091a\u0947 \u092a\u0941\u0930\u093e\u0928\u0947 Allow \u0914\u0930 Disallow \u0928\u093f\u092f\u092e \u091a\u0932\u0924\u0947 \u0939\u0948\u0902\u0964 \u091c\u0948\u0938\u0947 Disallow: \/ \u0938\u0947 \u092a\u0942\u0930\u0940 \u0938\u093e\u0907\u091f training \u0938\u0947 \u092e\u0928\u093e \u0939\u094b \u091c\u093e\u0924\u0940 \u0939\u0948, \u0914\u0930 Allow: \/press-kit\/ \u0938\u0947 press kit \u0915\u094b \u091b\u0942\u091f \u092e\u093f\u0932\u0924\u0940 \u0939\u0948\u0964 User-Agent: * \u0935\u093e\u0932\u093e \u0906\u092e \u0928\u093f\u092f\u092e \u0907\u0938 token \u0938\u0947 \u0928\u0939\u0940\u0902 \u091c\u0941\u0921\u093c\u0924\u093e, \u0907\u0938\u0932\u093f\u090f \u092f\u0939 \u092a\u0938\u0902\u0926 \u0924\u092d\u0940 \u092e\u093e\u0928\u0940 \u091c\u093e\u090f\u0917\u0940 \u091c\u092c \u092b\u093e\u0907\u0932 \u092e\u0947\u0902 \u092f\u0939 \u0928\u093e\u092e \u0938\u093e\u092b \u0932\u093f\u0916\u093e \u0939\u094b\u0964 \u092f\u0939 crawler \u0915\u094b \u0930\u094b\u0915\u0928\u0947 \u0915\u093e \u0906\u0926\u0947\u0936 \u0928\u0939\u0940\u0902 \u0939\u0948, \u092f\u0939 \u0938\u093f\u0930\u094d\u092b \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0915\u0940 \u092a\u0938\u0902\u0926 \u092c\u0924\u093e\u0924\u093e \u0939\u0948\u0964<\/p>\n

\u0939\u0930 \u0915\u0902\u092a\u0928\u0940 \u0915\u0940 \u0938\u092e\u092f \u0938\u0940\u092e\u093e \u0915\u094d\u092f\u093e \u0939\u0948<\/h2>\n

Google 2027 \u092e\u0947\u0902 \u0907\u0938 \u0938\u093e\u091d\u093e \u0928\u093f\u092f\u0902\u0924\u094d\u0930\u0923 \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0936\u0941\u0930\u0942 \u0915\u0930\u0928\u0947 \u0915\u093e \u0932\u0915\u094d\u0937\u094d\u092f \u0930\u0916\u0924\u093e \u0939\u0948, \u0909\u0938\u0915\u0947 crawler \u0926\u0938\u094d\u0924\u093e\u0935\u0947\u091c \u092e\u0947\u0902 2027 \u0915\u0940 \u0936\u0941\u0930\u0941\u0906\u0924 \u0915\u093e \u091c\u093f\u0915\u094d\u0930 \u0939\u0948\u0964 Microsoft \u0928\u0947 \u0938\u092c\u0938\u0947 \u0938\u093e\u092b \u0924\u093e\u0930\u0940\u0916 \u0926\u0940 \u0939\u0948, \u0935\u0939 1 \u092b\u0930\u0935\u0930\u0940 2027 \u0938\u0947 \u0928\u0908 \u092a\u0938\u0902\u0926\u094b\u0902 \u0915\u093e \u0938\u092e\u094d\u092e\u093e\u0928 \u0915\u0930\u0928\u093e \u0936\u0941\u0930\u0942 \u0915\u0930\u0947\u0917\u093e, \u091c\u0948\u0938\u0947 \u091c\u0948\u0938\u0947 Bingbot \u092a\u0928\u094d\u0928\u094b\u0902 \u0915\u094b \u0926\u094b\u092c\u093e\u0930\u093e crawl \u0915\u0930\u0947\u0917\u093e\u0964 OpenAI \u0928\u0947 \u0915\u0939\u093e \u0939\u0948 \u0915\u093f \u0935\u0939 \u0906\u0928\u0947 \u0935\u093e\u0932\u0947 \u092e\u0939\u0940\u0928\u094b\u0902 \u092e\u0947\u0902 \u0907\u0938 \u0938\u0902\u0915\u0947\u0924 \u0915\u094b \u0932\u093e\u0917\u0942 \u0915\u0930\u0928\u0947 \u0915\u093e \u0932\u0915\u094d\u0937\u094d\u092f \u0930\u0916\u0924\u093e \u0939\u0948, GPTBot \u0928\u093f\u092f\u0902\u0924\u094d\u0930\u0923 \u0924\u092c \u0924\u0915 \u091a\u0932\u0924\u0947 \u0930\u0939\u0947\u0902\u0917\u0947\u0964 Anthropic \u0928\u0947 \u0907\u0938 \u092e\u0938\u094c\u0926\u0947 \u092a\u0930 \u0905\u092a\u0928\u0947 crawler \u092e\u0947\u0902 \u0915\u093e\u092e \u0936\u0941\u0930\u0942 \u0915\u0930 \u0926\u093f\u092f\u093e \u0939\u0948, Anthropic \u0915\u0947 \u0928\u090f AI model<\/a> \u0938\u0947 \u092d\u0940 \u092f\u0939\u0940 \u0938\u093e\u092b \u0939\u0948\u0964 15 \u0926\u093f\u0938\u0902\u092c\u0930 2026 \u0938\u0947 Bing Webmaster Tools \u092e\u0947\u0902 \u0905\u0938\u094d\u0925\u093e\u092f\u0940 grounding \u092a\u0938\u0902\u0926 \u0926\u0930\u094d\u091c \u0939\u094b\u0917\u0940, \u091c\u094b 30 \u0938\u093f\u0924\u0902\u092c\u0930 2027 \u0915\u094b \u0916\u0924\u094d\u092e \u0939\u094b \u091c\u093e\u090f\u0917\u0940\u0964<\/p>\n

\u092f\u0939 \u0938\u0902\u0915\u0947\u0924 \u0915\u094d\u092f\u093e \u0928\u0939\u0940\u0902 \u0915\u0930\u0924\u093e: training \u0914\u0930 AI \u091c\u0935\u093e\u092c \u092e\u0947\u0902 \u092b\u0930\u094d\u0915<\/h2>\n

training \u0938\u0947 opt-out \u0915\u0930\u0928\u0947 \u0915\u094b AI \u091c\u0935\u093e\u092c\u094b\u0902 \u0938\u0947 \u0917\u093e\u092f\u092c \u0939\u094b \u091c\u093e\u0928\u093e \u0938\u092e\u091d\u0928\u093e \u0938\u092c\u0938\u0947 \u092c\u0921\u093c\u0940 \u0917\u0932\u0924\u0940 \u0939\u094b\u0917\u0940, \u092f\u0939 \u0926\u094b\u0928\u094b\u0902 \u0905\u0932\u0917 \u092c\u093e\u0924\u0947\u0902 \u0939\u0948\u0902\u0964 AI training \u0915\u093e \u092e\u0924\u0932\u092c \u0939\u0948 \u0915\u093f\u0938\u0940 \u0938\u093e\u092e\u0917\u094d\u0930\u0940 \u0938\u0947 generative AI model \u0915\u0947 \u0938\u0940\u0916\u0947 \u0939\u0941\u090f \u092e\u093e\u092a\u0926\u0902\u0921\u094b\u0902 \u0915\u094b \u092c\u0926\u0932\u0928\u093e, \u092f\u093e\u0928\u0940 model \u0915\u094b \u0938\u093f\u0916\u093e\u0928\u093e\u0964 \u0907\u0938\u0915\u0947 \u0909\u0932\u091f grounding \u0915\u093e \u092e\u0924\u0932\u092c \u0939\u0948 \u0915\u093f\u0938\u0940 \u092a\u0928\u094d\u0928\u0947 \u0915\u0940 \u0938\u093e\u092e\u0917\u094d\u0930\u0940 \u0938\u0947 AI \u0938\u0947 \u092e\u093f\u0932\u0947 \u091c\u0935\u093e\u092c \u0915\u094b \u0938\u0939\u093e\u0930\u093e \u0926\u0947\u0928\u093e\u0964 Microsoft \u0928\u0947 \u0907\u0928 \u0926\u094b\u0928\u094b\u0902 \u0915\u094b \u0938\u093e\u092b \u0905\u0932\u0917 \u0915\u093f\u092f\u093e \u0939\u0948, \u0909\u0938\u0915\u0947 \u092a\u093e\u0938 AI Training \u0914\u0930 AI Grounding \u0915\u0940 \u0905\u0932\u0917 \u0905\u0932\u0917 \u092a\u0938\u0902\u0926 \u0939\u0948\u0902, \u0914\u0930 \u090f\u0915 \u092a\u0938\u0902\u0926 \u092c\u0926\u0932\u0928\u0947 \u0938\u0947 \u0926\u0942\u0938\u0930\u0940 \u0928\u0939\u0940\u0902 \u092c\u0926\u0932\u0924\u0940\u0964 Google \u0915\u0947 \u0905\u0928\u0941\u0938\u093e\u0930 \u091c\u094b \u0935\u0947\u092c\u0938\u093e\u0907\u091f Google-Extended \u0915\u094b \u0938\u093e\u092b \u0924\u094c\u0930 \u092a\u0930 allow \u0915\u0930\u0924\u0940 \u0939\u0948, \u0935\u0939 Gemini Apps \u092e\u0947\u0902 grounding \u0915\u0947 \u091c\u0930\u093f\u090f \u091c\u0935\u093e\u092c\u094b\u0902 \u092e\u0947\u0902 \u0926\u093f\u0916 \u0938\u0915\u0924\u0940 \u0939\u0948\u0964<\/p>\n

\u092a\u094d\u0930\u0915\u093e\u0936\u0915\u094b\u0902 \u0915\u094b \u0907\u0938\u0915\u0940 \u091c\u0930\u0942\u0930\u0924 \u0915\u094d\u092f\u094b\u0902 \u0925\u0940<\/h2>\n

\u0906\u091c \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u092e\u093e\u0932\u093f\u0915 \u0915\u094b \u0939\u0930 \u0915\u0902\u092a\u0928\u0940 \u0915\u0947 crawler \u0915\u0947 \u0932\u093f\u090f \u0905\u0932\u0917 \u0928\u093f\u092f\u092e \u0932\u093f\u0916\u0928\u093e \u092a\u0921\u093c\u0924\u093e \u0939\u0948, Google \u0915\u0947 \u0932\u093f\u090f Google-Extended, OpenAI \u0915\u0947 \u0932\u093f\u090f GPTBot, \u0914\u0930 Microsoft \u0915\u0947 \u0932\u093f\u090f NoArchive \u0914\u0930 NoCache\u0964 \u092c\u0921\u093c\u0940 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u0915\u0947 \u092a\u093e\u0938 \u0907\u0938\u0915\u0947 \u0932\u093f\u090f \u091f\u0940\u092e \u0939\u094b\u0924\u0940 \u0939\u0948, \u0932\u0947\u0915\u093f\u0928 \u091b\u094b\u091f\u0947 \u092a\u094d\u0930\u0915\u093e\u0936\u0915 \u0914\u0930 \u092c\u094d\u0932\u0949\u0917\u0930 \u0907\u0938 \u091d\u0902\u091d\u091f \u092e\u0947\u0902 \u0909\u0932\u091d \u091c\u093e\u0924\u0947 \u0939\u0948\u0902\u0964 \u0938\u093e\u091d\u093e \u0938\u0902\u0915\u0947\u0924 \u0907\u0938\u0940 \u092a\u0930\u0947\u0936\u093e\u0928\u0940 \u0915\u093e \u091c\u0935\u093e\u092c \u0939\u0948, \u090f\u0915 \u092c\u093e\u0930 \u092a\u0938\u0902\u0926 \u0932\u093f\u0916\u0940 \u0914\u0930 \u0935\u0939 \u0939\u0930 \u092e\u093e\u0928\u0928\u0947 \u0935\u093e\u0932\u0940 \u0915\u0902\u092a\u0928\u0940 \u0924\u0915 \u092a\u0939\u0941\u0902\u091a \u0917\u0908\u0964<\/p>\n

\u0906\u091c \u0915\u0947 \u0905\u0932\u0917 \u0905\u0932\u0917 opt-out \u0938\u0947 \u0924\u0941\u0932\u0928\u093e: Google-Extended \u0914\u0930 \u0926\u0942\u0938\u0930\u0947 \u0928\u093f\u092f\u092e<\/h2>\n

Google \u0915\u093e \u0905\u092a\u0928\u093e \u0928\u093f\u092f\u0902\u0924\u094d\u0930\u0923 Google-Extended \u0939\u0948, \u091c\u094b \u0915\u0902\u092a\u0928\u0940 2023 \u0938\u0947 \u0926\u0947 \u0930\u0939\u0940 \u0939\u0948\u0964 Google \u0915\u0940 \u0918\u094b\u0937\u0923\u093e<\/a> \u092e\u0947\u0902 \u0915\u0939\u093e \u0917\u092f\u093e \u0939\u0948 \u0915\u093f \u091c\u092c \u0915\u094b\u0908 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u0938\u093e\u091d\u093e token \u0938\u0947 training \u0938\u0947 opt-out \u0915\u0930\u0924\u0940 \u0939\u0948 \u0914\u0930 Google-Extended \u0915\u093e \u0905\u0932\u0917 \u0938\u0947 \u091c\u093f\u0915\u094d\u0930 \u0928\u0939\u0940\u0902 \u0915\u0930\u0924\u0940, \u0924\u094b Google \u0907\u0938\u0947 \u0910\u0938\u0947 \u0938\u092e\u091d\u0947\u0917\u093e \u091c\u0948\u0938\u0947 \u092a\u094d\u0930\u0915\u093e\u0936\u0915 \u0928\u0947 Google-Extended \u0915\u094b disallow \u0915\u0930 \u0926\u093f\u092f\u093e \u0939\u094b\u0964 Google-Extended \u0938\u093f\u0930\u094d\u092b training \u0924\u0915 \u0938\u0940\u092e\u093f\u0924 \u0928\u0939\u0940\u0902 \u0939\u0948, \u092f\u0939 Gemini Apps \u092e\u0947\u0902 grounding \u0938\u0947 \u092d\u0940 \u091c\u0941\u0921\u093c\u093e \u0939\u0948\u0964 OpenAI \u0915\u0940 \u0924\u0930\u092b \u0938\u0947 GPTBot \u0935\u093e\u0932\u0947 \u092e\u094c\u091c\u0942\u0926\u093e \u0928\u093f\u092f\u0902\u0924\u094d\u0930\u0923 \u091a\u0932\u0924\u0947 \u0930\u0939\u0947\u0902\u0917\u0947, \u0928\u092f\u093e \u0938\u0902\u0915\u0947\u0924 \u092a\u0941\u0930\u093e\u0928\u0947 \u0928\u093f\u092f\u0902\u0924\u094d\u0930\u0923\u094b\u0902 \u0915\u0940 \u091c\u0917\u0939 \u0928\u0939\u0940\u0902 \u0932\u0947\u0917\u093e\u0964 Microsoft \u0928\u0947 2023 \u0938\u0947 NoArchive \u0914\u0930 NoCache \u0915\u094b AI \u0928\u093f\u092f\u0902\u0924\u094d\u0930\u0923 \u0915\u0940 \u0924\u0930\u0939 \u092a\u0922\u093c\u093e \u0939\u0948, \u0932\u0947\u0915\u093f\u0928 1 \u092e\u093e\u0930\u094d\u091a 2027 \u0915\u0947 \u092c\u093e\u0926 \u0907\u0928 \u0926\u094b\u0928\u094b\u0902 \u0915\u094b training \u092f\u093e grounding \u0915\u0940 \u092a\u0938\u0902\u0926 \u0915\u0947 \u0930\u0942\u092a \u092e\u0947\u0902 \u0928\u0939\u0940\u0902 \u092a\u0922\u093c\u093e \u091c\u093e\u090f\u0917\u093e\u0964<\/p>\n

\u0906\u092e \u092f\u0942\u091c\u0930 \u0915\u0947 \u0932\u093f\u090f \u0907\u0938\u0915\u093e \u092e\u0924\u0932\u092c \u0915\u094d\u092f\u093e \u0939\u0948<\/h2>\n

\u0905\u0917\u0930 \u0906\u092a \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u091a\u0932\u093e\u0924\u0947 \u0939\u0948\u0902, \u0924\u094b \u0906\u091c \u0915\u0941\u091b \u092d\u0940 \u092c\u0926\u0932\u0928\u0947 \u0915\u0940 \u091c\u0932\u094d\u0926\u092c\u093e\u091c\u0940 \u0928\u0939\u0940\u0902 \u0939\u0948\u0964 \u092f\u0939 \u0938\u0902\u0915\u0947\u0924 \u0905\u092d\u0940 \u0915\u093f\u0938\u0940 \u0915\u0902\u092a\u0928\u0940 \u0915\u0947 \u092f\u0939\u093e\u0902 \u092a\u0942\u0930\u0940 \u0924\u0930\u0939 \u0932\u093e\u0917\u0942 \u0928\u0939\u0940\u0902 \u0939\u0941\u0906 \u0939\u0948, \u0907\u0938\u0932\u093f\u090f \u0906\u092a\u0915\u0947 \u092e\u094c\u091c\u0942\u0926\u093e \u0928\u093f\u092f\u092e \u0939\u0940 \u0915\u093e\u092e \u0915\u0930 \u0930\u0939\u0947 \u0939\u0948\u0902\u0964 \u0932\u0947\u0915\u093f\u0928 \u0905\u092c \u092b\u0948\u0938\u0932\u093e \u0932\u0947\u0928\u0947 \u0915\u093e \u0938\u0939\u0940 \u0938\u092e\u092f \u0939\u0948, \u0924\u092f \u0915\u0930\u0947\u0902 \u0915\u093f \u0906\u092a\u0915\u0940 \u0938\u093e\u092e\u0917\u094d\u0930\u0940 training \u0915\u0947 \u0932\u093f\u090f \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0939\u094b \u092f\u093e \u0928\u0939\u0940\u0902, \u0914\u0930 AI \u091c\u0935\u093e\u092c\u094b\u0902 \u092e\u0947\u0902 \u0906\u092a\u0915\u0940 \u0938\u093e\u0907\u091f \u0926\u093f\u0916\u0947 \u092f\u093e \u0928\u0939\u0940\u0902\u0964 \u0905\u0917\u0930 \u0906\u092a Microsoft \u0915\u0947 \u092a\u0941\u0930\u093e\u0928\u0947 NoArchive \u092f\u093e NoCache \u0928\u093f\u092f\u092e\u094b\u0902 \u0915\u093e \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0915\u0930\u0924\u0947 \u0939\u0948\u0902, \u0924\u094b 1 \u092e\u093e\u0930\u094d\u091a 2027 \u0938\u0947 \u092a\u0939\u0932\u0947 \u0928\u0908 \u092a\u0938\u0902\u0926 \u0926\u0930\u094d\u091c \u0915\u0930\u0928\u093e \u091c\u0930\u0942\u0930\u0940 \u0939\u094b\u0917\u093e\u0964 \u0905\u0917\u0930 \u0906\u092a \u0938\u093f\u0930\u094d\u092b \u092a\u093e\u0920\u0915 \u0939\u0948\u0902, \u0924\u094b AI \u091c\u0935\u093e\u092c\u094b\u0902 \u092e\u0947\u0902 \u0915\u094c\u0928 \u0938\u0940 \u0938\u093e\u0907\u091f \u0926\u093f\u0916\u0947\u0917\u0940, \u092f\u0939 \u0925\u094b\u0921\u093c\u093e \u092c\u0926\u0932 \u0938\u0915\u0924\u093e \u0939\u0948, \u0932\u0947\u0915\u093f\u0928 Google Search \u092e\u0947\u0902 \u0915\u093f\u0938\u0940 \u0938\u093e\u0907\u091f \u0915\u093e \u0926\u093f\u0916\u0928\u093e \u0907\u0938 \u0938\u0902\u0915\u0947\u0924 \u0938\u0947 \u0924\u092f \u0928\u0939\u0940\u0902 \u0939\u094b\u0924\u093e\u0964 \u092e\u0947\u0930\u0947 \u0939\u093f\u0938\u093e\u092c \u0938\u0947 \u0938\u092c\u0938\u0947 \u092c\u0921\u093c\u0940 \u092c\u093e\u0924 \u092f\u0939 \u0939\u0948 \u0915\u093f \u0938\u093e\u092e\u0917\u094d\u0930\u0940 \u0915\u0947 \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0915\u094b \u0932\u0947\u0915\u0930 \u090f\u0915 \u0938\u093e\u091d\u093e \u092d\u093e\u0937\u093e \u092c\u0928 \u0930\u0939\u0940 \u0939\u0948\u0964<\/p>\n

\u0905\u0915\u094d\u0938\u0930 \u092a\u0942\u091b\u0947 \u091c\u093e\u0928\u0947 \u0935\u093e\u0932\u0947 \u0938\u0935\u093e\u0932<\/h2>\n

__usage_ai-training \u0915\u094d\u092f\u093e \u0939\u0948<\/h3>\n

\u092f\u0939 IETF \u0915\u0947 \u092e\u0938\u094c\u0926\u0947 \u0915\u093e \u090f\u0915 policy token \u0939\u0948, \u091c\u093f\u0938\u0947 robots.txt \u0915\u0940 User-Agent \u092a\u0902\u0915\u094d\u0924\u093f \u092e\u0947\u0902 \u0932\u093f\u0916\u093e \u091c\u093e\u0924\u093e \u0939\u0948\u0964 \u0907\u0938\u0938\u0947 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u092e\u093e\u0932\u093f\u0915 \u092c\u0924\u093e \u0938\u0915\u0924\u093e \u0939\u0948 \u0915\u093f \u0909\u0938\u0915\u0940 \u0938\u093e\u092e\u0917\u094d\u0930\u0940 AI training \u0915\u0947 \u0932\u093f\u090f \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0939\u094b \u0938\u0915\u0924\u0940 \u0939\u0948 \u092f\u093e \u0928\u0939\u0940\u0902\u0964<\/p>\n

\u0915\u094d\u092f\u093e \u092f\u0939 \u0938\u0902\u0915\u0947\u0924 \u0906\u091c \u0938\u0947 \u0915\u093e\u092e \u0915\u0930\u0924\u093e \u0939\u0948<\/h3>\n

\u0928\u0939\u0940\u0902, \u092f\u0939 \u0905\u092d\u0940 \u0915\u0939\u0940\u0902 \u092a\u0942\u0930\u0940 \u0924\u0930\u0939 \u0932\u093e\u0917\u0942 \u0928\u0939\u0940\u0902 \u0939\u0941\u0906 \u0939\u0948\u0964 Google 2027 \u092e\u0947\u0902, Microsoft 1 \u092b\u0930\u0935\u0930\u0940 2027 \u0938\u0947, \u0914\u0930 OpenAI \u0906\u0928\u0947 \u0935\u093e\u0932\u0947 \u092e\u0939\u0940\u0928\u094b\u0902 \u092e\u0947\u0902 \u0907\u0938\u0947 \u0932\u093e\u0917\u0942 \u0915\u0930\u0947\u0917\u093e\u0964<\/p>\n

\u0915\u094d\u092f\u093e training \u0938\u0947 opt-out \u0915\u0930\u0928\u0947 \u092a\u0930 \u092e\u0947\u0930\u0940 \u0935\u0947\u092c\u0938\u093e\u0907\u091f AI \u091c\u0935\u093e\u092c\u094b\u0902 \u092e\u0947\u0902 \u0928\u0939\u0940\u0902 \u0926\u093f\u0916\u0947\u0917\u0940<\/h3>\n

\u091c\u0930\u0942\u0930\u0940 \u0928\u0939\u0940\u0902 \u0939\u0948, training \u0914\u0930 grounding \u0905\u0932\u0917 \u092b\u0948\u0938\u0932\u0947 \u0939\u0948\u0902\u0964 Training \u0938\u0947 \u092e\u0928\u093e \u0915\u0930\u0928\u0947 \u0915\u093e \u092e\u0924\u0932\u092c \u092f\u0939 \u0928\u0939\u0940\u0902 \u0939\u0948 \u0915\u093f \u0906\u092a\u0915\u0940 \u0938\u093e\u092e\u0917\u094d\u0930\u0940 AI \u091c\u0935\u093e\u092c\u094b\u0902 \u092e\u0947\u0902 \u0938\u094d\u0930\u094b\u0924 \u0915\u0940 \u0924\u0930\u0939 \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0928\u0939\u0940\u0902 \u0939\u094b \u0938\u0915\u0924\u0940\u0964<\/p>\n

\u0915\u094d\u092f\u093e \u0907\u0938\u0938\u0947 Google Search \u092e\u0947\u0902 \u092e\u0947\u0930\u0940 \u0930\u0948\u0902\u0915\u093f\u0902\u0917 \u092a\u0930 \u0905\u0938\u0930 \u092a\u0921\u093c\u0947\u0917\u093e<\/h3>\n

\u0928\u0939\u0940\u0902, Google \u0915\u0947 \u0905\u0928\u0941\u0938\u093e\u0930 Google-Extended \u0938\u0947 \u0915\u093f\u0938\u0940 \u0938\u093e\u0907\u091f \u0915\u093e Google Search \u092e\u0947\u0902 \u0926\u093f\u0916\u0928\u093e \u092a\u094d\u0930\u092d\u093e\u0935\u093f\u0924 \u0928\u0939\u0940\u0902 \u0939\u094b\u0924\u093e, \u0914\u0930 \u092f\u0939 \u0930\u0948\u0902\u0915\u093f\u0902\u0917 \u0915\u093e \u0938\u0902\u0915\u0947\u0924 \u092d\u0940 \u0928\u0939\u0940\u0902 \u0939\u0948\u0964<\/p>\n

Microsoft \u0915\u0947 \u092a\u0941\u0930\u093e\u0928\u0947 NoArchive \u0914\u0930 NoCache \u0928\u093f\u092f\u092e\u094b\u0902 \u0915\u093e \u0915\u094d\u092f\u093e \u0939\u094b\u0917\u093e<\/h3>\n

1 \u092e\u093e\u0930\u094d\u091a 2027 \u0915\u0947 \u092c\u093e\u0926 Microsoft \u0907\u0928 \u0926\u094b\u0928\u094b\u0902 \u0915\u094b training \u092f\u093e grounding \u0915\u0940 \u092a\u0938\u0902\u0926 \u0915\u0947 \u0930\u0942\u092a \u092e\u0947\u0902 \u0928\u0939\u0940\u0902 \u092a\u0922\u093c\u0947\u0917\u093e\u0964 \u0907\u0928\u0915\u093e \u0907\u0938\u094d\u0924\u0947\u092e\u093e\u0932 \u0915\u0930\u0928\u0947 \u0935\u093e\u0932\u0940 \u0938\u093e\u0907\u091f\u094b\u0902 \u0915\u094b \u0909\u0938\u0938\u0947 \u092a\u0939\u0932\u0947 \u0928\u0908 \u092a\u0938\u0902\u0926 \u0926\u0930\u094d\u091c \u0915\u0930\u0928\u0940 \u0939\u094b\u0917\u0940\u0964<\/p>\n

\u0915\u094d\u092f\u093e \u092f\u0939 \u0928\u093f\u092f\u092e \u0905\u092c \u0905\u0902\u0924\u093f\u092e \u092e\u093e\u0928\u0915 \u092c\u0928 \u0917\u092f\u093e \u0939\u0948<\/h3>\n

\u0928\u0939\u0940\u0902, \u092f\u0939 \u0905\u092d\u0940 \u090f\u0915 \u0935\u094d\u092f\u0915\u094d\u0924\u093f\u0917\u0924 Internet-Draft \u0939\u0948, \u091c\u093f\u0938\u0947 IETF \u0928\u0947 \u0914\u092a\u091a\u093e\u0930\u093f\u0915 \u0930\u0942\u092a \u0938\u0947 \u0905\u092a\u0928\u093e\u092f\u093e \u0928\u0939\u0940\u0902 \u0939\u0948\u0964 \u092f\u0939 \u092e\u0938\u094c\u0926\u093e 3 \u092e\u0908 2027 \u0915\u094b \u0916\u0924\u094d\u092e \u0939\u094b \u091c\u093e\u090f\u0917\u093e, \u0905\u0917\u0930 \u0907\u0938\u0947 \u0928\u092f\u093e \u0930\u0942\u092a \u0928\u0939\u0940\u0902 \u0926\u093f\u092f\u093e \u0917\u092f\u093e\u0964<\/p>\n","protected":false},"excerpt":{"rendered":"

30 \u0905\u0915\u094d\u091f\u0942\u092c\u0930 2026 \u0915\u094b Google, Microsoft, OpenAI \u0914\u0930 Anthropic \u0928\u0947 \u090f\u0915 \u0938\u093e\u0925 \u090f\u0915 \u092c\u0921\u093c\u0940 \u0918\u094b\u0937\u0923\u093e \u0915\u0940 \u0939\u0948\u0964 \u091a\u093e\u0930\u094b\u0902 \u0915\u0902\u092a\u0928\u093f\u092f\u094b\u0902 \u0928\u0947 \u0915\u0939\u093e \u0939\u0948 \u0915\u093f \u0935\u0947 \u0935\u0947\u092c\u0938\u093e\u0907\u091f \u092e\u093e\u0932\u093f\u0915\u094b\u0902 \u0915\u0940 AI training \u092a\u0938\u0902\u0926 \u092c\u0924\u093e\u0928\u0947 \u0915\u0947 \u0932\u093f\u090f robots.txt \u092e\u0947\u0902 \u090f\u0915 \u0938\u093e\u091d\u093e \u0938\u0902\u0915\u0947\u0924 \u0915\u093e \u0938\u092e\u0930\u094d\u0925\u0928 \u0915\u0930\u0947\u0902\u0917\u0940\u0964 \u0907\u0938\u0938\u0947 \u0939\u0930 \u0915\u0902\u092a\u0928\u0940 \u0915\u0947 \u0932\u093f\u090f \u0905\u0932\u0917 \u0928\u093f\u092f\u092e \u0928\u0939\u0940\u0902 \u0932\u093f\u0916\u0928\u0947 \u092a\u0921\u093c\u0947\u0902\u0917\u0947, \u090f\u0915 \u0939\u0940 \u0938\u0902\u0915\u0947\u0924 \u0915\u093e\u092b\u0940 […]<\/p>\n","protected":false},"author":1,"featured_media":443,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[1],"tags":[302,43,303,12,65],"class_list":["post-444","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","tag-ai-training-opt-out","tag-anthropic","tag-google-extended","tag-openai","tag-robots-txt"],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/akshaymaurya.in\/blog\/wp-content\/uploads\/2026\/11\/thumb-ai-training-opt-out-signal-robots-txt-hindi.jpg","_links":{"self":[{"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/posts\/444","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/comments?post=444"}],"version-history":[{"count":3,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/posts\/444\/revisions"}],"predecessor-version":[{"id":460,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/posts\/444\/revisions\/460"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/media\/443"}],"wp:attachment":[{"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/media?parent=444"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/categories?post=444"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/akshaymaurya.in\/blog\/wp-json\/wp\/v2\/tags?post=444"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}