"Click-wrap consent by dominant digital platforms undermines the voluntary norms of the open web." Critically examine in light of recent changes to platform commercial terms.

The open web depends on voluntary norms such as robots.txt, a file in which a website tells crawlers what they may read. Meta's revised Commercial Terms take effect on 30 October 2026. They let its crawlers enter any website "associated with" a business account, and the consent comes from a click-through contract [1]. The claim largely holds, with some qualifications.

How click-wrap consent erodes open-web norms

• Contract over signal: robots.txt is voluntary, while a licence accepted with a click is binding. Meta says it respects robots.txt, but the terms do not say so [1].
• Vague scope: the terms cover any site "associated with" an account used for a "business or commercial purpose", even just running a Page [1]. A publisher's whole news site could fall within this.
• Forced consent: there is no opt-out, and continued use of Ads Manager counts as acceptance [1]. The 200 million+ businesses that depend on Meta's reach cannot realistically refuse.
• Private rule-making: with about 3.6 billion daily users, one firm's terms work as de facto rules for the web [1]. In 2024 the CCI imposed a ₹213.14 crore penalty over WhatsApp's "take-it-or-leave-it" privacy policy, treating it as abuse of dominance under Section 4, Competition Act, 2002 [2].

Counter-view: limits of the claim

• Legitimate purpose: businesses link their own sites to sell through Meta, so crawling ad landing pages to run their ads is an expected use.
• Self-correction: after Nieman Lab reported the change, Meta dropped the word "train" and limited use to "advertising and business products" [1].
• Legal checks exist: in November 2025 the NCLAT upheld the CCI's penalty [3].
• But these safeguards are fragile:
• The narrowing came from press scrutiny, not a regulator.
• "Business products" is undefined [1].
• The NCLAT also struck down the CCI's five-year ban on WhatsApp sharing data with Meta for ads [3], which shows that after-the-fact remedies are slow and easy to weaken.

Way forward

• Codify robots.txt as a binding term of the contract.
• Unbundle consent, so that agreeing to run ads does not also mean agreeing to have the website crawled.
• CCI scrutiny of the new terms using its own 2024 reasoning [2].
• Ex-ante rules for gatekeeper platforms, such as a ban on bundling unrelated consents.

Click-wrap consent turns a voluntary courtesy into a contractual obligation, though not every crawl is illegitimate. A binding robots.txt clause, separate consent for crawling and rules set in advance would keep platform power in line with the constitutional values of privacy and fair competition. That would keep the open web open and trusted.