User-agent: * Disallow: /web_page/ Disallow: /sass/ Disallow: /plugin/ Disallow: /payments/ Disallow: /node_modules/ Disallow: /libs/ Disallow: /js/ Disallow: /includes/ Disallow: /data/ Disallow: /css/ Disallow: /assets/ Disallow: /ajax/