# robots.txt for TestprepGPT (testprepgpt.ai) # Portal host studyabroad.center uses noindex meta on all pages (see index.html / SeoService). # Last updated: 2026-05-20 # ─── All crawlers ──────────────────────────────────────── User-agent: * Allow: / # Public pages — explicitly allow Allow: /home Allow: /about-us Allow: /contact-us Allow: /pricing-plan Allow: /home-subscriptions Allow: /ielts Allow: /ielts-signUp Allow: /band-calculator Allow: /vocabulary Allow: /writing_ideas Allow: /goal Allow: /precursor-course Allow: /question-mastery Allow: /english-essential/ Allow: /live-class Allow: /cambridge Allow: /blogandnews Allow: /blog/ Allow: /news/ Allow: /post/ Allow: /doubt-solver Allow: /ai-solver Allow: /duolingo Allow: /duolingo-prep Allow: /pte-voucher Allow: /toefl-voucher Allow: /privacy-policy Allow: /terms-and-conditions Allow: /refund-policy Allow: /shownews # Static assets Allow: /assets/ Allow: /*.css Allow: /*.js Allow: /*.png Allow: /*.jpg Allow: /*.jpeg Allow: /*.gif Allow: /*.svg Allow: /*.webp Allow: /*.woff Allow: /*.woff2 Allow: /*.ttf Allow: /*.eot Allow: /*.ico # ─── Portal (studyabroad.center) — do not crawl ──────── Disallow: /student-portal Disallow: /partner-live-admin # ─── Protected / admin routes — disallow ───────────────── Disallow: /dashboard/ Disallow: /admin/ Disallow: /ieltsAdmin/ Disallow: /dashboardfe Disallow: /ieltsDashboard Disallow: /ieltsEval Disallow: /ieltsEvalFinalScore # Auth Disallow: /login Disallow: /logout Disallow: /auth/ Disallow: /partner/login Disallow: /partner/dashboard # User-specific Disallow: /user-profile Disallow: /refer-friend Disallow: /my-subscriptions Disallow: /subscriptions Disallow: /support Disallow: /support-status Disallow: /ticket-panel Disallow: /study-plan Disallow: /goal-plan Disallow: /instruction-panel Disallow: /ai-tutor Disallow: /mindmap Disallow: /iapply-stats Disallow: /community # Test and evaluation (user-session content, not indexable) Disallow: /listIeltsTests Disallow: /listIeltsMockTest Disallow: /listEssays/ Disallow: /listPractiseEssays/ Disallow: /listInterviews Disallow: /listRolePlays Disallow: /evalEssay/ Disallow: /practice-tests/ Disallow: /writeEssay Disallow: /essayDiff Disallow: /studentEssays Disallow: /blitzEssayEval Disallow: /srt Disallow: /interview/ Disallow: /rp/ Disallow: /rpOpen/ Disallow: /gr/ Disallow: /pg/ # Creation / editing routes Disallow: /createHome Disallow: /createPresentation/ Disallow: /createRule/ Disallow: /essay-edit Disallow: /add-blog Disallow: /showPresentation/ Disallow: /showPresentationTimeline/ Disallow: /showRule/ Disallow: /publish Disallow: /unpublish # Internal / test routes Disallow: /test Disallow: /svgTest Disallow: /tl Disallow: /popup Disallow: /start Disallow: /receipt/ Disallow: /teacher Disallow: /impStudent Disallow: /chatbot Disallow: /duolingo-prep-study # ─── Googlebot specific ────────────────────────────────── User-agent: Googlebot Allow: / Disallow: /dashboard/ Disallow: /admin/ Disallow: /ieltsAdmin/ Disallow: /login Disallow: /auth/ Disallow: /evalEssay/ Disallow: /practice-tests/ # ─── Bingbot specific ──────────────────────────────────── User-agent: Bingbot Allow: / Disallow: /dashboard/ Disallow: /admin/ Disallow: /login Disallow: /auth/ # ─── Sitemap ───────────────────────────────────────────── Sitemap: https://testprepgpt.ai/sitemap.xml