# tompsonai.com # 검색엔진(Google·Naver·Bing): 공기업 분석 '리스트'만 색인 허용, 개별 기업 상세는 차단 User-agent: Googlebot Allow: /mock_ncs_free/guide/$ Disallow: /mock_ncs_free/guide/ Disallow: /admin/ Disallow: /staff/ Disallow: /mypage/ Disallow: /chatbot/ Disallow: /common/login/ User-agent: Yeti Allow: /mock_ncs_free/guide/$ Disallow: /mock_ncs_free/guide/ Disallow: /admin/ Disallow: /staff/ Disallow: /mypage/ Disallow: /chatbot/ Disallow: /common/login/ User-agent: bingbot Allow: /mock_ncs_free/guide/$ Disallow: /mock_ncs_free/guide/ Disallow: /admin/ Disallow: /staff/ Disallow: /mypage/ Disallow: /chatbot/ Disallow: /common/login/ # 그 외 일반 봇: 공기업 분석 전체 + 회원/관리/개인 영역 크롤링 금지 User-agent: * Disallow: /mock_ncs_free/guide/ Disallow: /admin/ Disallow: /staff/ Disallow: /mypage/ Disallow: /chatbot/ Disallow: /common/login/ # AI 학습·데이터 수집 크롤러: 사이트 전체 크롤링 금지 User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: meta-externalagent Disallow: /