# ========================================================= # 세종스타치과 robots.txt # https://sejongstar.com/ # SEO / AEO / GEO 최적화 # 목적: 검색엔진 및 AI/LLM 크롤러가 공개 진료 콘텐츠, 의료진 전문성, FAQ, 치료사례, 오시는 길 정보를 잘 읽도록 허용 # ========================================================= # ========================================================= # 기본 검색엔진 / 일반 크롤러 정책 # ========================================================= User-agent: * # ===== 워드프레스 관리자/로그인/시스템 영역 차단 ===== Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /wp-json/wp/v2/users # CSS/JS/이미지 등 렌더링 리소스 허용 Allow: /wp-content/uploads/ Allow: /wp-content/themes/ Allow: /wp-content/plugins/ Allow: /wp-includes/*.js$ Allow: /wp-includes/*.css$ Disallow: /wp-includes/ # ===== 회원/로그인/계정 관련 영역 차단 ===== Disallow: /login/ Disallow: /join/ Disallow: /my-account/ Disallow: /account/ Disallow: /member/ Disallow: /members/ Disallow: /register/ Disallow: /password-reset/ Disallow: /lost-password/ Disallow: /*redirect_to= # ===== 공개 핵심 콘텐츠 허용 ===== Allow: / # 세종스타치과 소개 / 철학 / 의료진 / 진료시간 / 오시는 길 Allow: /sejongstar/ Allow: /sejongstar/history-philosophy/ Allow: /sejongstar/introduction-to-medical-staff/ Allow: /sejongstar/information-on-treatment-hours/ Allow: /sejongstar/directions-interior-tour/ # 임플란트 진료 콘텐츠 Allow: /implant/ Allow: /implant/navigation-implant/ Allow: /implant/sleep-implant/ Allow: /implant/full-implant/ Allow: /implant/bone-grafting/ Allow: /implant/implant-faq/ # 치아교정 진료 콘텐츠 Allow: /teeth-correction/ Allow: /teeth-correction/invisalign/ Allow: /teeth-correction/teeth-straightening/ Allow: /teeth-correction/pediatric-jaw-correction/ Allow: /teeth-correction/staffs-correction-diary/ Allow: /teeth-correction/teeth-correction-faq/ # 통합진료 Allow: /integrated-treatment/ # 소아/청소년 진료 콘텐츠 Allow: /pediatric-adolescent-care/ Allow: /pediatric-adolescent-care/cavities-preventive-treatment/ Allow: /pediatric-adolescent-care/pediatric-sedation-laughing-gas/ Allow: /pediatric-adolescent-care/oral-examination-for-infants-and-toddlers/ Allow: /pediatric-adolescent-care/student-oral-examination/ Allow: /pediatric-adolescent-care/pediatric-dentist/ Allow: /pediatric-adolescent-care/pediatric-and-adolescent-care-faq/ # 치료 사례 / 공지 / 채용 / 비급여 정보 Allow: /treatment-case/ Allow: /community/notice-newsletter/ Allow: /community/recruitment-information/ Allow: /non-covered-fee-information/ # ===== GEO / AEO 보조 파일 허용 ===== Allow: /llms.txt Allow: /ai.json Allow: /for-ai.html Allow: /for-ai/ # ===== 중복/저품질/검색/파라미터 URL 차단 ===== Disallow: /?s= Disallow: /search/ Disallow: /tag/ Disallow: /tags/ Disallow: /category/ Disallow: /author/ Disallow: /date/ Disallow: /feed/ Disallow: /comments/feed/ Disallow: /*?replytocom= Disallow: /*?preview=true Disallow: /*?preview_id= Disallow: /*?preview_nonce= Disallow: /*?p= Disallow: /*?utm_ Disallow: /*?fbclid= Disallow: /*?gclid= Disallow: /*?gad_source= Disallow: /*?msclkid= Disallow: /*?yclid= Disallow: /*?ref= # KBoard 게시판 검색/정렬성 파라미터 차단 # 공개 치료사례/공지 본문은 허용하되, 내부 검색결과·중복 목록 URL은 차단 Disallow: /*kboard_search_option= Disallow: /*kboard_search_keyword= Disallow: /*kboard_list_sort= Disallow: /*kboard_list_sort_by= Disallow: /*mod=editor Disallow: /*mod=write # ===== 내부/테스트/백업성 URL 차단 ===== Disallow: /test/ Disallow: /staging/ Disallow: /dev/ Disallow: /backup/ Disallow: /tmp/ Disallow: /old/ Disallow: /new/ Disallow: /sample/ Disallow: /demo/ Disallow: /copy/ Disallow: /backup-*/ # ===== 개인정보/약관성 페이지는 AI/검색 크롤링 우선순위에서 제외 ===== # 법적 페이지를 검색 노출 대상으로 운영하려면 아래 2줄은 삭제하세요. Disallow: /privacy/ Disallow: /terms-of-use/ # ========================================================= # AI / LLM 크롤러 허용 정책 # 공개 의료 정보, 진료과목, FAQ, 의료진 전문성, 치료사례 페이지를 AI가 읽을 수 있도록 허용 # 단, 로그인/회원/관리자/개인정보 영역은 위 공통 규칙으로 차단 # ========================================================= # OpenAI / ChatGPT User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: SearchGPT Allow: / # Google AI / Gemini / Search rendering User-agent: Googlebot Allow: / User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / User-agent: GoogleOther-Image Allow: /wp-content/uploads/ # Anthropic / Claude User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: anthropic-ai Allow: / # Perplexity User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Microsoft / Bing / Copilot User-agent: Bingbot Allow: / User-agent: BingPreview Allow: / User-agent: msnbot Allow: / User-agent: CopilotBot Allow: / # Apple User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Meta User-agent: FacebookBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # Common Crawl / 기타 AI 학습·검색 크롤러 User-agent: CCBot Allow: / User-agent: Bytespider Allow: / User-agent: PetalBot Allow: / User-agent: YouBot Allow: / User-agent: BraveBot Allow: / User-agent: DuckAssistBot Allow: / User-agent: MistralAI-User Allow: / User-agent: MistralBot Allow: / User-agent: Qwantbot Allow: / User-agent: QwenBot Allow: / User-agent: DeepSeekBot Allow: / User-agent: GrokBot Allow: / # ========================================================= # 과도한 상업 SEO 크롤러 제한 # 사이트 부하 방지 목적. 완전 차단보다 Crawl-delay 우선. # ========================================================= User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 User-agent: SemrushBot-SA Crawl-delay: 10 User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / # ========================================================= # Sitemap / AI metadata # robots.txt 표준상 Sitemap 외 항목은 강제 지시가 아닌 AI/GEO용 힌트입니다. # ========================================================= Sitemap: https://sejongstar.com/sitemap.xml Sitemap: https://sejongstar.com/sitemap_index.xml Sitemap: https://sejongstar.com/page-sitemap.xml LLMs.txt: https://sejongstar.com/llms.txt ai.json: https://sejongstar.com/ai.json for-ai: https://sejongstar.com/for-ai.html for-ai-index: https://sejongstar.com/for-ai/