User-Agent: * Allow: / Disallow: /debug-env Disallow: /api/internal Disallow: /search Disallow: /threads/ Disallow: /auth Disallow: /ir-memos Disallow: /charity-sector-review-2026 Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /portfolio Disallow: /my-portfolio Disallow: /intelligence Disallow: /watchlist Disallow: /brief Disallow: /alerts Disallow: /admin/ Disallow: /account Disallow: /ir/ Disallow: /widgets/ Disallow: /login Disallow: /signup Disallow: /api/ Disallow: /_next/ Disallow: /directors Disallow: /issuers Disallow: /agencies Disallow: /officials Disallow: /charitydata-investment-intelligence-deck.html Disallow: /iwidata-investment-intelligence-deck.html Disallow: /charitydata-adviser-deck.html Disallow: /charitydata-craigs-deck.html Disallow: /charitydata-jbwere-deck.html Disallow: /search? Disallow: /articles? Disallow: /people? Disallow: /screener? Disallow: /companies/ Disallow: /directors/ Disallow: /analysts/ Disallow: /brokers/ Disallow: /people/ Disallow: /iwi-entities/ Disallow: /iwi-people/ Disallow: /iwi-insights/ Disallow: /public-sector-people/ Disallow: /central-government/ Disallow: /party Disallow: /councils/ Disallow: /councillors/ Disallow: /mp- Disallow: /gazette Crawl-delay: 5 User-Agent: OAI-SearchBot User-Agent: Claude-SearchBot User-Agent: Claude-User User-Agent: Perplexity-User Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: GPTBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 1 User-Agent: ChatGPT-User Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: ClaudeBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: Claude-Web Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: anthropic-ai Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: CCBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: PerplexityBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: Google-Extended Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: cohere-ai Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: FacebookBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: Applebot-Extended Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: Bytespider Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Crawl-delay: 10 User-Agent: Amazonbot Disallow: / User-Agent: Meta-ExternalAgent Disallow: / User-Agent: meta-externalagent Disallow: / User-Agent: AhrefsBot User-Agent: SemrushBot User-Agent: MJ12bot User-Agent: DotBot User-Agent: DataForSeoBot User-Agent: BLEXBot User-Agent: Barkrowler User-Agent: SeekportBot User-Agent: serpstatbot User-Agent: PetalBot User-Agent: ImagesiftBot User-Agent: YandexBot Disallow: / User-Agent: GoogleOther Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: YouBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: Diffbot Disallow: / User-Agent: DuckAssistBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: MistralAI-User Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: Timpibot Disallow: / User-Agent: Omgilibot Disallow: / User-Agent: PetalBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: ImagesiftBot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup User-Agent: kagibot Allow: / Allow: /api/v1/*/markdown Allow: /api/v1/*/facts.json Allow: /api/v1/*.md Disallow: /charity-people/ Disallow: /iwi-people/ Disallow: /iwi-entities/*/governance Disallow: /public-sector-people/ Disallow: /pd-companies/ Disallow: /api/ Disallow: /ask Disallow: /deep-research Disallow: /backtest Disallow: /search Disallow: /auth Disallow: /account Disallow: /admin/ Disallow: /login Disallow: /signup Sitemap: https://charitydata.co.nz/sitemap.xml