AWS Builder Center

How I Built an AI Tools Directory Solo — From Schema to SEO

I built Crawlers, a directory indexing 1,000+ AI tools across 45+ categories, using Next.js 16, Supabase, and Cloudflare Pages. This article covers the architecture decisions, scalability work for 5,000+ concurrent users, and the design system choices I made to avoid the generic "AI-generated" look most tool directories have.

  • The problem — why existing AI tool directories felt generic/untrustworthy
  • Stack & architecture — Next.js 16 App Router, Supabase (PostgreSQL + RLS), Cloudflare Pages
  • Design decisions — dark navy + lime accent system, why you avoided purple/cyan gradients and sparkle icons
  • Scalability — ISR/SSG strategy, load testing with k6/Artillery, connection pooling
  • A real bug you hit — the Cloudflare env var / RLS production issue (great technical war-story content)
  • What's next
Any opinions in this article are those of the individual author and may not reflect the opinions of AWS.
Enjoyed reading this content? Let the author know!

Your likes, comments, shares, and saves help creators reach more builders.

Loading recommendations

Loading article