This is the start of my story about building CrawlerCheck, a new SEO tool.
For a long time, my development mindset was rooted in Angular, but the creation of CrawlerCheck marked an exciting shift in my approach to technology. For this project, I chose a new stack that I believed was a perfect fit for the problem I was solving: Go, Svelte, and Nginx.
Go’s incredible speed and calculation power primarily drove my decision to use it. My backend needed to perform complex algorithms with minimal code while delivering super-fast, reliable results. Go was the clear choice. It has proven to be the engine that makes CrawlerCheck so powerful.
The frontend with Svelte
For the frontend, I chose Svelte. I’ve been monitoring the framework for a while. Its unparalleled speed and simplicity convinced me to try it. The user experience had to be as fast as the backend. Svelte helped me build a responsive, simple, and quick interface. It was a refreshing change of pace and a technology I’m excited to continue working with.
Overcoming development challenges
The biggest challenge was not the code itself, but the backend logic. The initial algorithms required countless hours of building, testing, and rebuilding. It was a rigorous process to get the calculations just right. My next challenge, which is still a work in progress, is writing clear documentation to explain everything.
The future of CrawlerCheck
I am focusing CrawlerCheck’s future roadmap on expanding it into a fully grown technical SEO tool. The immediate goal is a full partner API. This will allow other SEO tools to integrate our service. Next, I’m building a batch URL checker. This will move the tool beyond per-URL analysis. These steps will eventually lead to a full website crawler, followed by the crawl-budget analyzer, and other tools I have planned. This roadmap will help CrawlerCheck grow into a name known by SEO professionals worldwide. I see a bright future for these SEO tools. I just hope I’ll have the energy to meet the expectations of users and the tool itself.
All changes and updates are and will be fully documented on the changelog page. Check it out if you are interested in new features and updates here: https://crawlercheck.com/changelog.
All in all I see a bright future ahead of these SEO tools, I just hope I’ll have the energy to keep up with the expectations that a tool like this and it’s user will demand.
