December 8, 2022

What Does Google See When it Crawls Your Site?

For your website to rank on Google, or on any other search engine, it needs to first be crawled by that search engine. But how you see your website differs greatly from how Google sees it. That’s why it’s important to understand what elements search engines look at if you’d like to have a website that appears in search results.

So, what does Google see when it crawls your website? When a search engine crawls your website, it reads the on-page content and links, but in the form of HTML code. Additionally, it looks at the title and header tags and meta description of your page. Google also sees images by reading their alt text and looks at schema markups to understand what the website offers.

Want to find out more about how Google sees each of those elements? Read on as we go into more detail further down this blog.

Jump To:

How Does Google See My Website?

No matter what theme or CRM your website uses, when you open it, you should be able to see key elements such as your website’s URL, your logo, the navigation bar and the content on your pages – the title, the text content, the images and other media to name a few. 

And interestingly enough, Google is able to see that same information! Except, it sees it slightly differently.

Regardless of how many pages you’ve got on your website, Google can inspect them all with the help of Googlebot – Google’s very own web crawler. Googlebot comes across billions of pages and sites every day, but for it to see your website, especially if it has a lot of pages, it’s recommended you have a sitemap.

First Point of Contact of Google and Your Website

When Googlebot arrives on your website, the first thing it will read is your sitemap – a robots.txt file that contains all the pages of your website that you want Google to crawl and additional information about other files on your website. 

Think of a sitemap as a guide; you show Google which pages and files on your website are important so that once Googlebot arrives on your website, it knows where to go next.

Wildcat Top Tip: if your website is on WordPress, you can use the Yoast plugin, which will automatically generate it for you. Then, you can easily submit it to Google Search Console. Need help with this? Read more about building and submitting sitemaps on Google Search Central.

Once Googlebot discovers your sitemap,  it will move on to read your pages.

How Does Google Read My Content?

Google will read every single word that’s on your page – from the page titles in the navigation menu, through the page content, to the text in the footer. However, while you can see the different fonts and text sizes, Google will see it all in code.

Header Tags and Paragraph Text

Alongside paragraphs with text, your pages are likely to have a title and subheadings to help page visitors navigate easier through the page’s content. Those subheadings are likely to be tagged as header tags in the page code.

Google pays extra attention to the header tags. To differentiate them from the paragraph text on the page, they will be marked differently in the HTML code.

Top Tips for Structuring Your Page Content

How Does Google Crawl Images and Videos? 

Alt text is what helps Google understand what’s featured in an image. As Googlebot can’t see what an image looks like, it reads its Alt text, which should describe what’s included in it.

When it comes to videos, you can help Google index them by providing metadata about each video, including its title, description, length, thumbnail image and upload date. 

Googlebot crawls links in the same way it crawls content: it sees them in the HTML code. However, for Google to crawl your links, they need to have a <a> tag and an ‘href’ attribute. If they don’t follow this format, Googlebot wouldn’t be able to follow them.

Are There Elements That Google Sees But We Don’t?

Yes, there are certain page elements that you wouldn’t be able to see on-page without referring to the page code or using a tool to inspect your page. These include:

These elements, alongside title tags, meta description, user engagement and page mobile friendliness are just a few of the many elements Google can see, unlike us, and considers when deciding where to rank your website.

Google Crawlability FAQs

How Do I Get Google to Crawl My Site Faster?

You can get Google to crawl your website more often by removing low-quality pages from your website, especially if you have a large website. Google can crawl only so many pages at a time, so removing ones that don’t bring value will work in favour of your quality pages. 

In addition, adding fresh content regularly, building a good internal links structure and reducing the number of technical errors can also help Google crawl your website more often. 

How Often Does Google Crawl Websites?

This would depend on the size of your website and how often you update it, but in general, Google would crawl your website every 2-3 days to 2-3 weeks. Something to bear in mind though is that Googlebot crawls URLs with a different frequency. For example, it might crawl some URLs every 5-6 days, while others – every 5-6 months.

How Can I Check if Google Has Crawled My Website?

Use Google Search Console’s inspection tool which shows on which date a page was last crawled and indexed. If you find that a page on your website hasn’t been indexed, which is often the case for newly-created pages, you can request indexing manually.

Do You Need Help Making Your Website More Visible on Google?

You’re in the right place. We’ve helped a wide range of different businesses punch above their weight online with tailored SEO services. Contact us today for a free consultation.

Post by

Wildcat Digital

Will Hitchmough

Founder

Our founder, Will Hitchmough, worked at a number of high profile Sheffield Digital Agencies before founding Wildcat Digital in 2018. He brings an extensive knowledge of all things related to SEO, PPC and Paid Social, as well as an expert knowledge of digital strategy.

Digital Marketing can be a minefield for many businesses, with many agencies ready to take your money without knowing how to deliver results. I founded Wildcat Digital to deliver digital success to businesses with smaller budgets in a transparent way.

Chloe Robinson

Content Strategist Team Lead

With a degree in Marketing and a background in more traditional, offline marketing, Chloe joined Wildcat in 2021 after deciding to move into the digital marketing industry. She joined us as a Content Specialist and quickly moved up the ranks, becoming a Content Strategist and later an SEO Team Leader.

Outside of work, Chloe is an avid creative. If she’s not knitting, you’ll likely find her behind a sewing machine or in the kitchen trying (and often failing!) to make sourdough.

Paul Pennington

SEO Account Director

Paul has a strong background in SEO, having previously founded and ran a successful eCommerce business, as well as running a personal blog that achieves an average of 17K users per month. Paul’s knowledge of SEO is extensive, with a strong emphasis on client handling and technical SEO.

Outside of work, Paul enjoys spending time with his family and staying active with weight lifting and combat sports.

Nadea van der Merwe

Head of Operations

Nadea joined Wildcat in 2021 and has since overhauled the way we work. She has a background in various administrative, operations and HR roles, which gave her the experience and skills needed to lead and organise a growing business. 

Outside of work, Nadea loves anything that keeps her active, but she especially enjoys hiking, camping and mountain biking.

Molly Sturgeon

Senior SEO Account Manager

With a background in sales, Molly is a natural Account Manager, brilliantly handling any issues that come her way. Having joined us as a Digital Marketing Executive, and working part-time through her final year of University, Molly is a shining example of how hard work pays off. She is now an SEO Account Manager with a particular interest in Content and Client Management. 

In her spare time, Molly loves to get out in nature, hiking and exploring the Peak District. She also loves cooking and likes to unwind with a bit of yoga.

Libby Oldale

PPC Team Leader

Libby joined Wildcat in 2021 as our first PPC hire. With a degree in Digital Media Production, a Master’s in Digital Media Management and previous experience in Social Media Management, Libby hit the ground running and has since climbed the ranks to Senior PPC Account Manager and has a particular interest in the eCommerce sector.

Outside of work, Libby likes gaming, and cooking and likes to keep active by lifting weights.

Jasmine Savery

SEO Account Manager

Jasmine joined Wildcat in 2022 with a strong background in SEO and Account Management. At the time, she was finishing up a Level 4 Apprenticeship in Digital Marketing from the Chartered Institute of Marketing, and has since worked her way up to SEO Account Manager. Jasmine excels at content writing and promotion, and particularly enjoys finding creative ways to join the dots on multi-channel campaigns.

In her spare time, Jasmine volunteers at a charity, helping combat loneliness & social isolation experienced by older neighbours. Outside of Wildcat, she owns a catering company, Savery Grazing, creating delicious grazing tables & platters for a range of events. She also loves skiing and exploring the Peak District.

Braden Godley

Senior PPC Executive

Prior to joining Wildcat, Braden founded and ran his own Social Media Management agency where he gained valuable skills in growing brands’ online presence, which has since proven invaluable in his role at Wildcat. 

Outside of work, Braden is a big football fan, regularly travelling to Pride Park to support Derby County. He also enjoys watching and playing snooker, hiking in the Peak District, and attending air and car shows.

Jon Herdman

Senior SEO Executive

After spending ten years managing businesses, restaurants, cafes and event spaces across Sheffield, Jon decided to change careers and joined Wildcat as an SEO Executive in 2022. He especially enjoys the client management side of the job, helping them to understand digital marketing and ways in which they can build their business’s presence online. 

Outside of work, Jon likes to keep fit with running, badminton and football, and also loves music. 

Rachel Davies

Senior SEO Executive

Rachel joined us as a graduate, having recently graduated from Sheffield University with a degree in English Literature. Since joining, Rachel has proven herself to be a Content Queen, and particularly enjoys getting stuck into projects that allow her to explore her creative side. 

Outside of work, Rachel enjoys a wide range of hobbies, including rugby, singing, reading, and spending time with her family and three labradors.

Dariusz Baczyk

Team Lead & Technical SEO Account Manager

With a degree in Computer Science and SEO experience dating back to 2017, Dariusz has a wide range of SEO skills and knowledge. His specialist knowledge of Technical SEO has firmly landed him the title of Wildcat’s Technical Wizard, and he has recently taken on the responsibility of Team Leader for the Panthers Team.

In his spare time, Dariusz loves hiking, experimenting and trying new coffees and loves learning new things. He is currently learning more about CRO and AI and how this could benefit our clients.

Jamie Stowe

Senior SEO Account Manager

With a degree in Film and TV production, and a varied career history, Jamie made the move to marketing with a Masters degree in Digital Media Management. He has since worked in SEO at Agencies across Sheffield, before joining Wildcat and working his way up to SEO Account Manager. Jamie has a particular interest in backlinks and Digital PR and has recently gained a client a valuable backlink from Forbes!

In his spare time, Jamie is an avid foodie and loves trying new restaurants and cuisines. He also loves to travel and spent a year travelling to Australia after university.

Andy Blanchard

Senior SEO Executive

Andy joined Wildcat in 2023 after starting his digital marketing career in-house for a local Sheffield company. Since joining, he has developed a strong interest in Technical SEO and has strong skills in Account Management. 

Outside of work, Andy loves music and plays in a couple of bands. He also enjoys rock climbing, cycling, photography and good food.

Siena Russell

Client Success Coordinator

Siena joined us in 2023 with a background in sales and digital marketing. She leads on client relationships across the company, ensuring that our customers are happy throughout their journey with us, from their initial consultation through to onboarding and beyond. 

Outside of work, Siena enjoys travelling and getting stuck into the local culture. She likes to make the most of her experiences and particularly enjoys watching sunrises and sunsets from beautiful locations around the world.

Thea Chapman

SEO Account Manager

Thea has a wealth of experience in SEO, having previously worked for other Digital Marketing Agencies in Sheffield. She has a particular interest and skills in Technical SEO, but is more than willing to get stuck in and give anything a go. 

Outside of work, Thea spends most of her time with her children, but also loves reading, photography and gardening. 

Tom Brookes

PPC Executive

Before joining Wildcat, Tom worked across different industries, building skills in sales and customer service. He later developed a passion for digital marketing whilst working on personal marketing projects and freelance ventures, and gained numerous certifications in PPC and Social Media. 

Outside of work, Tom enjoys staying active by going to the gym and hiking. He also loves travelling and motorbiking.

Rich Ayre

Head of Growth

Rich joined us in May 2024 to head up our growth team. With years of experience helping other agencies to grow, Rich joins us at an exciting time as Wildcat is working on a five-year plan to become one of the biggest agencies in the UK.

Outside of work, Rich is a father to three children, which keeps him very busy! He’s also recently started running again to keep fit and loves a bit of DIY.

Kezia Humphries

SEO Executive

Kezia joined us in July 2024 after completing a CIM Certificate in Digital Marketing and gaining experience in Content SEO at another Sheffield agency.

In her spare time, Kezia loves to get outdoors, bouldering, hiking and travelling.

Amy Varley

SEO Executive

Amy joined Wildcat in 2024 with a background in journalism, having worked as a News Editor and Editor-in-Chief at The Sheffield Tab. She is naturally interested in Content SEO and research, so will no doubt prove to be a content power-house.

In her spare time, Amy loves watching crime shows, listening to music and hanging out with her dog, Eddie!

Masilda Hysi

PPC Account Manager

Masilda joined the Wildcat team in October 2024 with over seven years of experience in digital marketing. She specialises in Google Ads, but is also certified in Google Analytics, YouTube Ads, Google Ads for Ecommerce and Apple Search Ads. She has extensive expertise in performance marketing, display advertising, online lead generation and market planning.

In her free time, Masilda likes staying active, cooking, trying new restaurants and exploring new places.

 

More blogs.

View all

December Digital Marketing News Roundup

December 20, 2024

December has been a busy month in terms of Google Core Updates - the November update completed and a new…

Kezia Humphries

Knowledge Hub
News

Are Author Pages Important for SEO?

December 16, 2024

You might think that Author and Meet the Team pages are just a nice addition to your website that showcases…

Chloe Robinson

Content
Knowledge Hub
SEO

5 Marketing Trends You Need To Know About in 2025

December 16, 2024

As the digital landscape evolves, keeping pace with marketing trends is crucial to staying competitive. In this article, we explore…

Jasmine Savery

Knowledge Hub
SEO