In what format are the requested urls written in webserver log files?

i am developing a fre开发者_StackOverflow中文版e website sitemap application.

I would like to ask what is the format of the requested urls that are written in the webserver log files ?

I want to parse those log files in order to extract the various pages of the website.

Is the format always " GET /mywebpage.html " in each row ? Thank you !

---

It's not always the same - the default varies between servers, and it is configurable. For example, in Apache, you can set a CustomLog directive in your config and that allows complete customisation of the information that is logged, the order in which is it logged and the file it is logged to.

---

By far the most common format is Apache CLF (Common Log Format or Combined Log Format):

LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-agent}i\"" combined

To get a better answer you need to specify the webserver in use, or at the very least show a sample log line.