PDF rausgenommen
This commit is contained in:
aschwarz
178
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/README.md
vendored
Normal file
178
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/README.md
vendored
Normal file
@ -0,0 +1,178 @@
|
||||
These are community-contributed definitions for search engine and social network detections list maintained and used by [Matomo](https://matomo.org/) (formerly Piwik), the leading open source web analytics platform.
|
||||
|
||||
# Social Networks
|
||||
|
||||
Social networks are defined in YAML format in the file `Socials.yml`
|
||||
|
||||
The definitions contain the name of the social network, as well as a list of one or more urls.
|
||||
|
||||
```YAML
|
||||
"My Social Network":
|
||||
- my-social-network.com
|
||||
- mysocial.org
|
||||
```
|
||||
|
||||
# Search Engines
|
||||
|
||||
Search engines are defined in YAML format in the file `SearchEngines.yml`
|
||||
|
||||
Definitions of search engines contain several parameters that are required to be able to detect which search engine and which search keywords are included in a given url.
|
||||
|
||||
Those parameters are:
|
||||
- name of the engine
|
||||
- URLs of the engine
|
||||
- request parameters (or regexes), that can be used to get the search keyword
|
||||
- hidden keyword paths
|
||||
- backlink pattern, that can be used to create a valid link back to the search engine (with the keyword)
|
||||
- charsets that might be used to convert keyword to UTF-8
|
||||
|
||||
For each search engine (name) it is possible to define multiple configurations.
|
||||
Each configuration needs to include one or more urls, one or more parameters/regexes and may include a backlink and one or more charsets.
|
||||
|
||||
## Configuration parameters
|
||||
|
||||
### urls
|
||||
|
||||
Each configuration needs to contain one ore more urls. Please only define the hostname.
|
||||
You can use `{}` as a placeholder for country shortcodes in subdomains or tld.
|
||||
- `{}.searchengine.com` would also match `de.searchengine.com` or `nl.searchengine.com`
|
||||
- `searchengine.{}` would also match `searchengine.de` or `searchengine.nl`
|
||||
|
||||
#### Notes:
|
||||
- For TLDs only `{}` would also match combined TLDs like `co.uk`. (Full list `com.*, org.*, net.*, co.*, it.*, edu.*`)
|
||||
- The first URL will be used for the icon, so the most popular/representative URL should be placed there
|
||||
|
||||
### params
|
||||
|
||||
Each configuration needs to contain one or more params. A param is a name of a request param that might be available in the url.
|
||||
As many search engines do not use query parameters to handle the keywords, but include them in the url structure, it is also possible to define a regex.
|
||||
A regex need to be encapsulated by '/'
|
||||
|
||||
```YAML
|
||||
SearchEngine:
|
||||
-
|
||||
urls:
|
||||
- searchengine.com
|
||||
params:
|
||||
- q
|
||||
- '/search\/[^\/]+\/(.*)/'
|
||||
```
|
||||
|
||||
The example above would first try to get the keyword with the request param `q`. If that is not available it would use the regex `'/search\/[^\/]+\/(.*)/'` to get it.
|
||||
This regex would match an url like 'http://searchengine.com/search/web/matomo'
|
||||
|
||||
### backlink
|
||||
|
||||
A backlink will be used to generate a link back to the search engine including the given keyword. backlinks may be defined per configuration and need to include `{k}` as placeholder for the keyword.
|
||||
|
||||
```YAML
|
||||
SearchEngine:
|
||||
-
|
||||
urls:
|
||||
- searchengine.com
|
||||
params:
|
||||
- q
|
||||
backlink: '/search?q={k}'
|
||||
```
|
||||
|
||||
For the configuration above the generated backlink would look like `searchengine.com/search?q=matomo` (assuming that `matomo` is the keyword).
|
||||
|
||||
#### Note:
|
||||
|
||||
The backlink will always be generated using the __first__ defined url in this configuration block.
|
||||
|
||||
### hiddenkeyword
|
||||
|
||||
More and more search engines started to hide keywords in referrers for privacy reasons. `hiddenkeyword` allows to define if the search engines refers from paths that may not contain/provide a keyword.
|
||||
If a search engine always refers from the path `/do/search` that path should be added. If the path might vary regexes can be added with strings, starting and ending with `/`, e.g. `/\/search[0-9]*/`
|
||||
|
||||
NOTE: The path matched against will also include the referrers query string and hash. So if the referrer might contain a query you might use a regex like `/search(\?.*)?/`
|
||||
|
||||
```YAML
|
||||
SearchEngine:
|
||||
-
|
||||
urls:
|
||||
- searchengine.com
|
||||
params: []
|
||||
hiddenkeyword:
|
||||
- '/^$/'
|
||||
- '/'
|
||||
- '/search'
|
||||
```
|
||||
|
||||
The configuration above would allow an empty keyword for `searchengine.com`, `searchengine.com/` and `searchengine.com/search`
|
||||
|
||||
### charsets
|
||||
|
||||
Charsets can be defined if search engines are using charsets other than UTF-8. The provided charset will be used to convert any detected search keyword to UTF-8.
|
||||
|
||||
## Simple definition
|
||||
|
||||
A simple defintion of a search eninge might look like this:
|
||||
|
||||
```YAML
|
||||
SearchEngine:
|
||||
-
|
||||
urls:
|
||||
- searchengine.com
|
||||
- search-engine.org
|
||||
params:
|
||||
- q
|
||||
- as_q
|
||||
```
|
||||
|
||||
The example above would match for the hosts `searchengine.com` and `search-engine.org` and use the request parameters `q` and `as_q` (in this order) to detect the search keyword.
|
||||
|
||||
## Multiple configurations
|
||||
|
||||
A simple definition of a search engine with multiple configurations might look like this:
|
||||
|
||||
```YAML
|
||||
SearchEngine:
|
||||
-
|
||||
urls:
|
||||
- searchengine.com
|
||||
params:
|
||||
- as_q
|
||||
-
|
||||
urls:
|
||||
- search-engine.org
|
||||
params:
|
||||
- q
|
||||
```
|
||||
|
||||
The definition above would again match for the hosts `searchengine.com` and `search-engine.org`. However the request parameter `q` will be used specifically for `search-engine.org` while the request parameter `as_q` will be used specifically for `searchengine.com`.
|
||||
|
||||
## Complete definition
|
||||
|
||||
A complete definition (including all optionals) of a search engine might look like this:
|
||||
|
||||
```YAML
|
||||
SearchEngine:
|
||||
-
|
||||
urls:
|
||||
- searchengine.com
|
||||
params:
|
||||
- q
|
||||
backlink: '/search?q={k}'
|
||||
charsets:
|
||||
- windows-1250
|
||||
-
|
||||
urls:
|
||||
- search-engine.org
|
||||
params:
|
||||
- as_q
|
||||
-
|
||||
urls:
|
||||
- search-engine.fr
|
||||
params: []
|
||||
hiddenkeyword:
|
||||
- '/'
|
||||
- '/^search.*/
|
||||
```
|
||||
|
||||
In this case, a backlink and charset is only defined for the first configuration. Which means there is no backlink nor charset set for `search-engine.org`.
|
||||
|
||||
# Contribute
|
||||
|
||||
We welcome your contributions and Pull requests at [github.com/matomo-org/searchengine-and-social-list](https://github.com/matomo-org/searchengine-and-social-list/edit/master/README.md)!
|
||||
2553
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/SearchEngines.yml
vendored
Normal file
2553
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/SearchEngines.yml
vendored
Normal file
File diff suppressed because it is too large
Load Diff
256
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/Socials.yml
vendored
Normal file
256
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/Socials.yml
vendored
Normal file
@ -0,0 +1,256 @@
|
||||
Badoo:
|
||||
- badoo.com
|
||||
|
||||
Bebo:
|
||||
- bebo.com
|
||||
|
||||
BlackPlanet:
|
||||
- blackplanet.com
|
||||
|
||||
Buzznet:
|
||||
- buzznet.com
|
||||
|
||||
Classmates.com:
|
||||
- classmates.com
|
||||
|
||||
Cyworld:
|
||||
- global.cyworld.com
|
||||
|
||||
Gaia Online:
|
||||
- gaiaonline.com
|
||||
|
||||
Geni.com:
|
||||
- geni.com
|
||||
|
||||
GitHub:
|
||||
- github.com
|
||||
|
||||
Google%2B:
|
||||
- plus.google.com
|
||||
- url.google.com
|
||||
- com.google.android.apps.plus
|
||||
|
||||
Douban:
|
||||
- douban.com
|
||||
|
||||
Dribbble:
|
||||
- dribbble.com
|
||||
|
||||
Facebook:
|
||||
- facebook.com
|
||||
- fb.me
|
||||
- m.facebook.com
|
||||
- l.facebook.com
|
||||
|
||||
Fetlife:
|
||||
- fetlife.com
|
||||
|
||||
Flickr:
|
||||
- flickr.com
|
||||
|
||||
Flixster:
|
||||
- flixster.com
|
||||
|
||||
Fotolog:
|
||||
- fotolog.com
|
||||
|
||||
Foursquare:
|
||||
- foursquare.com
|
||||
|
||||
"Friends Reunited":
|
||||
- friendsreunited.com
|
||||
|
||||
Friendster:
|
||||
- friendster.com
|
||||
|
||||
gree:
|
||||
- gree.jp
|
||||
|
||||
Haboo:
|
||||
- habbo.com
|
||||
|
||||
"Hacker News":
|
||||
- news.ycombinator.com
|
||||
|
||||
hi5:
|
||||
- hi5.com
|
||||
|
||||
Hyves:
|
||||
- hyves.nl
|
||||
|
||||
identi.ca:
|
||||
- identi.ca
|
||||
|
||||
instagram:
|
||||
- instagram.com
|
||||
- l.instagram.com
|
||||
|
||||
lang-8:
|
||||
- lang-8.com
|
||||
|
||||
Last.fm:
|
||||
- last.fm
|
||||
- lastfm.ru
|
||||
- lastfm.de
|
||||
- lastfm.es
|
||||
- lastfm.fr
|
||||
- lastfm.it
|
||||
- lastfm.jp
|
||||
- lastfm.pl
|
||||
- lastfm.com.br
|
||||
- lastfm.se
|
||||
- lastfm.com.tr
|
||||
|
||||
LinkedIn:
|
||||
- linkedin.com
|
||||
- lnkd.in
|
||||
- linkedin.android
|
||||
|
||||
LiveJournal:
|
||||
- livejournal.ru
|
||||
- livejournal.com
|
||||
|
||||
MeinVZ:
|
||||
- meinvz.net
|
||||
|
||||
Mixi:
|
||||
- mixi.jp
|
||||
|
||||
MoiKrug.ru:
|
||||
- moikrug.ru
|
||||
|
||||
Multiply:
|
||||
- multiply.com
|
||||
|
||||
my.mail.ru:
|
||||
- my.mail.ru
|
||||
|
||||
MyHeritage:
|
||||
- myheritage.com
|
||||
|
||||
MyLife:
|
||||
- mylife.ru
|
||||
|
||||
Myspace:
|
||||
- myspace.com
|
||||
|
||||
myYearbook:
|
||||
- myyearbook.com
|
||||
|
||||
Nasza-klasa.pl:
|
||||
- nk.pl
|
||||
|
||||
Netlog:
|
||||
- netlog.com
|
||||
|
||||
Odnoklassniki:
|
||||
- odnoklassniki.ru
|
||||
|
||||
Orkut:
|
||||
- orkut.com
|
||||
|
||||
Ozone:
|
||||
- qzone.qq.com
|
||||
|
||||
Pinterest:
|
||||
- pinterest.com
|
||||
- pinterest.ca
|
||||
- pinterest.ch
|
||||
- pinterest.co.uk
|
||||
- pinterest.de
|
||||
- pinterest.dk
|
||||
- pinterest.es
|
||||
- pinterest.fr
|
||||
- pinterest.ie
|
||||
- pinterest.jp
|
||||
- pinterest.nz
|
||||
- pinterest.pt
|
||||
- pinterest.se
|
||||
|
||||
Plaxo:
|
||||
- plaxo.com
|
||||
|
||||
reddit:
|
||||
- reddit.com
|
||||
- np.reddit.com
|
||||
- pay.reddit.com
|
||||
|
||||
Renren:
|
||||
- renren.com
|
||||
|
||||
Skyrock:
|
||||
- skyrock.com
|
||||
|
||||
Sonico.com:
|
||||
- sonico.com
|
||||
|
||||
StackOverflow:
|
||||
- stackoverflow.com
|
||||
|
||||
StudiVZ:
|
||||
- studivz.net
|
||||
|
||||
Tagged:
|
||||
- login.tagged.com
|
||||
|
||||
Taringa!:
|
||||
- taringa.net
|
||||
|
||||
Telegram:
|
||||
- web.telegram.org
|
||||
- org.telegram.messenger
|
||||
|
||||
Tuenti:
|
||||
- tuenti.com
|
||||
|
||||
tumblr:
|
||||
- tumblr.com
|
||||
|
||||
Twitter:
|
||||
- twitter.com
|
||||
- t.co
|
||||
|
||||
Sourceforge:
|
||||
- sourceforge.net
|
||||
|
||||
StumbleUpon:
|
||||
- stumbleupon.com
|
||||
|
||||
Vkontakte:
|
||||
- vk.com
|
||||
- vkontakte.ru
|
||||
|
||||
YouTube:
|
||||
- youtube.com
|
||||
- youtu.be
|
||||
|
||||
V2EX:
|
||||
- v2ex.com
|
||||
|
||||
Viadeo:
|
||||
- viadeo.com
|
||||
|
||||
Vimeo:
|
||||
- vimeo.com
|
||||
|
||||
vkrugudruzei.ru:
|
||||
- vkrugudruzei.ru
|
||||
|
||||
WAYN:
|
||||
- wayn.com
|
||||
|
||||
Weibo:
|
||||
- weibo.com
|
||||
- t.cn
|
||||
|
||||
WeeWorld:
|
||||
- weeworld.com
|
||||
|
||||
"Windows Live Spaces":
|
||||
- login.live.com
|
||||
|
||||
Xanga:
|
||||
- xanga.com
|
||||
|
||||
XING:
|
||||
- xing.com
|
||||
8
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/composer.json
vendored
Normal file
8
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/composer.json
vendored
Normal file
@ -0,0 +1,8 @@
|
||||
{
|
||||
"name": "matomo/searchengine-and-social-list",
|
||||
"description": "Search engine and social network definitions used by Matomo (formerly Piwik)",
|
||||
"license": "CC0-1.0",
|
||||
"replace": {
|
||||
"piwik/searchengine-and-social-list":"*"
|
||||
}
|
||||
}
|
||||
20
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/package.json
vendored
Normal file
20
msd2/tracking/piwik/vendor/matomo/searchengine-and-social-list/package.json
vendored
Normal file
@ -0,0 +1,20 @@
|
||||
{
|
||||
"name": "searchengine-and-social-list",
|
||||
"version": "1.4.1",
|
||||
"description": "Search engine and social network definitions used by Matomo (formerly Piwik)",
|
||||
"keywords": [
|
||||
"searchengine",
|
||||
"social network"
|
||||
],
|
||||
"main": "SearchEngines.yml",
|
||||
"repository": {
|
||||
"type": "git",
|
||||
"url": "git://github.com/matomo-org/searchengine-and-social-list.git"
|
||||
},
|
||||
"homepage": "https://github.com/matomo-org/searchengine-and-social-list#readme",
|
||||
"bugs": {
|
||||
"url": "https://github.com/matomo-org/searchengine-and-social-list/issues"
|
||||
},
|
||||
"author": "Matomo Team",
|
||||
"license": "CC0-1.0"
|
||||
}
|
||||
Reference in New Issue
Block a user