http://www.investorhome.com/mining.htm
Statisticians are fond of pointing out that if you torture the data long enough, it will confess to anything.

http://www.bethefamilycfo.com/html_emails/kimmunique_20040527e.html
If you torture the data long enough, it will confess to anything.

Toughlog: We torture the data until it confess to itself.

------------------------------------------------

This version: 10000 records in 38.20 sec. =~ 1.000.000 records/hour

Start med

Installer PostgreSQL
su - postgres
dropuser tange
createuser -A -D tange
dropdb tange
createdb tange
psql tange < language.sql
su - tange
psql tange < create.sql
perl genfunc.pl | psql tange
psql tange < addhit.sql

Tilføj hit: se 2sql.pl

Sitemap med tykke streger
Forladende webside
Gennemsnitlig spenttime
  pr session
  pr side
Antal sider
  pr session

Folks båndbredde
  Xfertime for store filer

Brugere, der ikke loader grafik
  (Hvad plejer folk at loade fra siden)

Klassifikation af browser
  Netscape ver X
  Max 100 klasser
  BrowserClass vedligeholdes i hånden

Sider, der bliver refereret til, men som ikke findes
  Hvor bliver der refereret fra?
  - interne sider
  - externe sider

Total hits
  Total mime text/html sider
  Antal besøgende

Flere domæner til samme customerid
   www.lederskab.dk og www.detgodeliv.dk

Hvilke hosts bruges ved samme customerid

Gengangere (fast IPnr)

Exclude robots
Hvem laver mirrors?

Exclude virus-attack email-harvest

---
stat.stinet.dk lederskab annie nissefisk

Addhit

RefererHitID = NULL;
IF CHAR_LENGTH(p_RefererURLText) > 1 THEN
  --RefererHitid = Seneste hit fra dette IP-nummer med pågældende url
    select SessionID into v_RefererSessionID from Hit 
    where IPID=v_IPID
    and BrowserID=v_BrowserID
    and URLID=v_RefererURLID
    and CustomerID=v_CustomerID
    order by HitDateTime desc;
END IF;

IF v_RefererHitID NOT NULL THEN
  SessionID = v_RefererSessionID;
  select HitDateTime into v_LastHitDateTime from Hit 
    where IPID=v_IPID
    and BrowserID=v_BrowserID
    and CustomerID=v_CustomerID
    order by HitDateTime desc;
  v_Timespent = v_hitdatetime - v_LastHitDateTime;
} else {
  SessionID = nextval(''hit_SessionID_seq'');
  Timespent = NULL;
}




 173508 | domain00001.gov ID=14
  61572 | domain00021.gov
  47194 | domain00039.gov
  35008 | domain00005.gov
  34522 | domain00168.gov
  31644 | domain01076.gov
  29466 | domain00011.gov
  17873 | domain00246.gov


Fil: .htaccess
# http://httpd.apache.org/docs-2.0/mod/mod_usertrack.html
CookieTracking on
