Generating statistics from the Sun directory server access logs

I have been managing Sun’s directory server for close to four years, and it is one of the few products I use that has all the bells and whistles out of the box. One extremely useful feature is the ability to generate statistics from the server access logs. This capability is built into the logconv.pl perl script, which is part of the Sun directory server resource kit (as a side note, logconv.pl is what motivated me to write ldap-stats.pl to analyze OpenLDAP log files).

To use the logconv.pl statistics program to analyze your server access logs, you will first need to grab the resource kit from the Sun download page. Once you download and extract the resource kit, you can cd into the $RESOURCE_KIT_HOME/perl directory, and run logconv.pl with the optional “-V” (verbose) option, and the names of the log(s) to analyze:

$ logconv.pl -V access

This will produce a report similar to the following:

SunOne Access Log Analyzer 4.71

Initializing Variables...
Processing 1 Access Log(s)...

  /home/matty/access (Total Lines: 135987) 
       1000 Lines Processed
       2000 Lines Processed
          < ..... >
     134000 Lines Processed
     135000 Lines Processed
*    135987 Lines Processed                     Total Lines Processed:       135987

* Total Lines Analyzed:  135987


----------- Access Log Output ------------

Start of Log:  15/May/2007:16:13:30
End of Log:    16/May/2007:16:13:55

Restarts:                     0

Opened Connections:           16967
Closed Connections:           0
Total Operations:             34183
Total Results:                34183
Overall Performance:          100.0%
Most Pending Operations:      3

Searches:                     16552
Modifications:                13
Adds:                         4
Deletes:                      1
Mod RDNs:                     0
Compares:                     0

5.x Stats 
Persistent Searches:          0
Internal Operations:          0
Entry Operations:             0
Extended Operations:          658
Abandoned Requests:           0
Smart Referrals Received:     0

VLV Operations:               0
VLV Unindexed Searches:       0
SORT Operations:              0
SSL Connections:              0

Entire Search Base Queries:   1
Unindexed Searches:           0

FDs Taken:                    16967
FDs Returned:                 0
Highest FD Taken:             472

Broken Pipes:                 0
Connections Reset By Peer:    0
Resource Unavailable:         0

Binds:                        16955
Unbinds:                      16738

 LDAP v2 Binds:               2
 LDAP v3 Binds:               16953
 Expired Password Logins:     0
 SSL Client Binds:            0
 Failed SSL Client Binds:     0
 SASL Binds:                  0

 Directory Manager Binds:     0
 Anonymous Binds:             2
 Other Binds:                 16953



----- Errors -----

err=0                 33985    Successful Operations   
err=49                  148    Invalid Credentials (Bad Password)
err=32                   50    No Such Object          


----- Top 20 Failed Logins ------

9           uid=foo,ou=people,dc=prefetch,dc=net
9           uid=bar,ou=people,dc=prefetch,dc=net

 < ..... >


----- Total Connection Codes -----

U1                    16738    Cleanly Closed Connections              
B1                      220    Bad Ber Tag Encountered                 

 < ..... >

----- Top 20 Clients -----

Number of Clients:  9

7204   1.2.3.4  
                   7124 -  U1   Cleanly Closed Connections
                     25 -  B1   Bad Ber Tag Encountered

5340   1.2.3.5      
                   5322 -  U1   Cleanly Closed Connections
                     18 -  B1   Bad Ber Tag Encountered

 < ..... >


----- Top 20 Bind DN's -----

Number of Unique Bind DN's: 398

3857            uid=foo,ou=people,dc=prefetch,dc=net
2761            uid=bar,ou=people,dc=prefetch,dc=net

  < ..... >


----- Top 20 Search Bases -----

Number of Unique Search Bases: 25

7716            ou=people,dc=prefetch,dc=net
5302            ou=groups,dc=prefetch,dc=net

 < ..... >


----- Top 20 Search Filters -----

Number of Unique Search Filters: 619

5324            (&(objectclass=organizationalperson)(uid=foo))
2761            (&(objectclass=organizationalperson)(entrydn=uid=bar,ou=people,dc=prefetch,dc=net))

 < ..... >

----- Top 20 Most Frequent etimes -----

34049           etime=0     
134             etime=1     


----- Top 20 Longest etimes -----

etime=1         134       
etime=0         34049     


----- Top 20 Largest nentries -----

nentries=5                      1
nentries=1                  16537
nentries=0                     14


----- Top 20 Most returned nentries -----

16537           nentries=1    
14              nentries=0    
1               nentries=5    



----- 5.x Extended Operations -----

302         1.3.6.1.4.1.42.2.27.9.6.1     Other                                                       
302         1.3.6.1.4.1.42.2.27.9.6.6     Other                                                       
18          1.3.6.1.4.1.42.2.27.9.6.5     Other                                                       
18          1.3.6.1.4.1.42.2.27.9.6.8     Other                                                       
18          1.3.6.1.4.1.42.2.27.9.6.4     Other                                                       


----- Top 20 Most Requested Attributes -----

8127        nsRoleDN           
8123        displayName        

 < ..... >

----- Recommendations -----

None.

As you can see from the output above, there are numerous useful statistics, including the number of unindexed searches, a list of errors, operations by client, etc. These statistics are an invaluable tool, and extremely useful for proactively finding problems in your infrastructure.

1 thought on “Generating statistics from the Sun directory server access logs”

  1. Hi matty,

    It seems from your blog that you are quite experience in managing sun directory server. May I ask you for a help.

    I am planning to install sun directory server on a solaris box.Can you send me (sunil.rkl at gmail dot com)some usefull tips/steps on how to istall the product effectively.

    Thanks ..

Leave a Reply

Your email address will not be published. Required fields are marked *