home *** CD-ROM | disk | FTP | other *** search
- Newsgroups: comp.os.vms
- Path: sparky!uunet!zaphod.mps.ohio-state.edu!moe.ksu.ksu.edu!ux1.cso.uiuc.edu!usenet.ucs.indiana.edu!fractal!mdchaney
- From: mdchaney@fractal.ucs.indiana.edu (M Darrin Chaney)
- Subject: $add_holder is slow...
- Message-ID: <C031y8.9Bz@usenet.ucs.indiana.edu>
- Sender: news@usenet.ucs.indiana.edu (USENET News System)
- Nntp-Posting-Host: fractal.ucs.indiana.edu
- Organization: Indiana University, Bloomington
- References: <1992Dec30.044645.11200@cnplss5.cnps.philips.nl> <6844364@zl2tnm.gen.nz>
- Date: Wed, 30 Dec 1992 17:30:07 GMT
- Lines: 63
-
- We've got about 40,000 users on our cluster, which consists of various newer
- VAXen (the smallest being a 6500, I think). Anyway, we still keep a separate
- rightslist and uaf on each of the six nodes (I don't run these machines, so
- don't blame me).
-
- Recently, I set about rebuilding the rightslist for the cluster, in order to
- get each node in sync again, and make sure that everybody has only what they
- need. We have 5 different rights, of which everybody has at least one. They
- are:
-
- UCS - people who work at UCS
- STAFF - staff members
- FACULTY -faculty members
- GRAD - grad students
- UGRAD - undergraduate students
-
- It is possible for people to have more than one, for instance STAFF and UGRAD.
-
- Anyway, we had a spare 8820 sitting around (VMS 5.5-2), so I'm using it. It
- has 384MB of memory, and we set up a huge cache on it. We also made the
- account that we are using have high quotas:
-
- Maxjobs: 0 Fillm: 100 Bytlm: 50000
- Maxacctjobs: 0 Shrfillm: 0 Pbytlm: 0
- Maxdetach: 0 BIOlm: 50 JTquota: 1024
- Prclm: 2 DIOlm: 50 WSdef: 2048
- Prio: 4 ASTlm: 24 WSquo: 32768
- Queprio: 0 TQElm: 10 WSextent: 65535
- CPU: (none) Enqlm: 2000 Pgflquo: 40000
-
- Anyway, I copid the rest of the identifiers into the new rightslist, of which
- there were only a few thousand. Then, I used the cluster UAF to create the
- username rights (using add/ident/user=* in authorize). I made 5 files, each
- containing in "rightslist" format the UIC of each person who needed that
- right, and the right itself. So, each line was like such:
-
- right,uic,attr
-
- attr is always 0. The program loops through the file, reading each line and
- using $add_holder to add the holder. Here's the layout:
-
- UCS - 500 holders
- STAFF- 4000 holders
- FACULTY- 3000 holders
- GRAD- 8400 holders
- UGRAD- 30000 holders
-
- The amount of time it takes to add these increases rather dramatically. The
- first 50 (of any set) take maybe 10 seconds. After around 1000, it takes 10
- or 15 minutes to do 50. I figure it's because of RMS keeping track of all
- the duplicate keys. I have everything except UGRAD added, with about 16,000
- left. At the current rate (50 every 20 minutes), it'll take another 4 days.
- It will probably slow down even more, though, so the time will be longer.
-
- Does anyone know a way to speed this up? Pretty much anything is possible
- with the machine that we are using. Thanks in advance.
-
- Darrin
- --
-
- mdchaney@iubacs mdchaney@bronze.ucs.indiana.edu mdchaney@rose.ucs.indiana.edu
-
- "I want- I need- to live, to see it all..."
-