ProfitPress Mega CDROM2 …eeware (MSDOS)(1992)(Eng)/ProfitPress-MegaCDROM2.B6I/UTILITY/VIRUS/FWKCS102.ZIP/FWKCS102.DOC

Text File | 1990-10-30 | 22.1 KB | 398 lines

FWKCS(tm) Contents Signature, Ver. 1.02, 1990 Oct 30.
Copyright 1988,89,90 by Frederick W. Kantor. All rights reserved.

Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................

  The correct name for this zip file is FWKCS102.ZIP.
  In a true copy of this zip file, every file must test as  OK -AV.
  For help, see FWKCSF /h,/a,/d,/e,/l ; FWKZCS /h,/t,/l ; FWKDG <enter> .
  Re "external" programs, see list at end of FWKCSF /a .

(Copies of these help_screens are provided below.)

------------
Note:  This is a 'maintenance release', to protect against a particular
form of damaged zipfile which was brought to my attention by Mark Rapp,
for which I thank him.
------------

This Author_Verified zipfile contains:

        FWKCSF.COM   - which manipulates contents_signatures, calls other
                       programs, does other support work, and also produces
                       auxiliary .BAT files;

        FWKZCS.COM   - which generates contents_signatures for zipfiles and
                       non_zip files;

        FWKDG.COM    - which gathers together a work_list for setting up the
                       initial reference files;

        RAWSTART.BAT - for setting up an empty list_structure;

        LISTMAKR.BAT - for setting up an indexed system for referencing
                       contents_signatures from zip_files on a system which
                       has a hard_drive C: with suitable space; and

        FWKCS102.DOC - which you are now reading.


Other programs to have on your system:
--------------------------------------
LIST Ver. 7.5e is copyright 1983-90 by Vernon D. Buerg.
PCBoard v14.5 is copyright 1985-90 by Clark Development Company, Inc.
PKZIP, PKUNZIP Reg.U.S.Pat. and Tm.Off., Copr.1989-1990 PKWARE Inc., Ver.1.10.
QSORT Ver. 3.20 is copyright 1985,86,87,88 by Ben Baker.

Overview:
---------

    These FWKCSF and FWKZCS programs make use of what I have named
"contents_signature"s, for labelling files in a way which is independent of
the name, date, and amount of compression.  These "signatures" are made from a
32_bit CRC together with the uncompressed_file_length. The resulting signature
for a file caries at least 32, and more typically roughly 40 or more, bits of
significant information. This means that the probability of accidental match
between the contents_signatures of two unrelated files is statistically less
than one part in 4,000,000,000; and, noting that the file_length often can
carry more than 8 bits of information, more typically less than one part per
trillion.


Speed:
------

    The lists contain contents_signatures for all the files contained within
all the zipfiles, and/or all the "plain" files, scanned for this purpose on
your system.  For example, the master list serving the Invention Factory
Bulletin Board System is currently (1990 Oct 30) about 9.5 Megabytes long.
When a zipfile is uploaded onto the board, its contents are compared with the
contents of the other zipfiles, a report is prepared, and the files are
disposed of if they do not contain new material -- all in a few seconds
total, including the file_integrity test run by calling PKUNZIP and the
header_removal using PKZIP (see credits, above).  This "catches" files which
are duplicates of other zipfiles, and also catches files which are made up of
pieces which can be found scattered in separate zip files. If you are using
PCBoard Ver. 14.5 (see credits above), you can run the file, PCBTEST.BAT,
which you can generate by typing FWKCSF /a5m <enter>.  That's what's running
on the IFBB. It calls FWKCSF; which calls FWKZCS, PKUNZIP, QSORT, and PKZIP
(see credits above), deletes the rejects, and prepares PCBPASS.TXT or
PCBFAIL.TXT accordingly (see credits above).

Starting:
---------

    The first part is to make a work_list of what is to go into your
master_list of contents_signatures. If your system does not have redundant
volume_labels, then you can use FWKDG/L directly to gather the filenames and
paths. If you have a hard_drive C: with enough space, then you may wish to
run LISTMAKR.BAT to set up your working lists. It calls pipeline filter "FIND"
to restrict the work to zipfiles; calls FWKZCS to generate
contents_signatures; calls QSORT (see credits above and below) to sort the
resulting file; and calls FWKCSF to generate the index and set up the shorter
rapid_addition list.  The result winds up in a new subdirectory, C:\CS. The
four files are CSLIST.NDX, CSLIST.SRT, CSLIST1.NDX, and CSLIST1.SRT. The '1's
are for rapid_update. These defaults can be modified (see FWKCSF/d). (You may
want to filter out the names of any files which your operating system requires
be kept open, so that the signature_generation doesn't get put off_track
waiting for them.)

    You do not have to restrict the input to just zipfiles: FWKZCS can
calculate the contents_signatures for other files (all three of these FWK
programs are in assembly language).

    You can add files by using Y.BAT, which you can generate by typing
FWKCSF /a2m <enter>. Then just type  Y filename.ext <enter>. Wildcards * and ?
are OK. If you have LIST (see credits above) on your path or in your default
directory, then FWKCSF can call it to display the results of the search;
otherwise the results can be displayed by scrolling (with pause(s)). New
material is added to a (shorter) contents_signature list and indexed. Cross
associations are carried using both the master_list and the shorter updated
list, so that material scattered in pieces not all in one of the lists can
still be recognized as redundant.

    When you want to revise the master list, just type FWKCSF /v , and the
short list gets merged into the master list and restarted, with new indexes.

    If you wish to accession a set of files, and have their extensions changed
to indicate that they were redundant, as appropriate, you can use
ACCESION.BAT, which you can make by typing FWKCSF /a3m <enter>. With this on
your path, you can then type (for example) ACCESION J:\newstuf\*.* <enter>,
and let it work its way through a whole subdirectory of new files. It labels
those that fail as ".RNZ" (redundant non_zip); ".RED" (redundant, possibly
contained as part of a larger zipfile or spread among more than one zipfiles);
or ".DUP" (duplicate, where the contents_signatures appear to match one_to_one
those of each and every file in a single zipfile).

    If you are working with only zipfiles, and want them tested for integrity
as part of the accessioning process, then you can use ACCESZIP.BAT, which you
can make by typing FWKCSF /a4m <enter>. It calls PKUNZIP to test each file,
and attaches ".FZT" (failed zipfile test) to those that fail on that test, and
labels redundant ".RED" and duplicate ".DUP".

Here are those help_screens:
----------------------------


fwkcsf/h :

FWKCSF(tm) Contents Signature Finder, Ver. 1.02, 1990 Oct 30. FWKCSF/h for help
Copyright (C) 1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
Format 1:  FWKCSF [CSLIST.NDX CSLIST.SRT] /option[nnnn.nn] [<in [>out]] <ENTER>
   where CSLIST.NDX is index for CSLIST.SRT sorted contents_signature_list
Format 2:  FWKCSF f1 f2 [f3] /m[nnnn.nn] <ENTER>
Options:  (upper or lower case OK)        ; error messages logged to FWKCSF.ERR
a Auxiliary functions: see FWKCSF /a for help.
d Default filenames: see FWKCSF /d for help.
e Errorlevels + messages.
f Find if contents_signature(s) in CSLIST.SRT match the input, set errorlevel.
g Get all contents_signature(s) in CSLIST.SRT matching input, set errorlevel.
h Help (or FWKCSF <ENTER> sans option); see also /a , /d , /e .
i make Index CSLIST.NDX for use with CSLIST.SRT, (i m u v may take a while).
l License and dedication.
m Merge unique full lines from sorted files: f1 into f2, or f1 f2 make f3.
nnnn.nn decimal 0 - 9999.99 seconds of retry (networks); for opts f,g,i,m,u,v.
r Redirect help a,d,e,h to "standard output"; e.g., FWKCSF/rd >filename.
u Update FWKCSF [CSLIST1.NDX CSLIST1.SRT] /u < CSNEW.SRT , can create full [].
v reVise all four default files, consolidate into masterlist, restart CSLIST1.
   If you find FWKZCS(tm) and FWKCSF(tm) quick and useful in private, personal
use, your payment of 25$ by check or money order to Fred Kantor, 523 West 112
Street, New York, NY 10025-1614, would be appreciated. Licensing available.


fwkcsf/a :

FWKCSF(tm) Contents Signature Finder, Ver. 1.02, 1990 Oct 30. FWKCSF/h for help
Copyright (C) 1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
Auxiliary Functions, FWKCSF ... /an, where "n" is shown below:
1 format: FWKCSF filelist /a1 >nonmatch ; to find filenames not on system.
   this uses a local copy of DIRGUIDE.TXT(tm) (from FWKDG) and calls QSORT.
2 format: FWKCSF [d:][\path\]filename[.ext] /a2 ; * ? OK; to make contents_
   signature(s), get matching, add new signatures, make new index, make report;
   this uses default files (see FWKCSF /d); calls FWKZCS, LIST; may call QSORT.
  format: FWKCSF /a2m ; to make  Y.BAT= " FWKCSF %1 /a2" to call #2.
3 format: FWKCSF [d:][\path\]filename[.ext] /a3 ; * ? OK; for accessioning
   files into collection, renaming redundant ".RED"; redundant_non_zip ".RNZ";
   duplicate_zipfile_contents_signatures ".DUP".
  format: FWKCSF /a3m ; to make  ACCESION.BAT= " FWKCSF %1 /a3" to call #3.
4 format: FWKCSF [d:][\path\]filename[.ext] /a4 ; * ? OK; like #3, but for
   ZIPfiles only; calls PKUNZIP for testing zipfiles, failures renamed ".FZT".
  format: FWKCSF /a4m ; to make  ACCESZIP.BAT= " FWKCSF %1 /a4" to call #4.
5 format: FWKCSF [d:][\path\]filename[.ext] [UPLOAD] /a5 ; for automatic
   testing and accession of zipfiles, strips file_header and deletes rejects
   if "UPLOAD" , else only provides file integrity test; operates under
   PCBoard v14.5; calls FWKZCS, QSORT, PKZIP, PKUNZIP.
  format: FWKCSF /a5m ; to make  PCBTEST.BAT= " FWKCSF %1 %2 /a5" to call #5.

FWKCSF(tm) is a utility for use with contents_signature files in format made
by FWKZCS(tm); please see ZCS screens FWKZCS/h, /t, /l.
FWKDG(tm) Ver. 1.08 is copyright 1988,89,90 by Frederick W. Kantor.
FWKZCS(tm) Ver. 1.02 is copyright 1989,1990 by Frederick W. Kantor.
LIST Ver. 7.5e is copyright 1983-90 by Vernon D. Buerg.
PCBoard v14.5 is copyright 1985-90 by Clark Development Company, Inc.
PKZIP, PKUNZIP Reg.U.S.Pat. and Tm.Off., Copr.1989-1990 PKWARE Inc., Ver.1.10.
QSORT Ver. 3.20 is copyright 1985,86,87,88 by Ben Baker.
 -- please compensate properly.



fwkcsf/d :

FWKCSF(tm) Contents Signature Finder, Ver. 1.02, 1990 Oct 30. FWKCSF/h for help
Copyright (C) 1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
Formats:

 Where n is the single_digit number listed below for the item to be revised,

 FWKCSF /d - display this screen, showing current defaults on right of "=".
 FWKCSF [d:\path]filename[.ext] /dn - make this the new Default for item n.
 FWKCSF /dn - reset item n to the initial default shown on left of "=" below.

The full d:\path\name.ext to this copy of FWKCSF is
   C:\CS\CSF\2\FWKCSF.COM
CSLIST.SRT is used as a master_file, with index CSLIST.NDX; mostly read_only.
CSLIST1.SRT is for quick_update, with index CSLIST1.NDX.
This allocation of information_storage and access is revised by FWKCSF /v ,
according to the defaults in this copy of FWKCSF as shown to the right of the
"=", below:
1. C:\CS\CSLIST.NDX  = C:\CS\CSLIST.NDX
2. C:\CS\CSLIST.SRT  = C:\CS\CSLIST.SRT
3. C:\CS\CSLIST1.NDX = C:\CS\CSLIST1.NDX
4. C:\CS\CSLIST1.SRT = C:\CS\CSLIST1.SRT



fwkcsf/e :

FWKCSF(tm) Contents Signature Finder, Ver. 1.02, 1990 Oct 30. FWKCSF/h for help
Copyright (C) 1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
When FWKCSF is used for searching for contents_signature matches, it can
list those matches to the "standard output" (/g), e.g., to be displayed or
redirected into a file, and/or return an "errorlevel" nnn (/f,/g) which can be
used with "IF ERRORLEVEL nnn" to control execution in a .BAT program; or
rename or delete file(s) (see /a).
Here are some errorlevel settings + messages (note: 5, 7 are used internally):
  0 - did not find any contents_signature match.
  1 - found contents_signature_match for only some of the input files.
  5 - apparently non_zip.
  7 - failed PKUNZIP(R) zipfile test.
  8 - a contents_signature match was found for every contained file, but
not for zipfile_contents_signature; the contents may be present in
a larger ZIP, or may be spread among more than one ZIPfiles.
  9 - a contents_signature match was found for each input file;
the input file(s) might be not ZIPped.
 10 - a contents_signature match was found for every file, including
zipfile_contents_signature, so this material is probably all
available together in a single ZIPfile.
 64 - help_screen provides further information
101-188 - "DOS extended error" + 100 decimal; see also FWKCSF.ERR



fwkcsf/l :

FWKCSF(tm) Contents Signature Finder, Ver. 1.02, 1990 Oct 30. FWKCSF/h for help
Copyright (C) 1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
   FWKCS(tm) Ver 1.02: Provided that no fee is charged for the use, copying, or
distribution; and provided that they are not modified in any way; then, EXCEPT
FOR USE IN A COMMERCIAL, SCHOOL, OR GOVERNMENTAL ENVIRONMENT, you are free to
use and copy FWKZCS(tm), FWKCSF(tm), and FWKDG(tm), and to distribute them
solely in their original Author Verified Zipfile under the name FWKCS102.ZIP.
   Frederick W. Kantor disclaims any and all warranties as to this software,
whether express or implied, including by way of example and without limitation
any implied warranties of merchantability, fitness for a particular purpose,
functionality, data protection, or data integrity.
   Dedication: The file format of the files created by this program, which
file format is original with the first release of this software; and the
related nomenclature, "contents signature", "zipfile contents signature",
"file contents signature", "cs", "zcs", and "fcs"; are all hereby dedicated to
the public domain.
   If you have any questions or comments re FWKZCS(tm), FWKCSF(tm), FWKDG(tm),
please send them to Fred Kantor via The Invention Factory BBS, 212-431-1194.
   If you find FWKZCS(tm) and FWKCSF(tm) quick and useful in private, personal
use, your payment of 25$ by check or money order to Fred Kantor, 523 West 112
Street, New York, NY 10025-1614, would be appreciated. Licensing available.


fwkzcs/h :

FWKZCS(tm) Zipfile Contents Signature, Ver 1.02, 1990 Oct 30. FWKZCS/h for help
Copyright (C) 1989,1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
For: files in Phil Katz's ZIP format, both storage and self_extracting; and
   : plain files.      | For technical information plus options b,w,y: FWKZCS/t
Usage:  FWKZCS[/cdefmprsz[nnnn.nn]] file1 file2  (default is to do f, p, and z)
 calling /h, /t, or /l suppresses cdefmpsz; error messages logged to FWKZCS.ERR
The single '/' with option letter(s) and number are all contiguous.
 c - expect a Control_list; if its filename is not given, use 'standard input'.
 d - reDate zipfile to latest file in it.  |  e - Edit input from control_list.
 f - make a "File contents signature" for (each) File in zipfile(s).
 nnnn.nn time_span in seconds, 0 - 9999.99, to keep trying (for network use).
 p - make a "file contents signature" for (each) Plain file (non_zip).
 r - Redirect messages to standard output. |  l - License and dedication.
 s - Scan sorted cs_list for multiple(s); m - Make MULTCNT.RPT;s,m null cdefpyz
 z - make a "Zipfile contents signature" for (each) Zipfile.
Purpose:  each kind of "contents signature" detailed above does not depend on
file names, dates, order of collection, nor method nor amount of compression.
Sorting the output groups names of files having the same --> contents <-- .
   If you find FWKZCS(tm) and FWKCSF(tm) quick and useful in private, personal
use, your payment of 25$ by check or money order to Fred Kantor, 523 West 112
Street, New York, NY 10025-1614, would be appreciated. Licensing available.


fwkzcs/t :

FWKZCS(tm) Zipfile Contents Signature, Ver 1.02, 1990 Oct 30. FWKZCS/h for help
Copyright (C) 1989,1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
Full command line, showing paths and options:  options = bcdefmprswyz[nnnn.nn]
[d:][path]FWKZCS[/options] [[d:][path]file1.ext] [[>[>]][d:][path]file2[.ext]]
option b - suppress header;  w - set errorlevel = 1 if apparently nonzip file.
option y - make "file contents signature" for both zip and plain files as if
for plain files; for looking for exact duplicate (zip)files: unlike z, the
contents signature made using option y depends on compression, names, dates,
and order of files in a zipfile, and on comment(s). Options p and y can be used
in looking for change, e.g., in monitoring equipment performance, etc.
OUTPUT FORMAT: interletter spacing for zcs and fcs chosen for visual clarity;
left_16_characters output in hexadecimal, with filelength_leading_zeros blank:
|  16_character_contents_signature  | |cs_owner  | |in, or has| |where...
<   32_bit CRC   ><32_bit filelength> filename.ext zipfile.ext  [d:][\path]
<CRC_sum mod 2^32><32_bit length_sum> zipfile.ext   z   cs      [d:][\path]
<   32_bit CRC   ><32_bit filelength> filename.ext    f cs      [d:][\path]
- for "file contents signature" of a file in a zipfile, both files are named.
- "z   cs" designates a "zipfile contents signature", made by summing mod 2^32
all the 32_bit CRCs for the files in the zipfile, and summing (mod 2^32) their
uncompressed filelengths; zipfile_name is in contents_signature_owner's column.
- "f cs" designates "file contents signature" for plain file; filename goes in
signature_owner's column; in this case, FWKZCS calculates file's 32_bit CRC.


fwkzcs/l :   (only the header is different, because fwkcsf calls fwkzcs
              to make the rest of this screen)

FWKZCS(tm) Zipfile Contents Signature, Ver 1.02, 1990 Oct 30. FWKZCS/h for help
Copyright (C) 1989,1990 by Frederick W. Kantor. All rights reserved.
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS
........................ C A V E A T   O P E R A T O R ........................
   FWKCS(tm) Ver 1.02: Provided that no fee is charged for the use, copying, or
distribution; and provided that they are not modified in any way; then, EXCEPT
FOR USE IN A COMMERCIAL, SCHOOL, OR GOVERNMENTAL ENVIRONMENT, you are free to
use and copy FWKZCS(tm), FWKCSF(tm), and FWKDG(tm), and to distribute them
solely in their original Author Verified Zipfile under the name FWKCS102.ZIP.
   Frederick W. Kantor disclaims any and all warranties as to this software,
whether express or implied, including by way of example and without limitation
any implied warranties of merchantability, fitness for a particular purpose,
functionality, data protection, or data integrity.
   Dedication: The file format of the files created by this program, which
file format is original with the first release of this software; and the
related nomenclature, "contents signature", "zipfile contents signature",
"file contents signature", "cs", "zcs", and "fcs"; are all hereby dedicated to
the public domain.
   If you have any questions or comments re FWKZCS(tm), FWKCSF(tm), FWKDG(tm),
please send them to Fred Kantor via The Invention Factory BBS, 212-431-1194.
   If you find FWKZCS(tm) and FWKCSF(tm) quick and useful in private, personal
use, your payment of 25$ by check or money order to Fred Kantor, 523 West 112
Street, New York, NY 10025-1614, would be appreciated. Licensing available.



fwkdg <enter> :

FWKDG(tm) Copyright (C) 1988,89,90 by Frederick W. Kantor. All rights reserved.
Version 1.08  by Frederick W. Kantor circa 1990 Feb 21. For help: FWKDG <enter>
Your use of this program is at solely your own risk: PLEASE HAVE PROPER BACKUPS

                         C A V E A T   O P E R A T O R

Format:  FWKDG [d] [d] /option <ENTER>
  initial drive ^   ^ final drive  (each is a single letter; default: C Z)
  if only one drive is designated, then only that drive is scanned.

Options:  (using only one; upper or lower case OK)
          g  make source-file which when sorted becomes DIRGUIDE.TXT(tm)
          l  list files in this output format: d:\path\filename.ext <CRLF>
          t  read only from text directories for making DIRSONLY
NOTE: if not g, l, or t option, then you get this screen WITHOUT a full run.
          r  send this help screen to the redirectable "standard output"
Input:  if option g or l, then read from drives as specified above,
                          scanning all their root_ and sub_directories;
        if option g, then also read from the text directories;
        if option t, then read only from the text directories;
text directories:  DIR0 - DIR999 on default drive[\path\] (please see docs)

Output is via the "standard output", which is redirectable.

------------------------------------------------------------------------------