Heres a slightly different approach you might find easier to follow:

@echo off
setlocal

  :: put the values into a variable
  set _fixedfields=1,2,,4,5

  :: change any missing value into a space (two commas become comma-space-comma)
  set _fixedfields=%_fixedfields:,,=, ,%

  ::Echo what we have so far
  set _fixedfields

  :: now break it apart using FOR
  for /f "tokens=1-5 delims=," %%G in ("%_fixedfields%") do (
    echo [%%~G] [%%~H] [%%~I] [%%~J] [%%~K]
  )

Just be aware that the missing value is now a space character, you may need to allow for that depending what else the script is doing.

Yes all the switches and extentions are in the rcj file.
I made the change and this is what was created in the hashes.txt file:

//
// File Checksum Integrity Verifier version 2.05.
//
        *.doc\*

    Error msg  : The filename, directory name, or volume label syntax is incorrect.

    Error code : 7b

I think it is looking for just .doc ?

If the

I guess with my very limited scripting skills I need a little bit more time to exactly understand, how you are doing it, but it works like a charm.

Many thanks bluesxman.

You're going to have to pre-process the lines, such that the empty fields aren't empty any more.

Here's an example of how you could approach it:

@echo off

setlocal enabledelayedexpansion

set "_delim=,"

REM put each whole line into a single %% token
for /f "tokens=*" %%x in ("1,2,,4,5") do (
    set "_fixedfields=%%~x"

    REM wrap the delimiter, and indeed the whole string, in " to make all the fields valid double-quoted strings
    set "_fixedfields="!_fixedfields:%_delim%="%_delim%"!""

    REM now just break it apart as before, stripping all the " we just added to recreate any empty fields
    for /f "usebackq tokens=1-5 delims=%_delim%" %%a in ('!_fixedfields!') do echo "%%~a" "%%~b" "%%~c" "%%~d" "%%~e"
)

pause

Subject to the data you're going to be pumping in, there are some tweaks you might have to make.

Hi,

is there any way to force the "for" statement not to skip empty variables. This would greatly help parsing log file entries in the correct order:

Just a quick example:

@echo off
for /f "tokens=1-5 delims=," %%a in ("1,2,,4,5") do echo "%%a" "%%b" "%%c" "%%d" "%%e"

Output is:

"1" "2" "4" "5" ""

I would like to prefer ;):

"1" "2" "" "4" "5"

Thanks for any suggestions.

Hmmm on closer inspection, the documentation for FCIV isn't very clear!

Try just "fciv.exe "%%a" -sha1 >> "F:\AB561\Logs\hashes.txt"

(I'm presuming that all the switches I used for robocopy are in your .rcj file?)

I think this is getting closer. If I just run RoboCopy with the standard Job file and tje /L option and create a log of the files first. Next I usded that file for fciv.exe and created an output log hashes.txt. I appears the application can read the file but I get an error and it is logged in the hashes.txt file.

CODE

F:\AB561\Scripts\robocopy.exe /Job:"F:\AB561\Scripts\LT Onsite Filtered.rcj" "C:\temp" "F:\AB561\Data\PC\C\temp" /L /Log+:"F:\AB561\Logs\KO_Memorex.txt"


for /f "usebackq tokens=* delims= " %%a in ("F:\AB561\Logs\KO_Memorex.txt") do (
    fciv.exe -add "%%a" -sha1 >> "F:\AB561\Logs\hashes.txt"
)

Error in Log file:

//
// File Checksum Integrity Verifier version 2.05.
//
        MD5                SHA-1
-------------------------------------------------------------------------
                  c:\temp\img00037.jpg\*

    Error msg  : The filename, directory name, or volume label syntax is incorrect.

    Error code : 7b

The simple answer to how the list was being using by fciv is that it wasn't.

Having quickly looked at some fciv documentation and reviewing my initial code offering (which was a bit wrong BTW ... oops ... but I did put an "untested" disclaimer on it :D) I've come up with this also untested beauty, based on said initial code offering:

REM I've picked GIF and JPG files just to illustrate
REM by all means use your robocopy job file to select the files you want
robocopy /njs /njh /ndl /ns /nc /l x:\source c:\dummy *.jpg *.gif /log:"tempfile.txt"

for /f "usebackq tokens=* delims= " %%a in ("tempfile.txt") do (
    fciv.exe -add "%%a" -sha1 -md5  >> "hashes.txt"
)

Note that I've output the robocopy log to a file which we pick up in the "for" command ... and made corrections to the fciv command line I used before.  By all means hack this around to fit back in your script.

Your idea is better than what I was thinking. Robocopy is the primary tool I use for this and I would much rather have it get a list of files. Because I use a job file with various filters it would make more sense to have RoboCopy generate it.
What I don't get is how the list using C;\dummy is created and accessed by fciv. I seem to be hung up on having a list of files with extentions or extensions in a log that is used as a filter.
-Frank

Sorry I was only quickly scanning your code, didn't look properly at how you were using "%filter%".

But as it stands, your "%Dest_Path%\Scripts\robocopy /njs /njh /ndl /ns /nc /l %Source_Path% c:\dummy" line is serving no purprose whatsoever other than to display a list of files.  My initial idea was that you'd use robocopy to create a list of actual filenames to process, then pump that through "fciv" to get your hashes.  You would then use the same list to robocopy the files to perform whatever other actions it was you wanted to.

Entirely up to you how you want it to work though!

I would like to know the command for getting memory usage of target machine.
Currently i m using 2 command for getting memory utilization

1) top -n 1 | grep Memory
output : Memory: 32G real, 3792M free, 41G swap in use, 15G swap free

and 2) vmstat
output :

kthr      memory            page            disk          faults      cpu
r b w   swap  free  re  mf pi po fr de sr m0 m1 m2 m3   in   sy   cs us sy id
0 0 538 9428240 2431272 953 3618 272 33 29 0 14 7 5 5 1 7077 23302 11528 5 4 91


so which one is correct command ?

I really appreciate ur help on this.

Yes you are right about
Code
"%Dest_Path%\Logs\%Log_Name%"

What I am not quite sure of is the file defined as "%filter%".  I created a text file with the extensions that I want to include. Similar to the .rcj file with
    /IF        :: Include Files matching these names
        *.doc
        *.xls
        *.txt
except it only has:
                             .doc
                             .xls
                             .txt
Seems like fciv can use this but *.doc doesn't work at all.

What I want is to hash the files before and after a copy and if need be use the same filter list for the hash as I use in the job file for RoboCopy. So I set %filter% to the include filter = Include_Filter.txt. So when I run the batch file it reads the filter and only hashes the file extentions in the list. I does include the file when I use this filter and -type but it doesn't exclude files such a .exe when I use the exclude_filter.txt and  -exe.

So I am clearly not getting something.

If this is on a domain, then you can just customize one 'Default User' and copy it to the Netlogon share of  the Domain Controller.

see Q168475
http://support.microsoft.com/kb/168475

Alternatively apply a System Policy to change the registry settings.

OK I think I understand what you're up to.  I have a couple of thoughts on the matter (bearing in mind I've not tested either) ...

You might try using "psgetsid", available from the website formerly known as Sysinternals (latterly Borged by Microsoft), to figure out the SID of the new user account.  You can then (probably) do what you want to do with by using the REG command to address "HKU\<User SID>\Software\Microsoft\Windows\CurrentVersion\RunOnce".

Or, more straightforwardly, why not just drop the "RunOnce" thing into the Default User registry by addressing "HKU\.DEFAULT\Software\Microsoft\Windows\CurrentVersion\RunOnce", again with the REG command?

Hi. I am trying to create a value in the default user profile runonce to point at a login script.

This means that when you create a new user profile in xp, the runonce script will execute when the user first logs in.

As far as I am aware, this process can not be done by script, but only manually, like this.

01) open regedit
02) go to HKEY_USERS
03) Load Hive
04) Browse to C:\Documents and Settings\Default User\ntuser.dat
05) give it a temporary key name, for example ZZZ
06) go to HKEY_USERS\ZZZ\Software\Microsoft\Windows\CurrentVersion
07) Create a key RunOnce
08) Create a string value there eg: First Run, then change the value to where your script sits, eg: "D:\User\zxp\newUserProfile.cmd"
09) go back to HKEY_USERS\ZZZ
10) unload the hive

Now when you create a new user, the runonce value runs on the first login so you can run a first time user script; eg newUserProfile.cmd

The script below is only for illustrative purposes. but if anyone knows how i can add in a registry value into the different user hive by script, rather than manually, that will be cool, and a great time saver :pc:

Thanks :D

newUserProfile.cmd

@echo off&cls
title=%~n0

:: Stored @
:: D:\User\zXP\newUserProfile.cmd
::

taskkill /f /im explorer.exe

::
:: Create User Folder on data partition
::

echo Setting up your user profile for first time use ...

:: Set location where the users files will save to (NOT on systemdrive)
set _userstore=D:\User

set _desktop=%_userstore%\%USERNAME%\Desktop
set _favorites=%_userstore%\%USERNAME%\Favorites
set _mydocuments=%_userstore%\%USERNAME%\My Documents
set _mymusic=%_userstore%\%USERNAME%\My Documents\My Music
set _mypictures=%_userstore%\%USERNAME%\My Documents\My Pictures
set _myvideo=%_userstore%\%USERNAME%\My Documents\My Video
md "%_desktop%"
md "%_favorites%"
md "%_mydocuments%"
md "%_mymusic%"
md "%_mypictures%"
md "%_myvideo%"

:: Update registry to point @ the user folders
set _regusf=HKCU\Software\Microsoft\Windows\CurrentVersion\Explorer\User Shell Folders
reg add "%_regusf%" /v Desktop /t REG_EXPAND_SZ /d "%_desktop%" /f
reg add "%_regusf%" /v Favorites /t REG_EXPAND_SZ /d "%_favorites%" /f
reg add "%_regusf%" /v Personal /t REG_EXPAND_SZ /d "%_mydocuments%" /f
reg add "%_regusf%" /v My Music /t REG_EXPAND_SZ /d "%_mymusic%" /f
reg add "%_regusf%" /v My Pictures /t REG_EXPAND_SZ /d "%_mypictures%" /f
reg add "%_regusf%" /v My Video /t REG_EXPAND_SZ /d "%_myvideo%" /f

:: Restart explorer.exe so changes are immediate

start explorer.exe

:: Remove unneccesary user profile folders on systemdrive
rd /s /q "%USERPROFILE%\Favorites"
rd /s /q "%USERPROFILE%\My Documents"
rd /s /q "%USERPROFILE%\My Music"
rd /s /q "%USERPROFILE%\My Pictures"
rd /s /q "%USERPROFILE%\My Video"

::
:: UI Tweaks
::

::
:: Files Cleanup
::

del /q "%windir%\*.log"
del /q "%windir%\*.tmp"
del /q "%windir%\Temp\*.*"

::
:: Services
::

net stop "wuauserv"

sc config "Alerter" start= disabled
sc config "browser" start= disabled
sc config "messenger" start= disabled
sc config "upnphost" start= disabled
sc config "wuauserv" start= disabled

::
:: Restrictions
::

In this case I would use the %ProgramFiles% to find the winrar folder.

HOMEDRIVE=C:
ProgramFiles=C:\Program Files
SystemDrive=C:
SystemRoot=C:\WINDOWS

If you have windows installed on another drive, that is bad design, you should always install windows onto an active partition, if you are multi-booting of a hard-drive you should set the partition active before installing the OS, and using a boot loader to activate it.

But those variables will change if you installed windows on d: then they will change, so its a good idea to use something like %ProgramFiles% rather than C:\Program Files. I always use that in scripts for example

@ECHO OFF
TITLE Cleanup, Defrag, Shutdown - SAFE TO EXIT ANYTIME

set app1=%programfiles%\CCleaner\CCleaner.exe
set app2=%programfiles%\JKDefrag\JkDefragCmd
set app3=%programfiles%\NT Registry Optimizer\NTREGOPT.EXE

    "%app1%" /AUTO
    "%app2%"
    "%app3%" silent

    SHUTDOWN -s -t 60

Hello,
In some case, the "System drive letter" is different of C:, and a script can use an absolute path like C:\folder\bla.
So, this script cannot works if MS Windows is installed in a difference drive letter of C:

Here is a script using an absolute path in the C: drive (where C: is the System drive letter).

@ECHO OFF
SETLOCAL
IF NOT EXIST "C:\PROGRAM Files\WinRAR" (ECHO *** WinRAR is missing&Pause&EXIT)
SET PATH="C:\PROGRAM Files\WinRAR\";%PATH%
:: Then do something using WinRAR
ENDLOCAL

Is this method enough and safe to make the script independent of the "System drive letter"?
METHOD:
- add a variable: SET SD=%SYSTEMDRIVE%
- replace all absolute drive  C:  by  %SD%

Any comment?
Thanks and regards.

@ECHO OFF
SETLOCAL
SET SD=%SYSTEMDRIVE%
IF NOT EXIST "%SD%\PROGRAM Files\WinRAR" (ECHO *** WinRAR is missing&Pause&EXIT)
SET PATH="%SD%\PROGRAM Files\WinRAR\";%PATH%
:: Then do something using WinRAR
ENDLOCAL

Knocked this up for something at work.  It will subtract the given number of minutes from the current time (from 1 to 1440 inclusive -- IE 1 full day).  With a bit of tweaking it could be made to handle greater values (but that was without the scope of what I needed it for, so I didn't bother with that yet).  For the same reason, it doesn't bother to handle leap year scenarios more complicated than anything that's going to happen between now and 2099.  It also assumes 24 hour clock and dd/mm/yyyy dates.

@echo off

setlocal enabledelayedexpansion

set step=%~1
set /a step+=0

REM if an out of bounds value is given, we do nothing
if %step% GTR 1440 set step=0
if %step% LSS 0    set step=0

set /a "step.hh=step /  60"
set /a "step.mm=step %% 60"

set time=%time: =0%
set date=%date%

REM getting rid of the pesky zero padding that'll screw up calculations later
set /a in.year=  ( %date:~-4% )
set /a in.month= ( %date:~-7,1%  * 10 ) + ( %date:~-6,1% )
set /a in.day=   ( %date:~-10,1% * 10 ) + ( %date:~-9,1% )

set /a in.hh=    ( %time:~0,1% * 10 ) + ( %time:~1,1% )
set /a in.mm=    ( %time:~3,1% * 10 ) + ( %time:~4,1% )

REM duplicate the "in." values as "out." values, and only play with them from now on
for /f "usebackq tokens=2,3 delims=.=" %%a in (`set in.`) do set out.%%a=%%b

set /a "leap.check=in.year %% 4"

if %leap.check% EQU 0 (set 28.or.29=29) ELSE (set 28.or.29=28)

set month.1=31
set month.2=!28.or.29!
set month.3=31
set month.4=30
set month.5=31
set month.6=30
set month.7=31
set month.8=31
set month.9=30
set month.10=31
set month.11=30
set month.12=31

set /a out.mm-=step.mm
set /a out.hh-=step.hh

if %out.mm% LSS 0 (
    set /a out.mm+=60
    set /a out.hh-=1
)

if %out.hh% LSS 0 (
    set /a out.hh+=24
    set /a out.day-=1
)

if %out.day% EQU 0 (
    set /a out.month-=1
    if !out.month! EQU 0 (
        set /a out.month=12
        set /a out.year-=1
    )
    call :set_day
)

REM zero pad everything that needs it

for %%p in (month day hh mm) do (
    for %%d in (in out) do (
        set %%d.%%p=0!%%d.%%p!
        set %%d.%%p=!%%d.%%p:~-2!
    )
)

echo:IN : %in.year%/%in.month%/%in.day% %in.hh%:%in.mm%
echo:OUT: %out.year%/%out.month%/%out.day% %out.hh%:%out.mm%

goto :EOF

:set_day

set out.day=!month.%out.month%!

goto :EOF

I'm sure this problem has been solved many times before by many people.  But I like to do things for myself.

Glad to be of help.

Couple of things ...

You don't seem to have saved your robocopy output to the file defined as "%filter%", thus the subsequent "for" loop won't work as it's meant to.

Also I presume you meant to do this:

echo        "%Dest_Path%\Logs\%Log_Name%"

Rather than this:

echo        %Dest_Path%\Logs\Source_Log.txt"

Oh, and you might want to investigate using "set /p" instead of

echo If this is correct:
pause

... so that you can make exiting the script at this point a bit cleaner than a Ctrl+C.  Entirely up to you though.

First - thanks very much for all the help. I would not have been able to figure this out on my own.
Here is the batch file that does what I need:

CODE
cls
@echo off

:: ##### Set these variables before running the batch file ###############

set Project_Alias=AB561
set Asset_Tag=KO_334455
set Filter=IncludeFilter.txt
set Source_Path=\\server\LT\share\Test
set Dest_Path=F:\AB561
set Log_Name=Source_Log.txt

:: The log file is created first and the source information is entered.
:: After the SHA1 hash values are calculated they are appended to the log.
:: IncludeFilter.txt contains the file extentions that will be used as a filter for the source.

(
    echo:
    echo: =============================== 
    echo: Source Hash - New Log Entry
    echo: ===============================
    echo.
    echo: Source - Collection Specifics:
    echo: Project Alias ..........%Project_Alias%
    echo: Asset Tag ..............%Asset_Tag%
    echo: Filter .................%Filter%
    echo: Source_Path ............%Source_Path%
    echo: System Date.............%date%  %time%
    echo: Computer Name...........%computername%
    echo: User Logged On..........%USERNAME%
    echo: User Domain ............%USERDOMAIN%
    echo:
    echo.            SHA1 Hash Values                Source Path/File Name
    echo: ======================================= ===========================
   
) >> %Dest_Path%\Logs\%Log_Name%

:: Example robocopy /njs /njh /ndl /ns /nc /l C:\temp c:\dummy
:: C:temp is the source and c:\dummy is a dummy destination call so RoboCopy will not error out

echo Hash using the following values:
      echo: Project Alias ..........%Project_Alias%
      echo: Asset Tag ..............%Asset_Tag%
      echo: Filter .................%Filter%
      echo: Source Path ............%Source_Path%
      echo: Destination Path........%Dest_Path%\Logs\%Log_Name%

echo If this is correct:
Pause

%Dest_Path%\Scripts\robocopy /njs /njh /ndl /ns /nc /l %Source_Path% c:\dummy

echo  Calculating hash values for %Source_Path%

for /f "usebackq tokens=* delims= " %%a in (%Filter%) do (
    fciv.exe  -add "%Source_Path%" -type "%%a" -r -sha1 | find "\"  >> %Dest_Path%\Logs\%Log_Name%
)

cls

COLOR B

echo.
echo.
echo       -----The Calculation IS COMPLETE--------           
echo       REVIEW THE Source LOG FOR DETAILS 
echo        %Dest_Path%\Logs\Source_Log.txt"
echo.
echo.

Pause