To perform a find and replace with all entries of a file, enter the colon to invoke ex from vi. Then, from there, enter
:%s/find_string/replace_string/g
For example:
%s/oldHostname/newHostname/g
There are many other ways to do this, but I prefer this method. This is one of the reasons that vi stands for "Voodoo for Intellectuals."
This is a repository of all of my Linux/Unix writings as well as useful tips and tricks for systems administration, engineering, and programming.
Wednesday, May 6, 2009
Tuesday, April 14, 2009
Vacuumdb within crontab
Vacuumdb for postgres is best run in a cron. But when your database user needs a password, export it and the cron will run without a problem. Here is an example of a vacuumdb instance that exports the password and then does a full, quiet, and analyzing vacuumdb on the mydatabase database.
Clean, vacuum and analyze the tripplanning database
0 2 * * * export PGPASSWORD=mypassword && vacuumdb -f -q -z -U postgres -d mydatabase >> /var/log/messages 2>&1
Clean, vacuum and analyze the tripplanning database
0 2 * * * export PGPASSWORD=mypassword && vacuumdb -f -q -z -U postgres -d mydatabase >> /var/log/messages 2>&1
Tuesday, April 7, 2009
Take a network trace on HP UX
I needed to take a trace on an HP UX server the other day. These are the commands that I used:
nettl -tn 0x30800000 -e ns_ls_ip -tracemax 99999 -f /tmp/networkTrace
Then to kill it before it got to 99999 lines, I used the command
nettl -tf -e all
Then I analyzed /tmp/networkTrace with Wireshark.
nettl -tn 0x30800000 -e ns_ls_ip -tracemax 99999 -f /tmp/networkTrace
Then to kill it before it got to 99999 lines, I used the command
nettl -tf -e all
Then I analyzed /tmp/networkTrace with Wireshark.
Wednesday, April 1, 2009
zipidey-do daw, zipidey-de day, what a wonderful day!
The zip command will create a zip file that can be used across disparate platforms, including Linux/Unix to Windows or Mac. In other words, if you need to send your Windows friend several ziped files and he can only deal with .zip files, keep it simple. Don't use bzip or tar, just use zip. Here is a command to create a highly compressed zip file to contain some log files. Then just get the produced zipfile to your Windows "without walls" friend.
zip -9 logServices.zip /var/log/messages myapp/logs/mylog.log /usr/local/tomcat/logs/catalina.out
zip -9 logServices.zip /var/log/messages myapp/logs/mylog.log /usr/local/tomcat/logs/catalina.out
Add an temporary user account
If you need an account for a set period of time, or an account that you don't want to deactivate later, add the -e option on useradd:
useradd -m -e 2009-12-01 -c "Temp Account" tempUser
This user account will expire on December 1st, 2009 and will lock the user and their password.
useradd -m -e 2009-12-01 -c "Temp Account" tempUser
This user account will expire on December 1st, 2009 and will lock the user and their password.
Tuesday, March 31, 2009
Grep entire directories
To find a phrase that could be found somewhere in the current directory, use the command:
grep -r -i searchString ./
For example:
grep -r -i splunk /etc
This would search the entire /etc filesystem for any line with the word "splunk" located therein. Another way to do this would be the command:
find / -type f -print | xargs grep splunk
It works well with HP-UX and other Unixes.
grep -r -i searchString ./
For example:
grep -r -i splunk /etc
This would search the entire /etc filesystem for any line with the word "splunk" located therein. Another way to do this would be the command:
find / -type f -print | xargs grep splunk
It works well with HP-UX and other Unixes.
Thursday, March 26, 2009
Tar with date and a twist of chocolate
Here is a way to tar up a set of important directories with the date. You can use this as a log archive, or with Splunk. This uses the highest compression of gzip (-9).
tar cp /myapp/logs /var/log/messages /var/log/httpd/ | gzip -9c > /tmp/oldlogs`date +"%Y%m%d"`.tgz
tar cp /myapp/logs /var/log/messages /var/log/httpd/ | gzip -9c > /tmp/oldlogs`date +"%Y%m%d"`.tgz
Monday, March 23, 2009
Reboot your computer after 4082.97902312 years
For some cool reason, the maximum time that the Linux shutdown command will accept is 2,147,483,647 minutes, which is 4082.97902312 years. If you think your hardware is going to last that long, execute the command:
#shutdown -r -F 2147483647
In a little over 4,000 years, it will reboot and check your disks. Hopefully by then you will be doing something cooler than counting down, like golfing on Mars.
#shutdown -r -F 2147483647
In a little over 4,000 years, it will reboot and check your disks. Hopefully by then you will be doing something cooler than counting down, like golfing on Mars.
Thursday, March 12, 2009
A quality PostgreSQL startup script
I have went through several iterations of PostgreSQL startup scripts. Most are less than useful. This one, modified for my use (changed some of the directory structure, and tailored for Postgres 8.3.6) is originally provided by the Postgres YUM repository, and is actually useful. This is in stark comparison to the quasi-useful one that is included in the source package in file postgresql-version/contrib/start-scripts/linux This is designed for Red Hat iterations of Linux, but may with small modifications, work with Debian, Ubuntu, and SuSE. Enjoy.
#!/bin/sh
# postgresql This is the init script for starting up the PostgreSQL
# server
#
# chkconfig: - 64 36
# description: Starts and stops the PostgreSQL backend daemon that handles \
# all database requests.
# processname: postmaster
# pidfile: /var/run/postmaster.pid
PGVERSION=8.3.6
# PGMAJORVERSION is major version, e.g., 8.0 (this should match PG_VERSION)
PGMAJORVERSION=`echo "$PGVERSION" | sed 's/^\([0-9]*\.[0-9]*\).*$/\1/'`
# Source function library.
INITD=/etc/rc.d/init.d
. $INITD/functions
# Get function listing for cross-distribution logic.
TYPESET=`typeset -f|grep "declare"`
# Get config.
. /etc/sysconfig/network
# Find the name of the script
NAME=`basename $0`
if [ ${NAME:0:1} = "S" -o ${NAME:0:1} = "K" ]
then
NAME=${NAME:3}
fi
# For SELinux we need to use 'runuser' not 'su'
if [ -x /sbin/runuser ]
then
SU=runuser
else
SU=su
fi
# Set defaults for configuration variables
PGENGINE=/app/pgsql/bin
PGPORT=5432
PGDATA=/app/pgsql/data
if [ -f "$PGDATA/PG_VERSION" ] && [ -d "$PGDATA/base/template1" ]
then
echo "Using old-style directory structure"
else
PGDATA=/app/pgsql/data
fi
PGLOG=/app/pgsql/data/pgstartup.log
# Override defaults from /etc/sysconfig/pgsql if file is present
[ -f /etc/sysconfig/pgsql/${NAME} ] && . /etc/sysconfig/pgsql/${NAME}
export PGDATA
export PGPORT
# Check that networking is up.
# Pretty much need it for postmaster.
[ "${NETWORKING}" = "no" ] && exit 0
[ -f "$PGENGINE/postmaster" ] || exit 1
script_result=0
start(){
PSQL_START=$"Starting ${NAME} service: "
# Make sure startup-time log file is valid
if [ ! -e "$PGLOG" -a ! -h "$PGLOG" ]
then
touch "$PGLOG" || exit 1
chown postgres:postgres "$PGLOG"
chmod go-rwx "$PGLOG"
[ -x /usr/bin/chcon ] && /usr/bin/chcon -u system_u -r object_r -t postgresql_log_t "$PGLOG" 2>/dev/null
fi
# Check for the PGDATA structure
if [ -f "$PGDATA/PG_VERSION" ] && [ -d "$PGDATA/base" ]
then
# Check version of existing PGDATA
if [ x`cat "$PGDATA/PG_VERSION"` != x"$PGMAJORVERSION" ]
then
SYSDOCDIR="(Your System's documentation directory)"
if [ -d "/usr/doc/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/doc
fi
if [ -d "/usr/share/doc/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/share/doc
fi
if [ -d "/usr/doc/packages/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/doc/packages
fi
if [ -d "/usr/share/doc/packages/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/share/doc/packages
fi
echo
echo $"An old version of the database format was found."
echo $"You need to upgrade the data format before using PostgreSQL."
echo $"See $SYSDOCDIR/postgresql-$PGVERSION/README.rpm-dist for more information."
exit 1
fi
# No existing PGDATA! Warn the user to initdb it.
else
echo
echo "$PGDATA is missing. Use \"service postgresql initdb\" to initialize the cluster first."
echo_failure
echo
exit 1
fi
echo -n "$PSQL_START"
$SU -l postgres -c "$PGENGINE/postmaster -p '$PGPORT' -D '$PGDATA' ${PGOPTS} &" >> "$PGLOG" 2>&1 < /dev/null
sleep 2
pid=`pidof -s "$PGENGINE/postmaster"`
if [ $pid ] && [ -f "$PGDATA/postmaster.pid" ]
then
success "$PSQL_START"
touch /var/lock/subsys/${NAME}
head -n 1 "$PGDATA/postmaster.pid" > "/var/run/postmaster.${PGPORT}.pid"
echo
else
failure "$PSQL_START"
echo
script_result=1
fi
}
stop(){
echo -n $"Stopping ${NAME} service: "
$SU -l postgres -c "$PGENGINE/pg_ctl stop -D '$PGDATA' -s -m fast" > /dev/null 2>&1 < /dev/null
ret=$?
if [ $ret -eq 0 ]
then
echo_success
else
echo_failure
script_result=1
fi
echo
rm -f "/var/run/postmaster.${PGPORT}.pid"
rm -f "/var/lock/subsys/${NAME}"
}
restart(){
stop
start
}
initdb(){
if [ -f "$PGDATA/PG_VERSION" ]
then
echo "Data directory is not empty!"
echo_failure
else
echo -n $"Initializing database: "
if [ ! -e "$PGDATA" -a ! -h "$PGDATA" ]
then
mkdir -p "$PGDATA" || exit 1
chown postgres:postgres "$PGDATA"
chmod go-rwx "$PGDATA"
fi
# Clean up SELinux tagging for PGDATA
[ -x /sbin/restorecon ] && /sbin/restorecon "$PGDATA"
# Initialize the database
$SU -l postgres -c "$PGENGINE/initdb --pgdata='$PGDATA' --auth='ident sameuser'" >> "$PGLOG" 2>&1 < /dev/null
# Create directory for postmaster log
mkdir "$PGDATA/pg_log"
chown postgres:postgres "$PGDATA/pg_log"
chmod go-rwx "$PGDATA/pg_log"
[ -f "$PGDATA/PG_VERSION" ] && echo_success
[ ! -f "$PGDATA/PG_VERSION" ] && echo_failure
echo
fi
}
condrestart(){
[ -e /var/lock/subsys/${NAME} ] && restart
}
condstop(){
[ -e /var/lock/subsys/${NAME} ] && stop
}
reload(){
$SU -l postgres -c "$PGENGINE/pg_ctl reload -D '$PGDATA' -s" > /dev/null 2>&1 < /dev/null
}
# This script is slightly unusual in that the name of the daemon (postmaster)
# is not the same as the name of the subsystem (postgresql)
# See how we were called.
case "$1" in
start)
start
;;
stop)
stop
;;
status)
status -p /var/run/postmaster.${PGPORT}.pid
script_result=$?
;;
restart)
restart
;;
initdb)
initdb
;;
condrestart)
condrestart
;;
condstop)
condstop
;;
reload|force-reload)
reload
;;
*)
echo $"Usage: $0 {start|stop|status|restart|condrestart|condstop|reload|force-reload|initdb}"
exit 1
esac
exit $script_result
#!/bin/sh
# postgresql This is the init script for starting up the PostgreSQL
# server
#
# chkconfig: - 64 36
# description: Starts and stops the PostgreSQL backend daemon that handles \
# all database requests.
# processname: postmaster
# pidfile: /var/run/postmaster.pid
PGVERSION=8.3.6
# PGMAJORVERSION is major version, e.g., 8.0 (this should match PG_VERSION)
PGMAJORVERSION=`echo "$PGVERSION" | sed 's/^\([0-9]*\.[0-9]*\).*$/\1/'`
# Source function library.
INITD=/etc/rc.d/init.d
. $INITD/functions
# Get function listing for cross-distribution logic.
TYPESET=`typeset -f|grep "declare"`
# Get config.
. /etc/sysconfig/network
# Find the name of the script
NAME=`basename $0`
if [ ${NAME:0:1} = "S" -o ${NAME:0:1} = "K" ]
then
NAME=${NAME:3}
fi
# For SELinux we need to use 'runuser' not 'su'
if [ -x /sbin/runuser ]
then
SU=runuser
else
SU=su
fi
# Set defaults for configuration variables
PGENGINE=/app/pgsql/bin
PGPORT=5432
PGDATA=/app/pgsql/data
if [ -f "$PGDATA/PG_VERSION" ] && [ -d "$PGDATA/base/template1" ]
then
echo "Using old-style directory structure"
else
PGDATA=/app/pgsql/data
fi
PGLOG=/app/pgsql/data/pgstartup.log
# Override defaults from /etc/sysconfig/pgsql if file is present
[ -f /etc/sysconfig/pgsql/${NAME} ] && . /etc/sysconfig/pgsql/${NAME}
export PGDATA
export PGPORT
# Check that networking is up.
# Pretty much need it for postmaster.
[ "${NETWORKING}" = "no" ] && exit 0
[ -f "$PGENGINE/postmaster" ] || exit 1
script_result=0
start(){
PSQL_START=$"Starting ${NAME} service: "
# Make sure startup-time log file is valid
if [ ! -e "$PGLOG" -a ! -h "$PGLOG" ]
then
touch "$PGLOG" || exit 1
chown postgres:postgres "$PGLOG"
chmod go-rwx "$PGLOG"
[ -x /usr/bin/chcon ] && /usr/bin/chcon -u system_u -r object_r -t postgresql_log_t "$PGLOG" 2>/dev/null
fi
# Check for the PGDATA structure
if [ -f "$PGDATA/PG_VERSION" ] && [ -d "$PGDATA/base" ]
then
# Check version of existing PGDATA
if [ x`cat "$PGDATA/PG_VERSION"` != x"$PGMAJORVERSION" ]
then
SYSDOCDIR="(Your System's documentation directory)"
if [ -d "/usr/doc/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/doc
fi
if [ -d "/usr/share/doc/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/share/doc
fi
if [ -d "/usr/doc/packages/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/doc/packages
fi
if [ -d "/usr/share/doc/packages/postgresql-$PGVERSION" ]
then
SYSDOCDIR=/usr/share/doc/packages
fi
echo
echo $"An old version of the database format was found."
echo $"You need to upgrade the data format before using PostgreSQL."
echo $"See $SYSDOCDIR/postgresql-$PGVERSION/README.rpm-dist for more information."
exit 1
fi
# No existing PGDATA! Warn the user to initdb it.
else
echo
echo "$PGDATA is missing. Use \"service postgresql initdb\" to initialize the cluster first."
echo_failure
echo
exit 1
fi
echo -n "$PSQL_START"
$SU -l postgres -c "$PGENGINE/postmaster -p '$PGPORT' -D '$PGDATA' ${PGOPTS} &" >> "$PGLOG" 2>&1 < /dev/null
sleep 2
pid=`pidof -s "$PGENGINE/postmaster"`
if [ $pid ] && [ -f "$PGDATA/postmaster.pid" ]
then
success "$PSQL_START"
touch /var/lock/subsys/${NAME}
head -n 1 "$PGDATA/postmaster.pid" > "/var/run/postmaster.${PGPORT}.pid"
echo
else
failure "$PSQL_START"
echo
script_result=1
fi
}
stop(){
echo -n $"Stopping ${NAME} service: "
$SU -l postgres -c "$PGENGINE/pg_ctl stop -D '$PGDATA' -s -m fast" > /dev/null 2>&1 < /dev/null
ret=$?
if [ $ret -eq 0 ]
then
echo_success
else
echo_failure
script_result=1
fi
echo
rm -f "/var/run/postmaster.${PGPORT}.pid"
rm -f "/var/lock/subsys/${NAME}"
}
restart(){
stop
start
}
initdb(){
if [ -f "$PGDATA/PG_VERSION" ]
then
echo "Data directory is not empty!"
echo_failure
else
echo -n $"Initializing database: "
if [ ! -e "$PGDATA" -a ! -h "$PGDATA" ]
then
mkdir -p "$PGDATA" || exit 1
chown postgres:postgres "$PGDATA"
chmod go-rwx "$PGDATA"
fi
# Clean up SELinux tagging for PGDATA
[ -x /sbin/restorecon ] && /sbin/restorecon "$PGDATA"
# Initialize the database
$SU -l postgres -c "$PGENGINE/initdb --pgdata='$PGDATA' --auth='ident sameuser'" >> "$PGLOG" 2>&1 < /dev/null
# Create directory for postmaster log
mkdir "$PGDATA/pg_log"
chown postgres:postgres "$PGDATA/pg_log"
chmod go-rwx "$PGDATA/pg_log"
[ -f "$PGDATA/PG_VERSION" ] && echo_success
[ ! -f "$PGDATA/PG_VERSION" ] && echo_failure
echo
fi
}
condrestart(){
[ -e /var/lock/subsys/${NAME} ] && restart
}
condstop(){
[ -e /var/lock/subsys/${NAME} ] && stop
}
reload(){
$SU -l postgres -c "$PGENGINE/pg_ctl reload -D '$PGDATA' -s" > /dev/null 2>&1 < /dev/null
}
# This script is slightly unusual in that the name of the daemon (postmaster)
# is not the same as the name of the subsystem (postgresql)
# See how we were called.
case "$1" in
start)
start
;;
stop)
stop
;;
status)
status -p /var/run/postmaster.${PGPORT}.pid
script_result=$?
;;
restart)
restart
;;
initdb)
initdb
;;
condrestart)
condrestart
;;
condstop)
condstop
;;
reload|force-reload)
reload
;;
*)
echo $"Usage: $0 {start|stop|status|restart|condrestart|condstop|reload|force-reload|initdb}"
exit 1
esac
exit $script_result
Tuesday, February 10, 2009
Unique lines in a file
If you want to see all unique lines within a file, use the uniq command within Linux/Unix. To do so, just execute uniq against a file.
#uniq /var/log/messages
Or, less elegantly...
#cat /var/log/messages | uniq
This will also work with standard input.
#uniq /var/log/messages
Or, less elegantly...
#cat /var/log/messages | uniq
This will also work with standard input.
Friday, January 16, 2009
Quick and dirty openLDAP replication
This is a cursory view of how to install and configure a master and slave openLDAP server pair. Unless specified, follow each step on both the master and the slave servers. The only real difference between the servers is the presence of a slurpd configuration on the master and the unique slapd configuration on both servers. In the end, you will have a syncing pair which will replicate changes from the master server to the slave server every three seconds.
A. Install OS and LDAP
1.Install your OS. I am assuming Linux, specifically RHEL or Fedora Core, but openLDAP will run on a variety of systems and these instructions can be adapted to your specific flavor.
2.On both the master and the slave, install openldap, php, httpd and the dependencies with the command (assuming RHEL or Fedora Core):
# yum -t -y install openldap-clients openldap-servers openldap php-ldap nss_ldap httpd php
B. Install and configure phpLDAPadmin (optional)
3.Install phpLDAPadmin from this website: http://phpldapadmin.sourceforge.net/wiki/index.php/Main_Page
4.Untar the download, and then copy the file phpldapadmin-<version>/config/config.php.example to phpldapadmin-/config/config.php
5.Move the phpldapadmin-<version> to /var/www/html/phpldapadmin
6.Restart httpd with the command
#chkconfig httpd on
#service httpd restart
C. Configure and test LDAP
7.Make sure that the master server's hostname is pingable from the slave and vice versa. If not, add the entries to /etc/hosts and restart networking with the command:
#service network restart
8.Copy /etc/openldap/ldap.conf to /etc/openldap/ldap.conf.orig
9.Copy /etc/openldap/sldapd.conf to /etc/openldap/slapd.conf.orig
10.Copy /etc/openldap/DB_CONFIG.example to /var/lib/ldap/DB_CONFIG
11.Copy the configuration files to the respective servers. These are located at the bottom of this document. Make sure to copy the correct ldap.conf and slapd.conf to their respective servers.
12.Import the base dn from the base.ldif file (included later in this document)
#slapadd < /etc/openldap/base.ldif
13.Start the LDAP service
# chkconfig ldap on
# service ldap start
14.Point to http://hostname/ or http://hostname/phpldapadmin If you get a “php memory too low” error, change the memory limit to something meaningful in /etc/php.ini
memory_limit = 128M ; For example
15.The login for the server is cn=root,dc=example,dc=com and the password needs to be set with slappasswd. Use slappasswd and change the hash in the /etc/openldap/slapd.conf file.
# slappasswd
New password:
Re-enter new password:
{SSHA}At/pOvtko2KXcKfM7t0o/OPedJrpXQM0
Now enter the line with the hashed password in the file /etc/openldap/slapd.conf as shown:
rootpw {SSHA}At/pOvtko2KXcKfM7t0o/OPedJrpXQM0
16.From the phpLDAPadmin GUI or using #slapadd similar to before, import the ldif file from a backup or existing server to the master server. If you have not created or do not have a backup of the ldif file of the old directory server, the other option is to copy the /var/lib/ldap directory over to the new server. If starting from scratch, this is a mute point.
17.If syncing is working, it will be replicated on the slave server. If not, the file /var/lib/ldap/replica/openldap-master-replog on the master server will tell you why.
18.For testing the syncing and replication of the master and slave servers, add a new entry to the master server and see if the entry appears on the slave server. For testing the subordination of the slave server, create an entry on the slave server and watch as it is not replicated on the master server.
/etc/openldap/base.ldif (For both servers)
dn: dc=example,dc=com
objectClass: top
objectClass: dcObject
objectClass: organization
dc: example
o: Example
/etc/openldap/ldap.conf (For master server)
URI ldap://127.0.0.1/
BASE dc=example,dc=com
TLS_CACERTDIR /etc/openldap/cacerts
/etc/openldap/slapd.conf (For master server)
include /etc/openldap/schema/core.schema
include /etc/openldap/schema/cosine.schema
include /etc/openldap/schema/inetorgperson.schema
include /etc/openldap/schema/nis.schema
allow bind_v2
pidfile /var/run/openldap/slapd.pid
argsfile /var/run/openldap/slapd.args
#Note that this should be changed based upon the hostname or user for greater security
access to *
by * read
by anonymous auth
# if no access controls are present, the default policy
# allows anyone and everyone to read anything but restricts
# updates to rootdn. (e.g., "access to * by * read")
# rootdn can always read and write EVERYTHING!
database bdb
suffix "dc=example,dc=com"
rootdn "cn=root,dc=example,dc=com"
rootpw {SSHA}/mYjTZhwSR1hIGKt6qD0oBpHdRjeHSGh
directory /var/lib/ldap
index objectClass eq,pres
index ou,cn,mail,surname,givenname eq,pres,sub
index uidNumber,gidNumber,loginShell eq,pres
index uid,memberUid eq,pres,sub
index nisMapName,nisMapEntry eq,pres,sub
# Replicas of this database
replogfile /var/lib/ldap/openldap-master-replog
replica host="slave:389"
suffix="dc=example,dc=com"
binddn="cn=root,dc=example,dc=com"
credentials=changeme
bindmethod=simple
/etc/openldap/ldap.conf (For slave server)
URI ldap://127.0.0.1
BASE dc=example,dc=com
TLS_CACERTDIR /etc/openldap/cacerts
updatedn "cn=root,dc=example,dc=com"
updateref ldap://master
rootdn "cn=root,dc=example,dc=com"
rootpw {SSHA}nlb8tJHDUJCMqQMBMyMIIu26VF1ViVEu
/etc/openldap/slapd.conf (For slave server)
include /etc/openldap/schema/core.schema
include /etc/openldap/schema/cosine.schema
include /etc/openldap/schema/inetorgperson.schema
include /etc/openldap/schema/nis.schema
allow bind_v2
pidfile /var/run/openldap/slapd.pid
argsfile /var/run/openldap/slapd.args
# Note that you should change this based upon the hostname of the master server.
access to *
by * write
by anonymous auth
# if no access controls are present, the default policy
# allows anyone and everyone to read anything but restricts
# updates to rootdn. (e.g., "access to * by * read")
# rootdn can always read and write EVERYTHING!
database bdb
suffix "dc=example,dc=com"
rootdn "cn=root,dc=example,dc=com"
rootpw {SSHA}/mYjTZhwsR1hIGKt6qD0oBpHdRjeHSGh
updatedn "cn=root,dc=example,dc=com"
updateref ldap://master
directory /var/lib/ldap
index objectClass eq,pres
index ou,cn,mail,surname,givenname eq,pres,sub
index uidNumber,gidNumber,loginShell eq,pres
index uid,memberUid eq,pres,sub
index nisMapName,nisMapEntry eq,pres,sub
TLSCertificateFile /etc/openldap/ldap.cert
TLSCertificateKeyFile /etc/openldap/ldap.key
A. Install OS and LDAP
1.Install your OS. I am assuming Linux, specifically RHEL or Fedora Core, but openLDAP will run on a variety of systems and these instructions can be adapted to your specific flavor.
2.On both the master and the slave, install openldap, php, httpd and the dependencies with the command (assuming RHEL or Fedora Core):
# yum -t -y install openldap-clients openldap-servers openldap php-ldap nss_ldap httpd php
B. Install and configure phpLDAPadmin (optional)
3.Install phpLDAPadmin from this website: http://phpldapadmin.sourceforge.net/wiki/index.php/Main_Page
4.Untar the download, and then copy the file phpldapadmin-<version>/config/config.php.example to phpldapadmin-/config/config.php
5.Move the phpldapadmin-<version> to /var/www/html/phpldapadmin
6.Restart httpd with the command
#chkconfig httpd on
#service httpd restart
C. Configure and test LDAP
7.Make sure that the master server's hostname is pingable from the slave and vice versa. If not, add the entries to /etc/hosts and restart networking with the command:
#service network restart
8.Copy /etc/openldap/ldap.conf to /etc/openldap/ldap.conf.orig
9.Copy /etc/openldap/sldapd.conf to /etc/openldap/slapd.conf.orig
10.Copy /etc/openldap/DB_CONFIG.example to /var/lib/ldap/DB_CONFIG
11.Copy the configuration files to the respective servers. These are located at the bottom of this document. Make sure to copy the correct ldap.conf and slapd.conf to their respective servers.
12.Import the base dn from the base.ldif file (included later in this document)
#slapadd < /etc/openldap/base.ldif
13.Start the LDAP service
# chkconfig ldap on
# service ldap start
14.Point to http://hostname/ or http://hostname/phpldapadmin If you get a “php memory too low” error, change the memory limit to something meaningful in /etc/php.ini
memory_limit = 128M ; For example
15.The login for the server is cn=root,dc=example,dc=com and the password needs to be set with slappasswd. Use slappasswd and change the hash in the /etc/openldap/slapd.conf file.
# slappasswd
New password:
Re-enter new password:
{SSHA}At/pOvtko2KXcKfM7t0o/OPedJrpXQM0
Now enter the line with the hashed password in the file /etc/openldap/slapd.conf as shown:
rootpw {SSHA}At/pOvtko2KXcKfM7t0o/OPedJrpXQM0
16.From the phpLDAPadmin GUI or using #slapadd similar to before, import the ldif file from a backup or existing server to the master server. If you have not created or do not have a backup of the ldif file of the old directory server, the other option is to copy the /var/lib/ldap directory over to the new server. If starting from scratch, this is a mute point.
17.If syncing is working, it will be replicated on the slave server. If not, the file /var/lib/ldap/replica/openldap-master-replog on the master server will tell you why.
18.For testing the syncing and replication of the master and slave servers, add a new entry to the master server and see if the entry appears on the slave server. For testing the subordination of the slave server, create an entry on the slave server and watch as it is not replicated on the master server.
/etc/openldap/base.ldif (For both servers)
dn: dc=example,dc=com
objectClass: top
objectClass: dcObject
objectClass: organization
dc: example
o: Example
/etc/openldap/ldap.conf (For master server)
URI ldap://127.0.0.1/
BASE dc=example,dc=com
TLS_CACERTDIR /etc/openldap/cacerts
/etc/openldap/slapd.conf (For master server)
include /etc/openldap/schema/core.schema
include /etc/openldap/schema/cosine.schema
include /etc/openldap/schema/inetorgperson.schema
include /etc/openldap/schema/nis.schema
allow bind_v2
pidfile /var/run/openldap/slapd.pid
argsfile /var/run/openldap/slapd.args
#Note that this should be changed based upon the hostname or user for greater security
access to *
by * read
by anonymous auth
# if no access controls are present, the default policy
# allows anyone and everyone to read anything but restricts
# updates to rootdn. (e.g., "access to * by * read")
# rootdn can always read and write EVERYTHING!
database bdb
suffix "dc=example,dc=com"
rootdn "cn=root,dc=example,dc=com"
rootpw {SSHA}/mYjTZhwSR1hIGKt6qD0oBpHdRjeHSGh
directory /var/lib/ldap
index objectClass eq,pres
index ou,cn,mail,surname,givenname eq,pres,sub
index uidNumber,gidNumber,loginShell eq,pres
index uid,memberUid eq,pres,sub
index nisMapName,nisMapEntry eq,pres,sub
# Replicas of this database
replogfile /var/lib/ldap/openldap-master-replog
replica host="slave:389"
suffix="dc=example,dc=com"
binddn="cn=root,dc=example,dc=com"
credentials=changeme
bindmethod=simple
/etc/openldap/ldap.conf (For slave server)
URI ldap://127.0.0.1
BASE dc=example,dc=com
TLS_CACERTDIR /etc/openldap/cacerts
updatedn "cn=root,dc=example,dc=com"
updateref ldap://master
rootdn "cn=root,dc=example,dc=com"
rootpw {SSHA}nlb8tJHDUJCMqQMBMyMIIu26VF1ViVEu
/etc/openldap/slapd.conf (For slave server)
include /etc/openldap/schema/core.schema
include /etc/openldap/schema/cosine.schema
include /etc/openldap/schema/inetorgperson.schema
include /etc/openldap/schema/nis.schema
allow bind_v2
pidfile /var/run/openldap/slapd.pid
argsfile /var/run/openldap/slapd.args
# Note that you should change this based upon the hostname of the master server.
access to *
by * write
by anonymous auth
# if no access controls are present, the default policy
# allows anyone and everyone to read anything but restricts
# updates to rootdn. (e.g., "access to * by * read")
# rootdn can always read and write EVERYTHING!
database bdb
suffix "dc=example,dc=com"
rootdn "cn=root,dc=example,dc=com"
rootpw {SSHA}/mYjTZhwsR1hIGKt6qD0oBpHdRjeHSGh
updatedn "cn=root,dc=example,dc=com"
updateref ldap://master
directory /var/lib/ldap
index objectClass eq,pres
index ou,cn,mail,surname,givenname eq,pres,sub
index uidNumber,gidNumber,loginShell eq,pres
index uid,memberUid eq,pres,sub
index nisMapName,nisMapEntry eq,pres,sub
TLSCertificateFile /etc/openldap/ldap.cert
TLSCertificateKeyFile /etc/openldap/ldap.key
Labels:
ldap,
Linux,
openldap,
phpldapadmin,
Red Hat,
replication,
slapd,
slurpd
Wednesday, January 7, 2009
DNS lookups
To find a hostname when you know the IP address:
nmblookup -A <ip_address>
eg. nmblookup -A 192.168.0.148
or
host <ip_address>
eg. host 192.168.0.148
To find an IP address when you know the hostname, try the following ways:
whois www.google.com
dig www.google.com
nslookup www.google.com
nmblookup -A <ip_address>
eg. nmblookup -A 192.168.0.148
or
host <ip_address>
eg. host 192.168.0.148
To find an IP address when you know the hostname, try the following ways:
whois www.google.com
dig www.google.com
nslookup www.google.com
Friday, January 2, 2009
Install and configure NTP
NTP is great at keeping your Linux server or desktop's time synced. Not having the time synced can potentially cause issues with backup software, applications and some web applications. Here is a sample script to install and configure NTP on Linux. This was created for Red Hat, but it should work with other versions of Linux with few modifications (like the installation of the init scripts).
#NTP configuration script.
date
cat /var/lib/ntp/drift
chkconfig ntpd --list
service ntpd stop
ntpdate -u 0.rhel.pool.ntp.org
ntpdate -u 1.rhel.pool.ntp.org
ntpdate -u 2.rhel.pool.ntp.org
chkconfig ntpd on
cat /etc/ntp.conf | grep server
vi /etc/ntp.conf
#Based upon the output of those commands, add (or delete) the following lines in /etc/ntp.conf
server 0.rhel.pool.ntp.org
server 1.rhel.pool.ntp.org
server 2.rhel.pool.ntp.org
#Now save and test
service ntpd start
sleep 4
ntpq -p
cat /var/lib/ntp/drift
date
#NTP configuration script.
date
cat /var/lib/ntp/drift
chkconfig ntpd --list
service ntpd stop
ntpdate -u 0.rhel.pool.ntp.org
ntpdate -u 1.rhel.pool.ntp.org
ntpdate -u 2.rhel.pool.ntp.org
chkconfig ntpd on
cat /etc/ntp.conf | grep server
vi /etc/ntp.conf
#Based upon the output of those commands, add (or delete) the following lines in /etc/ntp.conf
server 0.rhel.pool.ntp.org
server 1.rhel.pool.ntp.org
server 2.rhel.pool.ntp.org
#Now save and test
service ntpd start
sleep 4
ntpq -p
cat /var/lib/ntp/drift
date
Friday, December 19, 2008
Friday, December 5, 2008
Rename files which match specific criteria
This renames all files within the current working directory from .exe to .exeold. This is useful if you are trying to rename any file extension from one to another.
for file in *.exe ; do mv $file `echo $file | sed 's/\(.*\.\)exe/\1exeold/'` ; done
for file in *.exe ; do mv $file `echo $file | sed 's/\(.*\.\)exe/\1exeold/'` ; done
Wednesday, November 12, 2008
Simple bash for loop
for kernelrpm in kernel-smp-2.6.9-5.EL kernel-smp-2.6.9-34.EL kernel-smp-2.6.9-67.0.1.EL kernel-utils-2.4-14.1.117
do rpm -e $kernelrpm
done
do rpm -e $kernelrpm
done
Thursday, October 9, 2008
Boot FreeBSD with Grub
If you have installed FreeBSD (or any operating system) and a partition and then later installed Linux (or any operating system with Grub) on another partition and can't get the latter to boot the former, add this line to /boot/grub/menu.lst
# For booting FreeBSDIn this case, the partition was /dev/sda2 which contained FreeBSD. Modify it for your needs.
title FreeBSD 7.0
root (hd0,1)
chainloader +1
Wednesday, October 8, 2008
Coraid documentation
I was able to do quite a bit of technical writing with Coraid. It is useful for those of you using AoE technology. I wrote all of the quickstart documentation here:
http://www.coraid.com/RESOURCES/Quickstart-Documentation
Also, I wrote the driver installation guides here:
http://www.coraid.com/SUPPORT/AoE-Drivers
http://www.coraid.com/RESOURCES/Quickstart-Documentation
Also, I wrote the driver installation guides here:
http://www.coraid.com/SUPPORT/AoE-Drivers
A Tag Cloud that works with Blogger
I have spent a great deal of time trying to find a Tag Cloud generator that works with Google Blogger. Finally, I found one.
http://www.compender.com/2007/12/simple-tag-cloud.html
http://www.compender.com/2007/12/simple-tag-cloud.html
LVM snapshots
Here is a script to create LVM snapshots in Linux. It is a skeleton only provided for your modification and my reference, but I am using AoE storage as my PV.
#create PV
pvcreate /dev/etherd/e1.0
#create VG
vgcreate cascade /dev/etherd/e1.0
#create LV
lvcreate cascade -n original -L 500G
#make XFS filesystem
mkfs.xfs /dev/cascade/original
#mount (and use) LV
mount /dev/cascade/original /mnt
#freeze filesystem (will hang processes that are using IO on /mnt)
xfs_freeze -f /mnt
#create snapshot of original (works best if it is the same size)
lvcreate -s /dev/cascade/original -n backup -L 500G
#mount snapshot
mount -o nouuid,ro /dev/cascade/backup /mnt2
#backup directory with rsync or backup utility
#unmount LV
umount /mnt2
#remove snapshot
lvremove /dev/cascade/backup
#additional information is found here: http://arstechnica.com/articles/columns/linux/linux-20041013.ars and here: http://tldp.org/HOWTO/LVM-HOWTO/snapshots_backup.html
#create PV
pvcreate /dev/etherd/e1.0
#create VG
vgcreate cascade /dev/etherd/e1.0
#create LV
lvcreate cascade -n original -L 500G
#make XFS filesystem
mkfs.xfs /dev/cascade/original
#mount (and use) LV
mount /dev/cascade/original /mnt
#freeze filesystem (will hang processes that are using IO on /mnt)
xfs_freeze -f /mnt
#create snapshot of original (works best if it is the same size)
lvcreate -s /dev/cascade/original -n backup -L 500G
#mount snapshot
mount -o nouuid,ro /dev/cascade/backup /mnt2
#backup directory with rsync or backup utility
#unmount LV
umount /mnt2
#remove snapshot
lvremove /dev/cascade/backup
#additional information is found here: http://arstechnica.com/articles/columns/linux/linux-20041013.ars and here: http://tldp.org/HOWTO/LVM-HOWTO/snapshots_backup.html
Wednesday, October 1, 2008
List largest (or smallest) files
If you want to find the largest files in a directory which are consuming precious space, you can use the following command:
openSuSEServer:~ # du -kh /var | sort -n | tail
then, to sort the smallest files, use the inverse command:
openSuSEServer:~ # du -kh /var | sort -n | head
openSuSEServer:~ # du -kh /var | sort -n | tail
then, to sort the smallest files, use the inverse command:
openSuSEServer:~ # du -kh /var | sort -n | head
Wednesday, August 13, 2008
Adding a subject to an e-mail link
Usually, an e-mail link would look like this:
<a href="mailto:sales@coraid.com">E-mail sales </a>
But to add a subject line to the e-mail when someone clicks the link and sends an e-mail is done with the one of the two following examples:
<a href="mailto:sales@coraid.com?subject=New%20sales%20inquiry">E-mail sales</a>
or
<a href="mailto:sales@coraid.com" title="New sales inquiry">E-mail sales</a>
The first one works every time that I have used it, but the second one is an HTML compliant way of doing the same thing.
<a href="mailto:sales@coraid.com">E-mail sales </a>
But to add a subject line to the e-mail when someone clicks the link and sends an e-mail is done with the one of the two following examples:
<a href="mailto:sales@coraid.com?subject=New%20sales%20inquiry">E-mail sales</a>
or
<a href="mailto:sales@coraid.com" title="New sales inquiry">E-mail sales</a>
The first one works every time that I have used it, but the second one is an HTML compliant way of doing the same thing.
Tuesday, August 12, 2008
Coraid blogging
I am now working for Coraid as a systems engineer. I will be blogging professionally at Coraid's blog, and also will be responsible for much of the company's new documentation, which has kept me very busy so far. I will continue to blog here when I find interesting things to blog about.
Friday, June 27, 2008
Dates within crontab
If you want to add dates to backups or logs, like mythtvDB27062008.sql within crontab, do the following:
0 0 * * * /usr/bin/mysqldump -u mythtv -pPassword mythconverg > /mythtv/recordings/mythtvDB`date +%d%m%Y`.sql
The key is the backquotes around the `date +%d%m%Y` command. This will backup a MythTV MySQL database to a file like this: /mythtv/recordings/mythtvDB27062008.sql every night at midnight.
0 0 * * * /usr/bin/mysqldump -u mythtv -pPassword mythconverg > /mythtv/recordings/mythtvDB`date +%d%m%Y`.sql
The key is the backquotes around the `date +%d%m%Y` command. This will backup a MythTV MySQL database to a file like this: /mythtv/recordings/mythtvDB27062008.sql every night at midnight.
Friday, June 13, 2008
Change hostname
To change the name of the computer's name (hostname) do the following:
#echo <hostname> > /etc/HOSTNAME
Example:
#echo earth > /etc/HOSTNAME
Tuesday, May 27, 2008
Mount ISO images as physical devices
Here is a great how-to with mounting ISO images as though they were a physical device like a CD-ROM or DVD drive:
http://www.cyberciti.biz/tips/how-to-mount-iso-image-under-linux.html
http://www.cyberciti.biz/tips/how-to-mount-iso-image-under-linux.html
Tag cloud generation
Of the many that I have tried, this website is the best for tag cloud generation:
http://www.tagcloud-generator.com/index.php
http://www.tagcloud-generator.com/index.php
Execute any custom command on bootup (Ubuntu, Debian)
This command is for anything that you would like to execute after the system has been started and all of the scripts in /etc/init.d/ have been run. If you want them to execute afterwards, put it in
/etc/rc.local
This is rather useful for network mounts, changes to hardware configuration, or custom programs that need to be started at boot. Make sure to make the file executable through the command: $sudo chmod +x /etc/rc.local
/etc/rc.local
This is rather useful for network mounts, changes to hardware configuration, or custom programs that need to be started at boot. Make sure to make the file executable through the command: $sudo chmod +x /etc/rc.local
Mount a cdrom from the command line
To mount a cdrom (or DVD) from the command line, do the following:
#mount -t iso9660 -o ro <device> <mountedDirectory>
Example:
# mount -t iso9660 -o ro /dev/cdrom /media/cdrom
Note: make sure that /media/cdrom exists.
#mount -t iso9660 -o ro <device> <mountedDirectory>
Example:
# mount -t iso9660 -o ro /dev/cdrom /media/cdrom
Note: make sure that /media/cdrom exists.
Monday, May 26, 2008
Configure a wireless connection from the command line
Here is how to configure a wireless network interface from the command line in Ubuntu.
http://www.stoltenow.com/archives/2006/12/ubuntu_configur.html
http://www.stoltenow.com/archives/2006/12/ubuntu_configur.html
Sunday, May 4, 2008
Copying DVDs from the command line
Would you like to store a backup of your DVD collection to disk? Here is how, using vobcopy, a lossless copy:
#vobcopy [--large-file] [-verbose] [-input-dir DVD_DEVICE]
Example:
#vobcopy -l -v -i /dev/dvd
#vobcopy [--large-file] [-verbose] [-input-dir DVD_DEVICE]
Example:
#vobcopy -l -v -i /dev/dvd
Thursday, April 17, 2008
Execute any custom command on bootup (SuSE or Red Hat)
This command is for anything that you would like to execute after the system has been started and all of the scripts in /etc/init.d/ have been run. If you want to execute these commands before any of these scripts, but the commands in the new file:
/etc/init.d/before.local
If you want them to execute afterwards, put it in
/etc/init.d/after.local
This is rather useful for network mounts, changes to hardware configuration, or custom programs that need to be started at boot. Make sure to make the file executable through the command: chmod +x /etc/init.d/after.local
The other option is to edit the /etc/rc.d/rc.local and do that same there.
/etc/init.d/before.local
If you want them to execute afterwards, put it in
/etc/init.d/after.local
This is rather useful for network mounts, changes to hardware configuration, or custom programs that need to be started at boot. Make sure to make the file executable through the command: chmod +x /etc/init.d/after.local
The other option is to edit the /etc/rc.d/rc.local and do that same there.
Thursday, April 3, 2008
Monday, March 24, 2008
Mythweb at its best

Mythweb, a component of MythTV, allows you to stream your own recorded videos, shows or movies from the Internet in a YouTube-like interface. Here is an example. One more reason MythTV beats the socks off TiVO.
Saturday, March 22, 2008
Why Webmin is the best tool for Systems Administrators
In the SysAdmin world, Webmin is the best invention next to sliced bread. It is a compete, web-based administration interface for dozens of different systems. Not only does it support a plethora of operating systems, but it is much better than Red Hat's system-config-* and almost as good as Novell's Yast. It knocks the socks off any other administration tool that I have seen. You can download the package for your distro at Webmin's Website I guess you can call me a Webmin fanboy.
Labels:
administration,
Novell,
Red Hat,
system-config,
webmin,
Yast
Lexmark Z645 Printer on Ubuntu Linux
This post, is how you can get a Lexmark Z645 Printer to work within Ubuntu 7.04, 7.10, 8.04 and later. It is most useful. http://ubuntuforums.org/archive/index.php/t-616097.html
Tuesday, March 11, 2008
Writing ISO files from the commandline
Maybe you want to rip a data CD or DVD into an ISO formatted file. Here is how to do it from the command line:
$wodim -v dev=<device> [speed] <trackName.iso>
For example:
$wodim -v dev=/dev/scd0 speed=4 puppy-3.01-seamonkey.iso
$wodim -v dev=<device> [speed] <trackName.iso>
For example:
$wodim -v dev=/dev/scd0 speed=4 puppy-3.01-seamonkey.iso
Backup or restore a MySQL database
They say that a system administrator is only as good as his last backup. If you need to backup or restore a MySQL database, you can execute these commands:
Backup the database:
$mysqldump -u <adminuser> -p <password> <databasename> > <databasebackupfile.sql>
For example:
$mysqldump -u root -p myPass mythconverg > mythdatabasebackup.sql
Restore the database:
$mysql -u <adminuser> -p <password> <databasename> < <databasebackupfile.sql>
For example:
$mysql -u root -p myPass mythconverg < mythdatabasebackup.sql
Backup the database:
$mysqldump -u <adminuser> -p <password> <databasename> > <databasebackupfile.sql>
For example:
$mysqldump -u root -p myPass mythconverg > mythdatabasebackup.sql
Restore the database:
$mysql -u <adminuser> -p <password> <databasename> < <databasebackupfile.sql>
For example:
$mysql -u root -p myPass mythconverg < mythdatabasebackup.sql
Repair a MySQL database
Sometimes you can do something to your MySQL database which causes corruption. You can fix this with the following command:
$mysqlcheck <database> -u <adminuser> -p <password> --auto-repair
For example:
$mysqlcheck mythconverg -u root -p myPass --auto-repair
This will automatically repair any corruption found within the database schema.
$mysqlcheck <database> -u <adminuser> -p <password> --auto-repair
For example:
$mysqlcheck mythconverg -u root -p myPass --auto-repair
This will automatically repair any corruption found within the database schema.
Align and clean printer heads for a Lexmark printer
If you have a Lexmark printer within Linux, it may be difficult to align or clean the printer heads as these utilities are nonexistent within cups. I have a Lexmark z645 printer. The workaround is to use the lpr utilities to get the job done. With some modification, this should work for most printers, not just Lexmark ones.
To align printer heads:
#lpr -P <printernamewithincups> -o raw <pathtoalignutility.out>
For example:
#lpr -P Lexmark_640_Series -o raw /usr/local/z600llpddk/utility/lxbcalgn.out
To clean printer heads:
#lpr -P <printernamewithincups> -o raw <pathtocleanutility.out>
For example:
#lpr -P Lexmark_640_Series -o raw /usr/local/z600llpddk/utility/lxbccln.out
The -o raw allows the job to be performed without going through MIME filters. Note that the paths may be different depending on your printer's driver. Use the command:
#find / -iname *.out to locate the correct path for the align and clean utility.
To align printer heads:
#lpr -P <printernamewithincups> -o raw <pathtoalignutility.out>
For example:
#lpr -P Lexmark_640_Series -o raw /usr/local/z600llpddk/utility/lxbcalgn.out
To clean printer heads:
#lpr -P <printernamewithincups> -o raw <pathtocleanutility.out>
For example:
#lpr -P Lexmark_640_Series -o raw /usr/local/z600llpddk/utility/lxbccln.out
The -o raw allows the job to be performed without going through MIME filters. Note that the paths may be different depending on your printer's driver. Use the command:
#find / -iname *.out to locate the correct path for the align and clean utility.
Labels:
align,
clean,
cups,
find,
Lexmark Z645,
lpr,
print heads
Past writings for the BYU-I Linux/Unix Society
I have been the BYU-Idaho Linux/Unix Society President for four semesters. During that time, I have had the opportunity to present articles on various themes. Here are links to those documents:
How to install Linux within VMWare (PDF)
Gaming in Linux (PDF)
Multimedia within Linux (PDF)
Build your own TiVo with MythTV (PDF)
The society's website is located here.
How to install Linux within VMWare (PDF)
Gaming in Linux (PDF)
Multimedia within Linux (PDF)
Build your own TiVo with MythTV (PDF)
The society's website is located here.
Why Masters of the Universe?

When I was younger, my brother and I were enthralled with He-Man and the Masters of the Universe cartoon show. We enjoyed playing with the action figures and imagining we were He-Man. This blog is a throwback to the idea of overwhelming power over evil. In this case, through using Linux.
Subscribe to:
Posts (Atom)