_____

HOWTO

for diff work: 

#!/bin/bash

diffy=/storeddiffs/diff_`date +%b-%d-%y`.log
#diff -ar --exclude="/diff/*" --exclude="/storeddiffs/*" --exclude="/dev/*" --exclude="/proc/*" / /diff > $diffy # runs out of memory

rsync --write-batch=$diffy -av --delete --exclude /sys --exclude /dev --exclude /proc --exclude /diff --exclude /storeddiffs / /dif

and we copy this as diffy to /etc/cron/daily

for jekyll:

  • bash to remove and add leading zeroes (after re-calculate to match frames: 
#!/bin/bash

for file in `ls ../*.jpg`
do
new=`basename $file .jpg`

vz="$(echo $new | sed 's/0*//')"
x=`expr $new - 96` 
zz=`printf "%08d" $x`
convert $file ../ital/${zz}.jpg -compose difference -composite test${new}.jpg
done
  • now we do it like this: 
#!/bin/bash

new=46 # start frame for english

while [ 1 = 1 ]
do
    yy=`printf "%08d" $new`
    x=`expr $new + 864` # whatever difference is...
    zz=`printf "%08d" $x`
# and scaling??
    convert -resize 720x576 ../jek-image-dutch/${zz}.jpg ${yy}.jpg -compose difference -composite ../diffdutchuk1/${zz}.jpg
    new=`expr $new + 1` 
done
  • jpgs to avi 
    mencoder "mf://*.jpg" -mf w=800:h=600:fps=25:type=jpg -ovc lavc \
   -lavcopts vcodec=mpeg4:mbd=2:trell -audiofile test.wav -oac copy -o output.avi
  • and to VCD (700MB)

use: 

mencoder -oac lavc -ovc lavc -of mpeg -mpegopts format=xvcd -vf \
   scale=352:288,harddup -srate 44100 -af lavcresample=44100 -lavcopts \
   vcodec=mpeg1video:keyint=15:vrc_buf_size=327:vrc_minrate=1152:\
vbitrate=1152:vrc_maxrate=1152:acodec=mp2:abitrate=224:aspect=16/9 -ofps 25 \
   -o jekylldiff1.mpg diffdutchuk1.avi

then to make vcd: 

vcdimager jekylldiff1.mpg

and burn with: 

cdrdao write --driver generic-mmc-raw videocd.cue

to avoid error message: Drive does not accept any cue sheet variant

numerical data to wav

octave: 

xx=load("hdvoice");
saveaudio("testt",xx,"mu",16) (16 bit mu-law)

commandline misc

  • remove all files from .tar.gz 
    tar tf <file.tar.gz> | sort -r | while read file; do if [ -d "$file" ]; then rmdir "$file"; else rm -f "$file"; fi; done

[from: http://www.commandlinefu.com/commands/view/2573/remove-all-files-previously-extracted-from-a-tar.gz-file. ]

  • imagemagick diff images 
     convert p1090152.jpg p1090153.jpg -compose difference -composite test.jpg
  • and scale 
    convert -resize 720x544 00000093.jpg 00000093.jpg
  • mencoder jpegs to avi (in zsh): 
    mencoder "mf://*.jpg" -mf w=800:h=600:fps=25:type=jpg -ovc lavc \
   -lavcopts vcodec=mpeg4:mbd=2:trell -oac copy -o output.avi

(and to add audio (xored?): -audiofile filename)

  • find 
    find . -newerct '1 minute ago' -print 

    find / -mmin -10
  • ifconfig mac address 
    ifconfig wlan0 hw ether 00:19:d2:29:ae:7e
  • gdb 
    attach <process id>

    x 0x8049180

    x/xb

step one byte at a time through memory

[not /dev/mem seems otherwise to this access]

  • search man pages: 
    man -k stderr
  • echo to an xterm

in the xterm: 

tty

then eg.: 

echo "llllllllll" > /dev/pts/3

or to interpret commands: 

echo $(whoami) > /dev/pts/4

but this uses command substitution and dumps output to the /dev/pts

  • resize lots of images with imagemagick 
    for i in `ls *.JPG`; do convert -resize 50% -quality 80 $i conv_$i; done
  • from camera to b/w scan: 
#!/bin/bash
for img in `ls *.jpg`
do
 convert -resize 50% -quality 80 -rotate -180 -colorspace gray $img -contrast -contrast -contrast -contrast rr$img

done
  • backup imap with offlineimap: 
[general]
accounts = Test
[Account Test]
localrepository = LocalExample
remoterepository = RemoteExample
[Repository LocalExample]
type = Maildir
localfolders = ~/Test
[Repository RemoteExample]
type = IMAP
remotehost = xxxxx.co.uk
ssl = yes
remoteuser = xxxxx@xxxxx.co.uk
  • beep 
    beep mute is in alsamixer
  • WPA 
    wpa_passphrase essid passphrase > /etc/wpa_supplicant.conf 

    wpa_supplicant -B -c/etc/wpa_supplicant.conf -iwlan0
  • text to pdf 
    e2ps -nh diana.txt > diana.ps

    ps2pdf diana.ps

very small, landscape: 

e2ps -nh -l -size 1 diana.txt > diana.ps
  • grep in binary file (treat binary as ascii) 
    grep -a purl
  • and show offset in bytes of the match 
    grep -aob test
  • most recent// and head 
    ls -t Wiki/images | head
  • use of watch as in: 
    watch --no-title --interval=5 "curl -Is slashdot.org | egrep '^X-(F|B)' | cut -d - -f 2"

    watch tail /var/log/messages
  • redirection of STDERR = 2> : 
    ./stego -e -t ~/projects/steganographia/island.txt ~/projects/steganographia/island.txt testout 2> tttt
  • stderr to less 
    ./bbn_80211b_tx.py 2>&1 | less

     for file in `ls *`; do cat $file | text2wave -o $file ; done  

    wget -c // to resume

    gpsbabel -t -i garmin -f /dev/ttyUSB0 -o gpx -F gpsfile.gpx

     rsync -av --delete /root/ /media/rsync
  • git: 
    git pull

    git checkout -f master ;; to overwrite all local changes

    git diff

    ./readrng -d /dev/ttyUSB0 -q 512  :: to fill entropy buffer for /dev/random

    gocr cuc1.png > cucumber_screen6   OCR

    modprobe snd-pcm-oss

    lsof -r 1 -i :22 // who is there?

    xawtv-remote snap jpeg 320x240 xxx.jpeg

    echo "sensor_fps:30" > /proc/cpia/video0

network/data forensics 

kismet -c wlan0

tcpdump -s 0 -A
  • tcpreplay and driftnet 
    airdecap-ng Kismet-Sep-25-2009-12.pcapdump                                                                                     

    tcpreplay -t -i lo Kismet-Sep-25-2009-12.pcapdump-dec

    driftnet -i lo
  • raw sniff in scapy 
    pkts = sniff(prn=lambda x:sys.stdout.write(str(x)))

    tcpdump -s 0 -w - | devdisplay 240 100 1 // raw packets

    tcpdump -s 0 -w - | tee pipe > /dev/dsp & ; cat pipe | devdisplay 240 240 2

which could equally well be: 

tcpdump -s 0 -w - | tee /dev/dsp | devdisplay 240 240 2

tcpflow -i eth0  // dumps reconstruction/tcpfollowed also with -C or -cg

shell//scripting

  • zsh number substitution 
     scp images_2/p10508{06..14}.*  katier@192.168.1.12:/home/katier/Desktop/udk/
  • sort in numerical: 
    ls xyz*([0-9]*).jpg | nawk -F'xyz' '{print $NF, $0}' | sort -n | cut -d ' ' -f2-
  • one liner: 
    for file in `ls *.jpeg`; do gocr $file done > ghost_out
  • fix for space/new lines: 
#!/bin/sh
tmpIFS=$IFS
IFS=$'\n'
for file in `ls *.mp3`
do
new=`basename $file .wav`
sox $file ${new}.wav
done
IFS=$tmpIFS
  • one-liner 
    while true; do mplayer /root/dump/test.wav -ao jack
done
  • rawify 
#!/bin/sh
for file in `ls *.wav`
do
new=`basename $file .wav`
sox $file -r 8000 -u -b -c 1 ${new}.raw
done
  • shuffle 
#!/bin/sh
for file in `ls`
do
new=$RANDOM.${file}
mv $file $new
done
  • and to use to cutup audio: 
    ./rawify.sh // convert to raw (8000 samples p/s)

    split -a 4 -d -b 8000 ../full_exq.raw // split into 1 second fragments pref in new dir

    ./shuffle.sh // shuffle these

    cat * > fulllll // cat these

    sox -t raw -r 8000 -u -b -c 1 fulllll full.wav // back to wav
  • evp-shell 
#!/bin/sh
for file in `ls *.wav`
do
new=`basename $file .wav`
sox $file -r 44100 -u -b -c 1 trans${new}.raw
cat trans${new}.raw | evp 8 32 400000 0 > evp${new}.raw
sox -r 44100 -u -b -c 1 -v 0.5 evp${new}.raw evp${new}.wav
rm *.raw
done
  • speaks files from list 
#!/bin/sh

cat test_sed2 |
while read line
do
flite $line
done
  • rotate all images: 
#!/bin/bash
for img in `ls *.jpg`
do
  convert -rotate -90 $img rr$img
done
  • concatenate wav files 
    sox *.wav (or list) concat.wav

sed/awk

  • adding up wordcounts: 
    awk '{sum+=$1} END{printf("%d\n",sum)}' testwc

GPS track and waypoint editing

using viking

  • seems to be the preferred way. Notes:

1] Acquire GPS works for Garmin (/dev/ttyUSB0)

2] Once acquired expand the Acquired left item and waypoints. Right click on an expanded waypoint and select GOTO

3] Maps - Add new map layer. Openstreetmap seems to work best. Make sure is moved down below our gps layer. Right click always to change options.

4] Crtl - + for zoom out and in.

5] Make a new TrackWayPoint layer and cut and paste tracks or waypoints into this and then right click to export this layer.

Viking reference: http://viking.sourceforge.net/mediawiki/index.php/Viking\_Reference\_Manual#Export

using gpsman

(can't run as root: remember on root: xhost +)

extract one gps track from gpx:

1] open in gpsman (running as xxxxx)

2] import gpx

3] got to data/track/export/gpx/select

learning python

own example code:

file:~/chip3.py

potential projects -

mode+v:

natural language:

scapy: sniffeur.py 

M-; - comment/uncomment region

emacs/gnus/mew/org-mode

lunar phases 

C-u M-x lunar-phases

nmea to decimal in emacs 

(defun nmeatodec()
  (interactive)
  (goto-char (point-min))
  (while
      (re-search-forward "^[0-9]" nil t)
    ;; find lat, insert dec point, divide 60, insert
    (forward-char 1)
    (insert ".")
    ;; remove next .
    (re-search-forward "\\." nil t)
    (delete-char -1)
    ;; grab region and /60.
    (setq pnt (- (point) 2))
    (re-search-forward "," nil t)
    (setq decstring (buffer-substring pnt (- (match-end 0) 1)))
    (setq dec (/ (string-to-number decstring) 60))
    ;; kill and insert
    (kill-region pnt (- (match-end 0) 1))
    (goto-char pnt)
    (insert (number-to-string dec))
    (re-search-forward "," nil t)
    (forward-char 3)
    (insert ".")
    ;; remove next .
    (re-search-forward "\\." nil t)
    (delete-char -1)  
    ;; same again
    (setq pnt (- (point) 2))
    (re-search-forward "," nil t)
    (setq decstring (buffer-substring pnt (- (match-end 0) 1)))
    (setq dec (/ (string-to-number decstring) 60.0)) ;; now get rid of .
    (kill-region pnt (- (match-end 0) 1))
    (goto-char pnt)
    (insert (number-to-string dec))
    (re-search-backward "\\." nil t)
    (delete-char 1)  
    (forward-line 1)
    (beginning-of-line)))

which we can use with: 

gpsbabel -t -i unicsv -f testlog -o gpx -F test.gpx

and then import into, say, viking…

shift whole org-mode tree 

M S left/right

mew

  • now using mew instead of gnus:
  • in .emacs 
 (autoload 'mew "mew" nil t)
 (autoload 'mew-send "mew" nil t)
 ;; Optional setup (e.g. C-xm for sending a message):
 (autoload 'mew-user-agent-compose "mew" nil t)
 (if (boundp 'mail-user-agent)
     (setq mail-user-agent 'mew-user-agent))
 (if (fboundp 'define-mail-user-agent)
     (define-mail-user-agent
       'mew-user-agent
       'mew-user-agent-compose
       'mew-draft-send-message
       'mew-draft-kill
       'mew-send-hook))

(setq mew-use-master-passwd t)

(autoload 'bbdb-insinuate-mew      "bbdb-mew"   "Hook BBDB into Mew")
(add-hook 'mew-init-hook 'bbdb-insinuate-mew)
(setq bbdb-send-mail-style 'mew)
(setq sc-auto-fill-region-p t)
(setq mew-smtp-user "user@domain")
(setq mew-smtp-server "server")
(setq mew-smtp-auth-list '("LOGIN"))   ; "CRAM-MD5", "PLAIN", and "LOGIN" can be used

and customize mew-field-completion-switch: ("To:" bbdb-complete-name)

  • to send an attachment/ make a multipart message: 
    C-c C-a

and then c to copy file in

  • to read an attachment: 
    n and then C-c C-e
  • later on attachment seem to disappear.

type . to re-analyse the message!

org2hpda

comment out loading twit.el in .emacs and then run (from ~/buff/hip) 

make -f org2hpda

registers 

C-x r s reg - copy region to register reg

C-x r i reg - insert region from register reg

also numbers in registers (handy for keyboard macros): 

C-u num C-x r n reg - store number in register

C-x r + reg - increment

C-x r g reg - insert

twit.el

(load "~/buff/twit.el") (twit-show-recent-tweets) (twit-follow-recent-tweets)

org-mode/org-babel 

C-c C-c on headline to add tags

C-c \
C-c / m

Create a sparse tree with all headlines matching a tags search. With a C-u prefix argument, ignore headlines that are not a TODO line.

LaTex, org-mode and pdfjam/pdfnup

  • how to prepare a 2x2 A0 PDF using org-mode and pdfnup
    • prepare tex using org-mode: 
    # Local Variables:
# org-export-latex-append-header: "\
# \\usepackage{geometry}
# \\geometry{verbose,a2paper}
# "
# End:

    is placed at the end of the org-mode file and we use: 

    M-x normal-mode

    to re-read the local variables

    then export C-c C-e to PDF as usual.

    • now we have A2 PDF which we can place four sheets on one page with: 
      pdfnup island_forpdf.pdf --nup 2x2
    • which gives us an A2 PDF also but with a grid of 2x2 pages on each page.
    • enlarge to A0 using acroread, print to file and custom size

and to embed fonts: 

# Local Variables:
# org-export-latex-append-header: "\
# \\usepackage{geometry}
# \\usepackage{times}
# \\usepackage{pslatex}
# \\geometry{verbose,a2paper}
# "
# End:

and see also:

http://www.ces.clemson.edu/~regroff/content/latex2pdf/

http://do.whileloop.org/soft/tricks/pdflatex-fonts.php

latex embed pdf etc notes

  • how to embed bmp images

    NOT! - convert to pdf/png

    with: 

    #!/bin/sh
for file in `ls *.bmp`
do
new=`basename $file .bmp`
convert $file ${new}.png
done
  • how to make page breaks

    embed: 

    \begin{test}
\pagebreak
\end{test}
  • how to embed other pdfs 
    #+ATTR_LaTeX: page=4,width=5cm
[[file:stegsx.pdf]]

    or

    with 

    \\usepackage{pdfpages} 

    \includepdf[pages=1-8]{/root/projects/magnetometer/protonmagnetometer.pdf}

notes for org-mode and agendas

for use with agenda - C-c a - can have several org-mode files into agenda

eg. 

C-c . - add date as below and it takes title from:

C-c a n - whole year
  • other commands
    • Shift-arrows to change date elements 
      M-S RET - insert TODO item

      C-c C-d - insert deadline

      C-c [ - add file to agenda list

      C-c ] - remove file

      C-c C-t - toggle status of TODO
  • commands 
    v - view mode (eg. week, month, year, insert diary entries)

    RET - goto relevant org file

ange-ftp format 

/newlife@ftp.1010.co.uk:/user/htdocs/1010/

jack.el notes

  • fixed and uploaded new jack.el

(jack-start)

run also: jack_simple_client as fake and disconnect all 

while true; do mplayer /root/dump/test.wav -ao jack:port=simple,name=monk 
done

to prevent straight connection mplayer (doesn't now seem to work though): 

mplayer /root/dump/test.wav -ao jack:name=monk 

(jack-list)

(jack-ports "monk")

(jack-get-port-connections "monk" 0) ????

(jack-disconnect "monk" "out_0" "system" "playback_1") 

(insert (format "\n\n%s" (jack-ports "system")))

bibtex, bibliography and org-mode 

\bibliographystyle{plain}
\bibliography{notes}

… is at the end of the document

We also need the following in .emacs: 

(defun org-mode-reftex-setup ()
(load-library "reftex")
(and (buffer-file-name)
(file-exists-p (buffer-file-name))
(reftex-parse-all))
(define-key org-mode-map (kbd "C-c )") 'reftex-citation)
)

(add-hook 'org-mode-hook 'org-mode-reftex-setup)

(require 'org-exp-bibtex)

(require 'org-latex)
  (setq org-export-latex-classes
        (cons '("article"
                "\\documentclass{article}
  \\usepackage{amsmath}
  \\usepackage{amssymb}
  \\usepackage{longtable}
  \\usepackage{float}
  \\usepackage{wrapfig}
  \\usepackage{soul}
  \\usepackage{hyperref}"
                ("\\section{%s}" . "\\section*{%s}")
                ("\\subsection{%s}" . "\\subsection*{%s}")
                ("\\subsubsection{%s}" . "\\subsubsection*{%s}")
                ("\\paragraph{%s}" . "\\paragraph*{%s}")
                ("\\subparagraph{%s}" . "\\subparagraph*{%s}"))
              org-export-latex-classes))

  (setq org-latex-to-pdf-process
        '("pdflatex -interaction nonstopmode %b"
          "bibtex %b"
          "pdflatex -interaction nonstopmode %b"
          "pdflatex -interaction nonstopmode %b"))

An example from notes.bib: 

@Book{pynchon1966,
 author = {Pynchon, Thomas},
 title = {The Crying of Lot 49},
 publisher = {Lippincott},
 year = {1966},
 address = {Philadelphia},
 isbn = {0397004184}
 }

which we can cite with: C-c C-)

rest notes 

\noindent // at start of line to kill paragraph indentation for that line

#+LaTeX: \setlength\parskip{5mm} // for spacing between paragraphs

C-u 0 C-l - puts line to top of screen

C-x C-f /ftp:newlife@1010.co.uk:/

(make-comint "sniff" "/root/sniffeur.py")

M-x image-dired-dired-display-image

C-x C- - = - smaller and larger fonts

Gnus: T T - turn off threading

C-c C-s C-d - gnus summary sort by date

flush the agent cache M-x gnus-agent-flush-cache RET M-x gnus-agent-expire[-group] RET

avr 

avrdude -c usbasp -p m168 -U lfuse:w:0xE2:m -U hfuse:w:0xDF:m -U flash:w:sd-reader.hex 

avrdude -c usbasp -p m128 -U lfuse:w:0xFD:m -U hfuse:w:0x99:m -U efuse:w:0xFF:m -U flash:w:serialtest.hex

set up latest avr-gcc

  • later than avr-libc-1.6.3 has

:clock_prescale_set(clock_div_1);

for the scripts to download and patch: 

sudo apt-get install build-essential texinfo texi2html libcwidget-dev tcl8.4-dev tk8.4-dev libncurses5-dev libx11-dev binutils-dev bison flex libusb-0.1-4 libusb-dev libmpfr-dev libexpat1-dev libbfd-dev

./getfiles.sh

./get-patches.sh

./buildavr-no-insight.sh

and in .zshrc: 

# User specific environment and startup programs
PREFIX=/usr/local/avr
export PREFIX

PATH=$PATH:$HOME/bin:$PREFIX/bin
export PATH

avr notes 

(0 << [anything]) is always 0. T

The usual way to reset invidual bits in a control register is actually along the lines of: 

USBCON &= ~(1 << [bit_name]);

deeper AVR

compile and linking of assembly to elf 

avr-gcc -Os -mmcu=atmega8 -Wa,-gstabs -I/usr/lib/avr/include/avr/ -o test.elf test.S

elf to hex: 

avr-objcopy -j .text -j .data -O ihex test.elf test.hex

disassembly (use this to get linked full assembly!): 

avr-objdump -S test.elf

(if we compile with -g // debugging // and not -Os (for size optimisation)??) 

avr-gcc -g -mmcu=atmega8 -I/usr/lib/avr/include/avr/ memtest.c -o memtest.elf

also to note: 

avr-gcc -g -mmcu=atmega8 -Wl,-Map,demo.map -o demo.elf demo.o

__exit->endless loop. 

 26c: ff cf           rjmp    .-2             ; 0x26c <__stop_program>

flash/rom sections

  • The .text Section

    The .text section contains the actual machine instructions which make up your program. Includes:

  • The .initN Sections

    init code

    • The .finiN Sections

      exit code

  • The .data Section

    This section contains static data which was defined in your code.

  • The .bss Section

    Uninitialized global or static variables end up in the .bss section. Includes:

    • The .noinit Section
  • The .eeprom Section
  • avr-size

    The avr-size program (part of binutils), coming from a Unix background, doesn't account for the .data initialization space added to the .text section, so in order to know how much flash the final program will consume, one needs to add the values for both, .text and .data (but not .bss), while the amount of pre-allocated SRAM is the sum of .data and .bss.

  • malloc?

    The variables __malloc_heap_start and __malloc_heap_end can be used to restrict the malloc() function to a certain memory region. These variables are statically initialized to point to __heap_start and __heap_end, respectively, where __heap_start is filled in by the linker to point just beyond .bss, and __heap_end is set to 0 which makes malloc() assume the heap is below the stack.

    • what is the heap?

      The standard RAM layout is to place .data variables first, from the beginning of the internal RAM, followed by .bss. The stack is started from the top of internal RAM, growing downwards. The so-called "heap" available for the dynamic memory allocator will be placed beyond the end of .bss.

    • note from scrying makefile:

      EXTERNAL_RAM = -Wl,-Tdata=0x801100,–defsym=__heap_end=0x80ffff

      and we use memory pointer directly from 1100 - how do we avoid writing over variables (in serialtest.c case).

    • TODO test serialtest code in scrying

      in new code - also PORTE is set strangely (for gplog to 0x00 , for main log to 0xff)

      same in noise2.c where we write to 1100+ and don't set PORTE

      possible answer as using: 

      avr-size noise2.o

      we see: 

         text    data     bss     dec     hex filename
   8336       4      10    8350    209e noise2.o

      how can we see what is in data and bss (-s switch)? 

      avr-objdump -sh -S noise2.o

      gives: 

      0000 0ad7233c

      but in the case of serialtest.o we have 621 bytes of data which is all text messages (for help and so on) which we know doesn't get overwritten???

      only conclusion is that data segment is not moved by Makefile (or possibility that as it is stored in ROM/FLASH????)

registers

scrying

use serial board with diode bypassed for charging

Remember to delay before we switch Trimble Lassen SQ to NMEA

Ref also: http://www.picbasic.co.uk/forum/archive/index.php/t-1260.html

mercurial 

hg ci - commit

hg clone - clone external repo
  • other commands 
    hg diff - show changes

    hg log - show all revisions

    hg diff -r 335 -r 338 - diffs between revisions

    hg export 338 337 336 > exportage - export patch

kernel 

kernel config

make-kpkg clean

fakeroot make-kpkg --revision=custom.1.0 kernel_image

dpkg -i kernel-image-2.6.8.1_custom.1.0_i386.deb

update-initramfs -c -k 2.6.30 -t

cd /boot/grub/

uname -r for running kernel version

add latest initrd to menu.lst

uml [user mode linux] 

apt-get install user-mode-linux uml-utilities

linux rootfstype=hostfs rw init=/bin/zsh

custom kernel 

make mrproper

make mrproper ARCH=um

make defconfig ARCH=um

make menuconfig ARCH=um

make ARCH=um

or 

export ARCH=um

dvd

  • kino - capture, export as dvd-video dual pass (dvd video directory) 
    mkisofs -dvd-video -o juego.iso juego

and regular data CD: 

mkisofs -r -R -J -l -L -o jek.iso jekyll

test with 

mount -t iso9660 -o loop jek.iso /mnt/

burn with 

cdrecord dev=0,4,0 -v -overburn --eject speed=4 jek.iso

mplayer/gstreamer 

mencoder input.avi -idx -ovc copy -oac copy -o output.avi // fix broken indexing

or to excerpt: 

mencoder -ss 2260 -frames 8000 -ovc copy -oac copy first.avi -o test.avi

seek to 1000 (seconds?) and convert 10 frames: 

mplayer -ss 1000 -frames 10 -vo jpeg:outdir=/tmp:quality=75 test.avi -ao null
  • raw: 
    gst-launch-0.10 filesrc location=/root/pipe ! videoparse ! xvimagesink
  • or in mplayer: 
    mplayer -rawvideo w=720:h=576 -demuxer rawvideo  /dev/sda

    gst-launch-0.10 v4l2src device=/dev/video1 ! queue ! ffmpegcolorspace ! theoraenc quality=1 ! queue ! oggmux name=mux alsasrc ! audio/x-raw-int,rate=8000,channels=1,depth=8 ! queue ! audioconvert ! vorbisenc ! queue ! mux. mux. ! queue ! shout2send ip=giss.tv port=8000 username=source password=ry92b mount=/micro.ogg

    mencoder mf://"@list.txt" -mf w=800:h=600:fps=10:type=jpg -ovc lavc \
   -lavcopts vcodec=mpeg4:mbd=2:trell -oac copy -o output.avi

    mencoder input.avi -idx -ovc copy -oac copy -o output.avi // fix broken indexing

and to encode raw to avi: 

 mencoder /storeddiffs/diff_Jun-21-11.log -ofps 25 -noaspect -demuxer rawvideo -rawvideo fps=25:w=400:h=320:format=i420 -ovc lavc -lavcopts vcodec=mpeg4 -ffourcc divx -o output.avi

gst-launch-0.10 filesrc location=/root/pipe ! videoparse ! xvimagesink

mplayer -rawvideo w=720:h=576 -demuxer rawvideo  /dev/sda
  • record stream: 
    mplayer -dumpstream -cache 8000 mms://streaming-26c3-wmv.fem-net.de/saal3
  • simple webcam 
    gst-launch-0.10 v4l2src device=/dev/video0 ! xvimagesink

see also own static.py

data carving

  • using foremost to extract: 
    foremost -v /dev/sdc1

config file is in: /usr/local/etc/foremost.conf

paper sizes ref

cm //inches

ISO A0 84.09 x 118.92 33.11 x 46.82

ISO A1 59.46 x 84.09 23.41 x 33.11

ISO A2 42.04 x 59.46 16.55 x 23.41

playing with images in octave

rough notes/example code 

imshow(0,gray) # to set grayscale???
x=getpgm("../page1_trith_003.pgm");
q = 6 ./ hilb(16) + 26
y = jpeg(x, q); # from jpegtools
imagesc(y, 2);
saveimage ("my_output.ps",y,ps);

myfile = fopen("../diana.txt", "r");
al = fread(myfile,[8,8],'uchar')'; # read as 8x8 matrix

QTx = quant(x, al);

diana = imread('../diana.pgm');

function [Stego, Extracted] = LSBHide(Cover, Hidden, n)
Stego = uint8(bitor(bitand(Cover, bitcmp(2^n - 1, 8)) , bitshift(Hidden, n - 8)));
Extracted = uint8(bitand(255, bitshift(Stego, 8 - n)));
endfunction

[Stego, Extracted] = LSBHide(xxx, xxxxx, n);

shell scripting with octave

  • for rough image analysis (white vs. black pixels):
  • image_an.m 
filename=argv(); 
pkg load image;
#disp(filename{1});
xx=imread(filename{1});
img = rgb2gray(xx);
ibw = img;
m=128;
disp(numel(ibw (ibw < m )))
  • analyse.sh 
#!/bin/bash

for file in `ls *.jpg`
do
octave -qf image_an.m $file
done

notes for (island2) gallery setup

avoid screen blanking 

xset s off

and edit /etc/X11/xorg.conf and restart X: 

Section "ServerFlags"
Option "BlankTime" "0"
Option "StandbyTime" "0"
Option "SuspendTime" "0"
Option "OffTime" "0"
EndSection

startx on boot without any login

  • edit /etc/inittab with: 
id:5:initdefault:
[...]
x:5:once:/bin/su PREFERED_USER -l -c "/bin/bash --login -c /usr/bin/startx >/dev/null 2>&1"

misc

  • .xinitrc example: machine 1 
xset s off
xmodmap /root/.Xmodmap
exec awesome &
exec xterm -maximized -exec watch tail /var/log/syslog &
sleep 4s
exec xterm -exec top &
exec xterm -exec /root/test.sh

machine 1 is now running minicom… (usb serial must be plugged in before booting)

  • .xinitrc example: machine 2 
killall -9 evilwm
xset s off
exec evilwm &
exec wireshark -i eth5 -f "icmp" -k &
sleep 20s
exec xterm -geometry 80x20+0+0 -exec minicom
  • open an xterm with dmesg showing but not closing - sleep for 1000 days 
#!/bin/bash
dmesg
sleep 1000d
  • edit /etc/rc.local for other post-boot options

/etc/network/interfaces

  • for dhcp 
# The loopback network interface
auto lo
iface lo inet loopback

# The primary network interface - use DHCP to find our address
auto eth0
iface eth0 inet dhcp
  • for static 
# The loopback network interface
auto lo
iface lo inet loopback

# The primary network interface
auto eth0
iface eth0 inet static
 address 192.168.1.90
 gateway 192.168.1.1
 netmask 255.255.255.0
 network 192.168.1.0
 broadcast 192.168.1.255

arpspoof

with address of switch: 

arpspoof -i eth0 192.168.1.1

tcpdump 

tcpdump -s 0 -w - icmp> /dev/dsp

both in /etc/rc.local

wireshark with ringbuffer 

wireshark -i eth5 -f "icmp" -k -w test -b files:10 -b duration:10

mini-scry filesystem for SD cards 

mkfs.vfat -F 16 /dev/mmcblk0p1

gnuplot tricks

  • multiple plots and colours 
    set multiplot
set style line 1 linecolor rgb "green"
 plot "whitenoise06022010.log" w lines ls 1
  • scaling one data set against another: 
    plot "/mnt/monk66" using 3 with lines, "/mnt/monk66" using ($1)/1000 with lines

python and gnuplot (for GPS) 

from pylab import *
import csv, os, Gnuplot, Gnuplot.funcutils

g = Gnuplot.Gnuplot(debug=1)
NMI = 1852.0
D2R = pi/180.0

#data = sys.argv[1]
#title = sys.argv[2]

def read_csv_file(filename):
    data = []
    for row in csv.reader(open(filename)):
        data.append(row)
    return data

def process_gps_data(data):
    latitude    = []
    longitude   = []
    intensity   = []
    gsr         = []
    for row in data:
        latitude.append(float(row[0][0:2]) + \
                            float(row[0][2:])/60.0)
        longitude.append((float(row[1][0:3]) + \
                              float(row[1][3:])/60.0))
        intensity.append(float(row[2]))
#        gsr.append(float(row[3]))

#    return (array(latitude), array(longitude), \
#                array(intensity), array(gsr))

    return (array(latitude), array(longitude), \
                array(intensity))


y=read_csv_file('/root/projects/summit/logfiles/riverwalk_short')
#(lat, long, intensity, gsr) = process_gps_data(y)
(lat, long, intensity) = process_gps_data(y)
# translate spherical coordinates to Cartesian
py = (lat-min(lat))*NMI*60.0
px = (long-min(long))*NMI*60.0*cos(D2R*lat)
newgsr=((gsr-min(gsr))*10.0)+500
#pack px, py, intensity and gsr into newy
newy=[]
for x,yz,z,zz in zip(px,py,intensity,newgsr):
    newy.append((x,yz,z,zz))

g('set parametric')
g('set style data line')
g('set surface')
g('unset key')
g('unset contour')
g('set dgrid3d 40,40,10')
g('set xlabel "metres EW"') 
g('set ylabel "metres SN"') 
g('set label "signal intensity"at -100,0,1000') 
g('set view 60,20')
g.title("underwater friday 6th")
g('set term png size 1200,800')
g('set output "/root/projects/summit/logfiles/images/river2.png"')

#g.splot(Gnuplot.Data(newy, using=(1,2,3), with='lines'),Gnuplot.Data(newy, using=(1,2,4), with='lines'))
g.splot(Gnuplot.Data(newy, using=(1,2,3), with='lines'))

fixing a hard drive

with errors 

sudo e2fsck -b 32768 /dev/sdb1

sudo mount -t ext3 -o sb=131072 /dev/sdb1 /mnt

avrdude and efuse on atmega32u4

change avrdude.conf: 

memory "efuse"
    size            = 1;
    write           = "1 0 1 0  1 1 0 0  1 0 1 0  0 1 0 0",
                      "x x x x  x x x x  i i i i  i i i i";

    read            = "0 1 0 1  0 0 0 0  0 0 0 0  1 0 0 0",
                      "x x x x  x x x x  o o o o  o o o o";
    min_write_delay = 9000;
    max_write_delay = 9000;
  ;

code rocks

  • five acts USE OLD KERNEL

http://1010.co.uk/five\_software\_acts.html

own software:

  • older

    jekyll-

    i_am- 

    /dev/mem | strings | espeak --stdout | ./i_am 4 2 1 > /dev/dsp
  • more recent

    evp- 

    cat /dev/dsp | ./evp 1 32 8000 1 > ~/pipe
play -t raw -r 8000 -u -b -c 1 pipe

    self-

commandline

  • tee: 
    tcpdump -s 0 -w - | tee /dev/dsp | devdisplay 240 240 2
  • turn off swap 
    swapoff -a
  • play a pipe 
    play -t raw -r 44100 -u -b -c 1 pipe

for example from: 

nice -n -10 top -d.1 | tee pipe

[for top always use 44100]

top commands:

A,M,N,P,T - alt display, sort by memory, PID, CPU, time

k - prompt to kill a PID

  • espeak: 
    cat /dev/mem | strings | espeak --stdout > /dev/dsp

or for correct speech: 

cat /dev/mem | strings | espeak --stdout > ~/pipe
play -t raw -r 22050 -u -1 -c 1 pipe

maybe insert evp process in there

  • dev/mem// use of tee for multiple processes 
    cat /dev/mem | tee >(devdisplay 240 240 1) | strings | espeak --stdout | ./jekyll 2 3 > /

rock 

stty -F /dev/ttyUSB0 115200

set list

START: stty, swapoff, old kernel 

swapoff -a
stty -F /dev/ttyUSB0 115200

5 acts:

1- process table and xxxx….sh yyyyy….sh 

nice -n -10 top -d.1 | tee pipe
play -t raw -r 44100 -u -b -c 1 pipe

also with: A,M,N,P,T - alt display, sort by memory, PID, CPU, time (and G for group)

2- evp/i_am/speech somehow 

cat /dev/mem | strings | espeak --stdout > /dev/dsp
play -t raw -r 44100 -u -b -c 1 pipe

3- self 

./self > /dev/dsp

4- code rocks 

cat /dev/mem > /dev/ttyUSB0
cat /dev/ttyUSB0 > /dev/dsp

5- rock off: 

cat /dev/mem > /dev/ttyUSB0
cat /dev/ttyUSB0 | tee /dev/dsp > /dev/mem

misc

where gthumb stores deleted files: .local/share/Trash/

Author: root <m@1010.co.uk>

Date: 2011-10-26 11:57:27 BST

HTML generated by org-mode 6.31trans in emacs 23