Compile John the Ripper w/ Jumbo Patch (Updated for 1.7.7 & 1.7.8)

19 thoughts to “Compile John the Ripper w/ Jumbo Patch (Updated for 1.7.7 & 1.7.8)”

1. I am not having any luck with the “make” part after I patch the JTR source. I keep getting errors during the XSHA make part (or if I remove it from the make statement other sections that got patched in)

   Any ideas?

   gcc -c -Wall -O2 -fomit-frame-pointer -I/usr/local/include -L/usr/local/lib -funroll-loops XSHA_fmt.c
   XSHA_fmt.c:7:25: openssl/sha.h: No such file or directory
   XSHA_fmt.c:43: error: syntax error before “ctx”
   XSHA_fmt.c:43: warning: type defaults to `int’ in declaration of `ctx’
   XSHA_fmt.c:43: warning: data definition has no type or storage class
   XSHA_fmt.c: In function `crypt_all’:

   I have openssl installed (I double checked)

2. What OS are you using and how did you install openssl? I ask about how you installed openssl because if it was as an OS package you would need the lib-dev version of the package. If you installed openssl from source like I’ve described above you may need to run ldconfig and make sure that the path to your libraries is updated. The openssl library may be installed in /usr/local/lib and not be in the library path.

   If you are looking for the functionality of cracking MS-Cache passwords you can try myjohn.tgz which has been floating around the Internet. It can be downloaded from my site and is already pre-patched for MS-Cache passwords. Try all these things and let me know how it goes.

   Download myjohn.tgz from http://www.jedge.com/utilities/myjohn.tgz

3. I was using RHEL 4 U4. Thank you so much for pointing out the fact I was missing the openssl-devel. After installing that it worked just fine. Boy do I feel dumb.

   Happy thanksgiving and thanks for the quick reply!

4. Hi there, this may seem a little old to asking questions but i’m also having probs on my John build after patching.

   I also have openssl installed (from scratch) and updated my path on ubuntu 10.04 to /usr/local/ssl/bin/openssl

   then did a ldconfig

   XSHA_fmt.c:7:25: error: openssl/sha.h: No such file or directory
   XSHA_fmt.c:43: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘ctx’

   but I still get the error after I try to build

   any suggestions?

5. Andy,

   I’ve recently upgraded to Ubuntu 10.04 and I will try to get John patched, installed, and update the tutorial. If I encounter any problems myself I will let you know.

   -James

   Update 1: I’m getting the same error as you and I’m using the latest OpenSSL and John stable source code.

   Update 2: I still want to figure out why installing openssl from source is causing a problem but if this will help you I got John to compile when I installed libssl-dev from the Ubuntu repositories (0.9.8k).

   Final Update: I’ve had the chance to figure out why John wasn’t finding the openssl headers when they were installed from source. The latest openssl installs the headers in /usr/local/ssl/include/openssl and the John make file only looks in /usr/local/include and /usr/local/lib. I created a symlink (#ln -s /usr/local/ssl/include/openssl /usr/local/include/openssl). You can also specify where openssl will be installed when you configure before compiling.

6. Hi, Thank you very much for the tutorial! I was able to compile and make it work JTR Perfectly!!

   I used JTR for MS-Cache users/passwords, do you know how much time will take?

   Thank you very much.
   Regards
   TMaGmA

7. Pingback: Behind the Rack » Cracking OS X Passwords

8. is it same to aplly a mpi patch ?

9. Hi,
   I am a wizard in Windows systems but Linux is abacadabra!!!
   I made a fresh install of Ubuntu 8.04, installed libssl-dev via Synaptic Package Manager.
   Then, I went through your instructions. I’ve downloaden JTR 1.7.8 with patch 1.7.8 jumbo 5.
   I keep getting errors when I enter command make linux-x86-sse2??
   ITS DRIVING ME CRAZY!!

   …
   /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_globallookup’:
   dso_dlfcn.c:(.text+0x1c): undefined reference to `dlopen’
   dso_dlfcn.c:(.text+0x32): undefined reference to `dlsym’
   dso_dlfcn.c:(.text+0x3c): undefined reference to `dlclose’
   /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_pathbyaddr’:
   dso_dlfcn.c:(.text+0x70): undefined reference to `dladdr’
   dso_dlfcn.c:(.text+0xc0): undefined reference to `dlerror’
   /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_bind_func’:
   dso_dlfcn.c:(.text+0x38d): undefined reference to `dlsym’
   dso_dlfcn.c:(.text+0x3ff): undefined reference to `dlerror’
   /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_bind_var’:
   dso_dlfcn.c:(.text+0x47d): undefined reference to `dlsym’
   dso_dlfcn.c:(.text+0x4f1): undefined reference to `dlerror’
   /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_unload’:
   dso_dlfcn.c:(.text+0x55c): undefined reference to `dlclose’
   /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_load’:
   dso_dlfcn.c:(.text+0x605): undefined reference to `dlopen’
   dso_dlfcn.c:(.text+0x656): undefined reference to `dlclose’
   dso_dlfcn.c:(.text+0x67f): undefined reference to `dlerror’
   /usr/local/lib/libssl.a(ssl_err2.o): In function `SSL_load_error_strings’:
   ssl_err2.c:(.text+0x4): undefined reference to `ERR_load_crypto_strings’
   /usr/local/lib/libssl.a(ssl_ciph.o): In function `load_builtin_compressions’:
   ssl_ciph.c:(.text+0x48a): undefined reference to `COMP_zlib’
   /usr/local/lib/libssl.a(ssl_ciph.o): In function `ssl_cipher_get_evp’:
   ssl_ciph.c:(.text+0x11f1): undefined reference to `EVP_enc_null’
   /usr/local/lib/libssl.a(ssl_lib.o): In function `ssl_clear_cipher_ctx’:
   ssl_lib.c:(.text+0xeb1): undefined reference to `COMP_CTX_free’
   ssl_lib.c:(.text+0xed1): undefined reference to `COMP_CTX_free’
   /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_set_rfd’:
   ssl_lib.c:(.text+0x3e66): undefined reference to `BIO_s_socket’
   /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_set_wfd’:
   ssl_lib.c:(.text+0x3fc6): undefined reference to `BIO_s_socket’
   /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_set_fd’:
   ssl_lib.c:(.text+0x410a): undefined reference to `BIO_s_socket’
   /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_CTX_load_verify_locations’:
   ssl_lib.c:(.text+0xcac): undefined reference to `X509_STORE_load_locations’
   /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_CTX_set_default_verify_paths’:
   ssl_lib.c:(.text+0xcbc): undefined reference to `X509_STORE_set_default_paths’
   /usr/local/lib/libssl.a(ssl_cert.o): In function `SSL_add_file_cert_subjects_to_stack’:
   ssl_cert.c:(.text+0x117): undefined reference to `PEM_read_bio_X509′
   /usr/local/lib/libssl.a(ssl_cert.o): In function `SSL_add_dir_cert_subjects_to_stack’:
   ssl_cert.c:(.text+0x1f9): undefined reference to `OPENSSL_DIR_read’
   ssl_cert.c:(.text+0x276): undefined reference to `OPENSSL_DIR_end’
   /usr/local/lib/libssl.a(ssl_cert.o): In function `SSL_load_client_CA_file’:
   ssl_cert.c:(.text+0x51b): undefined reference to `PEM_read_bio_X509′
   /usr/local/lib/libssl.a(ssl_sess.o): In function `SSL_CTX_set_client_cert_engine’:
   ssl_sess.c:(.text+0x305): undefined reference to `ENGINE_get_ssl_client_cert_function’
   /usr/local/lib/libssl.a(s3_pkt.o): In function `ssl3_do_compress’:
   s3_pkt.c:(.text+0x31d): undefined reference to `COMP_compress_block’
   /usr/local/lib/libssl.a(s3_pkt.o): In function `ssl3_do_uncompress’:
   s3_pkt.c:(.text+0x37d): undefined reference to `COMP_expand_block’
   /usr/local/lib/libssl.a(s3_pkt.o): In function `do_ssl3_write’:
   s3_pkt.c:(.text+0x851): undefined reference to `COMP_compress_block’
   /usr/local/lib/libssl.a(s3_pkt.o): In function `ssl3_read_bytes’:
   s3_pkt.c:(.text+0x1164): undefined reference to `COMP_expand_block’
   /usr/local/lib/libssl.a(t1_enc.o): In function `tls1_change_cipher_state’:
   t1_enc.c:(.text+0x12b4): undefined reference to `COMP_CTX_free’
   t1_enc.c:(.text+0x12d1): undefined reference to `COMP_CTX_new’
   t1_enc.c:(.text+0x1399): undefined reference to `COMP_CTX_free’
   t1_enc.c:(.text+0x13b6): undefined reference to `COMP_CTX_new’
   /usr/local/lib/libssl.a(s3_enc.o): In function `ssl3_change_cipher_state’:
   s3_enc.c:(.text+0x7ac): undefined reference to `COMP_CTX_free’
   s3_enc.c:(.text+0x7c6): undefined reference to `COMP_CTX_new’
   s3_enc.c:(.text+0x864): undefined reference to `COMP_CTX_free’
   s3_enc.c:(.text+0x87e): undefined reference to `COMP_CTX_new’
   collect2: ld returned 1 exit status
   make[1]: *** [../run/john] Error 1
   make[1]: Leaving directory `/home/marcel/john-1.7.8/src’
   make: *** [linux-x86-sse2] Error 2

10. Marcel: I haven’t tried to latest version of JtR but I’ll be sure to do that and update the tutorial if I have any issues. Quick question. Are you actually using 8.04 or is that a typo? All my work so far is done using the latest LTS which is 10.04. That may be the problem especially since you installed libssl-dev from the Ubuntu repositories. That version of libssl may be outdated. I would use my entire tutorial and install libssl from the source code. Make sure to remove libssl-dev first.

    $sudo apt-get remove libssl-dev

11. Hi,

    8.04 was no typo.
    On my other system I installed Ubuntu 11.04 however it giving me the same error.

    On 11.04, I noticed that libssl-div was not installed. Should I install it and then go through your instructions once again?

    Thanks,
    Marcel

12. Update:

    I got JTR installed on a fresh install of Ubuntu 10.04
    I did not used the above procedure to install openssl.
    Instead I installed libssl-dev via Synaptic Package Manager
    My steps after installation of Ubuntu:

    Install libssl-dev via Synaptic Package Manager
    $ wget http://www.openwall.com/john/g/john-1.7.8.tar.gz
    $ tar zxvf john-1.7.8.tar.gz
    $ cd john-1.7.8/
    $ wget http://www.openwall.com/john/g/john-1.7.8-jumbo-5.diff.gz
    $ gzip -d john-1.7.8-jumbo-5.diff.gz
    $ sudo apt-get install patch
    $ patch -p1 < john-1.7.8-jumbo-5.diff
    $ cd src/
    $ make linux-x86-sse2
    $ cd ../run/
    $ ./john –test

    Thanks,
    Marcel

13. On Ubuntu Natty Narwhal 11.4 my tutorial above has a hiccup. If you compile and install the latest Openssl you will get the following error.

    make generic
    rm -f arch.h
    ln -s generic.h arch.h
    make ../run/john ../run/unshadow ../run/unafs ../run/unique ../run/undrop ../run/ssh2john ../run/pdf2john ../run/rar2john ../run/zip2john ../run/genmkvpwd ../run/mkvcalcproba ../run/calc_stat ../run/tgtsnarf
    make[1]: Entering directory `/home/edge/source/john-1.7.8-jumbo-5/src’
    gcc DES_fmt.o DES_std.o DES_bs.o DES_bs_b.o BSDI_fmt.o MD5_fmt.o MD5_std.o BF_fmt.o BF_std.o AFS_fmt.o LM_fmt.o timer.o md5_go.o md5_eq.o md5.o hmacmd5.o base64.o md4.o md5_gen_fmt.o md5_gen_parser.o md5_gen_preloads.o md5_gen_utils.o rawSHA224_fmt.o rawSHA256_fmt.o rawSHA384_fmt.o rawSHA512_fmt.o hmailserver_fmt.o SybaseASE_fmt.o SKEY_fmt.o ssh_fmt.o ssh2john.o pdf_fmt.o pdf2john.o pdfcrack_common.o pdfcrack_md5.o pdfparser.o pdfcrack.o pdfcrack_rc4.o rar_fmt.o rar2john.o zip_fmt.o zip2john.o gladman_hmac.o gladman_pwd2key.o BFEgg_fmt_plug.o DMD5_fmt_plug.o DOMINOSEC_fmt_plug.o EPI_fmt_plug.o HDAA_fmt_plug.o hmacMD5_fmt_plug.o IPB2_fmt_plug.o KRB4_fmt_plug.o KRB4_std_plug.o KRB5_fmt_plug.o KRB5_std_plug.o lotus5_fmt_plug.o md4_gen_fmt_plug.o mediawiki_fmt_plug.o mscash1_fmt_plug.o mscash2_fmt_plug.o MSCHAPv2_fmt_plug.o mskrb5_fmt_plug.o mssql05_fmt_plug.o mssql-old_fmt_plug.o MYSQL_fast_fmt_plug.o MYSQL_fmt_plug.o mysqlSHA1_fmt_plug.o NETLM_fmt_plug.o NETLMv2_fmt_plug.o NETNTLM_fmt_plug.o NETNTLMv2_fmt_plug.o NETSPLITLM_fmt_plug.o NS_fmt_plug.o NSLDAP_fmt_plug.o NSLDAPS_fmt_plug.o NT_fmt_plug.o OPENLDAPS_fmt_plug.o oracle11_fmt_plug.o oracle_fmt_plug.o phpassMD5_fmt_plug.o PHPS_fmt_plug.o pixMD5_fmt_plug.o PO_fmt_plug.o rawMD4_fmt_plug.o rawMD5go_fmt_plug.o rawMD5unicode_fmt_plug.o rawSHA1_fmt_plug.o salted_sha1_fmt_plug.o sapB_fmt_plug.o sapG_fmt_plug.o sha1_gen_fmt_plug.o XSHA_fmt_plug.o dummy.o batch.o bench.o charset.o common.o compiler.o config.o cracker.o crc32.o external.o formats.o getopt.o idle.o inc.o john.o list.o loader.o logger.o math.o memory.o misc.o options.o params.o path.o recovery.o rpp.o rules.o signals.o single.o status.o tty.o wordlist.o mkv.o mkvlib.o unicode.o unshadow.o unafs.o undrop.o unique.o -s -L/usr/local/lib -L/usr/local/ssl/lib -lcrypto -lssl -lm -o ../run/john
    /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_globallookup’:
    dso_dlfcn.c:(.text+0x21): undefined reference to `dlopen’
    dso_dlfcn.c:(.text+0x34): undefined reference to `dlsym’
    dso_dlfcn.c:(.text+0x3f): undefined reference to `dlclose’
    /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_pathbyaddr’:
    dso_dlfcn.c:(.text+0x8e): undefined reference to `dladdr’
    dso_dlfcn.c:(.text+0xf1): undefined reference to `dlerror’
    /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_bind_func’:
    dso_dlfcn.c:(.text+0x434): undefined reference to `dlsym’
    dso_dlfcn.c:(.text+0x4db): undefined reference to `dlerror’
    /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_bind_var’:
    dso_dlfcn.c:(.text+0x554): undefined reference to `dlsym’
    dso_dlfcn.c:(.text+0x60e): undefined reference to `dlerror’
    /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_unload’:
    dso_dlfcn.c:(.text+0x67a): undefined reference to `dlclose’
    /usr/local/lib/libcrypto.a(dso_dlfcn.o): In function `dlfcn_load’:
    dso_dlfcn.c:(.text+0x734): undefined reference to `dlopen’
    dso_dlfcn.c:(.text+0x7a2): undefined reference to `dlclose’
    dso_dlfcn.c:(.text+0x7d0): undefined reference to `dlerror’
    /usr/local/lib/libssl.a(ssl_err2.o): In function `SSL_load_error_strings’:
    ssl_err2.c:(.text+0x5): undefined reference to `ERR_load_crypto_strings’
    /usr/local/lib/libssl.a(ssl_ciph.o): In function `load_builtin_compressions’:
    ssl_ciph.c:(.text+0xe3): undefined reference to `COMP_zlib’
    /usr/local/lib/libssl.a(ssl_ciph.o): In function `ssl_cipher_get_evp’:
    ssl_ciph.c:(.text+0xde9): undefined reference to `EVP_enc_null’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_clear’:
    ssl_lib.c:(.text+0x30b): undefined reference to `COMP_CTX_free’
    ssl_lib.c:(.text+0x327): undefined reference to `COMP_CTX_free’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_set_fd’:
    ssl_lib.c:(.text+0x98a): undefined reference to `BIO_s_socket’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_set_wfd’:
    ssl_lib.c:(.text+0xa83): undefined reference to `BIO_s_socket’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_set_rfd’:
    ssl_lib.c:(.text+0xbd4): undefined reference to `BIO_s_socket’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_accept’:
    ssl_lib.c:(.text+0x11de): undefined reference to `COMP_CTX_free’
    ssl_lib.c:(.text+0x11fa): undefined reference to `COMP_CTX_free’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_connect’:
    ssl_lib.c:(.text+0x12ee): undefined reference to `COMP_CTX_free’
    ssl_lib.c:(.text+0x130a): undefined reference to `COMP_CTX_free’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_free’:
    ssl_lib.c:(.text+0x2802): undefined reference to `COMP_CTX_free’
    /usr/local/lib/libssl.a(ssl_lib.o):ssl_lib.c:(.text+0x281e): more undefined references to `COMP_CTX_free’ follow
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_CTX_set_default_verify_paths’:
    ssl_lib.c:(.text+0x4445): undefined reference to `X509_STORE_set_default_paths’
    /usr/local/lib/libssl.a(ssl_lib.o): In function `SSL_CTX_load_verify_locations’:
    ssl_lib.c:(.text+0x4455): undefined reference to `X509_STORE_load_locations’
    /usr/local/lib/libssl.a(ssl_cert.o): In function `SSL_load_client_CA_file’:
    ssl_cert.c:(.text+0x1083): undefined reference to `PEM_read_bio_X509′
    /usr/local/lib/libssl.a(ssl_cert.o): In function `SSL_add_file_cert_subjects_to_stack’:
    ssl_cert.c:(.text+0x11fb): undefined reference to `PEM_read_bio_X509′
    /usr/local/lib/libssl.a(ssl_cert.o): In function `SSL_add_dir_cert_subjects_to_stack’:
    ssl_cert.c:(.text+0x138a): undefined reference to `OPENSSL_DIR_read’
    ssl_cert.c:(.text+0x13bb): undefined reference to `OPENSSL_DIR_end’
    /usr/local/lib/libssl.a(ssl_sess.o): In function `SSL_CTX_set_client_cert_engine’:
    ssl_sess.c:(.text+0x1854): undefined reference to `ENGINE_get_ssl_client_cert_function’
    /usr/local/lib/libssl.a(s3_pkt.o): In function `ssl3_do_uncompress’:
    s3_pkt.c:(.text+0x38a): undefined reference to `COMP_expand_block’
    /usr/local/lib/libssl.a(s3_pkt.o): In function `ssl3_do_compress’:
    s3_pkt.c:(.text+0x3ea): undefined reference to `COMP_compress_block’
    /usr/local/lib/libssl.a(s3_pkt.o): In function `do_ssl3_write’:
    s3_pkt.c:(.text+0x737): undefined reference to `COMP_compress_block’
    /usr/local/lib/libssl.a(s3_pkt.o): In function `ssl3_read_bytes’:
    s3_pkt.c:(.text+0x1281): undefined reference to `COMP_expand_block’
    /usr/local/lib/libssl.a(t1_enc.o): In function `tls1_change_cipher_state’:
    t1_enc.c:(.text+0x77e): undefined reference to `COMP_CTX_free’
    t1_enc.c:(.text+0x79c): undefined reference to `COMP_CTX_new’
    t1_enc.c:(.text+0x86f): undefined reference to `COMP_CTX_free’
    t1_enc.c:(.text+0x889): undefined reference to `COMP_CTX_new’
    /usr/local/lib/libssl.a(s3_enc.o): In function `ssl3_change_cipher_state’:
    s3_enc.c:(.text+0xc0): undefined reference to `COMP_CTX_free’
    s3_enc.c:(.text+0xdd): undefined reference to `COMP_CTX_new’
    s3_enc.c:(.text+0x187): undefined reference to `COMP_CTX_free’
    s3_enc.c:(.text+0x1a0): undefined reference to `COMP_CTX_new’
    collect2: ld returned 1 exit status
    make[1]: *** [../run/john] Error 1
    make[1]: Leaving directory `/home/edge/source/john-1.7.8-jumbo-5/src’
    make: *** [generic] Error 2

    DO NOT INSTALL OPENSSL FROM SOURCE. I got John to compile just fine with Openssl from the Ubuntu repository.

    $sudo apt-get install libssl-dev
    $ wget http://www.openwall.com/john/g/john-1.7.8-jumbo-5.tar.gz
    $ tar zxvf john-1.7.8-jumbo-5.tar.gz
    $ cd john-1.7.8-jumbo-5/src
    $ make linux-x86-64
    $ sudo make install

14. I have already installed openssl from source. How do I downgrade and install from repository? Thanks

15. Adil, the issue may have been resolved by now. I was getting the error compiling JtR 1.7.8 with openssl 1.0.0e on Ubuntu Natty Narwhal 11.4. I will look to update the tutorial with any new versions of JtR and openssl. For you there are a couple things I would try.

    1. Go ahead and try to compile JtR. Worse thing that happens is you get the error above.
    2. If you get the error just install openssl-dev from the repository. My instructions on installing openssl from source puts the files in /usr/local. I’m pretty sure your path environment variable will use the dev files from the repo first if you install from the Ubuntu repo.

16. ugh. why can’t people just distribute binaries?

17. I receive the following error when attempting to make install “make: *** No rule to make target `install’. Stop.”

18. I can’t do the last step for the newest install. I get this:

    root@vm-2:/john-1.7.8-jumbo-5/src# sudo make install
    make: *** No rule to make target `install’. Stop.

19. Jim – that is because I’m an idiot. There has never been a “make install” and I don’t know why I included that. After you compile the binaries will be in the run folder. If you want to you can copy those binaries to any directory in your PATH that can execute programs. /bin or /sbin or /usr/bin or /usr/sbin or /usr/local/bin or /usr/local/sbin

This site uses Akismet to reduce spam. Learn how your comment data is processed.