Download - 4.4. Hashcracking server on generic hardware
![Page 1: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/1.jpg)
Defcon-Moscow, 23/11/13
research
Hashcracking server on generic hardware
Ivan Novikov (@d0znpp)
![Page 2: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/2.jpg)
Cracking hashes? For what?• Web application security audits: whitebox
and blackbox• Passwords -> hashes• Crackings hashes to gain access
![Page 3: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/3.jpg)
2009-2011 - we used CPU on our laptops2011 - first hashcracker, named “Parovoz” based on Bulldozer + HD6990
2013 – parovoz-ng – HD6990 + 2xHD7990 –up to 7xPCIEx16 cards + water cooling
History
![Page 4: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/4.jpg)
GPU for hashcrackingNvidia or AMD ?
![Page 5: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/5.jpg)
Win7 + gtx580 Win7+HD7970 Ubuntu+HD6990 Ubuntu+gtx560ti
www.hashcat.net/oclhashcat-plus
![Page 6: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/6.jpg)
Just INTEGER for AMD ;)Float calculation – Nvidia
Why HD6990 faster than HD7970?
Why AMD faster?
![Page 7: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/7.jpg)
Depends from software…
JohnTheRipper – opensource, bothoclHashcat-plus/lite – free, bin, UNIXExtreme GPU bruteforcer – bin, Win, Nvidiaonly (CUDA)
Win or Linux ?
![Page 8: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/8.jpg)
Debian linuxoclHashcat-plus for every day usingoclHashcat-lite for single hash crackingJohnTheRipper for rules attacks, rare hashes, when hashcat not working ;)
Where we left of
![Page 9: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/9.jpg)
Configure X11 to use a few cards at the same time (thx @defconua)
Install Catalyst driver (.run file with black magic)
Find combination of oclHashcat and Catalyst versions which can works together
Monitoring/reports/etc on unstable hardware
Common software problems
![Page 10: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/10.jpg)
• Cheaper than server platform (starts from $5000 / platform)
• Easier to reproduce• Occupies less space• Funniest ;)
Generic hardware – for what?
![Page 11: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/11.jpg)
First! You need a big tower!
![Page 12: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/12.jpg)
![Page 13: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/13.jpg)
HD6990 - $700 – not in retail nowHD7990 - $1000 – easy to buyMotherboard –from $100 (1xPCIEx16)to $500 (7xPCIEx16)
Smth else? :)
What about costs
![Page 14: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/14.jpg)
CoolingCOOOOOLING !!!
Power supplyPOOOOOWER SUUUPLYY !!!
Common hardware problems
![Page 15: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/15.jpg)
One motherboard – one ATX connectorEach power supply need ATX connector to work
We want to use more that one power supply but only one motherboard!
How to build multi power supply system on general hardware?
![Page 16: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/16.jpg)
How to build multi power supply system on general hardware?
easy hack ;)
![Page 17: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/17.jpg)
~ 500W per card (HD[6|7]990)Seller: 1300W power supply2 x HD7990 on 1300W PS and… F*ck off!!!
Why?
How to choose power supply?
![Page 18: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/18.jpg)
1200W on power supply but…How many channels? (1/2)How many power per channel? (less than 500W ;-( )
How to choose power supply?
![Page 19: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/19.jpg)
Default air cooling on retail cardsHD6990 – good! Works well on 99% load, stock clocks, about 87 C temp
HD7990 – bad ;( Works on 99% load, stock clocks, about 20 seconds (than 99 C temp)
Cooooooling
![Page 20: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/20.jpg)
Water pump - $100-200 1-2 for systemWater block - $150-200 for each cardRadiator - $100-200Other supply - $150 (hoses, water, others)
Water cooling – only one way ;(
![Page 21: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/21.jpg)
Water pump - $100-200 1-2 for systemWater block - $150-200 for each cardRadiator - $100-200Other supply - $150 (hoses, water, others)
Water cooling – only one way ;(
![Page 22: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/22.jpg)
Aircooling• 20 seconds to 97C on HD7990• 87C on HD6990 stableWater cooling:• 60 C stable on HD6990 and HD7990 both
Water cooling – results
![Page 23: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/23.jpg)
<- Waterblock
Radiator ->
![Page 24: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/24.jpg)
![Page 25: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/25.jpg)
Current:• $5000 for all – 42G MD5/s (42*10^10
hashes per second)• $119/1G MD5Target:• $9000 for all – 112G MD5/s• $80/1G MD5
Our results
![Page 26: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/26.jpg)
Double Hawaii core card +40%Overclock of Hawaii +30%
Total about:$9000 for 216.5G MD5/s$41/1G MD5
Optimistic target
![Page 27: 4.4. Hashcracking server on generic hardware](https://reader030.vdocuments.net/reader030/viewer/2022032421/55a798141a28ab7f1f8b490d/html5/thumbnails/27.jpg)
The end
Contacts:
@wallarm, @d0znpp
research