Awesome

Summary:

Automating forensic artifact extraction, reduction, and analysis of cold disk and memory images. So far has only been tested on NTFS .E01 disk images. This tool essentially automates the data collection and processing for the majority of what's taught in SANS FOR508, then some..

fTriage leverages dozens of popular, open source tools to triage suspect memory/disk images. Each module automates a step in the investigation an analyst would otherwise perform manually. Moreover, I've written a wrapper (ftriage.sh) to execute collections of these modules. There is no limit to how many modules you can run at once, but naturally there are some that need to be run before others, review the "Recommended Usage" section for example usage of prebuilt modlists.

NOTE: This suite is being built on and developed for use with the SANS SIFT Workstation. Assuming you install every tool it depends on then it will work on other Linux distros, but I recommend downloading the VM.

Setup:

1. Install dependencies:

sudo ./dependencies.sh

2. Download NSRL hashlist if you will not be providing your own via baseline build + md5deep:

cd ./conf/nsrl/
./pull.sh
unzip rds_modernm.zip -d ./rds_modernm
./build_nsrl_idx.sh

3. (OPTIONAL) Setup shared host directory using VMware

# NOTE: It is unwise to share your output directory with the host - if fTriage carves out malware samples then you don't want them being exposed to your host. This is more to easily share timelines, and other benign forensic artifacts for analysis with Windows tools. I also tend to place my disk and memory images in this directory.

Create directory in desired location on host...
Share directory with SIFT guest by focusing the VM and selecting VM --> Settings --> Options --> Shared Folders

4. Edit ./conf/ftriage.conf and make sure all variables have been filled in.
5. Run modules individually, or in batches using ftriage.sh with modlists.
6. (OPTIONAL) Download 3rd party tools - These tools aren't yet integrated with fTriage, but they will be eventually and the scripts are nice shortcuts so we don't need to browse to the download site(s):

#NOTE: pescan requires a license from tzworks, you can request one by emailing "info@tzworks.net" or filling out the "demo" form at "https://www.tzworks.net/store/product_page.php"

cd ./3rd_party/
./wget_pescan.sh
./wget_autoruns.sh
./wget_sigcheck.sh
cp ~/<license> ./3rd_party/pescan*-*

Recommended Usage:

#NOTE: Each bulk acquisition will probably generate 30-80GB content, keep that in mind
#NOTE: Probably going to wrap all this into one script, but I think this helps visualize the process.

./ftriage.sh ./conf/ftriage.conf ./modlists/bulk.conf &&
./modules/analysis/aggregate_carved_exes.sh ./conf/ftriage.conf &&
./ftriage.sh ./conf/ftriage.conf ./modlists/process_files.conf &&
./modules/analysis/analyze_density_results.sh ./conf/ftriage.conf

ftriage.sh (wrapper for running an array of modules & scripts):

• ftriage.sh: Wrapper for running modules & scripts in the background and monitoring status. Logs can be found in the $OUTDIR/logs/ directory.

Modules (targeted scripts):

Disk:

• cold_image_export.sh: Runs image_export.py against the disk image with a filter file native to the SIFT Workstation. Great initial triage script because it quickly collects key forensic artifacts from a disk image (VSS too) and organizes them neatly. An analyst can start analyzing these forensic artifacts while the more time consuming scripts run (sorter.sh for example can take 30 minutes to several hours depending on hardware).
• hot_image_export.sh: Same thing as cold_image_export.sh, but can be used on mounted hot disk. Great for snagging forensic artifacts for initial triage before having to image the disk.
• sorter.sh: Runs sorter against the disk with a filter file native to the SIFT Workstation. Accepts an indexed hash white list, usually NSRL or md5deep of baseline.
• tsk_recover.sh: Runs tsk_recover to carve files out of unallocated space.
• d_unallocated_foremost.sh: Uses blkls to dump and redirect all unallocated space into a file, then runs foremost against the blkls unallocated file. Also outputs a snippit from the audit results.
• d_slack_foremost.sh: Uses blkls to dump and redirect all slack space into a file, then runs foremost against the blkls slack file. Also outputs a snippit from the audit results.
• d_strings.sh: Runs strings against the disk image and sorts the output.
• d_timeline.sh: Builds unfiltered and filtered filesystem timelines using fls, mactime, and grep.
• supertimeline.sh: Builds a SuperTimeline using log2timeline.py, psort.py, and grep.

Memory:

• imageinfo.sh: Runs the Volatility imageinfo command - usually used in initial setup stages to determine our memory $PROFILE variable.
• malprocfind.sh: Runs the Volatility malprocfind plugin - Finds malicious processes based on discrepancies from observed, normal behavior and properties. This plugin automates several manual checks performed on every memory image when looking for malware including expected PPID, name permutations, expected path, priority, expected cmdline args, proper user SID, session, time after boot, cmd.exe parent, missing binaries, and abnormal paths.
• malfind.sh: Runs the Volatility malfind plugin (looks for code injection), parses output, and dumps suspect memory sections to disk.
• ldrmodules.sh: Runs the Volatility ldrmodules plugin, and parses output. DLLs are tracked in three separate linked lists for each process. Some malware attempts to unlink loaded DLLs from these lists in order to evade detection. This plugin scans all process memory sections for DLLs, then parses each list and compares results to find unlinked DLLs.
• hollowfind.sh: Runs the volatility hollowfind plugin, and dumps suspect memory sections to disk. The plugin detects such attacks by finding discrepancy in the VAD and PEB, it also disassembles the address of entry point to detect any redirection attempts and also reports any suspicious memory regions which should help in detecting any injected code. Prime example of this technique was Stuxnet; if you analyze a sample memory image of a Stuxnet infected machine you will notice multiple lsass.exe processes, but there should only ever be one lsass.exe process running at a time. The malware started extra legitimate lsass.exe processes in a suspended state, hollowed them out, injected the malicious code, then resumed the process. Great writeup here.
• dlllist.sh: Runs the Volatility dlllist plugin. This output is derived from processes tracked in the Process Environment Block (PEB), so injected and unlinked DLLs will not be detected. Unlinked DLLs can be detected using ldrmodules.sh
• cmdline.sh: Runs the Volatility cmdline plugin, a simple plugin designed to list command line args passed for each running process.
• dlldump.sh: Runs the Volatility dlldump plugin.
• dumpfiles_dll.sh: Runs the Volatility dumpfiles command searching for .dll files via regex.
• dumpfiles_exe.sh: Runs the Volatility dumpfiles command searching for .exe files via regex.
• m_strings.sh: Runs strings against the memory image and sorts the output. Also runs the Volatility strings command to enrich our output with process info and virtual addresses.
• filescan.sh: Runs the Volatility filescan command (pool scanner for file objects) and saves the output in a file.
• m_timeline.sh: Builds unfiltered and filtered timelines using the Volatility timeliner command, mactime, and grep.
• apihooks.sh: Find DLL function (inline and trampoline) hooks using Volatility apihooks plugin.
• getsids.sh: Runs the Volatility getsids command,
• ssdt.sh: Display System Service Descriptor Table entries using Volatility ssdt plugin.
• idt.sh: Display Interupt Descriptor Table hooks using Volatility idt plugin.
• psxview.sh: Find hidden processes via cross-view techniques using Volatility psxview plugin.
• driverirp.sh: Identify I/O request Packets (IRP) hooks using Volatility driverirp plugin.
• modules.sh: Walk linked list to identify kernel drivers loaded using Volatility modules plugin.
• modscan.sh: Scan memory image to find loaded, unloaded, and unlinked kernel modules using Volatility modscan plugin.
• handles.sh: Print list of handles opened by the process using Volatility handles plugin.
• mutantscan.sh: Scan for _KMUTANT objects using Volatility mutantscan plugin.
• cmdscan.sh: Scan for COMMAND_HISTORY buffers using Volatility cmdscan plugin.
• consoles.sh: Scan for CONSOLE_INFORMATION output using Volatility consoles plugin.
• netscan.sh: Scan memory for both active & closed connections & sockets using Volatility netscan plugin (Only works with Vista+).
• shimcache.sh: Parses the Application Compatibility Shim Cache registry key using Volatility shimcache plugin.
• shimcachemem.sh: Parses the Application Compatibility Shim Cache stored in kernel memory using Volatility shimcachemem plugin.
• prefetchparser.sh: Parses memory address space for prefetch files by scanning for proper headers and then performing strong validation to reduce false positives. Plugin then parses discovered files and presents contents to analyst.

Hybrid:

• h_timeline.sh: Builds unfiltered and filtered combined filesystem/memory timelines using the Volatility timeliner command, fls, mactime, and grep.

Analysis:

• aggregate_carved_exes.sh: Moves all carved exes, pdfs, and Office docs from their respective carving output directories into a common directory.
• hash_aggregate_exes.sh: Builds md5 hash lists of carved exes, pdfs, and Office docs.
• densityscout.sh: Runs densityscout against all carved + aggregated EXEs/DLLs, and against image_export/Windows and image_export/Users
• analyze_density_results.sh: Parses output from densityscout.sh, sorter.sh, d_unallocated_foremost.sh, d_slack_foremost.sh, dlldump.sh, dumpfiles_dll.sh, and dumpfiles_exe.sh. Copies carved files with high density to $OUTDIR/carving/high_density_exes/ with original filename appended.
• get_mft_hunt_data.sh <_MFT_DIR>: Runs analyzeMFT.py with anomaly detection against each file ending in "_MFT". Optional <_MFT_DIR> directory parameter, or by default will run againt $OUTDIR/image_export.

Custom:

• Where user supplied modules should be placed - Have included a template file here

Devtools:

• mount_host_shares.sh: Creates /root/host_shares directory, then mounts all VMware shared folders from host.
• nuke.sh: Script I use to remove various output directories during development.
• pkiller.sh: Used by ftriage.sh to cleanup background jobs.
• rm_extra.sh: Removes excess output files that usually are unnecessary after initial triage.

Notes:

• Autoruns.exe & autorunsc.exe usage and references at my blog

Suite is still under development, but coming along quickly!