Re: Tracing linux server hacking

From: wcb (wbarwell_at_mylinuxisp.com)
Date: 05/16/05


Date: Mon, 16 May 2005 02:16:45 -0500

shannonwhitty@hotmail.com wrote:

> We had an instance this weekend where our network was bought to a
> grinding halt by what we believed was a problem with our network
> service provider. After 8-9 hours of our network professionals looking
> into the problem, they finally diagnosed the problem with my web server
> by unplugging it from the network and seeing instant improvements.
>
> I then started diagnosing the server and was getting no response - it
> too had come to a grinding halt due to the massive amounts of unknown
> activity. I was left with no choice but to reboot as I was getting no
> result from any commands.
>
> After a reboot the system came up fine and has now been operating as
> per normal for the past 24 hours. The problem I have is I don't know
> what happened or where to start looking!!! I have an operations guy
> who is overseas on annual leave and have limited experience in his
> absence...
>
> Can anyone suggest where I can start or any resources I can look into?
> Any advice or guidance would be greatly appreciated.
>

The usual advice is to not boot a possibly compromised hard disk.
Save to tape for possible forsenics, better yet yank the hard disks
and replace with backups.
At least, wipe and restore from known good backups.

At least you should have save the logs from /var, save /bin, sbin and
a copy of the kernel.

There are any number of live CD forsenics disks out there.
Such as Helix, Knoppix with forsenics suites.
Usually you start looking at logs. Sometimes a compromised
system will have the logs wiped and faked. So part
of forsenics may be looking back at logs for anomolies
showing signs of a wipe job, showing you have been compromised
and about when. Only a newb script kiddy would fail to tamper
with logs to cover his or her tracks.

You want to know, have we been purposefully hacked?
Was it an inside or outside job? When?
When is important as it tells you what backups are probably
compromised or not.

Live CD disks like this are also good for checking the usual
supected binaries for tampering. Finding the true size of ls
for example.

Today's hackers are moving to hacking kernels.
Better live CD forsenics CDs are good for checking for this.
You cannot trust a possibly compromised system tools to find out.

> The main machine the copped the brunt of the problem was:
>
> Linux 2.4.9-e.27smp #1 SMP Tue Aug 5 15:49:54 EDT 2003 i686 unknown
>
> The other machine which may have also copped some activity:
>
> Linux 2.4.18-14smp #1 SMP Wed Sep 4 12:34:47 EDT 2002 i686 i686 i386
> GNU/Linux

-- 
When I shake my killfile, I can hear them buzzing!
Cheerful Charlie


Relevant Pages

  • Re: Log file full of security problems!
    ... having with my small peer-to-peer network. ... Primary User Name: Mark ... Primary Logon ID: ... Disable the logging for the time being; Clear the logs or copy them to ...
    (microsoft.public.windowsxp.network_web)
  • Re: account not allowing domain access
    ... It sounds like it could be a problem with wrong credentials, network ... Have the admin check the security logs of LT2000s to see if there are any ... have basic connectivity to it and if you can not ping by name try it's IP ... like profile settings, please let me know where to get that so I can post ...
    (microsoft.public.windowsxp.security_admin)
  • RE: Setting up an IDS system
    ... and filtering my logs for sensibly viewing i.e. colour coded etc. ... earlier post about filters on routers). ... but this is to be aware of traffic patterns and network activity. ... Setting up an IDS system ...
    (Security-Basics)
  • RE: Anon Logon Events 538/540
    ... The event 540 logs the Successful Network Logon and the event 538 logs the ... Successful Network Logoff. ... Windows 2000, and Windows XP) ...
    (microsoft.public.windowsxp.security_admin)