Extract and Count Unique IP Addresses from access.log

太过爱你忘了你带给我的痛 2023-10-05 08:55 42阅读 0赞

Extract unique IP addresses from Nginx access.log file and sort IP addresses based on HTTP requests count. Useful to identify bad IP addresses that flood or DDoS a website.

Get all IP addresses from Nginx access.log:

<table style="width:423.75pt;"> 
 <tbody> 
  <tr> 
   <td style="width:423.75pt;"> <p style="margin-left:0cm;"><strong><span style="color:#c20cb9;">cat</span></strong><span style="color:#333333;"> access.log </span><strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">awk</span></strong> <span style="color:#FF0000;">'{print $1}'</span></p> </td> 
  </tr> 
 </tbody> 
</table>

Get only unique IP addresses:

<table style="width:423.75pt;"> 
 <tbody> 
  <tr> 
   <td style="width:423.75pt;"> <p style="margin-left:0cm;"><strong><span style="color:#c20cb9;">cat</span></strong><span style="color:#333333;"> access.log </span><strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">awk</span></strong> <span style="color:#FF0000;">'{print $1}'</span> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">sort</span></strong> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">uniq</span></strong></p> </td> 
  </tr> 
 </tbody> 
</table>

Get only unique IP addresses and count them:

<table style="width:428.25pt;"> 
 <tbody> 
  <tr> 
   <td style="width:428.25pt;"> <p style="margin-left:0cm;"><strong><span style="color:#c20cb9;">cat</span></strong><span style="color:#333333;"> access.log </span><strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">awk</span></strong> <span style="color:#FF0000;">'{print $1}'</span> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">sort</span></strong> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">uniq</span></strong> <span style="color:#660033;">-c</span> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">sort</span></strong> <span style="color:#660033;">-nr</span></p> </td> 
  </tr> 
 </tbody> 
</table>

Another command is this:

<table style="width:428.25pt;"> 
 <tbody> 
  <tr> 
   <td style="width:428.25pt;"> <p style="margin-left:0cm;"><strong><span style="color:#c20cb9;">cat</span></strong><span style="color:#333333;"> access.log </span><strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">cut</span></strong> <span style="color:#660033;">-f1</span> <span style="color:#660033;">-d</span> <span style="color:#FF0000;">' '</span> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">sort</span></strong> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">uniq</span></strong> <span style="color:#660033;">-c</span> <strong><span style="color:#000000;">|</span></strong> <strong><span style="color:#c20cb9;">sort</span></strong> <span style="color:#660033;">-nr</span></p> </td> 
  </tr> 
 </tbody> 
</table>

Example output:

<table style="width:428.25pt;"> 
 <tbody> 
  <tr> 
   <td style="width:428.25pt;"> <p style="margin-left:0cm;"><span style="color:#333333;">412 66.249.89.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">371 66.249.89.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">361 66.249.89.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">344 31.59.82.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">129 85.15.0.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;70 151.237.238.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;48 66.249.92.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;42 212.114.111.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;42 212.114.110.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;36 212.114.111.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;31 95.108.158.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;30 68.180.228.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;29 46.148.99.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;28 95.226.111.XXX</span></p> <p style="margin-left:0cm;"><span style="color:#333333;">&nbsp;26 68.180.229.XXX</span></p> </td> 
  </tr> 
 </tbody> 
</table>

发表评论取消回复

表情：

评论列表（有 0 条评论，42人围观）

还没有评论，来说两句吧...

相关阅读

相关 Extract and Count Unique IP Addresses from access.log

Extract unique IP addresses from Nginx access.log file and sort IP addresses based on HT

太过爱你忘了你带给我的痛/ 2023年10月05日 08:55/ 0 赞/ 43 阅读

相关 sqlzoo:SUM and COUNT

> 1. Show the total population of the world. SELECT SUM(population) FROM world

梦里梦外;/ 2022年12月27日 01:50/ 0 赞/ 171 阅读

相关 IP Address

IP Address Time Limit: 1000ms Memory limit: 65536K 有疑问？点这里^\_^ 题目描述 Suppose

快来打我*/ 2022年08月18日 02:35/ 0 赞/ 180 阅读

相关 Restore IP Addresses--LeetCode

Given a string containing only digits, restore it by returning all possible valid IP add

﹏ヽ暗。殇╰゛Y/ 2022年08月07日 13:55/ 0 赞/ 17 阅读

相关 38. Count and Say

[38. Count and Say][] The count-and-say sequence is the sequence of integers with the f

Myth丶恋晨/ 2022年06月08日 11:14/ 0 赞/ 194 阅读

相关 IP address prefixes

![20181116100022790.gif][] IP address prefixes are patterns which match the first n bin

秒速五厘米/ 2022年04月16日 03:17/ 0 赞/ 186 阅读

相关 Unique Email Addresses

Unique Email Addresses Every email consists of a local name and a domain name, separa

灰太狼/ 2022年03月30日 03:11/ 0 赞/ 417 阅读

相关 extract specified contents from two files.

src_dir=$(pwd)/All_h dst_dir=$(pwd)/All diff_dir=$(pwd)/diff if [ !

拼搏现实的明天。/ 2021年12月17日 07:09/ 0 赞/ 168 阅读

相关 Convert IP address to integer and back

/ Convert an IPv4 to a long number. @param ip

怼烎@/ 2021年11月11日 02:06/ 0 赞/ 258 阅读

相关 38. Count and Say

description: 就是看前面那个数有几个几，然后写一串。 Note: Example: The count-and-say sequence is

╰+哭是因爲堅強的太久メ/ 2021年10月18日 10:48/ 0 赞/ 307 阅读