Difference between revisions of "Nodes.dat file"
(→Format (version 1)) |
(→Format (version 2)) |
||
Line 51: | Line 51: | ||
== Format (version 2) == | == Format (version 2) == | ||
This format is used in aMule version 2.2.0 and later. | This format is used in aMule version 2.2.0 and later. | ||
+ | |||
+ | Here again, all fields are stored without any separator character. This is done like this because all the fields have a specific size. | ||
+ | |||
+ | The file begins with 4 bytes storing the null value (hex 0x00000000) | ||
+ | Then follows the fields: | ||
+ | |||
+ | *''Version number'': value 2 stored in little endian (0x02000000 , 4 bytes) | ||
+ | *''Number of contacts'': Number of contacts that will be listed (4 bytes) | ||
+ | After specifying the number of contacts that will be listed, the file lists them. | ||
+ | Each contact takes 34 bytes, splitted into the following fields: | ||
+ | *''ClientID'': The contact's [[ID|ClientID]] (16 bytes) | ||
+ | *''IP'': The contact's [[IP address|IP]] (4 bytes) | ||
+ | *''UDP Port'': The [http://www.ietf.org/rfc/rfc768.txt UDP] [[port]] to [[connect]] to when trying to reach the contact (2 bytes) | ||
+ | *''TCP Port'': The [http://www.ietf.org/rfc/rfc793.txt TCP] [[port]] to [[connect]] to when trying to reach the contact (2 bytes) | ||
+ | *''contactVersion'': This indicates the [[type]] of the contact | ||
+ | *''KadUDPKey'': 8 bytes | ||
+ | *''Verified'': 1 byte, any value different from 0 states the contact has been verified. | ||
+ | |||
+ | Once this data is put together, it is stored in little-endian. | ||
== Extra == | == Extra == |
Revision as of 19:36, 14 March 2009
English | Deutsch
Contents
File
Name: nodes.dat
Location: ~/.aMule/
Description
This file stores details about known Kademlia clients (also known as Kad nodes).
It is used to bootstrap the Kad network when aMule starts.
Format (version 1)
This format was used for aMule up to 2.1.3 , and it is no more used
All fields are stored without any separator character. This is done like this because all the fields have a specific size:
- Number of contacts: Number of contacts that will be listed (4 bytes)
After specifying the number of contacts that will be listed, the file lists them. Each contact takes 25 bytes, splitted into the following fields:
- ClientID: The contact's ClientID (16 bytes)
- IP: The contact's IP (4 bytes)
- UDP Port: The UDP port to connect to when trying to reach the contact (2 bytes)
- TCP Port: The TCP port to connect to when trying to reach the contact (2 bytes)
- Type: This indicates the type of the contact, which is how much you can be confident on that contact (a scale from 0 to 4, being 0 the best and 4 the worst). (1 byte)
Once this data is put together, it is stored in little-endian.
Example of nodes.dat version 1 file
The following is a hex dump of an hypothetic nodes.dat file:
0200000012257425DBA4EDDBD097150757404486E55E04DE40123612021F64632587A31EC2FC8566C4A9BAB184E6E9B7D44012361202
In the above example, the following data can be seen:
- Number of contacts: 2 (In hex: 02000000, remember it's in little endian)
- Contact #1:
- ClientID: 12257425DBA4EDDBD097150757404486
- IP: 222.4.94.229 (In hex: E55E04DE, remember it's in little endian)
- UDP Port: 1240 (In hex: 4012, remember it's in little endian)
- TCP Port: 1236 (In hex: 3612, remember it's in little endian)
- Type: 2 (In hex: 02)
- Contact #2:
- ClientID: 1F64632587A31EC2FC8566C4A9BAB184
- IP: 212.183.233.230 (In hex: E6E9B7D4, remember it's in little endian)
- UDP Port: 1240 (In hex: 4012, remember it's in little endian)
- TCP Port: 1236 (In hex: 3612, remember it's in little endian)
- Type: 2 (In hex: 02)
Format (version 2)
This format is used in aMule version 2.2.0 and later.
Here again, all fields are stored without any separator character. This is done like this because all the fields have a specific size.
The file begins with 4 bytes storing the null value (hex 0x00000000) Then follows the fields:
- Version number: value 2 stored in little endian (0x02000000 , 4 bytes)
- Number of contacts: Number of contacts that will be listed (4 bytes)
After specifying the number of contacts that will be listed, the file lists them. Each contact takes 34 bytes, splitted into the following fields:
- ClientID: The contact's ClientID (16 bytes)
- IP: The contact's IP (4 bytes)
- UDP Port: The UDP port to connect to when trying to reach the contact (2 bytes)
- TCP Port: The TCP port to connect to when trying to reach the contact (2 bytes)
- contactVersion: This indicates the type of the contact
- KadUDPKey: 8 bytes
- Verified: 1 byte, any value different from 0 states the contact has been verified.
Once this data is put together, it is stored in little-endian.
Extra
Since the number of contacts field is 4 bytes long, the maximum number of nodes you could store in this file is 4294967296 (~4300M), which should be far enough. Anyway, since this number is so big, aMule, eMule and all clients have hard limitted the amount of contacts that can be stored (aMule's hard limit is 5000).
Since Type 4 contacts are those which are marked for deletion, there should never be any Type 4 contact in the nodes.dat file. If there was, it would just be ignored when reading the file.
Script for dumping nodes.dat
Here's a python script which can be used for dumping contents of the nodes.dat v1 and v2 files:
#!/usr/bin/env python # this code belongs to public domain import struct version = 1 count = 0 nodefile = open('nodes.dat', 'r') (count,) = struct.unpack("<I", nodefile.read(4)) if (count == 0) : (version,) = struct.unpack("<I", nodefile.read(4)) if (version == 2) : (count,) = struct.unpack("<I", nodefile.read(4)) if (version > 0 & version < 3) : print 'Nodes.dat file version = %d' %(version) print 'Node count = %d' %(count) print ' ' if (version == 1): print ' idx type IP address udp tcp' else : print ' idx type IP address udp tcp' for i in xrange(count): if (version == 1): (clientid, ip1, ip2, ip3, ip4, udpport, tcpport, type) = \ struct.unpack("<16s4BHHB", nodefile.read(25)) else : (clientid, ip1, ip2, ip3, ip4, udpport, tcpport, type, kadUDPkey, verified) = \ struct.unpack("<16s4BHHB8sB", nodefile.read(34)) ipaddr = '%d.%d.%d.%d' % (ip1, ip2, ip3, ip4) print '%4d %4d %-15s %5d %5d' % (i, type, ipaddr, udpport, tcpport) else : print 'Cannot handle nodes.dat version %d !' (version) nodefile.close()