<feed xmlns='http://www.w3.org/2005/Atom'>
<title>monzero-core.git/src/daemon/main.cpp, branch v0.9.1</title>
<subtitle>Monzero core node, command-line wallet, consensus code, and release tooling.
</subtitle>
<id>https://code.monzero.org/monzero-core.git/atom?h=v0.9.1</id>
<link rel='self' href='https://code.monzero.org/monzero-core.git/atom?h=v0.9.1'/>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/'/>
<updated>2015-12-31T21:12:13Z</updated>
<entry>
<title>update version</title>
<updated>2015-12-31T21:12:13Z</updated>
<author>
<name>Riccardo Spagni</name>
<email>ric@spagni.net</email>
</author>
<published>2015-12-31T21:12:13Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=5c71f5d13ebb5db5743f81161382a831f9fa8450'/>
<id>urn:sha1:5c71f5d13ebb5db5743f81161382a831f9fa8450</id>
<content type='text'>
</content>
</entry>
<entry>
<title>updated copyright year</title>
<updated>2015-12-31T06:39:56Z</updated>
<author>
<name>Riccardo Spagni</name>
<email>ric@spagni.net</email>
</author>
<published>2015-12-31T06:39:56Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=de0392685063d93dbdad3a6b1a2712eaf94dd51a'/>
<id>urn:sha1:de0392685063d93dbdad3a6b1a2712eaf94dd51a</id>
<content type='text'>
</content>
</entry>
<entry>
<title>Merge pull request #552</title>
<updated>2015-12-22T08:29:29Z</updated>
<author>
<name>Riccardo Spagni</name>
<email>ric@spagni.net</email>
</author>
<published>2015-12-22T08:29:04Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=40880d7cb8ea9b86d18ca97960291d3965f23f51'/>
<id>urn:sha1:40880d7cb8ea9b86d18ca97960291d3965f23f51</id>
<content type='text'>
9428d53 Strip redundant includes (hyc)
</content>
</entry>
<entry>
<title>Strip redundant includes</title>
<updated>2015-12-21T16:23:59Z</updated>
<author>
<name>hyc</name>
<email>hyc@symas.com</email>
</author>
<published>2015-12-21T16:21:50Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=9428d53d6f9bb4a269579cfbdc993e270726bdd4'/>
<id>urn:sha1:9428d53d6f9bb4a269579cfbdc993e270726bdd4</id>
<content type='text'>
In particular, &lt;boost/program_options.hpp&gt; blows up daemon.cpp.obj,
making it too big to compile in debug mode on Win32. Even on a
release build it drops daemon.cpp.o on Linux from 31MB to 20MB.
This has no effect on the final linked binary size.
</content>
</entry>
<entry>
<title>Replace tabs with two spaces for consistency with rest of codebase</title>
<updated>2015-12-15T14:22:06Z</updated>
<author>
<name>warptangent</name>
<email>warptangent@tutanota.com</email>
</author>
<published>2015-12-14T04:54:39Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=725acc7f17e47e0ea0e7e690f241ee8a286411ea'/>
<id>urn:sha1:725acc7f17e47e0ea0e7e690f241ee8a286411ea</id>
<content type='text'>
Remove trailing whitespace in same files.
</content>
</entry>
<entry>
<title>Register daemon command line arguments to core if they're used in core</title>
<updated>2015-12-08T23:06:29Z</updated>
<author>
<name>moneromooo-monero</name>
<email>moneromooo-monero@users.noreply.github.com</email>
</author>
<published>2015-12-08T23:06:29Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=336b37580f6b889d57f888acfc883a179d69e35c'/>
<id>urn:sha1:336b37580f6b889d57f888acfc883a179d69e35c</id>
<content type='text'>
This fixes coretests, which does not register daemon specific arguments,
but uses core, which uses those arguments. Also gets rid of an unwanted
dependency on daemon code from core.
</content>
</entry>
<entry>
<title>Fix startup crash when using a locale boost does not like</title>
<updated>2015-11-21T10:13:10Z</updated>
<author>
<name>moneromooo-monero</name>
<email>moneromooo-monero@users.noreply.github.com</email>
</author>
<published>2015-11-21T10:13:10Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=f3724aef881ff2fdada98eddc792059e4e18c1c8'/>
<id>urn:sha1:f3724aef881ff2fdada98eddc792059e4e18c1c8</id>
<content type='text'>
There are various locale related bugs in various versions of boost,
where exceptions are thrown in boost::filesystem APIs when the
current locale is not to boost's liking. It's not clear what "not
to boost's liking" means in detail, though "en" and "en_US.UTF-8"
are not to its liking.

Fix it by running a test function that's known to throw in such
a case, and resetting LANG and LC_ALL to C if an exception is
thrown. In simplewallet, the locale is queried before that so the
correct translations will still be used.
</content>
</entry>
<entry>
<title>** CHANGES ARE EXPERIMENTAL (FOR TESTING ONLY)</title>
<updated>2015-07-16T06:20:16Z</updated>
<author>
<name>NoodleDoodleNoodleDoodleNoodleDoodleNoo</name>
<email>xeven77@outlook.com</email>
</author>
<published>2015-07-10T20:09:32Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=e5d2680094ee15889934fe28901e4e133cda56f2'/>
<id>urn:sha1:e5d2680094ee15889934fe28901e4e133cda56f2</id>
<content type='text'>
Bockchain:
1. Optim: Multi-thread long-hash computation when encountering groups of blocks.
2. Optim: Cache verified txs and return result from cache instead of re-checking whenever possible.
3. Optim: Preload output-keys when encoutering groups of blocks. Sort by amount and global-index before bulk querying database and multi-thread when possible.
4. Optim: Disable double spend check on block verification, double spend is already detected when trying to add blocks.
5. Optim: Multi-thread signature computation whenever possible.
6. Patch: Disable locking (recursive mutex) on called functions from check_tx_inputs which causes slowdowns (only seems to happen on ubuntu/VMs??? Reason: TBD)
7. Optim: Removed looped full-tx hash computation when retrieving transactions from pool (???).
8. Optim: Cache difficulty/timestamps (735 blocks) for next-difficulty calculations so that only 2 db reads per new block is needed when a new block arrives (instead of 1470 reads).

Berkeley-DB:
1. Fix: 32-bit data errors causing wrong output global indices and failure to send blocks to peers (etc).
2. Fix: Unable to pop blocks on reorganize due to transaction errors.
3. Patch: Large number of transaction aborts when running multi-threaded bulk queries.
4. Patch: Insufficient locks error when running full sync.
5. Patch: Incorrect db stats when returning from an immediate exit from "pop block" operation.
6. Optim: Add bulk queries to get output global indices.
7. Optim: Modified output_keys table to store public_key+unlock_time+height for single transaction lookup (vs 3)
8. Optim: Used output_keys table retrieve public_keys instead of going through output_amounts-&gt;output_txs+output_indices-&gt;txs-&gt;output:public_key
9. Optim: Added thread-safe buffers used when multi-threading bulk queries.
10. Optim: Added support for nosync/write_nosync options for improved performance (*see --db-sync-mode option for details)
11. Mod: Added checkpoint thread and auto-remove-logs option.
12. *Now usable on 32-bit systems like RPI2.

LMDB:
1. Optim: Added custom comparison for 256-bit key tables (minor speed-up, TBD: get actual effect)
2. Optim: Modified output_keys table to store public_key+unlock_time+height for single transaction lookup (vs 3)
3. Optim: Used output_keys table retrieve public_keys instead of going through output_amounts-&gt;output_txs+output_indices-&gt;txs-&gt;output:public_key
4. Optim: Added support for sync/writemap options for improved performance (*see --db-sync-mode option for details)
5. Mod: Auto resize to +1GB instead of multiplier x1.5

ETC:
1. Minor optimizations for slow-hash for ARM (RPI2). Incomplete.
2. Fix: 32-bit saturation bug when computing next difficulty on large blocks.

[PENDING ISSUES]
1. Berkely db has a very slow "pop-block" operation. This is very noticeable on the RPI2 as it sometimes takes &gt; 10 MINUTES to pop a block during reorganization.
   This does not happen very often however, most reorgs seem to take a few seconds but it possibly depends on the number of outputs present. TBD.
2. Berkeley db, possible bug "unable to allocate memory". TBD.

[NEW OPTIONS] (*Currently all enabled for testing purposes)
1. --fast-block-sync arg=[0:1] (default: 1)
	a. 0 = Compute long hash per block (may take a while depending on CPU)
	b. 1 = Skip long-hash and verify blocks based on embedded known good block hashes (faster, minimal CPU dependence)
2. --db-sync-mode arg=[[safe|fast|fastest]:[sync|async]:[nblocks_per_sync]] (default: fastest:async:1000)
	a. safe = fdatasync/fsync (or equivalent) per stored block. Very slow, but safest option to protect against power-out/crash conditions.
	b. fast/fastest = Enables asynchronous fdatasync/fsync (or equivalent). Useful for battery operated devices or STABLE systems with UPS and/or systems with battery backed write cache/solid state cache.
	Fast    - Write meta-data but defer data flush.
	Fastest - Defer meta-data and data flush.
	Sync    - Flush data after nblocks_per_sync and wait.
	Async   - Flush data after nblocks_per_sync but do not wait for the operation to finish.
3. --prep-blocks-threads arg=[n] (default: 4 or system max threads, whichever is lower)
        Max number of threads to use when computing long-hash in groups.
4. --show-time-stats arg=[0:1] (default: 1)
	Show benchmark related time stats.
5. --db-auto-remove-logs arg=[0:1] (default: 1)
	For berkeley-db only. Auto remove logs if enabled.

**Note: lmdb and berkeley-db have changes to the tables and are not compatible with official git head version.
	At the moment, you need a full resync to use this optimized version.

[PERFORMANCE COMPARISON]
**Some figures are approximations only.
Using a baseline machine of an i7-2600K+SSD+(with full pow computation):
1. The optimized lmdb/blockhain core can process blocks up to 585K for ~1.25 hours + download time, so it usually takes 2.5 hours to sync the full chain.
2. The current head with memory can process blocks up to 585K for ~4.2 hours + download time, so it usually takes 5.5 hours to sync the full chain.
3. The current head with lmdb can process blocks up to 585K for ~32 hours + download time and usually takes 36 hours to sync the full chain.

Averate procesing times (with full pow computation):
lmdb-optimized:
1. tx_ave = 2.5 ms / tx
2. block_ave = 5.87 ms / block
memory-official-repo:
1. tx_ave = 8.85 ms / tx
2. block_ave = 19.68 ms / block
lmdb-official-repo (0f4a036437fd41a5498ee5e74e2422ea6177aa3e)
1. tx_ave = 47.8 ms / tx
2. block_ave = 64.2 ms / block

**Note: The following data denotes processing times only (does not include p2p download time)
lmdb-optimized processing times (with full pow computation):
1. Desktop,  Quad-core / 8-threads 2600k  (8Mb) - 1.25 hours processing time (--db-sync-mode=fastest:async:1000).
2. Laptop,   Dual-core / 4-threads U4200  (3Mb) - 4.90 hours processing time (--db-sync-mode=fastest:async:1000).
3. Embedded, Quad-core / 4-threads Z3735F (2x1Mb) - 12.0 hours processing time (--db-sync-mode=fastest:async:1000).

lmdb-optimized processing times (with per-block-checkpoint)
1. Desktop,  Quad-core / 8-threads 2600k  (8Mb) - 10 minutes processing time (--db-sync-mode=fastest:async:1000).

berkeley-db optimized processing times (with full pow computation)
1. Desktop, Quad-core / 8-threads 2600k  (8Mb) - 1.8 hours processing time (--db-sync-mode=fastest:async:1000).
2. RPI2. Improved from estimated 3 months(???) into 2.5 days (*Need 2AMP supply + Clock:1Ghz + [usb+ssd] to achieve this speed) (--db-sync-mode=fastest:async:1000).

berkeley-db optimized processing times (with per-block-checkpoint)
1. RPI2. 12-15 hours (*Need 2AMP supply + Clock:1Ghz + [usb+ssd] to achieve this speed) (--db-sync-mode=fastest:async:1000).
</content>
</entry>
<entry>
<title>cleaning up, removing redundant files, renaming, fixing incorrect licenses</title>
<updated>2015-05-31T11:40:18Z</updated>
<author>
<name>Riccardo Spagni</name>
<email>ric@spagni.net</email>
</author>
<published>2015-05-31T11:40:18Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=e01d32e52d862d590ec23a17d3460066639a3803'/>
<id>urn:sha1:e01d32e52d862d590ec23a17d3460066639a3803</id>
<content type='text'>
</content>
</entry>
<entry>
<title>daemon: Set log file default to use data dir</title>
<updated>2015-05-28T10:52:19Z</updated>
<author>
<name>warptangent</name>
<email>warptangent@inbox.com</email>
</author>
<published>2015-05-27T11:19:34Z</published>
<link rel='alternate' type='text/html' href='https://code.monzero.org/monzero-core.git/commit/?id=10ff75e92e5e65e23579c038aff917e78b2f7964'/>
<id>urn:sha1:10ff75e92e5e65e23579c038aff917e78b2f7964</id>
<content type='text'>
The log file previously used the default data dir even if --data-dir was
set to something else.

Document data dir and log file path.
</content>
</entry>
</feed>
