summaryrefslogtreecommitdiff
path: root/src/blockchain_db
Commit message (Collapse)AuthorAgeFilesLines
* db_lmdb: commit pruning txn at checkpointsmoneromooo-monero2019-06-181-1/+50
| | | | to avoid errors when the txn is too large
* ensure no NULL is passed to memcpymoneromooo-monero2019-06-141-2/+2
| | | | | NULL is valid when size is 0, but memcpy uses nonnull attributes, so let's not poke the bear
* core: do not commit half constructed batch db txnmoneromooo-monero2019-05-252-0/+16
|
* fix wide difficulty conversion with some versions of boostmoneromooo-monero2019-05-011-2/+2
|
* testdb: add override keyword where missingstoffu2019-04-173-132/+100
| | | | and delete obsolete BlockchainBDB::get_tx_output_indices along the way
* blockchain_db: fix db txn ending too earlymoneromooo-monero2019-04-145-58/+98
| | | | | | | | | | The db txn in add_block ending caused the entire overarching batch txn to stop. Also add a new guard class so a db txn can be stopped in the face of exceptions. Also use a read only db txn in init when the db itself is read only, and do not save the max tx size in that case.
* cryptonote: rework block blob size sanity checkmoneromooo-monero2019-04-054-0/+72
| | | | | Use the actual block weight limit, assuming that weight is always greater or equal to size
* Make difficulty 128 bit instead of 64 bitmoneromooo-monero2019-03-242-7/+155
| | | | | | Based on Boolberry work by: jahrsg <jahr@jahr.me> cr.zoidberg <crypto.zoidberg@gmail.com>
* Merge pull request #5256Riccardo Spagni2019-03-214-0/+94
|\ | | | | | | 4b21d38d blockchain: speed up getting N blocks weights/long term weights (moneromooo-monero)
| * blockchain: speed up getting N blocks weights/long term weightsmoneromooo-monero2019-03-084-0/+94
| |
* | Update 2019 copyrightbinaryFate2019-03-059-9/+9
|/
* Merge pull request #5119Riccardo Spagni2019-03-051-5/+5
|\ | | | | | | f024a10b db_lmdb: make mdb_block_info format conversion more future proof (moneromooo-monero)
| * db_lmdb: make mdb_block_info format conversion more future proofmoneromooo-monero2019-03-051-5/+5
| | | | | | | | | | If mdb_block_info changes again, the v2 to v3 conversion would convert to an incorrect format.
* | save some database calls when getting top block hash and heightmoneromooo-monero2019-03-054-4/+8
| |
* | Avoid repeated (de)serialization when syncingmoneromooo-monero2019-03-055-22/+27
| |
* | db: speedup block additionmoneromooo-monero2019-03-051-11/+16
|/ | | | by avoiding repeated (de)serialization
* Merge pull request #5081Riccardo Spagni2019-03-041-3/+3
|\ | | | | | | d78addcb db_lmdb: don't unnecessarily cast to double on the way to uint64_t (moneromooo-monero)
| * db_lmdb: don't unnecessarily cast to double on the way to uint64_tmoneromooo-monero2019-01-191-3/+3
| |
* | Merge pull request #5175Riccardo Spagni2019-03-041-0/+1
|\ \ | | | | | | | | | 85088d9f db_lmdb: fix missing mdb_dbi_close in migration (moneromooo-monero)
| * | db_lmdb: fix missing mdb_dbi_close in migrationmoneromooo-monero2019-02-211-0/+1
| | | | | | | | | | | | Fixed by hyc
* | | ArticMine's new block weight algorithmmoneromooo-monero2019-03-045-8/+384
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This curbs runaway growth while still allowing substantial spikes in block weight Original specification from ArticMine: here is the scaling proposal Define: LongTermBlockWeight Before fork: LongTermBlockWeight = BlockWeight At or after fork: LongTermBlockWeight = min(BlockWeight, 1.4*LongTermEffectiveMedianBlockWeight) Note: To avoid possible consensus issues over rounding the LongTermBlockWeight for a given block should be calculated to the nearest byte, and stored as a integer in the block itself. The stored LongTermBlockWeight is then used for future calculations of the LongTermEffectiveMedianBlockWeight and not recalculated each time. Define: LongTermEffectiveMedianBlockWeight LongTermEffectiveMedianBlockWeight = max(300000, MedianOverPrevious100000Blocks(LongTermBlockWeight)) Change Definition of EffectiveMedianBlockWeight From (current definition) EffectiveMedianBlockWeight = max(300000, MedianOverPrevious100Blocks(BlockWeight)) To (proposed definition) EffectiveMedianBlockWeight = min(max(300000, MedianOverPrevious100Blocks(BlockWeight)), 50*LongTermEffectiveMedianBlockWeight) Notes: 1) There are no other changes to the existing penalty formula, median calculation, fees etc. 2) There is the requirement to store the LongTermBlockWeight of a block unencrypted in the block itself. This is to avoid possible consensus issues over rounding and also to prevent the calculations from becoming unwieldy as we move away from the fork. 3) When the EffectiveMedianBlockWeight cap is reached it is still possible to mine blocks up to 2x the EffectiveMedianBlockWeight by paying the corresponding penalty. Note: the long term block weight is stored in the database, but not in the actual block itself, since it requires recalculating anyway for verification.
* / Pruningmoneromooo-monero2019-01-224-25/+491
|/ | | | | | | | | | | | | | | | | | | | | | | | | | | | The blockchain prunes seven eighths of prunable tx data. This saves about two thirds of the blockchain size, while keeping the node useful as a sync source for an eighth of the blockchain. No other data is currently pruned. There are three ways to prune a blockchain: - run monerod with --prune-blockchain - run "prune_blockchain" in the monerod console - run the monero-blockchain-prune utility The first two will prune in place. Due to how LMDB works, this will not reduce the blockchain size on disk. Instead, it will mark parts of the file as free, so that future data will use that free space, causing the file to not grow until free space grows scarce. The third way will create a second database, a pruned copy of the original one. Since this is a new file, this one will be smaller than the original one. Once the database is pruned, it will stay pruned as it syncs. That is, there is no need to use --prune-blockchain again, etc.
* blockchain_db: allow getting output keys without commitmentmoneromooo-monero2019-01-163-4/+5
| | | | | Since the commitment has to be calculated for non rct outputs, it slows down a lot unnecessarily if we don't need it
* Merge pull request #4984Riccardo Spagni2019-01-163-23/+30
|\ | | | | | | 008647d7 blockchain_db: speedup tx output gathering (moneromooo-monero)
| * blockchain_db: speedup tx output gatheringmoneromooo-monero2018-12-183-23/+30
| | | | | | | | We know all the data we'll want for getblocks.bin is contiguous
* | Make get_output_key method constmoneroexamples2019-01-074-8/+8
| | | | | | | | | | | | get_output_key method is commonly used when working with txs and their key images. Because the method is not const, passing blockchain object though const& or pointers to const is not possible in this context. This is especially problematic in external projects (e.g., projects in moneroexamples) that use monero C++ api to operate on the blockchain and txs. Thus, having get_output_key method will simplify moving blockchain object around through const references and pointers to const objects.
* | Merge pull request #4946luigi11112018-12-315-96/+13
|\ \ | |/ |/| | | | | | | | | | | | | 6644b9b blockchain_db: remove a couple unused functions (moneromooo-monero) ce594f5 blockchain_db: allocate known size vector only once (moneromooo-monero) 8332698 db_lmdb: inline check_open, it's trivial and called everywhere (moneromooo-monero) 5511563 db_lmdb: avoid pointless division (moneromooo-monero) d1efe3d cryptonote: set tx hash on newly parsed txes when known (moneromooo-monero) 9cc68a2 tx_pool: add a few std::move where it can make a difference (moneromooo-monero)
| * db_lmdb: avoid pointless divisionmoneromooo-monero2018-12-051-1/+1
| |
| * db_lmdb: inline check_open, it's trivial and called everywheremoneromooo-monero2018-12-052-8/+7
| |
| * blockchain_db: allocate known size vector only oncemoneromooo-monero2018-12-051-5/+5
| |
| * blockchain_db: remove a couple unused functionsmoneromooo-monero2018-12-054-82/+0
| |
* | Merge pull request #4901Riccardo Spagni2018-12-123-4/+75
|\ \ | |/ |/| | | | | a48f2dab blockchain_prune_known_spent_data: blackball file is now optional (moneromooo-monero) 17b45725 Outputs where all amounts are known spent can now be pruned (moneromooo-monero)
| * Outputs where all amounts are known spent can now be prunedmoneromooo-monero2018-11-273-4/+75
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Only for pre rct for obvious reasons. Note: DO NOT use a known spent list which includes outputs which are not known spent. If the list includes any output that's just strongly thought to be spent, but not provably so, you risk finding yourself unable to sync past the point where that output is spent. I estimate only 200 MB saved on current mainnet though, unless the new blackballing rule unearths a good amount of large-amount-set extra spent outs.
* | Merge pull request #4872Riccardo Spagni2018-12-041-10/+6
|\ \ | | | | | | | | | fc99f177 lmdb: fix gcc 7.3.0 'implicit-fallthrough' warning (xiphon)
| * | lmdb: fix gcc 7.3.0 'implicit-fallthrough' warningxiphon2018-11-191-10/+6
| | |
* | | Merge pull request #4854Riccardo Spagni2018-12-042-3/+0
|\ \ \ | |_|/ |/| | | | | bd98e99c Removed a lot of unnecessary includes (Martijn Otto)
| * | Removed a lot of unnecessary includesMartijn Otto2018-11-152-3/+0
| | |
* | | Merge pull request #4821Riccardo Spagni2018-11-263-8/+12
|\ \ \ | | | | | | | | | | | | fc98f7a0 rpc: speedup get_outs.bin (moneromooo-monero)
| * | | rpc: speedup get_outs.binmoneromooo-monero2018-11-263-8/+12
| | |/ | |/|
* | | Merge pull request #4830Riccardo Spagni2018-11-261-0/+9
|\ \ \ | |/ / |/| | | | | dffec258 db_lmdb: error out if the db needs migration in read only mode (moneromooo-monero)
| * | db_lmdb: error out if the db needs migration in read only modemoneromooo-monero2018-11-091-0/+9
| |/
* | Merge pull request #4769Riccardo Spagni2018-11-143-22/+27
|\ \ | |/ |/| | | | | | | | | | | | | | | | | | | 5808530f blockchain: remove unused output_scan_worker parameter (moneromooo-monero) 1426209a blockchain: don't run threads if we have just one function to run (moneromooo-monero) 6f7a5fd4 db_lmdb: slight speedup getting array data from the blockchain (moneromooo-monero) 99fbe100 db_lmdb: save some string copies for readonly db keys/values (moneromooo-monero) bf31447e tx_pool: speed up take_tx for transactions from blocks (moneromooo-monero) 4f005a77 tx_pool: remove unnecessary get_transaction_hash (moneromooo-monero) 593ef598 perf_timer: call reserve on new timer array (moneromooo-monero) 6ecc99ad core: avoid unnecessary tx/blob conversions (moneromooo-monero) 00cc1a16 unit_tests: notify test special case for the usual weirdo (moneromooo-monero)
| * db_lmdb: slight speedup getting array data from the blockchainmoneromooo-monero2018-11-041-6/+8
| |
| * db_lmdb: save some string copies for readonly db keys/valuesmoneromooo-monero2018-11-011-11/+16
| |
| * core: avoid unnecessary tx/blob conversionsmoneromooo-monero2018-11-013-6/+4
| |
* | db_lmdb: log which output was not found in get_output_keymoneromooo-monero2018-11-021-1/+2
| |
* | Merge pull request #4664Riccardo Spagni2018-11-011-9/+23
|\ \ | | | | | | | | | 61304151 db_lmdb: use MDB_MULTIPLE_NEXT where possible for some speedup (moneromooo-monero)
| * | db_lmdb: use MDB_MULTIPLE_NEXT where possible for some speedupmoneromooo-monero2018-10-191-9/+23
| | |
* | | Merge pull request #4639Riccardo Spagni2018-11-011-1/+1
|\ \ \ | |_|/ |/| | | | | ec301390 Update db_lmdb.cpp (Cactii1)
| * | Update db_lmdb.cppCactii12018-10-171-1/+1
| |/