summaryrefslogtreecommitdiffstats
path: root/include
Commit message (Collapse)AuthorAgeFilesLines
...
* Use huge size class infrastructure for large size classes.Jason Evans2016-06-0610-245/+133
|
* Implement cache-oblivious support for huge size classes.Jason Evans2016-06-035-23/+87
|
* Allow chunks to not be naturally aligned.Jason Evans2016-06-034-17/+26
| | | | | Precisely size extents for huge size classes that aren't multiples of chunksize.
* Remove CHUNK_ADDR2BASE() and CHUNK_ADDR2OFFSET().Jason Evans2016-06-033-99/+22
|
* Make extent_prof_tctx_[gs]et() atomic.Jason Evans2016-06-031-3/+7
|
* Add extent_dirty_[gs]et().Jason Evans2016-06-032-2/+25
|
* Convert rtree from per chunk to per page.Jason Evans2016-06-032-4/+2
| | | | Refactor [de]registration to maintain interior rtree entries for slabs.
* Refactor chunk_purge_wrapper() to take extent argument.Jason Evans2016-06-031-2/+1
|
* Refactor chunk_[de]commit_wrapper() to take extent arguments.Jason Evans2016-06-031-4/+2
|
* Refactor chunk_dalloc_{cache,wrapper}() to take extent arguments.Jason Evans2016-06-034-16/+9
| | | | | | Rename arena_extent_[d]alloc() to extent_[d]alloc(). Move all chunk [de]registration responsibility into chunk.c.
* Add/use chunk_split_wrapper().Jason Evans2016-06-034-35/+35
| | | | | | Remove redundant ptr/oldsize args from huge_*(). Refactor huge/chunk/arena code boundaries.
* Add/use chunk_merge_wrapper().Jason Evans2016-06-033-1/+4
|
* Add/use chunk_commit_wrapper().Jason Evans2016-06-032-0/+4
|
* Add/use chunk_decommit_wrapper().Jason Evans2016-06-032-0/+4
|
* Merge chunk_alloc_base() into its only caller.Jason Evans2016-06-032-2/+0
|
* Replace extent_tree_szad_* with extent_heap_*.Jason Evans2016-06-033-26/+18
|
* Use rtree rather than [sz]ad trees for chunk split/coalesce operations.Jason Evans2016-06-033-31/+12
|
* Remove redundant chunk argument from chunk_{,de,re}register().Jason Evans2016-06-031-5/+3
|
* Add extent_past_get().Jason Evans2016-06-032-0/+9
|
* Replace extent_achunk_[gs]et() with extent_slab_[gs]et().Jason Evans2016-06-034-22/+22
|
* Add extent_active_[gs]et().Jason Evans2016-06-033-10/+25
| | | | Always initialize extents' runs_dirty and chunks_cache linkage.
* Move *PAGE* definitions to pages.h.Jason Evans2016-06-032-15/+15
|
* Add rtree element witnesses.Jason Evans2016-06-035-19/+90
|
* Refactor rtree to always use base_alloc() for node allocation.Jason Evans2016-06-036-68/+71
|
* Use rtree-based chunk lookups rather than pointer bit twiddling.Jason Evans2016-06-037-170/+196
| | | | | | | | | | | Look up chunk metadata via the radix tree, rather than using CHUNK_ADDR2BASE(). Propagate pointer's containing extent. Minimize extent lookups by doing a single lookup (e.g. in free()) and propagating the pointer's extent into nearly all the functions that may need it.
* Add element acquire/release capabilities to rtree.Jason Evans2016-06-033-85/+166
| | | | | | | | This makes it possible to acquire short-term "ownership" of rtree elements so that it is possible to read an extent pointer *and* read the extent's contents with a guarantee that the element will not be modified until the ownership is released. This is intended as a mechanism for resolving rtree read/write races rather than as a way to lock extents.
* Rename extent_node_t to extent_t.Jason Evans2016-05-167-166/+173
|
* Simplify run quantization.Jason Evans2016-05-162-17/+1
|
* Refactor runs_avail.Jason Evans2016-05-164-11/+43
| | | | | | | | Use pszind_t size classes rather than szind_t size classes, and always reserve space for NPSIZES elements. This removes unused heaps that are not multiples of the page size, and adds (currently) unused heaps for all huge size classes, with the immediate benefit that the size of arena_t allocations is constant (no longer dependent on chunk size).
* Implement pz2ind(), pind2sz(), and psz2u().Jason Evans2016-05-133-11/+115
| | | | | | | These compute size classes and indices similarly to size2index(), index2size() and s2u(), respectively, but using the subset of size classes that are multiples of the page size. Note that pszind_t and szind_t are not interchangeable.
* Initialize arena_bin_info at compile time rather than at boot time.Jason Evans2016-05-132-14/+64
| | | | This resolves #370.
* Implement BITMAP_INFO_INITIALIZER(nbits).Jason Evans2016-05-131-19/+67
| | | | This allows static initialization of bitmap_info_t structures.
* Remove redzone support.Jason Evans2016-05-134-80/+16
| | | | This resolves #369.
* Remove quarantine support.Jason Evans2016-05-137-113/+13
|
* Remove Valgrind support.Jason Evans2016-05-135-138/+0
|
* Use TSDN_NULL rather than NULL as appropriate.Jason Evans2016-05-131-2/+2
|
* Optimize witness fast path.Jason Evans2016-05-113-14/+153
| | | | | | | | | | | Short-circuit commonly called witness functions so that they only execute in debug builds, and remove equivalent guards from mutex functions. This avoids pointless code execution in witness_assert_lockless(), which is typically called twice per allocation/deallocation function invocation. Inline commonly called witness functions so that optimized builds can completely remove calls as dead code.
* Resolve bootstrapping issues when embedded in FreeBSD libc.Jason Evans2016-05-1115-270/+362
| | | | | | | | | | | | | b2c0d6322d2307458ae2b28545f8a5c9903d7ef5 (Add witness, a simple online locking validator.) caused a broad propagation of tsd throughout the internal API, but tsd_fetch() was designed to fail prior to tsd bootstrapping. Fix this by splitting tsd_t into non-nullable tsd_t and nullable tsdn_t, and modifying all internal APIs that do not critically rely on tsd to take nullable pointers. Furthermore, add the tsd_booted_get() function so that tsdn_fetch() can probe whether tsd bootstrapping is complete and return NULL if not. All dangerous conversions of nullable pointers are tsdn_tsd() calls that assert-fail on invalid conversion.
* Add LG_QUANTUM definition for the RISC-V architecture.Jason Evans2016-05-071-0/+3
|
* Update private_symbols.txt.Jason Evans2016-05-061-2/+11
|
* Optimize the fast paths of calloc() and [m,d,sd]allocx().Jason Evans2016-05-063-55/+21
| | | | | | | | This is a broader application of optimizations to malloc() and free() in f4a0f32d340985de477bbe329ecdaecd69ed1055 (Fast-path improvement: reduce # of branches and unnecessary operations.). This resolves #321.
* Modify pages_map() to support mapping uncommitted virtual memory.Jason Evans2016-05-063-2/+13
| | | | | | | | | | | If the OS overcommits: - Commit all mappings in pages_map() regardless of whether the caller requested committed memory. - Linux-specific: Specify MAP_NORESERVE to avoid unfortunate interactions with heuristic overcommit mode during fork(2). This resolves #193.
* Add the stats.retained and stats.arenas.<i>.retained statistics.Jason Evans2016-05-042-0/+9
| | | | This resolves #367.
* Fix huge_palloc() regression.Jason Evans2016-05-043-6/+27
| | | | | | | | | | Split arena_choose() into arena_[i]choose() and use arena_ichoose() for arena lookup during internal allocation. This fixes huge_palloc() so that it always succeeds during extent node allocation. This regression was introduced by 66cd953514a18477eb49732e40d5c2ab5f1b12c5 (Do not allocate metadata via non-auto arenas, nor tcaches.).
* Fix witness/fork() interactions.Jason Evans2016-04-262-2/+4
| | | | | | Fix witness to clear its list of owned mutexes in the child if platform-specific malloc_mutex code re-initializes mutexes rather than unlocking them.
* Fix fork()-related lock rank ordering reversals.Jason Evans2016-04-265-5/+21
|
* Fix degenerate mb_write() compilation error.Jason Evans2016-04-231-3/+3
| | | | This resolves #375.
* Implement the arena.<i>.reset mallctl.Jason Evans2016-04-223-1/+7
| | | | | | | This makes it possible to discard all of an arena's allocations in a single operation. This resolves #146.
* Do not allocate metadata via non-auto arenas, nor tcaches.Jason Evans2016-04-226-23/+47
| | | | | This assures that all internally allocated metadata come from the first opt_narenas arenas, i.e. the automatically multiplexed arenas.
* Fix malloc_mutex_assert_[not_]owner() for --enable-lazy-lock case.Jason Evans2016-04-181-2/+2
|
generated by cgit v0.12 at 2025-04-21 22:43:53 (GMT)