Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add defragment support for HFE #13229

Merged
merged 87 commits into from
May 14, 2024
Merged

Add defragment support for HFE #13229

merged 87 commits into from
May 14, 2024

Commits on Apr 19, 2024

  1. Hash Field Expiration Defragmentation

    @sundb
    sundb committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    5ee153e View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2024

  1. Optimize ebScanDefrag

    @sundb
    sundb committed Apr 20, 2024
    Configuration menu
    Copy the full SHA
    53dbff1 View commit details
    Browse the repository at this point in the history

  2. Spell

    @sundb
    sundb committed Apr 20, 2024
    Configuration menu
    Copy the full SHA
    3162c25 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Add notification tests for HFE

    @sundb
    sundb committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    9117b42 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. New way to skip defraging the fields with TTL

    @sundb
    sundb committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4986870 View commit details
    Browse the repository at this point in the history

  2. Remove activeDefragHfieldDict

    @sundb
    sundb committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    f7bf686 View commit details
    Browse the repository at this point in the history

  3. Use dictUseStoredKeyApi to get hash from hfield

    @sundb
    sundb committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    99b3bad View commit details
    Browse the repository at this point in the history

  4. Revert the code for defraging hash obj with TTL

    @sundb
    sundb committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    09562c4 View commit details
    Browse the repository at this point in the history

  5. Add commands.def

    @sundb
    sundb committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    761b3a4 View commit details
    Browse the repository at this point in the history

  6. Add activeDefragHfieldSkipTTL

    @sundb
    sundb committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    5a86b46 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. add new ebDefragItem

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    6942c4a View commit details
    Browse the repository at this point in the history

  2. Revert some code

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    fdbc69e View commit details
    Browse the repository at this point in the history

  3. Simplify code

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    af9eadc View commit details
    Browse the repository at this point in the history

  4. Fix compile warning

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    871ec6f View commit details
    Browse the repository at this point in the history

  5. Fix crash due to forget skip defraging hfield with TTL in scanLaterHash

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b19f6f5 View commit details
    Browse the repository at this point in the history

  6. Unify the defragment of hfield in the callback of dictScanDefrag

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    5e8dfd1 View commit details
    Browse the repository at this point in the history

  7. Add comment

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    2f988f0 View commit details
    Browse the repository at this point in the history

  8. Cleanup

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    f8bbf7f View commit details
    Browse the repository at this point in the history

  9. Use zmalloc_usable_size instead of zmalloc_size

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    acfc293 View commit details
    Browse the repository at this point in the history

  10. Remove unused code

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    4a9f8f6 View commit details
    Browse the repository at this point in the history

  11. Remove unused code

    @sundb
    sundb committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    d701bf8 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Add missing raxStop

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    dcc5da0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hfe' into hfe-defrag

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    35ec1a3 View commit details
    Browse the repository at this point in the history

  3. Add individual test for HFE defragment

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    1f62c55 View commit details
    Browse the repository at this point in the history

  4. For CI test

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    c0ec94c View commit details
    Browse the repository at this point in the history

  5. Fix defrag HFE test failed

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    c270ca4 View commit details
    Browse the repository at this point in the history

  6. add listpack support (todo: fix rebase issues)

    @tezc
    tezc committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    5fe4b02 View commit details
    Browse the repository at this point in the history

  7. test fix

    @tezc
    tezc committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    1318272 View commit details
    Browse the repository at this point in the history

  8. Make HFE defrag test more stable

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    6177070 View commit details
    Browse the repository at this point in the history

  9. Remove test code

    @sundb
    sundb committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    06d13a3 View commit details
    Browse the repository at this point in the history

  10. add hgetf

    @tezc
    tezc committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    cd7396c View commit details
    Browse the repository at this point in the history

  11. silence compiler warning

    @tezc
    tezc committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    3b5b33b View commit details
    Browse the repository at this point in the history

  12. fix

    @tezc
    tezc committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    eada402 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. Reflect ebDefragItem() about rax and other CRs 

    Co-authored-by: Moti Cohen <moti.cohen@redis.com>
    @sundb @moticless
    sundb and moticless committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    c952c1e View commit details
    Browse the repository at this point in the history

  2. Merge the tests about item defragmentation 

    Co-authored-by: Moti Cohen <moti.cohen@redis.com>
    @sundb @moticless
    sundb and moticless committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    08c4276 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. add hashTypeIsDictWithMetaHFE to check if hash obj is dict with HFE

    @sundb
    sundb committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    b8f81a0 View commit details
    Browse the repository at this point in the history

  2. cleanup

    @sundb
    sundb committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    78cebfc View commit details
    Browse the repository at this point in the history

  3. Try to fix the failure of expiration test

    @sundb
    sundb committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    ea61eb4 View commit details
    Browse the repository at this point in the history

  4. hsetf

    @tezc
    tezc committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    2d40d61 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Make dictExpireMetadata opaque

    @sundb
    sundb committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    b90ab61 View commit details
    Browse the repository at this point in the history

  2. Fix the reply schema for HFE

    @sundb
    sundb committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    66c8785 View commit details
    Browse the repository at this point in the history

  3. Add .def

    @sundb
    sundb committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    f2124a5 View commit details
    Browse the repository at this point in the history

  4. Revert the reply schema for hexpire

    @sundb
    sundb committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    4f64806 View commit details
    Browse the repository at this point in the history

  5. Fix reply schema for hpersist

    @sundb
    sundb committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    2ea37aa View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. Remvoe reply schema def

    @sundb
    sundb committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f9c0106 View commit details
    Browse the repository at this point in the history

  2. Add test for hpexpireat for schema validate CI

    @sundb
    sundb committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    293b127 View commit details
    Browse the repository at this point in the history

  3. Defrag listpack for HFE

    @sundb
    sundb committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    765ebc4 View commit details
    Browse the repository at this point in the history

  4. Fix missing update ob->ptr after defraging listpack

    @sundb
    sundb committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    b59dbb7 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. simply hsetf

    @tezc
    tezc committed May 1, 2024
    Configuration menu
    Copy the full SHA
    7e8cd04 View commit details
    Browse the repository at this point in the history

  2. comment

    @tezc
    tezc committed May 1, 2024
    Configuration menu
    Copy the full SHA
    aa096d1 View commit details
    Browse the repository at this point in the history

  3. expose struct listpackTTL

    @tezc
    tezc committed May 1, 2024
    Configuration menu
    Copy the full SHA
    2296d05 View commit details
    Browse the repository at this point in the history

  4. minor

    @tezc
    tezc committed May 1, 2024
    Configuration menu
    Copy the full SHA
    920d784 View commit details
    Browse the repository at this point in the history

  5. minor

    @tezc
    tezc committed May 1, 2024
    Configuration menu
    Copy the full SHA
    d0b523c View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. rename listpackttl to listpackex

    @tezc
    tezc committed May 2, 2024
    Configuration menu
    Copy the full SHA
    6c6c6a4 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Merge branch 'hfe-listpack-v1' into hfe-listpack-defrag

    @sundb
    sundb committed May 6, 2024
    Configuration menu
    Copy the full SHA
    7712b00 View commit details
    Browse the repository at this point in the history

  2. Fix complaint

    @sundb
    sundb committed May 6, 2024
    Configuration menu
    Copy the full SHA
    d20743e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hash-field-expiry-integ' into hfe-listpack-defrag

    @sundb
    sundb committed May 6, 2024
    Configuration menu
    Copy the full SHA
    ac1130f View commit details
    Browse the repository at this point in the history

  4. comments

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    f0c74fa View commit details
    Browse the repository at this point in the history

  5. merge

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    07dad91 View commit details
    Browse the repository at this point in the history

  6. schema fix

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    36bd618 View commit details
    Browse the repository at this point in the history

  7. comment

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    2c0b560 View commit details
    Browse the repository at this point in the history

  8. comment

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    e8ea643 View commit details
    Browse the repository at this point in the history

  9. minor

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    d1ce106 View commit details
    Browse the repository at this point in the history

  10. minor

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    5775ba0 View commit details
    Browse the repository at this point in the history

  11. minor

    @tezc
    tezc committed May 6, 2024
    Configuration menu
    Copy the full SHA
    f0ec7e3 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'hfe-listpack-v1' into hfe-listpack-defrag

    @sundb
    sundb committed May 6, 2024
    Configuration menu
    Copy the full SHA
    9e323bb View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Revert code

    @sundb
    sundb committed May 7, 2024
    Configuration menu
    Copy the full SHA
    01563e6 View commit details
    Browse the repository at this point in the history

  2. test fix

    @tezc
    tezc committed May 7, 2024
    Configuration menu
    Copy the full SHA
    9a2fb77 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hfe-listpack-v1' into hfe-listpack-defrag

    @sundb
    sundb committed May 7, 2024
    Configuration menu
    Copy the full SHA
    af548c8 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Merge branch 'hash-field-expiry-integ' into hfe-defrag

    @sundb
    sundb committed May 8, 2024
    Configuration menu
    Copy the full SHA
    661fc72 View commit details
    Browse the repository at this point in the history

  2. Missing .def

    @sundb
    sundb committed May 8, 2024
    Configuration menu
    Copy the full SHA
    b187702 View commit details
    Browse the repository at this point in the history

  3. Add ebValidate() to check if the data is corrupted in the unittest

    @sundb
    sundb committed May 8, 2024
    Configuration menu
    Copy the full SHA
    e6b8b6b View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Merge branch 'hash-field-expiry-integ' into hfe-defrag

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    1662f40 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hfe-listpack-defrag' into hfe-defrag

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    1452444 View commit details
    Browse the repository at this point in the history

  3. Revert some code

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    496e242 View commit details
    Browse the repository at this point in the history

  4. Add comments

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    b18cb26 View commit details
    Browse the repository at this point in the history

  5. Revert some code

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    2d86fc8 View commit details
    Browse the repository at this point in the history

  6. Fix comment

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    6fdbfb3 View commit details
    Browse the repository at this point in the history

  7. Fix CR

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    5bf9ddb View commit details
    Browse the repository at this point in the history

  8. Format

    @sundb
    sundb committed May 9, 2024
    Configuration menu
    Copy the full SHA
    0936517 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Update src/defrag.c 

    Co-authored-by: Ozan Tezcan <ozantezcan@gmail.com>
    @sundb @tezc
    sundb and tezc committed May 10, 2024
    Configuration menu
    Copy the full SHA
    1bea6c9 View commit details
    Browse the repository at this point in the history

  2. Add a assertion for ExpireMeta's trash in ebDefragItem() 

    Co-authored-by: Moti Cohen <moti.cohen@redis.com>
    @sundb @moticless
    sundb and moticless committed May 10, 2024
    Configuration menu
    Copy the full SHA
    b619ea5 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2024

  1. Fix a else if mistake

    @sundb
    sundb committed May 11, 2024
    Configuration menu
    Copy the full SHA
    5023c03 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Merge branch 'hash-field-expiry-integ' into hfe-defrag

    @sundb
    sundb committed May 13, 2024
    Configuration menu
    Copy the full SHA
    ebbb291 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Improve the HFE deframent test to cover listpackex and eblist

    @sundb
    sundb committed May 14, 2024
    Configuration menu
    Copy the full SHA
    8db938b View commit details
    Browse the repository at this point in the history

  2. Increase the threshold to make test more stable

    @sundb
    sundb committed May 14, 2024
    Configuration menu
    Copy the full SHA
    8363b2c View commit details
    Browse the repository at this point in the history

  3. Improve test

    @sundb
    sundb committed May 14, 2024
    Configuration menu
    Copy the full SHA
    79cdbb0 View commit details
    Browse the repository at this point in the history