{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":756620350,"defaultBranch":"main","name":"openhouse","ownerLogin":"linkedin","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2024-02-13T00:52:30.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/357098?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1716404486.0","currentOid":""},"activityList":{"items":[{"before":"46b1d0a4fd7d1c6f22acf44ed6eb3d2fdcce5763","after":"58a05a80c5dc35a65a18c3e7cab6f4370d0ad56c","ref":"refs/heads/main","pushedAt":"2024-05-22T18:44:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rohitkum2506","name":"Rohit kumar","path":"/rohitkum2506","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1126602?s=80&v=4"},"commit":{"message":"Adding memory config param in JobConf for spark applications (#103)\n\n## Summary\r\n\r\nBy default, spark applications run with 1G memory. OH maintenance jobs\r\nfor tables with large size require larger memory in order to avoid OOM\r\nfailures.\r\nThe PR allows to set memory param in jobs POST request to set spark\r\nmemory config.\r\nMemory param only allows format:  <PositiveInteger><G or M>\r\ne.g: 4G, 10G, 250M\r\n\r\nSample POST request:\r\n` {\r\n    \"jobName\": \"test_job\",\r\n    \"clusterId\": \"local\",\r\n    \"jobConf\": {\r\n      \"jobType\": \"ORPHAN_FILES_DELETION\",\r\n      \"proxyUser\": \"openhouse\",\r\n      \"executionConf\": {\"memory\": \"4G\"},\r\n      \"args\": [\r\n        \"--tableName\", \"$table\",\r\n        \"--trashDir\", \".trash\" \r\n      ]\r\n    }\r\n  }`\r\n\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [x] Internal API Changes\r\n- [ ] Bug Fixes\r\n- [x] New Features\r\n- [ ] Performance Improvements\r\n- [ ] Code Style\r\n- [ ] Refactoring\r\n- [ ] Documentation\r\n- [ ] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\n## Testing Done\r\n<!--- Check any relevant boxes with \"x\" -->\r\n- [ ] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [x] Added new tests for the changes made.\r\n- [ ] Updated existing tests to reflect the changes made.\r\n- [ ] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [x] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nBuild tests\r\nRan Setu jobs with memory config set in spark properties. ref: Image\r\n<img width=\"674\" alt=\"Screenshot 2024-05-12 at 6 33 04 PM\"\r\nsrc=\"https://github.com/linkedin/openhouse/assets/1126602/6ccc2648-7d21-4693-93b5-b586f1e2cf1c\">\r\n\r\nDocker tests:\r\nPost with execution conf:\r\n<img width=\"1501\" alt=\"Screenshot 2024-05-17 at 5 39 59 PM\"\r\nsrc=\"https://github.com/linkedin/openhouse/assets/1126602/d8de983b-f1cf-44fd-9a9d-b2ff71a4e964\">\r\n\r\nPost/Get without execution conf\r\n<img width=\"1520\" alt=\"Screenshot 2024-05-17 at 5 40 14 PM\"\r\nsrc=\"https://github.com/linkedin/openhouse/assets/1126602/11552926-b3fa-4ef8-abeb-77b56038660c\">\r\n<img width=\"1428\" alt=\"Screenshot 2024-05-17 at 5 41 03 PM\"\r\nsrc=\"https://github.com/linkedin/openhouse/assets/1126602/c42deff7-a0df-43ff-bd56-28ea588317bc\">\r\n\r\nFor all the boxes checked, include a detailed description of the testing\r\ndone for the changes made in this pull request.\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Adding memory config param in JobConf for spark applications (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2291693957\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/103\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/103/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/103\">#103</a>)"}},{"before":"ca05f77e598d8522592a29632af32c62d065d348","after":"46b1d0a4fd7d1c6f22acf44ed6eb3d2fdcce5763","ref":"refs/heads/main","pushedAt":"2024-05-20T16:34:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jainlavina","name":"Lavina Jain","path":"/jainlavina","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/114708561?s=80&v=4"},"commit":{"message":"Fix variable names to eliminate checkstyle warnings (#105)\n\n## Summary\r\n\r\nFix checkstyle warnings by fixing variable names as per Java naming\r\nconventions.\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [ ] Bug Fixes\r\n- [ ] New Features\r\n- [ ] Performance Improvements\r\n- [x] Code Style\r\n- [ ] Refactoring\r\n- [ ] Documentation\r\n- [ ] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\n## Testing Done\r\n\r\n- [x] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [ ] Added new tests for the changes made.\r\n- [ ] Updated existing tests to reflect the changes made.\r\n- [ ] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [ ] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nFor all the boxes checked, include a detailed description of the testing\r\ndone for the changes made in this pull request.\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Fix variable names to eliminate checkstyle warnings (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2303604055\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/105\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/105/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/105\">#105</a>)"}},{"before":"ca05f77e598d8522592a29632af32c62d065d348","after":null,"ref":"refs/heads/dlo","pushedAt":"2024-05-15T21:15:21.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"teamurko","name":"Stas Pak","path":"/teamurko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/270580?s=80&v=4"}},{"before":null,"after":"ca05f77e598d8522592a29632af32c62d065d348","ref":"refs/heads/dlo","pushedAt":"2024-05-15T21:15:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"teamurko","name":"Stas Pak","path":"/teamurko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/270580?s=80&v=4"},"commit":{"message":"Refactor: Remove FsStorageProvider from Table Service   (#104)\n\nRefactor: Remove FsStorageProvider from Table Service   (#104)","shortMessageHtmlLink":"Refactor: Remove FsStorageProvider from Table Service (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2293840738\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/104\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/104/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/104\">#104</a>)"}},{"before":"81c08873b170b7fc9709fd4ee2a69f57e680ccde","after":"ca05f77e598d8522592a29632af32c62d065d348","ref":"refs/heads/main","pushedAt":"2024-05-15T17:10:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Refactor: Remove FsStorageProvider from Table Service   (#104)\n\nRefactor: Remove FsStorageProvider from Table Service   (#104)","shortMessageHtmlLink":"Refactor: Remove FsStorageProvider from Table Service (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2293840738\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/104\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/104/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/104\">#104</a>)"}},{"before":"f9b2417ad9cf941df0ea5c546277eb7ef137a157","after":"81c08873b170b7fc9709fd4ee2a69f57e680ccde","ref":"refs/heads/main","pushedAt":"2024-05-13T20:22:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Refactor: Remove @LegacyFileIO and Make DelegationRefreshToken use new cluster.yaml (#100)\n\nRefactor: Remove @LegacyFileIO and Make DelegationRefreshToken use new cluster.yaml (#100)","shortMessageHtmlLink":"Refactor: Remove @LegacyFileIO and Make DelegationRefreshToken use ne…"}},{"before":"bc5287cfa86cea52c2215fbf9259b11992f18a42","after":"f9b2417ad9cf941df0ea5c546277eb7ef137a157","ref":"refs/heads/main","pushedAt":"2024-05-09T18:44:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Fix typo in SETUP.md (#101)\n\n## Summary\r\n\r\n<!--- HINT: Replace #nnn with corresponding Issue number, if you are\r\nfixing an existing issue -->\r\n\r\n[Issue](https://github.com/linkedin/openhouse/issues/#nnn)] Briefly\r\ndiscuss the summary of the changes made in this\r\npull request in 2-3 lines.\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [ ] Bug Fixes\r\n- [ ] New Features\r\n- [ ] Performance Improvements\r\n- [ ] Code Style\r\n- [ ] Refactoring\r\n- [x] Documentation\r\n- [ ] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\n## Testing Done\r\n<!--- Check any relevant boxes with \"x\" -->\r\n\r\n- [ ] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [ ] Added new tests for the changes made.\r\n- [ ] Updated existing tests to reflect the changes made.\r\n- [ ] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [ ] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nFor all the boxes checked, include a detailed description of the testing\r\ndone for the changes made in this pull request.\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Fix typo in SETUP.md (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2286940239\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/101\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/101/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/101\">#101</a>)"}},{"before":"d8d136b6d286d6c13005bab5c9fcbcdc6ed95300","after":"bc5287cfa86cea52c2215fbf9259b11992f18a42","ref":"refs/heads/main","pushedAt":"2024-05-08T17:51:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"maluchari","name":"Malini Mahalakshmi Venkatachari","path":"/maluchari","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1776785?s=80&v=4"},"commit":{"message":"Fix NPE during empty table stats collection (#99)\n\n## Summary\r\n\r\nThis PR brings in the following fixed for a couple of issues observed.\r\n1. Fix an incorrect check for right timestamps of table creation and\r\nlast modified.\r\n2. Handle a case where a table does not have any data files.\r\n\r\nAlso added unit tests to address the above cases.\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [X] Bug Fixes\r\n- [ ] New Features\r\n- [ ] Performance Improvements\r\n- [ ] Code Style\r\n- [ ] Refactoring\r\n- [ ] Documentation\r\n- [ ] Tests\r\n\r\n\r\n## Testing Done\r\n\r\n\r\n- [X] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [X] Added new tests for the changes made.\r\n- [ ] Updated existing tests to reflect the changes made.\r\n- [ ] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [ ] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nDocker testing:\r\n\r\nCreated an empty table. emptytbl\r\n\r\n`openhouse@6c67d19838cc:/opt/spark$ hdfs dfs -ls\r\n/data/openhouse/db/emptytbl-e0ff80fe-6eeb-4df9-9d04-9437444b0761/\r\nFound 1 items\r\n-rw-r--r-- 3 openhouse supergroup 2002 2024-05-08 06:46\r\n/data/openhouse/db/emptytbl-e0ff80fe-6eeb-4df9-9d04-9437444b0761/00000-69745f53-4772-44db-a180-919652f4f6da.metadata.json\r\n`\r\n\r\n```\r\nscala> spark.sql(\"show tblproperties openhouse.db.emptytbl\").show(false)\r\n+------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+\r\n|key                                       |value                                                                                                                    |\r\n+------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+\r\n                                                                                                        |\r\n|openhouse.creationTime                    |1715150780639                                                                                                            |\r\n                                                                                                                 |\r\n|openhouse.lastModifiedTime                |1715150780639                                                                                                            |\r\n                                                                                                              |\r\n|openhouse.tableId                         |emptytbl                                                                                                                 |\r\n|openhouse.tableVersion                    |INITIAL_VERSION                                                                                                          |\r\n                                                                                                               |\r\n+-------------------------\r\n```\r\n\r\nRight **tableCreationTimestamp** populated and also no NPE due to\r\nabsence of datafiles:\r\n\r\n`INFO spark.TableStatsCollectionSparkApp: Publishing stats for table:\r\ndb.emptytbl\",\"2024-05-08 07:56:04,464 INFO\r\nspark.TableStatsCollectionSparkApp:\r\n{\\\"totalReferencedDataFilesSizeInBytes\\\":0,\\\"numReferencedDataFiles\\\":0,\\\"totalDirectorySizeInBytes\\\":2002,\\\"numObjectsInDirectory\\\":1,\\\"numCurrentSnapshotReferencedDataFiles\\\":0,\\\"totalCurrentSnapshotReferencedDataFilesSizeInBytes\\\":0,\\\"numExistingMetadataJsonFiles\\\":1,\\\"numReferencedManifestFiles\\\":0,\\\"numReferencedManifestLists\\\":0,\\\"recordTimestamp\\\":1715154955889,\\\"clusterName\\\":\\\"LocalHadoopCluster\\\",\\\"databaseName\\\":\\\"db\\\",\\\"tableName\\\":\\\"emptytbl\\\",\\\"tableUUID\\\":\\\"e0ff80fe-6eeb-4df9-9d04-9437444b0761\\\",\\\"tableLocation\\\":\\\"/data/openhouse/db/emptytbl-e0ff80fe-6eeb-4df9-9d04-9437444b0761\\\",\\\"tableCreator\\\":\\\"openhouse\\\",\\\"tableCreationTimestamp\\\":1715150780639,\\\"tableLastUpdatedTimestamp\\\":1715150780639,\\\"tableType\\\":\\\"PRIMARY_TABLE\\\"}\",\"2024-05-08\r\n07:56:04,465`\r\n\r\n\r\n\r\nFor all the boxes checked, include a detailed description of the testing\r\ndone for the changes made in this pull request.\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Fix NPE during empty table stats collection (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2284991050\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/99\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/99/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/99\">#99</a>)"}},{"before":null,"after":"c2f93e394144fde97a0455485dd82eeec14e12ab","ref":"refs/heads/spark_catalog_proto","pushedAt":"2024-05-08T06:32:09.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"autumnust","name":"Lei","path":"/autumnust","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5044213?s=80&v=4"},"commit":{"message":"Prototype sparkCatalog overwrite","shortMessageHtmlLink":"Prototype sparkCatalog overwrite"}},{"before":"9339553558d6d2e128f2a0b79c410f7d1c7710c9","after":"d8d136b6d286d6c13005bab5c9fcbcdc6ed95300","ref":"refs/heads/main","pushedAt":"2024-05-07T00:10:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Add storageType field to HouseTable Entity (#81)\n\n## Summary\r\n\r\n<!--- HINT: Replace #nnn with corresponding Issue number, if you are\r\nfixing an existing issue -->\r\n\r\n[Issue](https://github.com/linkedin/openhouse/issues/#80) Added a\r\nstorageType field to the HouseTable Entity to support multiple storage\r\ntypes.\r\n\r\nResolves #80 \r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [ ] Bug Fixes\r\n- [x] New Features\r\n- [ ] Performance Improvements\r\n- [ ] Code Style\r\n- [ ] Refactoring\r\n- [ ] Documentation\r\n- [x] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\nAdded storageType field to the HouseTable DTO.\r\n\r\n## Testing Done\r\n<!--- Check any relevant boxes with \"x\" -->\r\n\r\n- [ ] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [ ] Added new tests for the changes made.\r\n- [x] Updated existing tests to reflect the changes made.\r\n- [ ] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [ ] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nFor all the boxes checked, include a detailed description of the testing\r\ndone for the changes made in this pull request.\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.\r\n\r\n---------\r\n\r\nCo-authored-by: Sushant Raikar <sraikar@linkedin.com>","shortMessageHtmlLink":"Add storageType field to HouseTable Entity (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2257380725\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/81\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/81/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/81\">#81</a>)"}},{"before":"d824024837fecae7a18b13c24fba8bf122a47796","after":"9339553558d6d2e128f2a0b79c410f7d1c7710c9","ref":"refs/heads/main","pushedAt":"2024-05-06T19:11:46.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Introduce FileIOManager and FileIO implementations for HDFS and Local Storage (#96)\n\nLaying foundations for storage part 4: `FileIOManager` and FileIO\r\nimplementations for `HDFS` and `Local`","shortMessageHtmlLink":"Introduce FileIOManager and FileIO implementations for HDFS and Local…"}},{"before":"041cdd36ce703fd1c8bf1cedd0efb06152f1567b","after":"d824024837fecae7a18b13c24fba8bf122a47796","ref":"refs/heads/main","pushedAt":"2024-05-01T23:02:34.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"autumnust","name":"Lei","path":"/autumnust","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5044213?s=80&v=4"},"commit":{"message":"Ensure putSnapshot path honoring case insensitive contract (#85)\n\n## Summary\r\n\r\nThis is a bug fixes for put-snapshot code path, where UUID-extraction\r\nprocess is using `tableId` and `databaseId` from the request itself.\r\nThose ids, if directly obtained from top-level request body, can lost\r\ncasing if the requests were from platform like Spark SQL. Since the\r\nunderlying storage (e.g. HDFS ) is case sensitive in its path URL, we\r\nwill need to ensure the original casing info when issue the first commit\r\nas part of CTAS is preserved in the process of UUID-extraction of the\r\nsecond commit.\r\n\r\nThe other parts in this PR is to ensure, when `put` is happening, the\r\n`tableDto` is not always built from scratch when there's existing object\r\ndiscovered by `findById` method previously. This is done by switch\r\n`orElse` method to `orElseGet`, in which the latter will only call the\r\nsupplier lazily when the calling object is absent. This leads to a\r\nwasteful implementation as well as confusion on the code stack.\r\n\r\nThis PR also include:\r\n- Some refactoring to share code with existing code. \r\n- Ensure `text-fixtures` module has its repository horning case\r\ninsensitive contract so that this behavior can be tested through\r\nembedded instances.\r\n- Testing the casing contract in both SQL and Catalog API.","shortMessageHtmlLink":"Ensure putSnapshot path honoring case insensitive contract (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2260286616\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/85\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/85/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/85\">#85</a>)"}},{"before":"fe1f03eb18c6590cf5ea9a083499c18c939b9ee7","after":"041cdd36ce703fd1c8bf1cedd0efb06152f1567b","ref":"refs/heads/main","pushedAt":"2024-05-01T16:25:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jainlavina","name":"Lavina Jain","path":"/jainlavina","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/114708561?s=80&v=4"},"commit":{"message":"Use fileIO to delete files in dropTable (#94)\n\n## Summary\r\n\r\nUse fileIO instead of filesystem to delete data and metadata files in\r\ndropTable.\r\nIt uses deletePrefix() and expects an instance of FileIO that supports\r\nprefix operations. If table operations are instantiated with a fileIO\r\ninstance that does not extend from SupportPrefixOperations then it will\r\nthrow an exception. But, that is ok because all popular FileIO\r\nimplementations like HadoopFileIO and major cloud providers support the\r\nprefix operations.\r\n\r\nThis change allows us to completely eliminate dependency on hadoop\r\nfilesystem for the catalog.\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [x] Bug Fixes\r\n- [ ] New Features\r\n- [ ] Performance Improvements\r\n- [ ] Code Style\r\n- [ ] Refactoring\r\n- [ ] Documentation\r\n- [ ] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\n## Testing Done\r\nTested using docker and existing e2e tests that cover dropTable.\r\nAlso, added logs and validated by manually inspecting logs in docker.\r\n\r\n- [x] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [ ] Added new tests for the changes made.\r\n- [ ] Updated existing tests to reflect the changes made.\r\n- [ ] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [ ] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nTested by inspecting namenode in docker.\r\n1. Created table lj_test_tbl in db \"ljdb\":\r\n$ curl \"${curlArgs[@]}\" -XPOST\r\nhttp://localhost:8000/v1/databases/ljdb/tables/ --data-raw '{\r\n  \"tableId\": \"lj_test_tbl\",\r\n  \"databaseId\": \"ljdb\",\r\n  \"baseTableVersion\": \"INITIAL_VERSION\",\r\n  \"clusterId\": \"LocalHadoopCluster\",\r\n  .......\r\n\r\n2. Verified that the folder and files exist in hdfs:\r\n<img width=\"1174\" alt=\"Screenshot 2024-04-30 at 2 59 13 PM\"\r\nsrc=\"https://github.com/linkedin/openhouse/assets/114708561/085a94c3-406c-421b-b659-54f1d95ea2ef\">\r\n\r\n3. Dropped table.\r\n$ curl \"${curlArgs[@]}\" -XDELETE\r\nhttp://localhost:8000/v1/databases/ljdb/tables/lj_test_tbl\r\n\r\n4. Verified on namenode in docker that the directory got deleted in\r\nhdfs:\r\n<img width=\"1174\" alt=\"Screenshot 2024-04-30 at 3 03 49 PM\"\r\nsrc=\"https://github.com/linkedin/openhouse/assets/114708561/c3063865-3817-4367-9d15-bb34db093692\">\r\n\r\nDocker test output.\r\n1. Create table:\r\n$ curl \"${curlArgs[@]}\" -XPOST\r\nhttp://localhost:8000/v1/databases/d3/tables/ --data-raw '{\r\n  \"tableId\": \"t1\",\r\n  \"databaseId\": \"d3\",\r\n  \"baseTableVersion\": \"INITIAL_VERSION\",\r\n  \"clusterId\": \"LocalHadoopCluster\",\r\n\"schema\": \"{\\\"type\\\": \\\"struct\\\", \\\"fields\\\": [{\\\"id\\\": 1,\\\"required\\\":\r\ntrue,\\\"name\\\": \\\"id\\\",\\\"type\\\": \\\"string\\\"},{\\\"id\\\": 2,\\\"required\\\":\r\ntrue,\\\"name\\\": \\\"name\\\",\\\"type\\\": \\\"string\\\"},{\\\"id\\\": 3,\\\"required\\\":\r\ntrue,\\\"name\\\": \\\"ts\\\",\\\"type\\\": \\\"timestamp\\\"}]}\",\r\n  \"timePartitioning\": {\r\n    \"columnName\": \"ts\",\r\n    \"granularity\": \"HOUR\"\r\n  },\r\n  \"clustering\": [\r\n    {\r\n      \"columnName\": \"name\"\r\n    }\r\n  ],\r\n  \"tableProperties\": {\r\n    \"key\": \"value\"\r\n  }\r\n}' | json_pp\r\n% Total % Received % Xferd Average Speed Time Time Time Current\r\nDload Upload Total Spent Left Speed\r\n100 2152 0 1578 100 574 1218 443 0:00:01 0:00:01 --:--:-- 1663\r\n{\r\n   \"clusterId\" : \"LocalHadoopCluster\",\r\n   \"clustering\" : [\r\n      {\r\n         \"columnName\" : \"name\",\r\n         \"transform\" : null\r\n      }\r\n   ],\r\n   \"creationTime\" : 1714428252917,\r\n   \"databaseId\" : \"d3\",\r\n   \"lastModifiedTime\" : 1714428252917,\r\n   \"policies\" : null,\r\n\"schema\" :\r\n\"{\\\"type\\\":\\\"struct\\\",\\\"schema-id\\\":0,\\\"fields\\\":[{\\\"id\\\":1,\\\"name\\\":\\\"id\\\",\\\"required\\\":true,\\\"type\\\":\\\"string\\\"},{\\\"id\\\":2,\\\"name\\\":\\\"name\\\",\\\"required\\\":true,\\\"type\\\":\\\"string\\\"},{\\\"id\\\":3,\\\"name\\\":\\\"ts\\\",\\\"required\\\":true,\\\"type\\\":\\\"timestamp\\\"}]}\",\r\n   \"tableCreator\" : \"openhouse\",\r\n   \"tableId\" : \"t1\",\r\n\"tableLocation\" :\r\n\"hdfs://namenode:9000/data/openhouse/d3/t1-eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3/00000-9076ff1b-5823-449f-b31c-d0d653f3e18f.metadata.json\",\r\n   \"tableProperties\" : {\r\n      \"key\" : \"value\",\r\n      \"openhouse.clusterId\" : \"LocalHadoopCluster\",\r\n      \"openhouse.creationTime\" : \"1714428252917\",\r\n      \"openhouse.databaseId\" : \"d3\",\r\n      \"openhouse.lastModifiedTime\" : \"1714428252917\",\r\n      \"openhouse.tableCreator\" : \"openhouse\",\r\n      \"openhouse.tableId\" : \"t1\",\r\n\"openhouse.tableLocation\" :\r\n\"/data/openhouse/d3/t1-eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3/00000-9076ff1b-5823-449f-b31c-d0d653f3e18f.metadata.json\",\r\n      \"openhouse.tableType\" : \"PRIMARY_TABLE\",\r\n      \"openhouse.tableUUID\" : \"eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3\",\r\n      \"openhouse.tableUri\" : \"LocalHadoopCluster.d3.t1\",\r\n      \"openhouse.tableVersion\" : \"INITIAL_VERSION\",\r\n      \"policies\" : \"\",\r\n      \"write.format.default\" : \"orc\",\r\n      \"write.metadata.delete-after-commit.enabled\" : \"true\",\r\n      \"write.metadata.previous-versions-max\" : \"28\"\r\n   },\r\n   \"tableType\" : \"PRIMARY_TABLE\",\r\n   \"tableUUID\" : \"eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3\",\r\n   \"tableUri\" : \"LocalHadoopCluster.d3.t1\",\r\n   \"tableVersion\" : \"INITIAL_VERSION\",\r\n   \"timePartitioning\" : {\r\n      \"columnName\" : \"ts\",\r\n      \"granularity\" : \"HOUR\"\r\n   }\r\n}\r\n\r\n5. Get table:\r\n$ curl \"${curlArgs[@]}\" -XGET\r\nhttp://localhost:8000/v1/databases/d3/tables/t1 | json_pp\r\n% Total % Received % Xferd Average Speed Time Time Time Current\r\nDload Upload Total Spent Left Speed\r\n100 1578 0 1578 0 0 8131 0 --:--:-- --:--:-- --:--:-- 8092\r\n{\r\n   \"clusterId\" : \"LocalHadoopCluster\",\r\n   \"clustering\" : [\r\n      {\r\n         \"columnName\" : \"name\",\r\n         \"transform\" : null\r\n      }\r\n   ],\r\n   \"creationTime\" : 1714428252917,\r\n   \"databaseId\" : \"d3\",\r\n   \"lastModifiedTime\" : 1714428252917,\r\n   \"policies\" : null,\r\n\"schema\" :\r\n\"{\\\"type\\\":\\\"struct\\\",\\\"schema-id\\\":0,\\\"fields\\\":[{\\\"id\\\":1,\\\"name\\\":\\\"id\\\",\\\"required\\\":true,\\\"type\\\":\\\"string\\\"},{\\\"id\\\":2,\\\"name\\\":\\\"name\\\",\\\"required\\\":true,\\\"type\\\":\\\"string\\\"},{\\\"id\\\":3,\\\"name\\\":\\\"ts\\\",\\\"required\\\":true,\\\"type\\\":\\\"timestamp\\\"}]}\",\r\n   \"tableCreator\" : \"openhouse\",\r\n   \"tableId\" : \"t1\",\r\n\"tableLocation\" :\r\n\"hdfs://namenode:9000/data/openhouse/d3/t1-eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3/00000-9076ff1b-5823-449f-b31c-d0d653f3e18f.metadata.json\",\r\n   \"tableProperties\" : {\r\n      \"key\" : \"value\",\r\n      \"openhouse.clusterId\" : \"LocalHadoopCluster\",\r\n      \"openhouse.creationTime\" : \"1714428252917\",\r\n      \"openhouse.databaseId\" : \"d3\",\r\n      \"openhouse.lastModifiedTime\" : \"1714428252917\",\r\n      \"openhouse.tableCreator\" : \"openhouse\",\r\n      \"openhouse.tableId\" : \"t1\",\r\n\"openhouse.tableLocation\" :\r\n\"/data/openhouse/d3/t1-eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3/00000-9076ff1b-5823-449f-b31c-d0d653f3e18f.metadata.json\",\r\n      \"openhouse.tableType\" : \"PRIMARY_TABLE\",\r\n      \"openhouse.tableUUID\" : \"eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3\",\r\n      \"openhouse.tableUri\" : \"LocalHadoopCluster.d3.t1\",\r\n      \"openhouse.tableVersion\" : \"INITIAL_VERSION\",\r\n      \"policies\" : \"\",\r\n      \"write.format.default\" : \"orc\",\r\n      \"write.metadata.delete-after-commit.enabled\" : \"true\",\r\n      \"write.metadata.previous-versions-max\" : \"28\"\r\n   },\r\n   \"tableType\" : \"PRIMARY_TABLE\",\r\n   \"tableUUID\" : \"eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3\",\r\n   \"tableUri\" : \"LocalHadoopCluster.d3.t1\",\r\n   \"tableVersion\" : \"INITIAL_VERSION\",\r\n   \"timePartitioning\" : {\r\n      \"columnName\" : \"ts\",\r\n      \"granularity\" : \"HOUR\"\r\n   }\r\n}\r\n\r\n6. List tables in a db:\r\n$ curl \"${curlArgs[@]}\" -XGET\r\nhttp://localhost:8000/v1/databases/d3/tables/ | json_pp\r\n% Total % Received % Xferd Average Speed Time Time Time Current\r\nDload Upload Total Spent Left Speed\r\n100 1592 0 1592 0 0 25026 0 --:--:-- --:--:-- --:--:-- 25269\r\n{\r\n   \"results\" : [\r\n      {\r\n         \"clusterId\" : \"LocalHadoopCluster\",\r\n         \"clustering\" : [\r\n            {\r\n               \"columnName\" : \"name\",\r\n               \"transform\" : null\r\n            }\r\n         ],\r\n         \"creationTime\" : 1714428252917,\r\n         \"databaseId\" : \"d3\",\r\n         \"lastModifiedTime\" : 1714428252917,\r\n         \"policies\" : null,\r\n\"schema\" :\r\n\"{\\\"type\\\":\\\"struct\\\",\\\"schema-id\\\":0,\\\"fields\\\":[{\\\"id\\\":1,\\\"name\\\":\\\"id\\\",\\\"required\\\":true,\\\"type\\\":\\\"string\\\"},{\\\"id\\\":2,\\\"name\\\":\\\"name\\\",\\\"required\\\":true,\\\"type\\\":\\\"string\\\"},{\\\"id\\\":3,\\\"name\\\":\\\"ts\\\",\\\"required\\\":true,\\\"type\\\":\\\"timestamp\\\"}]}\",\r\n         \"tableCreator\" : \"openhouse\",\r\n         \"tableId\" : \"t1\",\r\n\"tableLocation\" :\r\n\"hdfs://namenode:9000/data/openhouse/d3/t1-eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3/00000-9076ff1b-5823-449f-b31c-d0d653f3e18f.metadata.json\",\r\n         \"tableProperties\" : {\r\n            \"key\" : \"value\",\r\n            \"openhouse.clusterId\" : \"LocalHadoopCluster\",\r\n            \"openhouse.creationTime\" : \"1714428252917\",\r\n            \"openhouse.databaseId\" : \"d3\",\r\n            \"openhouse.lastModifiedTime\" : \"1714428252917\",\r\n            \"openhouse.tableCreator\" : \"openhouse\",\r\n            \"openhouse.tableId\" : \"t1\",\r\n\"openhouse.tableLocation\" :\r\n\"/data/openhouse/d3/t1-eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3/00000-9076ff1b-5823-449f-b31c-d0d653f3e18f.metadata.json\",\r\n            \"openhouse.tableType\" : \"PRIMARY_TABLE\",\r\n\"openhouse.tableUUID\" : \"eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3\",\r\n            \"openhouse.tableUri\" : \"LocalHadoopCluster.d3.t1\",\r\n            \"openhouse.tableVersion\" : \"INITIAL_VERSION\",\r\n            \"policies\" : \"\",\r\n            \"write.format.default\" : \"orc\",\r\n            \"write.metadata.delete-after-commit.enabled\" : \"true\",\r\n            \"write.metadata.previous-versions-max\" : \"28\"\r\n         },\r\n         \"tableType\" : \"PRIMARY_TABLE\",\r\n         \"tableUUID\" : \"eb5975fd-f68d-44d7-9fa4-9b5a4b98a7b3\",\r\n         \"tableUri\" : \"LocalHadoopCluster.d3.t1\",\r\n         \"tableVersion\" : \"INITIAL_VERSION\",\r\n         \"timePartitioning\" : {\r\n            \"columnName\" : \"ts\",\r\n            \"granularity\" : \"HOUR\"\r\n         }\r\n      }\r\n   ]\r\n}\r\n\r\n7. Drop table:\r\n$ curl \"${curlArgs[@]}\" -XDELETE\r\nhttp://localhost:8000/v1/databases/d3/tables/t1\r\n<Validated logs>\r\n\r\n8. List tables in a db again:\r\n$ curl \"${curlArgs[@]}\" -XGET\r\nhttp://localhost:8000/v1/databases/d3/tables/ | json_pp\r\n% Total % Received % Xferd Average Speed Time Time Time Current\r\nDload Upload Total Spent Left Speed\r\n100 14 0 14 0 0 162 0 --:--:-- --:--:-- --:--:-- 160\r\n{\r\n   \"results\" : []\r\n}\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Use fileIO to delete files in dropTable (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270089510\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/94\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/94/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/94\">#94</a>)"}},{"before":"e002146b9a073c6581b2d1ce11d7d039e85eeaf3","after":"fe1f03eb18c6590cf5ea9a083499c18c939b9ee7","ref":"refs/heads/main","pushedAt":"2024-05-01T16:19:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"y242yang","name":"Ann Yiming Yang","path":"/y242yang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/35815874?s=80&v=4"},"commit":{"message":"Pass the right ODD implementation class in jobs.yaml  (#65)\n\n## Summary\r\n\r\nImplementation class name is wrong in jobs.yaml. Added new job type in\r\ndocumentation\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [x] Bug Fixes\r\n- [ ] New Features\r\n- [ ] Performance Improvements\r\n- [ ] Code Style\r\n- [ ] Refactoring\r\n- [ ] Documentation\r\n- [ ] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\n## Testing Done\r\n<!--- Check any relevant boxes with \"x\" -->\r\n\r\n- [ ] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [ ] Added new tests for the changes made.\r\n- [ ] Updated existing tests to reflect the changes made.\r\n- [x] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n- [ ] Some other form of testing like staging or soak time in\r\nproduction. Please explain.\r\n\r\nNo class is named the old name. \r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Pass the right ODD implementation class in jobs.yaml (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2231887474\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/65\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/65/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/65\">#65</a>)"}},{"before":"283d150c46635872d1bdbc36fc7f51df04eaeb26","after":"e002146b9a073c6581b2d1ce11d7d039e85eeaf3","ref":"refs/heads/main","pushedAt":"2024-04-29T18:52:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"teamurko","name":"Stas Pak","path":"/teamurko","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/270580?s=80&v=4"},"commit":{"message":"Log task counts per status in JobScheduler (#93)\n\n## Summary\r\n\r\nCurrently only success, cancel count and total count are logged. This\r\nincomplete information can mislead to think that success rate is slow.\r\nWe need to also show skipped count since many tasks will be skipped for\r\nsome tables, e.g. missing retention policy, replica, etc.\r\n\r\n## Changes\r\n\r\n- [ ] Client-facing API Changes\r\n- [ ] Internal API Changes\r\n- [ ] Bug Fixes\r\n- [ ] New Features\r\n- [ ] Performance Improvements\r\n- [x] Code Style\r\n- [x] Refactoring\r\n- [ ] Documentation\r\n- [ ] Tests\r\n\r\nFor all the boxes checked, please include additional details of the\r\nchanges made in this pull request.\r\n\r\n## Testing Done\r\n<!--- Check any relevant boxes with \"x\" -->\r\n\r\n- [x] Manually Tested on local docker setup. Please include commands\r\nran, and their output.\r\n- [x] No tests added or updated. Please explain why. If unsure, please\r\nfeel free to ask for help.\r\n\r\nFor all the boxes checked, include a detailed description of the testing\r\ndone for the changes made in this pull request.\r\n\r\n# Additional Information\r\n\r\n- [ ] Breaking Changes\r\n- [ ] Deprecations\r\n- [ ] Large PR broken into smaller PRs, and PR plan linked in the\r\ndescription.\r\n\r\nFor all the boxes checked, include additional details of the changes\r\nmade in this pull request.","shortMessageHtmlLink":"Log task counts per status in JobScheduler (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2269455073\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/93\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/93/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/93\">#93</a>)"}},{"before":"52abbc539b1fef53d3b873655cb1cb70e7bdb6e5","after":"283d150c46635872d1bdbc36fc7f51df04eaeb26","ref":"refs/heads/main","pushedAt":"2024-04-29T17:42:51.000Z","pushType":"pr_merge","commitsCount":3,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Merge pull request #90 from HotSushi/storage\n\nIntroduce StorageManager and an Hdfs Implementation for Storage","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2264322558\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/90\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/90/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/90\">#90</a> from HotSushi/storage"}},{"before":"8a7cc973122c7eac62cff6f980c34292343a2f6a","after":null,"ref":"refs/heads/snapshot_casing","pushedAt":"2024-04-27T00:01:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"autumnust","name":"Lei","path":"/autumnust","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5044213?s=80&v=4"}},{"before":null,"after":"8a7cc973122c7eac62cff6f980c34292343a2f6a","ref":"refs/heads/snapshot_casing","pushedAt":"2024-04-26T23:59:12.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"autumnust","name":"Lei","path":"/autumnust","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5044213?s=80&v=4"},"commit":{"message":"Ensure table-service and put-snapshot is lasizy evaluating tableDto only when absent","shortMessageHtmlLink":"Ensure table-service and put-snapshot is lasizy evaluating tableDto o…"}},{"before":"8ec34297e48993544841e0959469380630715e7c","after":"52abbc539b1fef53d3b873655cb1cb70e7bdb6e5","ref":"refs/heads/main","pushedAt":"2024-04-26T21:01:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"maluchari","name":"Malini Mahalakshmi Venkatachari","path":"/maluchari","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1776785?s=80&v=4"},"commit":{"message":"Return CommitStateUnknownException in case of an internal server error to prevent commit abort leading to data loss. (#63)\n\n* Fix error handling to prevent commit abort from causing data loss\r\n\r\n* Update to capture responseBody as part of CommitStateUnknownException\r\n\r\n* Empty commit\r\n\r\n* Fix typo","shortMessageHtmlLink":"Return CommitStateUnknownException in case of an internal server erro…"}},{"before":"54791f32c747e0c414aec413bbfa4c2daa78d988","after":"8ec34297e48993544841e0959469380630715e7c","ref":"refs/heads/main","pushedAt":"2024-04-26T20:13:17.000Z","pushType":"pr_merge","commitsCount":3,"pusher":{"login":"jiang95-dev","name":"Levi Jiang","path":"/jiang95-dev","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19853208?s=80&v=4"},"commit":{"message":"Merge pull request #89 from jiang95-dev/hts-concurrency\n\nHTS concurrent put and delete resolution -- Reopen and Refractor tests","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2262749063\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/89\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/89/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/89\">#89</a> from jiang95-dev/hts-concurrency"}},{"before":"b3e6f39a34d8db00c490d111ff85477018324053","after":"54791f32c747e0c414aec413bbfa4c2daa78d988","ref":"refs/heads/main","pushedAt":"2024-04-26T01:03:49.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"},"commit":{"message":"Merge pull request #92 from HotSushi/classifier_uber_2\n\nFix build issues after classifier change","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2264654527\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/92\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/92/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/92\">#92</a> from HotSushi/classifier_uber_2"}},{"before":"8d6dc6aa418c1310bc5448f5036e46a12440e303","after":"b3e6f39a34d8db00c490d111ff85477018324053","ref":"refs/heads/main","pushedAt":"2024-04-25T21:26:34.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Merge pull request #91 from HotSushi/classifier_uber\n\nChange classifier from 'all' -> 'uber'","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2264501249\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/91\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/91/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/91\">#91</a> from HotSushi/classifier_uber"}},{"before":"879c4290aeb24e91fc39e6552e8bb1c0811abd4d","after":"8d6dc6aa418c1310bc5448f5036e46a12440e303","ref":"refs/heads/main","pushedAt":"2024-04-25T20:32:17.000Z","pushType":"pr_merge","commitsCount":5,"pusher":{"login":"rohitkum2506","name":"Rohit kumar","path":"/rohitkum2506","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1126602?s=80&v=4"},"commit":{"message":"Merge pull request #83 from rohitkum2506/rohitkumar2506/RetentionLogicFix\n\nMade Retention Operation Lightweight by removing/fixing non-metadata ops","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2260058363\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/83\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/83/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/83\">#83</a> from rohitkum2506/rohitkumar2506/RetentionLogi…"}},{"before":"e27be64e730995eb65262f58889667e8015d2ce6","after":"879c4290aeb24e91fc39e6552e8bb1c0811abd4d","ref":"refs/heads/main","pushedAt":"2024-04-25T16:37:58.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"HotSushi","name":"Sushant Raikar","path":"/HotSushi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6441597?s=80&v=4"},"commit":{"message":"Merge pull request #82 from HotSushi/storage\n\nAdd interfaces for StorageClient, Storage and its Implementation for Local","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2257613702\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/82\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/82/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/82\">#82</a> from HotSushi/storage"}},{"before":"75b51b0ddc4c76268ef94b595567d58a5a12387f","after":"e27be64e730995eb65262f58889667e8015d2ce6","ref":"refs/heads/main","pushedAt":"2024-04-24T11:33:09.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"},"commit":{"message":"Merge pull request #88 from linkedin/revert-86-gradle_module\n\nRevert \"publish gradle module metadata\"","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2261076904\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/88\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/88/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/88\">#88</a> from linkedin/revert-86-gradle_module"}},{"before":null,"after":"c91467fc4837e02d26052e1beacdc0174256714d","ref":"refs/heads/revert-86-gradle_module","pushedAt":"2024-04-24T11:32:05.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"},"commit":{"message":"Revert \"publish gradle module metadata\"","shortMessageHtmlLink":"Revert \"publish gradle module metadata\""}},{"before":"5289a2228eb84f073ba63c0ae5786dbbe6def0ba","after":"75b51b0ddc4c76268ef94b595567d58a5a12387f","ref":"refs/heads/main","pushedAt":"2024-04-24T10:26:57.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"},"commit":{"message":"Merge pull request #87 from linkedin/revert-75-hts-concurrency\n\nRevert \"HTS concurrent put and delete resolution\"","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2260955343\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/87\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/87/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/87\">#87</a> from linkedin/revert-75-hts-concurrency"}},{"before":null,"after":"dd2f2a6587452570a88b036269ab437c7eb2fe06","ref":"refs/heads/revert-75-hts-concurrency","pushedAt":"2024-04-24T10:25:08.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"},"commit":{"message":"Revert \"HTS concurrent put and delete resolution\"","shortMessageHtmlLink":"Revert \"HTS concurrent put and delete resolution\""}},{"before":"6a9d4d6d6a01cc5b7fa682819df47a2d6812504a","after":null,"ref":"refs/heads/yiyang/fixOdd","pushedAt":"2024-04-24T10:14:54.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"}},{"before":"02b55773b6658f08dfcc25a660ea78c75c54c89d","after":"5289a2228eb84f073ba63c0ae5786dbbe6def0ba","ref":"refs/heads/main","pushedAt":"2024-04-24T10:14:33.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"sumedhsakdeo","name":"Sumedh Sakdeo","path":"/sumedhsakdeo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/773250?s=80&v=4"},"commit":{"message":"Merge pull request #86 from sumedhsakdeo/gradle_module\n\npublish gradle module metadata","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2260924389\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/openhouse/issues/86\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/openhouse/pull/86/hovercard\" href=\"https://github.com/linkedin/openhouse/pull/86\">#86</a> from sumedhsakdeo/gradle_module"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEUUWf2gA","startCursor":null,"endCursor":null}},"title":"Activity · linkedin/openhouse"}