Releases: pola-rs/polars
Python Polars 0.20.26
⚠️ Deprecations
- Deprecate
allow_infinities
andnull_probability
args to parametric test strategies (#16183)
🚀 Performance improvements
- Avoid needless copy when converting chunked Series to NumPy (#16178)
- use zeroable_vec in ewm_mean_by (#16166)
- Improve cost of chunk_idx compute (#16154)
- Don't rechunk by default in
concat
(#16128) - Ensure rechunk is parallel (#16127)
✨ Enhancements
- Clarify
to_torch
"features" and "label" parameter behaviour when return type is not "dataset" (#16218) - Native CSV file list reading (#16180)
- Register memory mapped files and raise when written to (#16208)
- Implement support for Struct types in parametric tests (#16197)
- Enable Null datatype and null values by default in parametric testing (#16192)
- Support
Enum
types in parametric testing (#16188) - Raise when encountering invalid supertype in functions during conversion (#16182)
- Add SQL support for
GROUP BY ALL
syntax and fix several issues with aliased group keys (#16179) - Overhaul parametric test implementations and update Hypothesis to latest version (#16062)
- Avoid an extra copy when converting Boolean Series to writable NumPy array (#16164)
- Allow implicit string → temporal conversion in SQL comparisons (#15958)
- Add run-length encoding to Parquet writer (#16125)
- Support passing instantiated adbc/alchemy connection objects to
write_database
(#16099) - Add top-level
nth(n)
method, to go with existingfirst
andlast
(#16112)
🐞 Bug fixes
- Empty unique (#16214)
- Fix empty drop nulls (#16213)
- Fix get expression group-by state (#16189)
- Fix rolling empty group OOB (#16186)
- offset=-0i was being treated differently to offset=0i in rolling (#16184)
- Fix panic on empty frame joins (#16181)
- Fix streaming glob slice (#16174)
- Fix CSV skip_rows_after_header for streaming (#16176)
- Flush parquet at end of batches tick (#16073)
- Check CSE name aliases for collisions. (#16149)
- Don't override CSV reader encoding with lossy UTF-8 (#16151)
- Respect
dtype
andstrict
inpl.Series
's constructor for pyarrow arrays, numpy arrays, and pyarrow-backed pandas (#15962) - Ensure hex and bitstring literals work inside SQL
IN
clauses (#16101)
📖 Documentation
- Add examples for multiple
Series
functions (#16172) - Add deprecated messages to
cumfold
andcumreduce
(#16173) - StringNameSpace.replace_all docstring (#16169)
- Explain how Polars floor division differs from Python (#16054)
- Clarify arrow usage (#16152)
- Add example to polars.Series.flags (#16123)
🛠️ Other improvements
- Switch over some of the custom Python date/time conversions to native PyO3 conversions (#16203)
- move describe to IR instead of DSL (#16191)
- More PyO3 0.21 Bound<> APIs, and finally disable gil-refs backwards compat feature on pyo3 crate (#16143)
- Move hypothesis tests into unit test module (#16185)
- Remove unused code (#16175)
- Update plugin example to PyO3 0.21 (#16157)
- Return correct temporal type from Rust in
to_numpy
(#14353) - Create NumPy view for Datetime/Duration Series on the Rust side (#16148)
- Don't override CSV reader encoding with lossy UTF-8 (#16151)
- Continue converting to PyO3 0.21 Bound<> APIs (#16081)
Thank you to all our contributors for making this release possible!
@MarcoGorelli, @YichiZhang0613, @alexander-beedie, @bertiewooster, @coastalwhite, @dangotbanned, @itamarst, @janpipek, @jrycw, @luke396, @nameexhaustion, @pydanny, @ritchie46, @stinodego, @thalassemia and @tharunsuresh-code
Python Polars 0.20.25
🐞 Bug fixes
- Revert "Add RLE to
RLE_DICTIONARY
encoder" - Improve error handling of
ParameterCollisionError
inread_excel
(#16100)
Thank you to all our contributors for making this release possible!
@nameexhaustion, @ritchie46 and @wsyxbcl
Python Polars 0.20.24
Warning
This release was yanked. Please use the 0.20.25 release instead.
🏆 Highlights
- Support
pytorch
Tensor and Dataset export with newto_torch
DataFrame/Series method (#15931)
🚀 Performance improvements
- Don't traverse deep datasets that we repr as union in CSE (#16096)
- Ensure better chunk sizes (#16071)
✨ Enhancements
- split out rolling_*(..., by='foo') into rolling_*_by('foo', ...) (#16059)
- add date pattern
dd.mm.YYYY
(#16045) - split Expr.top_k and Expr.top_k_by into separate functions (#16041)
- Support non-coalescing joins in default engine (#16036)
- Support
pytorch
Tensor and Dataset export with newto_torch
DataFrame/Series method (#15931) - Minor DB type inference updates (#16030)
- Move diagonal & horizontal concat schema resolving to IR phase (#16034)
- raise more informative error messages in rolling_* aggregations instead of panicking (#15979)
- Convert concat during IR conversion (#16016)
- Improve dynamic supertypes (#16009)
- Additional
uint
datatype support for the SQL interface (#15993) - Add post-optimization callback (#15972)
- Support Decimal read from IPC (#15965)
- Expose plan and expression nodes through
NodeTraverser
to Python (#15776) - Add typed collection from par iterators (#15961)
- Add
by
argument forExpr.top_k
andExpr.bottom_k
(#15468)
🐞 Bug fixes
- Respect user passed 'reader_schema' in 'scan_csv' (#16080)
- Lazy csv + projection; respect null values arg (#16077)
- Materialize dtypes when converting to arrow (#16074)
- Fix casting decimal to decimal for high precision (#16049)
- Fix Series constructor failure for Array types for large integers (#16050)
- Fix printing max scale decimals (#16048)
- Decimal supertype for dyn int (#16046)
- Correctly handle large timedelta objects in Series constructor (#16043)
- Do not close connection just because we're not returning Arrow data in batches (#16031)
- properly handle nulls in DictionaryArray::iter_typed (#16013)
- Fix CSE case where upper plan has no projection (#16011)
- Crash/incorrect group_by/n_unique on categoricals created by (q)cut (#16006)
- converting from numpy datetime64 and overriding dtype with a different resolution was returning incorrect results (#15994)
- Ternary supertype dynamics (#15995)
- Fix PartialEq for DataType::Unknown (#15992)
- Finish adding
typed_lit
to help schema determination in SQL "extract" func (#15955) - Fix dtype parameter in
pandas_to_pyseries
function (#15948) - do not panic when comparing against categorical with incompatible dtype (#15857)
- Join validation for multiple keys (#15947)
- Add missing "truncate_ragged_lines" parameter to
read_csv_batched
(#15944)
📖 Documentation
- Ensure consistent docstring warning in
fill_nan
methods (pointing out thatnan
isn'tnull
) (#16061) - add filter docstring examples to date and datetime (#15996)
- Fix docstring mistake for polars.concat_str (#15937)
- Update reference to
apply
(#15982) - Remove unwanted linebreaks from docstrings (#16002)
- correct default in rolling_* function examples (#16000)
- Improve user-guide doc of UDF (#15923)
- update the link to R API docs (#15973)
🛠️ Other improvements
- Bump
sccache
action (#16088) - Fix failures in test coverage workflow (#16083)
- Update benchmarks/coverage jobs with "requirements-ci" (#16072)
- Add TypeGuard to
is_polars_dtype
util (#16065) - Clean up hypothesis decimal strategy (#16056)
- split Expr.top_k and Expr.top_k_by into separate functions (#16041)
- Use UnionArgs for DSL side (#16017)
- Add some comments (#16008)
- Improve hypothesis strategy for decimals (#16001)
- Set up TPC-H benchmark tests (#15908)
- Even more Pyo3 0.21 Bound<> APIs (#15914)
- Fix failing test (#15936)
Thank you to all our contributors for making this release possible!
@CanglongCl, @JulianCologne, @KDruzhkin, @MarcoGorelli, @alexander-beedie, @avimallu, @bertiewooster, @c-peters, @dependabot, @dependabot[bot], @eitsupi, @haocheng6, @itamarst, @luke396, @marenwestermann, @nameexhaustion, @orlp, @ritchie46, @stinodego, @thalassemia, @wence- and @wsyxbcl
Python Polars 0.20.23
🏆 Highlights
- Add a low-friction
sql
method for DataFrame and LazyFrame (#15783)
🚀 Performance improvements
- Don't rechunk in parallel collection (#15907)
- Improve non-trivial list aggregations (#15888)
- Ensure we hit specialized gather for binary/strings (#15886)
- Limit the cache size for
to_datetime
(#15826) - skip initial null items and don't recompute
slope
ininterpolate
(#15819)
✨ Enhancements
- don't require pyarrow for converting pandas to Polars if all columns have simple numpy-backed datatypes (#15933)
- Add option to disable globbing in csv (#15930)
- Add option to disable globbing in parquet (#15928)
- Expressify
dt.round
(#15861) - Improve error messages in context stack (#15881)
- Add dynamic literals to ensure schema correctness (#15832)
- add timestamp time travel in delta scan/read (#15813)
🐞 Bug fixes
- Set default limit for String column display to 30 and fix edge cases (#15934)
- Change recognition of numba ufunc (#15916)
- series.search_sorted could support more types of input (#15940)
- Remove ffspec from parquet reader (#15927)
- avoid WRITE+EXEC for CPUID check (#15912)
- fix inconsistent decimal formatting (#15457)
- Preserve NULLs for
is_not_nan
(#15889) - double projection check should only take the upstream projections into account (#15901)
- Ensure we don't create invalid frames when combining unit lit + … (#15903)
- Clear cached rename schema (#15902)
- Fix OOB in struct lit/agg aggregation (#15891)
- Refine interaction of "schema_overrides" with
read_excel
when using "calamine" engine (#15827) - Don't modify user-supplied
storage_options
dict (take a shallow-copy) (#15859) - create (q)cut labels in fixed order (#15843)
- Tag
shrink_dtype
as non-streaming (#15828)
📖 Documentation
- improve graphviz install documentation/error message (#15791)
- Extend docstring examples for asof_join (#15810)
📦 Build system
- Don't import jemalloc (#15942)
- Use default allocator for lts-cpu (#15941)
- replace all macos-latest referrals with macos-13 (#15926)
- pin mimalloc and macos-13 (#15925)
- use jemalloc in lts-cpu (#15913)
- Update Cargo.lock (#15865)
- Bump
ruff
version and improvemake clean
on the Python side (#15858) - Exclude
rust-toolchain.toml
from wheels (#15840)
🛠️ Other improvements
- Replace copy/paste import handling with
import_optional
utility function (#15906) - Reorganize from_iter and dispatch to collect_ca when possible (#15904)
- More PyO3 0.21 bound APIs (#15872)
- Improve type-coercion (#15879)
- Move type coercion to IR conversion phase (#15868)
- Fix Python test coverage upload (#15853)
- More upgrades to PyO3 0.21 Bound<> APIs (#15790)
- Use uv for installing Python dependencies in CI (#15848)
- Update benchmark tests (#15825)
Thank you to all our contributors for making this release possible!
@JulianCologne, @MarcoGorelli, @NedJWestern, @NexVeridian, @alexander-beedie, @deanm0000, @dependabot, @dependabot[bot], @ion-elgreco, @itamarst, @jr200, @nameexhaustion, @orlp, @reswqa, @ritchie46 and @stinodego
Python Polars 0.20.22
🚀 Performance improvements
- Improved type-inference for
read_excel
andread_ods
, use calamine engine forread_ods
(#15808) - Fix quadratic in binview growable same source (#15734)
- use two binary searches for equality mask when data is sorted (#15702)
- improve filter parallelism (#15686)
✨ Enhancements
- Minor type-inference update for
read_database
(#15809) - Improved type-inference for
read_excel
andread_ods
, use calamine engine forread_ods
(#15808) dt.truncate
supports broadcasting lhs (#15768)- Expressify
str.json_path_match
(#15764) - raise if
storage_options
is passed to read_csv butfsspec
isnt available (#15778) - Support decimal float parsing in CSV (#15774)
- Add context trace to
LazyFrame
conversion errors (#15761) - Improve error message when passing invalid input to
lit
(#15718) - Remove outdated join validation checks (#15701)
🐞 Bug fixes
- drop-nulls edge case; remove drop-nulls special case (#15815)
- ewm_mean_by was skipping initial nulls when it was already sorted by "by" column (#15812)
- Consult cgroups to determine free memory (#15798)
- raise if index count like 2i is used when performing rolling, group_by_dynamic, upsample, or other temporal operatios (#15751)
- Don't deduplicate sort that has slice pushdown (#15784)
- Allow passing files opened by fsspec in
read_parquet
(#15770) - Fix incorrect
is_between
pushdown toscan_pyarrow_dataset
(#15769) - Handle null index correctly for list take (#15737)
- Preserve lexical ordering on concat (#15753)
- Remove incorrect unsafe pointer cast for int -> enum (#15740)
- pass series name to apply for cut/qcut (#15715)
- count of null column shouldn't panic in agg context (#15710)
- manual cache (#15711)
- Ensure we don't hold onto Mutex when grabbing join tuples (#15704)
- allow null dtypes in UDFs if they match the schema (#15699)
- Respect join_null argument for semi/anti joins (#15696)
- Ensure we don't hold RwLock when spawning group parallelism in w… (#15697)
- Ensure empty with_columns is a no-op (#15694)
- Include predicate in cache state union (#15693)
- Add the missing feature flag for
ewm_mean_by
(#15687) - 8/16-bits int could also apply in place for log expr (#15680)
prepare_expression_for_context
shouldn't panic if exceptions raised from optimizer (#15681)
📖 Documentation
- Add docstring examples for datetimes (#13161) (#15804)
- Fix a typo in categorical section of the user guide (#15777)
- Fix a docstring mistake for DataType.is_float (#15773)
- Remove incorrect "1i (1 index count)" from some docs methods (#15750)
- Add example for
Config.set_tbl_width_chars
(#15566) - Align docstring phrasing in
Series/Expr.dt.truncate/round
(#15698) - Various deprecation docstring improvements (#15648)
🛠️ Other improvements
- Always expand horizontal_any/all (#15816)
- Rename decimal_float to decimal_comma (#15817)
- Split coverage calculation (#15780)
- Update readme (#15787)
- Start at using new Bound<> API from PyO3 (#15752)
- Make
json_path_match
expr non-anonymous (#15682)
Thank you to all our contributors for making this release possible!
@MarcoGorelli, @NedJWestern, @Robinsane, @TobiasDummschat, @alexander-beedie, @c-peters, @dependabot, @dependabot[bot], @gasmith, @henryharbeck, @itamarst, @kszlim, @mbuhidar, @nameexhaustion, @orlp, @reswqa, @ritchie46, @stinodego and @wsyxbcl
Rust Polars 0.39.2
🚀 Performance improvements
- use two binary searches for equality mask when data is sorted (#15702)
- improve filter parallelism (#15686)
✨ Enhancements
- Remove outdated join validation checks (#15701)
🐞 Bug fixes
- manual cache (#15711)
- Ensure we don't hold onto Mutex when grabbing join tuples (#15704)
- allow null dtypes in UDFs if they match the schema (#15699)
- Respect join_null argument for semi/anti joins (#15696)
- Ensure we don't hold RwLock when spawning group parallelism in w… (#15697)
- Ensure empty with_columns is a no-op (#15694)
- Include predicate in cache state union (#15693)
- Add the missing feature flag for
ewm_mean_by
(#15687) - 8/16-bits int could also apply in place for log expr (#15680)
prepare_expression_for_context
shouldn't panic if exceptions raised from optimizer (#15681)
🛠️ Other improvements
- Make
json_path_match
expr non-anonymous (#15682)
Thank you to all our contributors for making this release possible!
@henryharbeck, @kszlim, @orlp, @reswqa and @ritchie46
Python Polars 0.20.22-rc.1
🚀 Performance improvements
- improve filter parallelism (#15686)
🐞 Bug fixes
- Add the missing feature flag for
ewm_mean_by
(#15687) - 8/16-bits int could also apply in place for log expr (#15680)
prepare_expression_for_context
shouldn't panic if exceptions raised from optimizer (#15681)
📖 Documentation
- Various deprecation docstring improvements (#15648)
🛠️ Other improvements
- Make
json_path_match
expr non-anonymous (#15682)
Thank you to all our contributors for making this release possible!
@henryharbeck, @reswqa and @ritchie46
Rust Polars 0.39.1
🚀 Performance improvements
- Fix regression that led to using only a single thread (#15667)
✨ Enhancements
- add ewm_mean_by (#15638)
🐞 Bug fixes
- Ensure profile of simple-projection only take own runtime (#15671)
- Panic if invalid array in object (#15664)
- Ensure 'CachedSchema' doesn't get synced between plans (#15661)
group_by
multiple null columns produce phantom row (#15659)- rolling_* aggs were behaving as if they return scalars in group-by (#15657)
- Correct the unsoundness slice range of
arr.min/max
(#15654) list.mean
fast path shouldn't produce NaN (#15652)- Fix Display implementation of Duration (#15647)
📖 Documentation
🛠️ Other improvements
- Remove the remaining usage of deprecated
numpy
crate APIs (#15668) - make Duration.is_constant_duration less strict for non-timezone-aware case (#15639)
- Fix some typos in comments (#15665)
- remove unnecessary unsafe in list mean/sum (#15660)
Thank you to all our contributors for making this release possible!
@MarcoGorelli, @Priyansh4444, @StevenMia, @itamarst, @mcrumiller, @orlp, @reswqa, @ritchie46 and @stinodego
Python Polars 0.20.21
🚀 Performance improvements
- Fix regression that led to using only a single thread (#15667)
✨ Enhancements
- add ewm_mean_by (#15638)
🐞 Bug fixes
- Ensure profile of simple-projection only take own runtime (#15671)
- Panic if invalid array in object (#15664)
- Ensure 'CachedSchema' doesn't get synced between plans (#15661)
group_by
multiple null columns produce phantom row (#15659)- rolling_* aggs were behaving as if they return scalars in group-by (#15657)
- Correct the unsoundness slice range of
arr.min/max
(#15654) list.mean
fast path shouldn't produce NaN (#15652)
📖 Documentation
- Add missing deprecation warning to
DataFrame.replace
(#15612) - Fix typo in legacy install instructions (#15662)
🛠️ Other improvements
- make Duration.is_constant_duration less strict for non-timezone-aware case (#15639)
- Fix some typos in comments (#15665)
- remove unnecessary unsafe in list mean/sum (#15660)
- fixup failing test due to
offset
deprecation inupsample
(#15636)
Thank you to all our contributors for making this release possible!
@MarcoGorelli, @Priyansh4444, @StevenMia, @eitsupi, @itamarst, @mcrumiller, @orlp, @reswqa, @ritchie46 and @stinodego
Rust Polars 0.39.0
🏆 Highlights
- Full plan CSE (#15264)
💥 Breaking changes
- rename
memmap
->memory_map
as like Python (#15642) - pref(rust!, python): Unify
sort
withSortOptions
andSortMultipleOptions
(#15590) - Update the argument name from
dims
todimensions
inreshape
(#15561) - Allow specifying Hive schema in
read/scan_parquet
(#15434) - Raise error when
schema_overrides
contains nonexistent column name (#15290) - Rename
Chunk
toRecordBatch
(#15298) - Refactor AnyValue supertype logic (#15280)
- Rename
group_by_rolling
torolling
and improve related error messages (#14765) - Rename
ChunkedArray.try_apply
totry_apply_values
(#14947) - Rename parameter
by
togroup_by
inDataFrame.upsample/group_by_dynamic/rolling
(#14840)
🚀 Performance improvements
- Fix cross join batch size when one of the DataFrames is tiny (#14347)
- Fix binview growable complexity O(n*m) -> O(n) (#15628)
- Remove extra thread spawn from row group fetcher (#15626)
- Use vertical parallelism if input is chunked for
Filter
,Select
,WithColumns
(#15608) - read_ipc memory usage tests, and writing fix (#15599)
- Refactor CSV serialization to not go thorough
AnyValue
(#15576) - don't use dynamic dispatch in visitors (#15607)
- Improve Bitmap construction performance (#15570)
- join by row-encoding (#15559)
- Replace std::thread spawn with tokio block_in_place (#15517)
- speed up offset_by when a single offset is passed (#15493)
- Avoid allocation in the hot path for struct JSON serialization (#15449)
- avoid double-allocation in rolling_apply_agg_window (#15423)
- Make LogicalPlan immutable (#15416)
- Add non-order preserving variable row-encoding (#15414)
- Use row-encoding for multiple key group by (#15392)
- load bits one word at a time for BitmapIter (#15333)
- Ipc exec multiple paths (#15040)
- add SIMD support for if-then-else kernels (#15131)
✨ Enhancements
- add Expr.dt.add_business_days and Series.dt.add_business_days (#15595)
- Add
str.head
andstr.tail
(#14425) - Extended
BytecodeParser
to handle additional math functions, and imports from the global namespace (#15627) - Push down
is_between
expressions to Arrow (#15180) - add holidays argument to business_day_count (#15580)
- change default to write parquet statistics (#15597)
- Expressify
to_integer
(#15604) - Optimizer; remove double SORT and redundant projections (#15573)
- Add
null_on_oob
parameter toexpr.array.get
(#15426) - support weekend argument in business_day_count (#15544)
- Enable
is_first/last_distinct
for not nested non-numeric list (#15552) - Turn off cse if cache node found (#15554)
- Tag concat list as elementwise (#15545)
- Support list group-by of non numeric lists (#15540)
- add business_day_count function (#15512)
- Add SQL support for
MEDIAN
aggfunc (#15519) - Implement
string
,boolean
andbinary
dtype intop_k
(#15488) - Add SQL support for
TRUNCATE TABLE
command (#15513) - Add SQL support for
GREATEST
andLEAST
(#15511) - Allow specifying Hive schema in
read/scan_parquet
(#15434) - Implements
agg_list
forNullChunked
(#15439) - Supports
explode_by_offsets
for decimal (#15417) - Add
null_on_oob
parameter toexpr.list.get
(#15395) - CSV-writer escape carriage return (#15399)
- Remove 'FileCacher' optimization (#15357)
- check input type in entropy (#15351)
- Implements
arr.n_unique
(#15296) - CSE don't scan share if predicate pushdown predicates don't match (#15328)
- Remove cached nodes when finished (#15310)
- Full plan CSE (#15264)
- Add IR for expressions. (#15168)
- Warn if
map_elements
is called withoutreturn_dtype
specified (#15188) - Rename
group_by_rolling
torolling
and improve related error messages (#14765) - Rename
ChunkedArray.try_apply
totry_apply_values
(#14947) - Implement strict AnyValue construction for temporal types (#15146)
🐞 Bug fixes
- Return appropriate data type for time
mean
andmedian
(#14471) - Support index upsampling (#13621)
- Fix issue in
write_excel
that could lead to incorrect spanning range determination (#15631) - Output correct dtype for
mean_horizontal
on a single column (#15118) - Recompute RowIndex schema after projection pd (#15625)
- Mean of boolean in streaming group_by incorrectly always gave NULL (#15616)
- Include cloud creds in cache key (#15609)
- Fix elementwise-apply if any input is
AggregatedScalar
(#15606) - Explode list should take validity into account (#15572)
- use larger recursive stack in debug mode (#15593)
- SQL interface "off-by-one' indexing error with
GROUP BY
clauses that use position ordinals (#15584) - Enable missing features in polars-time (#15558)
- Handle quoted identifiers when registering CTEs in the SQL engine (#15564)
- Decompress moved out of schema initialization (#15550)
- Turn off cse if cache node found (#15554)
- Resolve function names and prune all aliases. (#15522)
list.get
should take validity into account (#15516)- block decimal in streaming (#15520)
group_by
partitioned with literalSeries
panic (#15487)- Initialize validity for
GroupsProxy::Slice
windows (#15509) - Fix struct name resolving (#15507)
pow
return type evaluation (#15506)- Allow selectors inside frame-level
.filter()
(#15445) - Don't prune alias in AnonymousFunction subtree (#15453)
- Fix deadlock in async parquet scan (#15440)
- datetime operations (e.g. .dt.year) were raising when null values were backed by out-of-range integers (#15420)
- Ensure Binary -> Binview cast doesn't overflow the buffer size (#15408)
- Don't prune alias in function subtree (#15406)
- Return 0 for
n_unique()
in group-by context when group is empty (#15289) - Unset UpdateGroups after group-sensitive expression (#15400)
to_any_value
should supports all LiteralValue type (#15387)- Hash failure combining hash of two numeric columns containing equal values (#15397)
- Add FixedSizeBinary to arrow field conversion (#15389)
- Conversion of expr_ir in partition fast path (#15388)
sort
for series with unsupported dtype should raise instead of panic (#15385)- Return correct dtype for
s.clear()
when dtype isObject
(#15315) - ensure first datapoint is always included in group_by_dynamic (#15312)
- Non-exhaustive patterns: arrow-schema::DataType in polars-arrow (#15250)
- use dynamic stacks for problematic recursive functions (#15355)
- Raise error when
schema_overrides
contains nonexistent column name (#15290) - Fix cache dot visualization (#15311)
- Properly propagate
strict
flag when constructing a Struct Series from any values (#15302) - ensure
eq
forBinaryViewArray
checks all elements (#15268) - Raise when join projects name with suffix that doesn't exist (#15256)
- fix kurtosis/skew (#15137)
- Ensure ooc_start is set (#15255)
- Fix bug where rolling operations were ignoring
check_sorted
in some cases (#15227) - Fix lazy schema for
rle
expression (#15248) - incorrect negative offset in multi-byte string slicing (#15140)
- do not clamp negative offsets to start of array prematurely (#15242)
- allow null index in list.get and array.get (#15239)
- properly support nulls_last + descending (#15212)
- Block rounding/truncating to negative durations (#15175)
- Make parse_url work on windows with object_store (#15191)
- divide by zero in download speed computation (#15182)
📖 Documentation
- Add legacy CPU install instructions in user guide (#13676)
- Various minor updates to User Guide's SQL intro section (#15557)
- Add
outer_coalesce
join strategy in the user guide (#15405) - Improve docs for
Series::new
withAnyValue
input (#15306) - Fix formatting in
Series::from_any_values_and_dtype
docs (#15244) - Correct the definition of an expression in the user guide (#14750)
📦 Build system
🛠️ Other improvements
- rename
memmap
->memory_map
as like Python (#15642) - fixup failing test due to
offset
deprecation inupsample
(#15636) - use bound api (#15630)
- Don't run streaming group-by in partitionable gb (#15611)
- pref(rust!, python): Unify
sort
withSortOptions
andSortMultipleOptions
(#15590) - remove try_binary_elementwise_values (#15592)
- remove raw pointers from visitors. (#15579)
- rename to IR (#15571)
- Update the argument name from
dims
todimensions
inreshape
(#15561) - Rename ALogicalPlan to FullAccessIR (#15553)
- Set up CodSpeed (#15537)
- make dsl immutable and cheap to clone (#15394)
- use recursive crate, add missing recursive tag (#15393)
- Update CODEOWNERS (polars-sql) (#15384)
- Update Rust toolchain (#15353)
- Update CODEOWNERS (#15352)
- remove try_apply_values (#15336)
- always use non-legacy float_sum for mean (#15343)
- remove legacy bitmap module (#15335)
- More clippy in Makefile (#15340)
- Rename
Cache[count]
toCache[cache_hits]
(#15300) - Cleanup file_caching optimization call (#15299)
- Rename
Chunk
toRecordBatch
(#15298) - Refactor AnyValue supertype logic (#15280)
- reuse message parsing in IPC (#15265)
- remove 'fast-projection' node (#15253)
- cleanup column names in optimizer (#15252)
- remove left_most_input_name from expr ir (#15251)
- add AlignedBitmapSlice (#15171)
- Refactor AnyValue construction for Categorical/Enum dtype (#15220)
- Move ConsecutiveCountState into support module (#15186)
- Run non-benchmark tests in benchmark workflow (#15207)
- Add
wrapping_abs
to arithmetic kernel (#15210) - remove raw buffers from BinViewArray (#15206)
- Enable
RUST_BACKTRACE=1
in the CI test suite (#15204) - Rename parameter
by
togroup_by
inDataFrame.upsample/group_by_dynamic/rolling
(#14840) - Set dual license for
polars-arrow
andpolars-parquet
(#15173)
...