Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Additional methods and fixes to DataFrameMixin #43

Merged
merged 43 commits into from
Aug 1, 2024
Merged

Additional methods and fixes to DataFrameMixin #43

merged 43 commits into from
Aug 1, 2024

Conversation

adamamer20
Copy link
Collaborator

This PR adds some useful methods to DataFrameMixin and fixes the logic of some methods in pandas and polars.
Added methods:

  • remove: remove values from DF based on a mask
  • add: equivalent of df.add from pandas
  • all: equivalent of df.all from pandas
  • column_names
  • div: equivalent of df.div from pandas
  • drop_columns
  • drop_duplicates
  • filter: remove values with a boolean dataframe
  • groupby_cum_count: equivalent of df.group_by.cum_count from pandas
  • join: equivalent of df.join from pandas
  • mul: equivalent of df.mul from pandas
  • norm: obtain a series with the L2 norm per every row in the DF
  • reset_index: equivalent of df.reset_index in pandas
  • set_index: equivalent of df.set_index in pandas
  • with_columns: equivalent of df.with_columns in polars
  • contains: equivalent to srs.contains in pandas
  • range: get the series of a specified range (start, end, step)
  • srs_to_df: convert series to DF

@adamamer20
adding __repr__ and __str__ to DiscreteDF
24ce034
@adamamer20
implement random_pos in DiscreteSpaceDF
f3d5201
@adamamer20
Changing set_cells docstring
6e86635
@adamamer20
adding _df_columns to mixin
ff812c9
@adamamer20
add _df_column_names
8b049ee
@adamamer20
- move capacity to DiscreteSpaceDF
c2218c6 
- create set_cells at DiscreteSpaceDF level
@adamamer20
adding _contains to mixin, changed _add_columns to _with_columns
6436186
@adamamer20
- moved column names to SpaceDF
0777041 
- created concrete swap in SpaceDF
- update due to changes in mixin
@adamamer20
add _srs_range
3e3f457
@adamamer20
add _df_join to mixin
00a5e1a
@adamamer20
adding "cross" option to _df_join
dee33f5
@adamamer20
adding _df_filter_ to mixin
fe2abfb
@adamamer20
add _df_rename_columns to DataFrameMixin
e47742c
@adamamer20
adding get_neighborhood to GridDF
365b240
@adamamer20
- remove _place_agents_df and move it to move_agents
16dfd5d 
- add remaining capacity property
- branching _update_capacity in cells and agents
@adamamer20
fix move update capacity first
49e5617
@adamamer20
pandas implementation
de5aaf6
@adamamer20
move pandas, polars tests to their folders
6d185f4
@adamamer20
adding GridPandas to __init__
46500a7
@adamamer20
adding remaining capacity
12bae83
@adamamer20
reorder mixin
00cb4be
@adamamer20
adding mixin_test for pandas
71281cf
@adamamer20
fixes to abstract DataFrameMixin syntax
0363e67
@adamamer20
updates to types
d26404e
@adamamer20
renamed files for pytest
1794388
@adamamer20
adding typeguard to mixin
499e4e2
@adamamer20
added series concatenation to DataFrameMixin
3943365
@adamamer20
adding place_agents
fd1b5f1
@adamamer20
renaming test_agentsets (for pytest compatibility)
91bc4aa
@adamamer20
added index as abstract property and changed inactive_agents mismatch…
96307e6 
…ed return type
@adamamer20
- changed index_col to index_cols across methods
b33d083 
- added some useful method (add, all, div, drop_columns, drop_duplicates, group_by_cum_count, mul, norm, reset_index, set_index, srs_to_df)
- minor fixes
@adamamer20
- new methods in PandasMixin based on additions to DataFrameMixin
5c07e53 
- fixes to the logic of some methods
@adamamer20
- Distinction between place and move: the first raises Warning if age…
b43449c 
…nts are already present, the second if agents aren't already present

- Fixes to the logic of some methods of SpaceDF (random_agents, swap_agents),
DiscreteSpaceDF (__repr__, __str__)
GridDF (__init__, get_directions, get_distances, get_neighbors, get_neighborhood, get_cells, out_of_bounds, remove_agents, torus_adj, _compute_offsets, _get_df_coords)
@adamamer20
addition of the new methods to PolarsMixin according to the new abstr…
054ebf9 
…act DataFrameMixin
@adamamer20
- added index property to AgentsDF
7e5bca4
@adamamer20
- specified _copy_with_method attribute for fast copy through CopyMixin
e6e8f2a 
- added custom _empty_cell_condition
- fixed the logic of some methods (_generate_empty_grid, _sample_cells, _update_capacity_agents, remaining_capacity)
@adamamer20
added tests for GridPandas
2b181e7
@adamamer20
Merge branch 'main' of https://github.com/adamamer20/mesa-frames into…
34a6368 
… 34-concrete-gridpandas
@adamamer20
Merge branch 'main' of https://github.com/adamamer20/mesa-frames into…
2a2284e 
… 34-concrete-gridpandas
@adamamer20
Merge branch 'main' of https://github.com/adamamer20/mesa-frames into…
b166d66 
… 34-concrete-gridpandas
@adamamer20
test_mixin_pandas will be added with it's own PR
5106501
@adamamer20
moved test_space_pandas to pandas test folder and changed named to te…
e90cacd 
…st_grid_pandas
@adamamer20
Revert space files to main/origin (will have their own PR)
02b3ab4
@adamamer20 adamamer20 self-assigned this Aug 1, 2024
@adamamer20 adamamer20 added the enhancement Improvements to existing features or performance. label Aug 1, 2024
@adamamer20 adamamer20 mentioned this pull request Aug 1, 2024
Merged
@adamamer20 adamamer20 requested a review from rht August 1, 2024 19:27
@adamamer20 adamamer20 added this to the 0.1.0 Alpha Release milestone Aug 1, 2024
@rht
Copy link
Contributor

rht commented Aug 1, 2024

Tangent: it seems to me it could be its useful own package for a general DF with either pandas or Polars backend. Useful for people who can't decide which one to use, like us, haha. Otherwise, to add a selling point, we could implement R's dplyr-style grammar of data manipulation. Though there is already https://github.com/machow/siuba.

@rht rht merged commit 43f3baa into main Aug 1, 2024
6 checks passed
@rht rht deleted the addition-and-fixes-to-DataFrameMixin branch August 1, 2024 20:04
@adamamer20
Copy link
Collaborator Author

Agree! A separate package with a unique interface for any DF library could be worthwile, especially since there are methods which are almost the same with only a name change. However right now I wrote up just the methods I needed so far. We can think about it when the library is a bit more mature.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@rht rht rht approved these changes

Assignees

@adamamer20 adamamer20

Labels
enhancement Improvements to existing features or performance.
Projects
None yet
Milestone
0.1.0 Alpha Release
Development

Successfully merging this pull request may close these issues.
2 participants
@adamamer20 @rht