Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Virtual Component Groups filtered by completion IDs #3570

Merged
merged 63 commits into from
Jul 22, 2022
Merged
Show file tree
Hide file tree
Changes from 61 commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
b8727f7
WIP todo
akavel Jul 7, 2022
07c0d71
WIP add components_by_id field
akavel Jul 7, 2022
b60c77d
WIP another TODO
akavel Jul 7, 2022
50d9f27
WIP store component IDs
akavel Jul 7, 2022
ee4d725
WIP filtered_favorites()
akavel Jul 7, 2022
82aab62
WIP filter_favorites()
akavel Jul 7, 2022
6d3dfde
CLEANUP some comments
akavel Jul 7, 2022
254fd0e
sketch of test
akavel Jul 7, 2022
61933fa
add test
akavel Jul 7, 2022
d078009
cargo fmt
akavel Jul 7, 2022
226f18a
retain_components_by_id
akavel Jul 7, 2022
760b54a
retain_favorites_with_ids_passed_to_extend
akavel Jul 7, 2022
cc63b02
CLEANUP a comment
akavel Jul 7, 2022
13fab9b
renames in test
akavel Jul 7, 2022
964c654
tweak comment
akavel Jul 7, 2022
ab8f406
add test case in wasm test
akavel Jul 7, 2022
998ad8b
fix clippy
akavel Jul 7, 2022
e74d211
tweak comment
akavel Jul 11, 2022
fcd8942
better test + docs
akavel Jul 11, 2022
72e3828
Merge remote-tracking branch 'origin/develop' into wip/akavel/filter-…
akavel Jul 14, 2022
9b60a90
DEBUG
akavel Jul 13, 2022
8282b15
WIP set_initial_entries_order
akavel Jul 13, 2022
5961b13
WIP matched_items
akavel Jul 13, 2022
5c0f2ed
Revert "DEBUG"
akavel Jul 13, 2022
70f9352
WIP with_initial_entries_order_filtered
akavel Jul 14, 2022
c64022f
cleanup & fmt
akavel Jul 14, 2022
edddc81
rename with_... func
akavel Jul 14, 2022
2e28fd3
WIP doc for with_...
akavel Jul 14, 2022
bfedb83
doc for with_...
akavel Jul 14, 2022
c59c6a9
review: improve docs
akavel Jul 14, 2022
fafff46
tweak doc
akavel Jul 14, 2022
62ebf9b
When building...
akavel Jul 14, 2022
d7299c3
fix layoing
akavel Jul 14, 2022
e2450bf
link component group in docs
akavel Jul 14, 2022
ea97bbb
cargo fmt
akavel Jul 14, 2022
6e93a34
review: WIP set_favorites -> set_structure_of_favorites
akavel Jul 20, 2022
732b343
review: WIP rename extend to extend_list_and_enable_matching_favorites
akavel Jul 20, 2022
a41e095
review: WIP favorites_structure, favorites_to_enable
akavel Jul 20, 2022
ee5d332
WIP add favs to all_components only when building
akavel Jul 20, 2022
9130830
WIP build_favorites_and_add_to_all_components
akavel Jul 20, 2022
0212860
WIP further rename in build_favs...
akavel Jul 20, 2022
4ae4fea
WIP rename set_grouping_and_order_of_favs
akavel Jul 20, 2022
e21eb89
WIP start writing module doc
akavel Jul 20, 2022
52233b1
Groups...by name
akavel Jul 20, 2022
a0451f1
Components in each Group are ordered...
akavel Jul 20, 2022
72a75b5
field grouping_and_order_of_favorites
akavel Jul 20, 2022
34daefc
rename extend_list_and_enable_favs_with_ids
akavel Jul 20, 2022
1838258
WIP more module docs
akavel Jul 20, 2022
358113e
WIP cleanup docs step 1
akavel Jul 20, 2022
fa7e5d7
tweak doc to explain purpose of builder
akavel Jul 20, 2022
a6e0de3
move and doc favorites_to_enable
akavel Jul 20, 2022
7379f7c
allowed_favorites
akavel Jul 20, 2022
2728721
extend_list_and_allow_...
akavel Jul 20, 2022
d5efc8a
shorten List doc + update extend_... doc
akavel Jul 20, 2022
e16fc70
shorten doc of build() and mention empty groups in module doc
akavel Jul 20, 2022
3de3d8a
WIP retain_entries
akavel Jul 20, 2022
ddb1e7d
Group::retain_entries
akavel Jul 20, 2022
7aceafa
tweak method docs to not mention other methods
akavel Jul 20, 2022
6c241ea
cargo fmt
akavel Jul 20, 2022
d7495db
WIP tweaking build_favorites...
akavel Jul 20, 2022
547be3b
shorten & cleanup build_favorites_...
akavel Jul 20, 2022
79afbd7
Merge branch 'develop' into wip/akavel/filter-favs-by-this-182661634
mergify[bot] Jul 21, 2022
4177173
Merge branch 'develop' into wip/akavel/filter-favs-by-this-182661634
mergify[bot] Jul 21, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 12 additions & 6 deletions app/gui/src/controller/searcher.rs
Original file line number Diff line number Diff line change
Expand Up @@ -1043,7 +1043,7 @@ impl Searcher {
entry_ids: impl IntoIterator<Item = suggestion_database::entry::Id>,
) -> component::List {
let mut builder = self.list_builder_with_favorites.deref().clone();
builder.extend(&self.database, entry_ids);
builder.extend_list_and_allow_favorites_with_ids(&self.database, entry_ids);
builder.build()
}

Expand Down Expand Up @@ -1187,7 +1187,7 @@ fn component_list_builder_with_favorites<'a>(
if let Some((id, _)) = suggestion_db.lookup_by_qualified_name(local_scope_module) {
builder = builder.with_local_scope_module_id(id);
}
builder.set_favorites(suggestion_db, groups);
builder.set_grouping_and_order_of_favorites(suggestion_db, groups);
builder
}

Expand Down Expand Up @@ -1788,10 +1788,16 @@ pub mod test {
name: "Test Group 1".to_string(),
color: None,
icon: None,
exports: vec![language_server::LibraryComponent {
name: module_qualified_name + ".testFunction1",
shortcut: None,
}],
exports: vec![
language_server::LibraryComponent {
name: module_qualified_name.clone() + ".testFunction1",
shortcut: None,
},
language_server::LibraryComponent {
name: module_qualified_name + ".testMethod1",
shortcut: None,
},
],
};
// Create a test fixture with mocked Engine responses.
let Fixture { mut test, searcher, entry1, entry9, .. } =
Expand Down
6 changes: 3 additions & 3 deletions app/gui/src/controller/searcher/component.rs
Original file line number Diff line number Diff line change
Expand Up @@ -400,8 +400,8 @@ pub(crate) mod tests {
}
let favorites = mock_favorites(&suggestion_db, &[3, 2]);
let mut builder = builder::List::new().with_local_scope_module_id(0);
builder.set_favorites(&suggestion_db, &favorites);
builder.extend(&suggestion_db, 0..4);
builder.set_grouping_and_order_of_favorites(&suggestion_db, &favorites);
builder.extend_list_and_allow_favorites_with_ids(&suggestion_db, 0..4);
let list = builder.build();

list.update_filtering("fu");
Expand Down Expand Up @@ -446,7 +446,7 @@ pub(crate) mod tests {
let logger = Logger::new("test::component_list_modules_tree");
let suggestion_db = mock_suggestion_db(logger);
let mut builder = builder::List::new().with_local_scope_module_id(0);
builder.extend(&suggestion_db, 0..11);
builder.extend_list_and_allow_favorites_with_ids(&suggestion_db, 0..11);
let list = builder.build();

// Verify that we can read all top-level modules from the component list.
Expand Down
144 changes: 114 additions & 30 deletions app/gui/src/controller/searcher/component/builder.rs
Original file line number Diff line number Diff line change
@@ -1,4 +1,21 @@
//! A module with entities used for building proper [`component::List`].
//!
//! The [`List`] type builds a [`component::List`] with contents sorted as described below:
//! - [`component::Group`]s are sorted alphabetically by name;
//! - [`Component`]s in each [`component::Group`] are ordered: non-modules sorted alphabetically,
//! followed by modules sorted alphabetically;
//! - [`Component`]s and [`component::Group`]s in [`component::List::favorites`] keep the grouping
//! and order set with [`List::set_grouping_and_order_of_favorites`].
//!
//! When using the methods of the [`List`] type to build a [`component::List`]:
//! - The components and groups are sorted once.
//! - The [`component::List::favorites`] contain only components with IDs that were passed both to
//! [`List::set_grouping_and_order_of_favorites`] and to
//! [`List::extend_list_and_allow_favorites_with_ids`].
//! - Empty component groups are allowed in favorites. (This simplifies distributing groups of
//! favorites over columns in [Component Browser](crate::controller::Searcher) consistently.
//! That's because for the same input to [`List::set_grouping_and_order_of_favorites`], the same
//! number of groups will be always present in favorites.)

use crate::prelude::*;

Expand Down Expand Up @@ -59,16 +76,16 @@ impl ModuleGroups {
// === List ===
// ============

/// A [`component::List`] builder.
///
/// The builder allow extending the list with new entries, and build a list with properly sorted
/// groups.
/// A [`component::List`] builder. See the documentation of the module for more details.
#[derive(Clone, Debug, Default)]
pub struct List {
all_components: Vec<Component>,
module_groups: HashMap<component::Id, ModuleGroups>,
local_scope: component::Group,
favorites: component::group::List,
all_components: Vec<Component>,
module_groups: HashMap<component::Id, ModuleGroups>,
local_scope: component::Group,
grouping_and_order_of_favorites: component::group::List,
/// IDs of [`Component`]s allowed in [`component::List::favorites`] if they are also present in
/// [`grouping_and_order_of_favorites`].
allowed_favorites: HashSet<component::Id>,
}

impl List {
Expand All @@ -78,18 +95,20 @@ impl List {
}

/// Return [`List`] with a new [`local_scope`] with its [`Group::component_id`] field set to
/// `module_id`. When the [`extend`] method is called on the returned object, components passed
/// to the method which have their parent module ID equal to `module_id` will be cloned into
/// [`component::List::local_scope`].
/// `module_id`. When the [`extend_list_and_allow_favorites_with_ids`] method is called on the
/// returned object, components passed to the method which have their parent module ID equal
/// to `module_id` will be cloned into [`component::List::local_scope`].
pub fn with_local_scope_module_id(self, module_id: component::Id) -> Self {
const LOCAL_SCOPE_GROUP_NAME: &str = "Local Scope";
let id = Some(module_id);
let local_scope = component::Group::from_name_and_id(LOCAL_SCOPE_GROUP_NAME, id);
Self { local_scope, ..self }
}

/// Extend the list with new entries looked up by ID in suggestion database.
pub fn extend(
/// Extend the list with new entries looked up by ID in suggestion database. Allow those
/// entries to be present in [`component::List::favorites`]. See the module documentation for
/// more details.
pub fn extend_list_and_allow_favorites_with_ids(
&mut self,
db: &model::SuggestionDatabase,
entries: impl IntoIterator<Item = component::Id>,
Expand All @@ -99,6 +118,7 @@ impl List {
let lookup_component_by_id = |id| Some(Component::new(id, db.lookup(id).ok()?));
let components = entries.into_iter().filter_map(lookup_component_by_id);
for component in components {
self.allowed_favorites.insert(*component.id);
let mut component_inserted_somewhere = false;
if let Some(parent_module) = component.suggestion.parent_module() {
if let Some(parent_group) = self.lookup_module_group(db, &parent_module) {
Expand All @@ -124,19 +144,17 @@ impl List {
}
}

/// Set the favorites in the list. Components are looked up by ID in the suggestion database.
pub fn set_favorites<'a>(
/// Set the grouping and order of [`Components`] in [`component::List::favorites`]. Skips
/// components not present in the suggestion database and skips empty groups.
pub fn set_grouping_and_order_of_favorites<'a>(
&mut self,
db: &model::SuggestionDatabase,
component_groups: impl IntoIterator<Item = &'a execution_context::ComponentGroup>,
) {
self.favorites = component_groups
self.grouping_and_order_of_favorites = component_groups
.into_iter()
.filter_map(|g| component::Group::from_execution_context_component_group(g, db))
.collect();
for group in &*self.favorites {
self.all_components.extend(group.entries.borrow().iter().cloned());
}
}

fn lookup_module_group(
Expand Down Expand Up @@ -164,9 +182,8 @@ impl List {
}
}

/// Build the list, sorting all group lists and groups' contents appropriately. (Does not sort
/// the [`component::List::favorites`].)
pub fn build(self) -> component::List {
/// Build the list as described in the module's documentation.
pub fn build(mut self) -> component::List {
let components_order = component::Order::ByNameNonModulesThenModules;
for group in self.module_groups.values() {
group.content.update_sorting(components_order);
Expand All @@ -180,17 +197,28 @@ impl List {
top_mdl_bld.extend(top_modules_iter.clone().map(|g| g.content.clone_ref()));
let mut top_mdl_flat_bld = component::group::AlphabeticalListBuilder::default();
top_mdl_flat_bld.extend(top_modules_iter.filter_map(|g| g.flattened_content.clone()));
let favorites = self.build_favorites_and_add_to_all_components();
component::List {
all_components: Rc::new(self.all_components),
top_modules: top_mdl_bld.build(),
all_components: Rc::new(self.all_components),
top_modules: top_mdl_bld.build(),
top_modules_flattened: top_mdl_flat_bld.build(),
module_groups: Rc::new(
module_groups: Rc::new(
self.module_groups.into_iter().map(|(id, group)| (id, group.build())).collect(),
),
local_scope: self.local_scope,
filtered: default(),
favorites: self.favorites,
local_scope: self.local_scope,
filtered: default(),
favorites,
}
}

fn build_favorites_and_add_to_all_components(&mut self) -> component::group::List {
let grouping_and_order = std::mem::take(&mut self.grouping_and_order_of_favorites);
let mut favorites_groups = grouping_and_order.into_iter().collect_vec();
for group in favorites_groups.iter_mut() {
group.retain_entries(|e| self.allowed_favorites.contains(&e.id));
self.all_components.extend(group.entries.borrow().iter().cloned());
}
component::group::List::new(favorites_groups)
}
}

Expand Down Expand Up @@ -231,8 +259,8 @@ mod tests {
let mut builder = List::new().with_local_scope_module_id(0);
let first_part = (0..3).chain(6..11);
let second_part = 3..6;
builder.extend(&suggestion_db, first_part);
builder.extend(&suggestion_db, second_part);
builder.extend_list_and_allow_favorites_with_ids(&suggestion_db, first_part);
builder.extend_list_and_allow_favorites_with_ids(&suggestion_db, second_part);
let list = builder.build();

let top_modules: Vec<ComparableGroupData> =
Expand Down Expand Up @@ -326,4 +354,60 @@ mod tests {
let expected_ids = vec![5, 6];
assert_eq!(local_scope_ids, expected_ids);
}

/// Test building a component list with non-empty favorites. Verify that the favorites are
/// processed as described in the docs of the [`List::build`] method.
#[test]
fn building_component_list_with_favorites() {
let logger = Logger::new("tests::building_component_list_with_favorites");
let db = mock_suggestion_db(logger);
let mut builder = List::new();
let qn_of_db_entry_0 = db.lookup(0).unwrap().qualified_name();
let qn_of_db_entry_1 = db.lookup(1).unwrap().qualified_name();
let qn_of_db_entry_3 = db.lookup(3).unwrap().qualified_name();
const QN_NOT_IN_DB: &str = "test.Test.NameNotInSuggestionDb";
assert_eq!(db.lookup_by_qualified_name_str(QN_NOT_IN_DB), None);
let groups = [
execution_context::ComponentGroup {
name: "Group 1".into(),
color: None,
components: vec![
qn_of_db_entry_0.clone(),
qn_of_db_entry_3.clone(),
QN_NOT_IN_DB.into(),
qn_of_db_entry_3.clone(),
QN_NOT_IN_DB.into(),
qn_of_db_entry_1,
qn_of_db_entry_0,
],
},
execution_context::ComponentGroup {
name: "Group 2".into(),
color: None,
components: vec![
qn_of_db_entry_3.clone(),
QN_NOT_IN_DB.into(),
qn_of_db_entry_3,
QN_NOT_IN_DB.into(),
],
},
];
builder.set_grouping_and_order_of_favorites(&db, &groups);
builder.extend_list_and_allow_favorites_with_ids(&db, [0, 1, 2].into_iter());
let list = builder.build();
let favorites: Vec<ComparableGroupData> = list.favorites.iter().map(Into::into).collect();
let expected = vec![
ComparableGroupData {
name: "Group 1",
component_id: None,
entries: vec![0, 1, 0],
},
ComparableGroupData {
name: "Group 2",
component_id: None,
entries: vec![],
},
];
assert_eq!(favorites, expected);
}
}
28 changes: 25 additions & 3 deletions app/gui/src/controller/searcher/component/group.rs
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,12 @@ impl Data {
matched_items: Cell::new(0),
}
}

fn update_matched_items(&self) {
let entries = self.entries.borrow();
let matched_items = entries.iter().take_while(|c| !c.is_filtered_out()).count();
self.matched_items.set(matched_items);
}
}


Expand Down Expand Up @@ -118,6 +124,15 @@ impl Group {
})
}

/// Modify the group keeping only the [`Component`]s for which `f` returns [`true`].
pub fn retain_entries<F>(&mut self, mut f: F)
where F: FnMut(&Component) -> bool {
let group_data = Rc::make_mut(&mut self.data);
group_data.entries.borrow_mut().retain(&mut f);
group_data.initial_entries_order.retain(f);
group_data.update_matched_items();
}

/// Update the group sorting according to the `order` and update information about matched items
/// count.
pub fn update_sorting(&self, order: component::Order) {
Expand All @@ -127,9 +142,7 @@ impl Group {
self.sort_by_name_non_modules_then_modules(),
component::Order::ByMatch => self.sort_by_match(),
}
let entries = self.entries.borrow();
let matched_items = entries.iter().take_while(|c| !c.is_filtered_out()).count();
self.matched_items.set(matched_items);
self.update_matched_items();
}

fn restore_initial_order(&self) {
Expand Down Expand Up @@ -230,6 +243,15 @@ impl FromIterator<Group> for List {
}
}

impl IntoIterator for List {
type Item = Group;
type IntoIter = std::vec::IntoIter<Group>;

fn into_iter(self) -> Self::IntoIter {
Rc::unwrap_or_clone(self.groups).into_iter()
}
}

impl Deref for List {
type Target = [Group];
fn deref(&self) -> &Self::Target {
Expand Down
1 change: 1 addition & 0 deletions app/gui/src/lib.rs
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@

#![recursion_limit = "512"]
// === Features ===
#![feature(arc_unwrap_or_clone)]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why this is needed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To allow the use of the Rc::unwrap_or_clone function.

#![feature(async_closure)]
#![feature(associated_type_bounds)]
#![feature(bool_to_option)]
Expand Down