Filament select is too slow when having a large number of data

[AHMED-GAMAL-AG]

Package

Panel builder

Package Version

3.2

How can we help you?

When getting a large amount of data (60k in my case for test and performance purposes) in the Select component, it takes minutes to load, even if I am loading the data from the cache using Redis driver and not directly from the database. Any ideas on how to enhance the performance?

the code

                Select::make('user_id')
                    ->live()
                    ->required()
                    ->searchable()
                    ->optionsLimit(20)
                    ->label(__('Pioneer name'))
                    ->hidden(fn (Get $get) => !$get('health_unit_id'))
                    ->options(static fn (Get $get) => User::getPioneerOptions($get('health_unit_id')))
                    ->required(),

    public static function getPioneerOptions(?string $health_unit = null): Collection
    {
        if ($health_unit === null) {
            return collect();
        }

        if (!Cache::has('pioneers')) {
            return Cache::remember('pioneers', 60, function () use ($health_unit) {
                return self::where('health_unit_id', $health_unit)->get()->pluck('name', 'id');
            });
        } else {
            return Cache::get('pioneers');
        }
    }