Can I use JSON and Search (like RedisJSON, RediSearch)?

Dragonfly Technical
101

@praiseworthy-antelop hi. Are you using Dragonfly by any chance?

102

nope, as I wasn’t able to use it for what I needed

103

I don’t believe the search part was ever implemented, was it?

104

It’s in the works. Wanted to ask you whether you can help is with that.

105

If you use RedisSearch, could you share your dataset with us, together with search query stream?

106

@praiseworthy-antelop that would help us with evaluating performance/correctness issues

107

I don’t actually, redis didn’t fit my usecase either because of being single threaded and clustering was kinda complex that I lacked time so I no longer use it

108

But I could get an example I guess

109

Here’s how I do it in JS:

Set:

await redis.json.set(`guilds:${guildOrId}`, '$', guild);

Get:

await redis.json.get(`guilds:${id}`)

Index creation:

redis.ft
    .CREATE(
        'index:guilds',
        {
            '$.id': {
                type: SchemaFieldTypes.TEXT,
                AS: 'id',
                SORTABLE: true,
            },
            '$.icon': {
                type: SchemaFieldTypes.TEXT,
                AS: 'icon',
            },
            '$.memberCount': {
                type: SchemaFieldTypes.NUMERIC,
                AS: 'memberCount',
                SORTABLE: true,
            },
            '$.name': {
                type: SchemaFieldTypes.TEXT,
                AS: 'name',
                SORTABLE: true,
            },
            '$.ownerId': {
                type: SchemaFieldTypes.TEXT,
                AS: 'ownerId',
                SORTABLE: true,
            },
            '$.shardId': {
                type: SchemaFieldTypes.NUMERIC,
                AS: 'shardId',
                SORTABLE: true,
            },
            '$.toggles': {
                type: SchemaFieldTypes.TEXT,
                AS: 'toggles',
                SORTABLE: true,
            },
            '$.lastInteractedTime': {
                type: SchemaFieldTypes.NUMERIC,
                AS: 'lastInteractedTime',
                SORTABLE: true,
            },
        },
        {
            ON: 'JSON',
            PREFIX: 'guilds',
        }
    )```

Do you still need a sample data or should the index be fine?
110

Can you tell he what’s the size of the data and what exactly did not work for you with Redis?

111

I would like to reproduce the problem with Redis first so we could verify we solve it in Dragonfly

112

Could you ping me whenever you reply please, as I forget to check the server

113

Scaling, it was single threaded or something so I couldn’t get it to work without clustering and I didn’t feel like learning how to cluster and all

114

(replying with mention also works (@ON if you dk))

115

@praiseworthy-antelop We are planning to release search functionality. Would you like to try it out?

116

I’d have to start from first, setting up dragonfly, coding the get, set etc. stuff (I might have an old commit lying somewhere I guess so have to find) but I can try it out and see if it matches my needs and if it does, I can try to get it in prod and see if it survives that

117

(I don’t use redis either currently so it requires time to setup and stuff)

118

Do you know how it would perform if I do like ~5m set suddenly every 5s for like a minute (and then pretty much very less sets but probably more gets and searches), would it be entirely based on the cpu’s performance and automatically be split through diff cores for it to do it? (tried to see a rough estimation of how my previous implementation would work currently)

119

what do you mean ~5m set ? I do not understand you @praiseworthy-antelop

120

Oh I meant 5 million set operations