Skip to content

RedisAI arm64 Dockerfile #879

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
brainysteven opened this issue Nov 24, 2021 · 10 comments
Open

RedisAI arm64 Dockerfile #879

brainysteven opened this issue Nov 24, 2021 · 10 comments
Assignees

Comments

@brainysteven
Copy link

Is your feature request related to a problem? Please describe.
First of all, Thanks for the wonderful product. Our team are amazed by the performance gained with RedisAI.
I would like to ask on the possibility to bring RedisAI to arm64. So far I am unable to build the dockerfile for arm version, and no arm version is available on redisai dockerhub thus far.

Describe the solution you'd like
A guide for arm64 version, or an ETA for such version would be nice.

Describe alternatives you've considered
I have try to build the Dockerfile.arm within the arm64v8 branch https://github.com/RedisAI/RedisAI/tree/arm64v8, but no such luck. It appear to be a WIP.
Tried the dockerfile on redisfab/redis:6.0-latest-arm64v8-bionic and redisfab/arm64v8-xbuild:bionic

Additional context

@DvirDukhan
Copy link
Collaborator

hi @brainysteven
Can you share more details about your request? What kind of build are you after? arm64v8 only (Rasberry-py-like devices) or arm64v8+cuda (NVidia Jetson like devices)? What kind of backends are you after?

cc @chayim

@brainysteven
Copy link
Author

Hi @DvirDukhan @chayim,
The target we are after is for the 64-bit Arm [Arm64v8], specifically for the AWS A1 instance. We want to deploy an instance of RedisAI on AWS EC2 for AI Inference.
I tried launch an A1 instance and build with Dockerfile.arm but with no success. Would love to have some pointer on this.

Thanks!

@DvirDukhan
Copy link
Collaborator

Thanks @brainysteven
We will look at it. Any preferred backend?

@brainysteven
Copy link
Author

Thanks @brainysteven We will look at it. Any preferred backend?

Thanks for your help. Not sure I understand it correctly, but currently we integrate RedisAI with a python-based backend.

@DvirDukhan
Copy link
Collaborator

DvirDukhan commented Nov 28, 2021

@brainysteven By backend we mean: Tensorflow/Torch/ONNXRuntime

@brainysteven
Copy link
Author

All of our models are ONNX-compatible. so ONNXRuntime is enough for my case 👍

@brainysteven
Copy link
Author

Hi, is there an update to this issue? Can we have an ETA for when RedisAI have ARM support?

@brainysteven
Copy link
Author

Hi, any update on this?
@chayim

@dallaybatta
Copy link

Can you guys please provide an update about this?

Thanks,
Vicky

@brainysteven
Copy link
Author

Is this project abandoned by Redis? 👀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants