Thanks for the code ! I'll try to give you some ideas that maybe can help you improve it further. I was looking at void batch_addition. I attach below your logic, it is not the code of course, I just took the comments to explain better: I think you could save some operation by precomputing neg(x1) out of the loop and at each iteration calculating A=(-x1-x2) since you use this value for both P+Q and P-Q. I'll try to show you, I hope you can understand it: This way, you should be able to save batch_size additions and 3*batch_size-1 negations. I know it's not a lot in the end, but it should still be a bit more efficient. When I implemented this in my CUDA kernel, I did notice a slight speedup. Maybe it won't make any real difference in practice, but as soon as I have more time, I'll try to implement it in your code
Thanks for the code ! I'll try to give you some ideas that maybe can help you improve it further. I was looking at void batch_addition. I attach below your logic, it is not the code of course, I just took the comments to explain better: I think you could save some operation by precomputing neg(x1) out of the loop and at each iteration calculating A=(-x1-x2) since you use this value for both P+Q and P-Q. I'll try to show you, I hope you can understand it: This way, you should be able to save batch_size additions and 3*batch_size-1 negations. I know it's not a lot in the end, but it should still be a bit more efficient. When I implemented this in my CUDA kernel, I did notice a slight speedup. Maybe it won't make any real difference in practice, but as soon as I have more time, I'll try to implement it in your code

Thanks for the code ! I'll try to give you some ideas that maybe can help you improve it further. I was looking at void batch_addition. I attach below your logic, it is not the code of course, I just took the comments to explain better: I think you could save some operation by precomputing neg(x1) out of the loop and at each iteration calculating A=(-x1-x2) since you use this value for both P+Q and P-Q. I'll try to show you, I hope you can understand it: This way, you should be able to save batch_size additions and 3*batch_size-1 negations. I know it's not a lot in the end, but it should still be a bit more efficient. When I implemented this in my CUDA kernel, I did notice a slight speedup. Maybe it won't make any real difference in practice, but as soon as I have more time, I'll try to implement it in your code

Thanks for the code ! I'll try to give you some ideas that maybe can help you improve it further. I was looking at void batch_addition. I attach below your logic, it is not the code of course, I just took the comments to explain better: I think you could save some operation by precomputing neg(x1) out of the loop and at each iteration calculating A=(-x1-x2) since you use this value for both P+Q and P-Q. I'll try to show you, I hope you can understand it: This way, you should be able to save batch_size additions and 3*batch_size-1 negations. I know it's not a lot in the end, but it should still be a bit more efficient. When I implemented this in my CUDA kernel, I did notice a slight speedup. Maybe it won't make any real difference in practice, but as soon as I have more time, I'll try to implement it in your code