We use Spark through Spark API with pyspark. I know Numba can make python code very fast so it is a good thing to use it on our udfs (user-defined function) but I’m not sure Numba can help me with map or mapPartion. I’m mapping with spark over all our data but the function itself doesn’t have a for…

Use Numba with PySpark

gmarkall June 27, 2022, 10:16am 3

Topic		Replies	Views
Numba and PySpark users? Community Support	3	1452	May 11, 2022
Feedback on tips for first-timers Community Support	14	505	August 15, 2023
Complex Structured Inputs Community Support	10	430	July 13, 2022
Convert array with numbers to array of strings with format Support: How do I do ...?	1	342	April 9, 2023
Issue 3164 still not working Support: How do I do ...?	0	300	December 3, 2020