Nov 2023 – Dec 2024 · 1 yr 1 mo

Mar 2022 – Oct 2023 · 1 yr 7 mos

Sep 2020 – Feb 2022 · 1 yr 5 mos

Apr 2020 – Aug 2020 · 4 mos

Jul 2019 – Sep 2020 · 1 yr 2 mos

Jul 2018 – Jul 2019 · 1 yr

Jul 2017 – Jul 2018 · 1 yr

May 2018 – Aug 2018 · 3 mos · CERN-HSF

• A large amount of 3D data is generated in High Energy Physics & Astrophysics experiments and telescopes. To process this data efficiently, one would need state-of-the-art tools. Already a lot of development has been done in processing 2D data with projects like spatial Hadoop and GeoSpark but, there are very few frameworks to process the 3D data. The idea is to follow the footsteps of GeoSpark and provide a way to load, process and analyse 3D data sets economically and efficiently by leveraging the distributed computation functionality of the spark. Spark3D would provide the set of out-of-the-box 3D Spatial RDD (3D SRDD) to partition the data across machines. Ultimately, Spark3D would be available as an open-source library which works with all recent versions of the Spark (2.0+), has user friendly APIs (in Scala, Java and Python), works on top of all major platforms out of the box (HDFS, S3, Cassandra, etc.) and supports all major file formats (CSV, Parquet, JSON, Avro, etc.) including popular scientific file formats such as FITS.

May 2016 – Jul 2016 · 2 mos · Nasik Area, India

May 2015 – Jul 2015 · 2 mos · Pune Area, India